Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
2026-03-18T02:51:15Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-03-18T02:51:15Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260318 02:51:15.548986 418 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu
/tmp/dist-test-taskvjTIu6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.104.190:39451
--webserver_interface=127.0.104.190
--webserver_port=0
--builtin_ntp_servers=127.0.104.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.104.190:39451,127.0.104.189:45933,127.0.104.188:41593
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260318 02:51:15.900532 426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260318 02:51:15.900928 426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260318 02:51:15.901026 426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260318 02:51:15.909600 426 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260318 02:51:15.909708 426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260318 02:51:15.909761 426 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260318 02:51:15.909807 426 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260318 02:51:15.920277 426 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.104.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.104.190:39451,127.0.104.189:45933,127.0.104.188:41593
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.104.190:39451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.104.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type FASTDEBUG
built by None at 18 Mar 2026 02:43:20 UTC on bdcb31816ec0
build id 10982
ASAN enabled
I20260318 02:51:15.921938 426 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260318 02:51:15.923775 426 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260318 02:51:15.932118 432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260318 02:51:15.933179 431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260318 02:51:15.933961 434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260318 02:51:15.935379 426 server_base.cc:1060] running on GCE node
I20260318 02:51:15.936275 426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260318 02:51:15.937872 426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260318 02:51:15.939116 426 hybrid_clock.cc:648] HybridClock initialized: now 1773802275939045 us; error 69 us; skew 500 ppm
I20260318 02:51:15.939507 426 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260318 02:51:15.942060 426 webserver.cc:492] Webserver started at http://127.0.104.190:42617/ using document root <none> and password file <none>
I20260318 02:51:15.942835 426 fs_manager.cc:362] Metadata directory not provided
I20260318 02:51:15.942946 426 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260318 02:51:15.943285 426 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260318 02:51:15.945813 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-0/data/instance:
uuid: "ee6aa91804a2401fa0ceb31b196ec40a"
format_stamp: "Formatted at 2026-03-18 02:51:15 on dist-test-slave-km68"
I20260318 02:51:15.946615 426 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-0/wal/instance:
uuid: "ee6aa91804a2401fa0ceb31b196ec40a"
format_stamp: "Formatted at 2026-03-18 02:51:15 on dist-test-slave-km68"
I20260318 02:51:15.952348 426 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260318 02:51:15.956177 440 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260318 02:51:15.957734 426 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260318 02:51:15.957927 426 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-0/data,/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-0/wal
uuid: "ee6aa91804a2401fa0ceb31b196ec40a"
format_stamp: "Formatted at 2026-03-18 02:51:15 on dist-test-slave-km68"
I20260318 02:51:15.958148 426 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260318 02:51:15.984084 426 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260318 02:51:15.985105 426 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260318 02:51:15.985390 426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260318 02:51:16.006698 426 rpc_server.cc:307] RPC server started. Bound to: 127.0.104.190:39451
I20260318 02:51:16.006718 491 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.104.190:39451 every 8 connection(s)
I20260318 02:51:16.008322 426 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-0/data/info.pb
I20260318 02:51:16.013114 492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:16.017212 418 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu as pid 426
I20260318 02:51:16.017590 418 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-0/wal/instance
I20260318 02:51:16.021163 418 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu
/tmp/dist-test-taskvjTIu6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.104.189:45933
--webserver_interface=127.0.104.189
--webserver_port=0
--builtin_ntp_servers=127.0.104.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.104.190:39451,127.0.104.189:45933,127.0.104.188:41593
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260318 02:51:16.021341 492 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } has no permanent_uuid. Determining permanent_uuid...
I20260318 02:51:16.043568 492 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } has no permanent_uuid. Determining permanent_uuid...
W20260318 02:51:16.044689 441 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.104.189:45933: connect: Connection refused (error 111)
W20260318 02:51:16.046253 492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.104.189:45933: Network error: Client connection negotiation failed: client connection to 127.0.104.189:45933: connect: Connection refused (error 111)
I20260318 02:51:16.095630 492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } attempt: 1
W20260318 02:51:16.097853 492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.104.189:45933: Network error: Client connection negotiation failed: client connection to 127.0.104.189:45933: connect: Connection refused (error 111)
I20260318 02:51:16.166126 492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } attempt: 2
W20260318 02:51:16.168303 492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.104.189:45933: Network error: Client connection negotiation failed: client connection to 127.0.104.189:45933: connect: Connection refused (error 111)
I20260318 02:51:16.259582 492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } attempt: 3
W20260318 02:51:16.261801 492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.104.189:45933: Network error: Client connection negotiation failed: client connection to 127.0.104.189:45933: connect: Connection refused (error 111)
W20260318 02:51:16.375995 494 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260318 02:51:16.376338 494 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260318 02:51:16.376418 494 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260318 02:51:16.384842 494 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260318 02:51:16.384951 494 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260318 02:51:16.385011 494 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260318 02:51:16.385051 494 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260318 02:51:16.395403 494 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.104.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.104.190:39451,127.0.104.189:45933,127.0.104.188:41593
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.104.189:45933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.104.189
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type FASTDEBUG
built by None at 18 Mar 2026 02:43:20 UTC on bdcb31816ec0
build id 10982
ASAN enabled
I20260318 02:51:16.397044 494 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260318 02:51:16.398828 494 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260318 02:51:16.405076 492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } attempt: 4
W20260318 02:51:16.407347 492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.104.189:45933: Network error: Client connection negotiation failed: client connection to 127.0.104.189:45933: connect: Connection refused (error 111)
W20260318 02:51:16.408001 502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260318 02:51:16.408201 503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260318 02:51:16.408543 505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260318 02:51:16.409899 494 server_base.cc:1060] running on GCE node
I20260318 02:51:16.410681 494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260318 02:51:16.412251 494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260318 02:51:16.413465 494 hybrid_clock.cc:648] HybridClock initialized: now 1773802276413419 us; error 37 us; skew 500 ppm
I20260318 02:51:16.413830 494 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260318 02:51:16.416132 494 webserver.cc:492] Webserver started at http://127.0.104.189:44181/ using document root <none> and password file <none>
I20260318 02:51:16.416944 494 fs_manager.cc:362] Metadata directory not provided
I20260318 02:51:16.417049 494 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260318 02:51:16.417374 494 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260318 02:51:16.419835 494 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/data/instance:
uuid: "8b701993861d4c11b3394a2d6588b3b7"
format_stamp: "Formatted at 2026-03-18 02:51:16 on dist-test-slave-km68"
I20260318 02:51:16.420643 494 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/wal/instance:
uuid: "8b701993861d4c11b3394a2d6588b3b7"
format_stamp: "Formatted at 2026-03-18 02:51:16 on dist-test-slave-km68"
I20260318 02:51:16.426221 494 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260318 02:51:16.430300 511 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260318 02:51:16.431988 494 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260318 02:51:16.432180 494 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/data,/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/wal
uuid: "8b701993861d4c11b3394a2d6588b3b7"
format_stamp: "Formatted at 2026-03-18 02:51:16 on dist-test-slave-km68"
I20260318 02:51:16.432407 494 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260318 02:51:16.454559 494 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260318 02:51:16.455547 494 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260318 02:51:16.455822 494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260318 02:51:16.478049 494 rpc_server.cc:307] RPC server started. Bound to: 127.0.104.189:45933
I20260318 02:51:16.478065 562 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.104.189:45933 every 8 connection(s)
I20260318 02:51:16.479586 494 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/data/info.pb
I20260318 02:51:16.480146 418 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu as pid 494
I20260318 02:51:16.480336 418 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/wal/instance
I20260318 02:51:16.481468 418 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu
/tmp/dist-test-taskvjTIu6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.104.188:41593
--webserver_interface=127.0.104.188
--webserver_port=0
--builtin_ntp_servers=127.0.104.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.104.190:39451,127.0.104.189:45933,127.0.104.188:41593
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260318 02:51:16.484140 563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:16.491168 563 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } has no permanent_uuid. Determining permanent_uuid...
I20260318 02:51:16.507530 563 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } has no permanent_uuid. Determining permanent_uuid...
I20260318 02:51:16.519125 563 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } has no permanent_uuid. Determining permanent_uuid...
W20260318 02:51:16.520503 514 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: connect: Connection refused (error 111)
W20260318 02:51:16.522305 563 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.104.188:41593: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: connect: Connection refused (error 111)
I20260318 02:51:16.571681 563 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } attempt: 1
W20260318 02:51:16.573643 563 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.104.188:41593: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: connect: Connection refused (error 111)
I20260318 02:51:16.641906 563 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } attempt: 2
W20260318 02:51:16.644016 563 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.104.188:41593: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: connect: Connection refused (error 111)
I20260318 02:51:16.706730 492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } attempt: 5
I20260318 02:51:16.714444 492 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } has no permanent_uuid. Determining permanent_uuid...
W20260318 02:51:16.716341 492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.104.188:41593: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: connect: Connection refused (error 111)
I20260318 02:51:16.735296 563 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } attempt: 3
W20260318 02:51:16.737406 563 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.104.188:41593: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: connect: Connection refused (error 111)
I20260318 02:51:16.767666 492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } attempt: 1
W20260318 02:51:16.769709 492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.104.188:41593: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: connect: Connection refused (error 111)
I20260318 02:51:16.837962 492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } attempt: 2
W20260318 02:51:16.839900 492 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.104.188:41593: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: connect: Connection refused (error 111)
W20260318 02:51:16.843741 565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260318 02:51:16.844077 565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260318 02:51:16.844161 565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260318 02:51:16.853037 565 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260318 02:51:16.853142 565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260318 02:51:16.853193 565 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260318 02:51:16.853237 565 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260318 02:51:16.864001 565 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.104.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.104.190:39451,127.0.104.189:45933,127.0.104.188:41593
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.104.188:41593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.104.188
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type FASTDEBUG
built by None at 18 Mar 2026 02:43:20 UTC on bdcb31816ec0
build id 10982
ASAN enabled
I20260318 02:51:16.865660 565 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260318 02:51:16.867486 565 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260318 02:51:16.876158 573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260318 02:51:16.876132 574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260318 02:51:16.877099 576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260318 02:51:16.877931 565 server_base.cc:1060] running on GCE node
I20260318 02:51:16.878767 565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260318 02:51:16.880339 565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260318 02:51:16.880635 563 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } attempt: 4
I20260318 02:51:16.881588 565 hybrid_clock.cc:648] HybridClock initialized: now 1773802276881535 us; error 39 us; skew 500 ppm
I20260318 02:51:16.881971 565 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260318 02:51:16.882519 563 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.104.188:41593: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: connect: Connection refused (error 111)
I20260318 02:51:16.884536 565 webserver.cc:492] Webserver started at http://127.0.104.188:37041/ using document root <none> and password file <none>
I20260318 02:51:16.885357 565 fs_manager.cc:362] Metadata directory not provided
I20260318 02:51:16.885453 565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260318 02:51:16.885794 565 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260318 02:51:16.888309 565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data/instance:
uuid: "971baf5b9e4644c990dbf4d4fc7ba900"
format_stamp: "Formatted at 2026-03-18 02:51:16 on dist-test-slave-km68"
I20260318 02:51:16.889232 565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/wal/instance:
uuid: "971baf5b9e4644c990dbf4d4fc7ba900"
format_stamp: "Formatted at 2026-03-18 02:51:16 on dist-test-slave-km68"
I20260318 02:51:16.895079 565 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260318 02:51:16.899576 582 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260318 02:51:16.901399 565 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:16.901599 565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data,/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/wal
uuid: "971baf5b9e4644c990dbf4d4fc7ba900"
format_stamp: "Formatted at 2026-03-18 02:51:16 on dist-test-slave-km68"
I20260318 02:51:16.901830 565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260318 02:51:16.918352 565 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260318 02:51:16.919275 565 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260318 02:51:16.919538 565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260318 02:51:16.941361 565 rpc_server.cc:307] RPC server started. Bound to: 127.0.104.188:41593
I20260318 02:51:16.941380 633 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.104.188:41593 every 8 connection(s)
I20260318 02:51:16.942914 565 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data/info.pb
I20260318 02:51:16.946151 492 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } attempt: 3
I20260318 02:51:16.948100 634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:16.949045 418 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu as pid 565
I20260318 02:51:16.949227 418 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/wal/instance
I20260318 02:51:16.956589 634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } has no permanent_uuid. Determining permanent_uuid...
I20260318 02:51:16.969311 492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Bootstrap starting.
I20260318 02:51:16.974074 492 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:16.975667 492 log.cc:826] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Log is configured to *not* fsync() on all Append() calls
I20260318 02:51:16.977092 634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } has no permanent_uuid. Determining permanent_uuid...
I20260318 02:51:16.979339 492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: No bootstrap required, opened a new log
I20260318 02:51:16.986127 634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } has no permanent_uuid. Determining permanent_uuid...
I20260318 02:51:16.987089 492 raft_consensus.cc:359] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:16.987466 492 raft_consensus.cc:385] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:16.988085 492 raft_consensus.cc:740] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee6aa91804a2401fa0ceb31b196ec40a, State: Initialized, Role: FOLLOWER
I20260318 02:51:16.989024 492 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:16.993297 643 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:16.993639 643 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: This master's current role is: FOLLOWER
I20260318 02:51:16.994899 492 sys_catalog.cc:565] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: configured and running, proceeding with master startup.
I20260318 02:51:17.000408 634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900: Bootstrap starting.
I20260318 02:51:17.004247 634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:17.005508 634 log.cc:826] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900: Log is configured to *not* fsync() on all Append() calls
I20260318 02:51:17.008579 634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900: No bootstrap required, opened a new log
I20260318 02:51:17.015455 634 raft_consensus.cc:359] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:17.015802 634 raft_consensus.cc:385] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:17.015919 634 raft_consensus.cc:740] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 971baf5b9e4644c990dbf4d4fc7ba900, State: Initialized, Role: FOLLOWER
I20260318 02:51:17.016798 634 consensus_queue.cc:260] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
W20260318 02:51:17.026688 655 catalog_manager.cc:1568] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260318 02:51:17.026937 655 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260318 02:51:17.027702 656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:17.028079 656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [sys.catalog]: This master's current role is: FOLLOWER
I20260318 02:51:17.029219 634 sys_catalog.cc:565] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [sys.catalog]: configured and running, proceeding with master startup.
I20260318 02:51:17.021332 426 master_runner.cc:186] Error getting master registration for 127.0.104.189:45933: OK, instance_id { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" instance_seqno: 1773802276471752 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260318 02:51:17.030100 426 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260318 02:51:17.051796 668 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260318 02:51:17.051970 668 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260318 02:51:17.049286 565 master_runner.cc:186] Error getting master registration for 127.0.104.189:45933: OK, instance_id { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" instance_seqno: 1773802276471752 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260318 02:51:17.056221 565 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260318 02:51:17.084373 656 raft_consensus.cc:493] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:17.084749 656 raft_consensus.cc:515] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:17.086675 656 leader_election.cc:290] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee6aa91804a2401fa0ceb31b196ec40a (127.0.104.190:39451), 8b701993861d4c11b3394a2d6588b3b7 (127.0.104.189:45933)
I20260318 02:51:17.088172 467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" is_pre_election: true
I20260318 02:51:17.088749 467 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 971baf5b9e4644c990dbf4d4fc7ba900 in term 0.
I20260318 02:51:17.089589 586 leader_election.cc:304] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 971baf5b9e4644c990dbf4d4fc7ba900, ee6aa91804a2401fa0ceb31b196ec40a; no voters:
I20260318 02:51:17.090175 656 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:17.090341 656 raft_consensus.cc:493] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:17.090440 656 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:17.094518 656 raft_consensus.cc:515] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:17.096364 656 leader_election.cc:290] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [CANDIDATE]: Term 1 election: Requested vote from peers ee6aa91804a2401fa0ceb31b196ec40a (127.0.104.190:39451), 8b701993861d4c11b3394a2d6588b3b7 (127.0.104.189:45933)
I20260318 02:51:17.096490 467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee6aa91804a2401fa0ceb31b196ec40a"
I20260318 02:51:17.096855 467 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:17.100520 467 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 971baf5b9e4644c990dbf4d4fc7ba900 in term 1.
I20260318 02:51:17.101323 586 leader_election.cc:304] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 971baf5b9e4644c990dbf4d4fc7ba900, ee6aa91804a2401fa0ceb31b196ec40a; no voters:
I20260318 02:51:17.101956 656 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:17.111016 656 raft_consensus.cc:697] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 1 LEADER]: Becoming Leader. State: Replica: 971baf5b9e4644c990dbf4d4fc7ba900, State: Running, Role: LEADER
I20260318 02:51:17.112136 656 consensus_queue.cc:237] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:17.120278 670 sys_catalog.cc:455] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 971baf5b9e4644c990dbf4d4fc7ba900. Latest consensus state: current_term: 1 leader_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:17.121052 670 sys_catalog.cc:458] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [sys.catalog]: This master's current role is: LEADER
I20260318 02:51:17.123050 672 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260318 02:51:17.125427 672 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260318 02:51:17.139906 467 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [term 1 FOLLOWER]: Refusing update from remote peer 971baf5b9e4644c990dbf4d4fc7ba900: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:17.141060 670 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:17.168684 643 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 971baf5b9e4644c990dbf4d4fc7ba900. Latest consensus state: current_term: 1 leader_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:17.169457 673 mvcc.cc:204] Tried to move back new op lower bound from 7265494127147462656 to 7265494127061876736. Current Snapshot: MvccSnapshot[applied={T|T < 7265494127147462656}]
I20260318 02:51:17.169575 643 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: This master's current role is: FOLLOWER
I20260318 02:51:17.178597 674 mvcc.cc:204] Tried to move back new op lower bound from 7265494127147462656 to 7265494127061876736. Current Snapshot: MvccSnapshot[applied={T|T < 7265494127147462656}]
I20260318 02:51:17.181737 563 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } attempt: 5
I20260318 02:51:17.187075 643 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:17.187296 643 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: This master's current role is: FOLLOWER
I20260318 02:51:17.190866 656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:17.191149 656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [sys.catalog]: This master's current role is: LEADER
I20260318 02:51:17.197395 563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7: Bootstrap starting.
I20260318 02:51:17.199795 672 catalog_manager.cc:1357] Generated new cluster ID: 97dfc1ee825e4087980ac883e1ff8527
I20260318 02:51:17.200004 672 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260318 02:51:17.202412 563 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:17.203642 563 log.cc:826] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7: Log is configured to *not* fsync() on all Append() calls
I20260318 02:51:17.215549 563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7: No bootstrap required, opened a new log
I20260318 02:51:17.231244 563 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:17.231673 563 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:17.231837 563 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b701993861d4c11b3394a2d6588b3b7, State: Initialized, Role: FOLLOWER
I20260318 02:51:17.232599 563 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:17.234292 679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:17.234957 679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260318 02:51:17.240664 563 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260318 02:51:17.240731 537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b701993861d4c11b3394a2d6588b3b7"
I20260318 02:51:17.241209 537 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:17.242386 538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b701993861d4c11b3394a2d6588b3b7" is_pre_election: true
I20260318 02:51:17.245900 537 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 971baf5b9e4644c990dbf4d4fc7ba900 in term 1.
I20260318 02:51:17.247231 536 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 1 FOLLOWER]: Refusing update from remote peer 971baf5b9e4644c990dbf4d4fc7ba900: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:17.249022 670 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:17.264420 672 catalog_manager.cc:1380] Generated new certificate authority record
I20260318 02:51:17.266808 672 catalog_manager.cc:1514] Loading token signing keys...
I20260318 02:51:17.295874 679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 971baf5b9e4644c990dbf4d4fc7ba900. Latest consensus state: current_term: 1 leader_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:17.296168 679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260318 02:51:17.296481 656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:17.296706 656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [sys.catalog]: This master's current role is: LEADER
I20260318 02:51:17.299510 685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:17.300215 685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260318 02:51:17.315366 672 catalog_manager.cc:6044] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900: Generated new TSK 0
I20260318 02:51:17.318308 672 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260318 02:51:17.332687 418 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu
/tmp/dist-test-taskvjTIu6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.104.129:0
--local_ip_for_outbound_sockets=127.0.104.129
--webserver_interface=127.0.104.129
--webserver_port=0
--tserver_master_addrs=127.0.104.190:39451,127.0.104.189:45933,127.0.104.188:41593
--builtin_ntp_servers=127.0.104.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260318 02:51:17.348943 696 catalog_manager.cc:1269] Loaded cluster ID: 97dfc1ee825e4087980ac883e1ff8527
I20260318 02:51:17.349169 696 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7: loading cluster ID for follower catalog manager: success
I20260318 02:51:17.354108 696 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7: acquiring CA information for follower catalog manager: success
I20260318 02:51:17.357224 696 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260318 02:51:17.809993 699 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 971baf5b9e4644c990dbf4d4fc7ba900)
I20260318 02:51:17.810225 699 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:17.812326 466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8b701993861d4c11b3394a2d6588b3b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" is_pre_election: true
I20260318 02:51:17.812469 609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8b701993861d4c11b3394a2d6588b3b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" is_pre_election: true
I20260318 02:51:17.812660 699 leader_election.cc:290] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee6aa91804a2401fa0ceb31b196ec40a (127.0.104.190:39451), 971baf5b9e4644c990dbf4d4fc7ba900 (127.0.104.188:41593)
I20260318 02:51:17.813431 514 leader_election.cc:304] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b701993861d4c11b3394a2d6588b3b7; no voters: 971baf5b9e4644c990dbf4d4fc7ba900, ee6aa91804a2401fa0ceb31b196ec40a
I20260318 02:51:17.813892 699 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260318 02:51:17.824326 703 raft_consensus.cc:493] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 971baf5b9e4644c990dbf4d4fc7ba900)
I20260318 02:51:17.824644 703 raft_consensus.cc:515] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:17.826642 537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b701993861d4c11b3394a2d6588b3b7" is_pre_election: true
I20260318 02:51:17.826910 537 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee6aa91804a2401fa0ceb31b196ec40a in term 1.
I20260318 02:51:17.826862 609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" is_pre_election: true
I20260318 02:51:17.827627 703 leader_election.cc:290] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b701993861d4c11b3394a2d6588b3b7 (127.0.104.189:45933), 971baf5b9e4644c990dbf4d4fc7ba900 (127.0.104.188:41593)
I20260318 02:51:17.827617 441 leader_election.cc:304] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b701993861d4c11b3394a2d6588b3b7, ee6aa91804a2401fa0ceb31b196ec40a; no voters: 971baf5b9e4644c990dbf4d4fc7ba900
I20260318 02:51:17.828195 703 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260318 02:51:17.828357 703 raft_consensus.cc:493] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 971baf5b9e4644c990dbf4d4fc7ba900)
I20260318 02:51:17.828481 703 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [term 1 FOLLOWER]: Advancing to term 2
I20260318 02:51:17.831444 703 raft_consensus.cc:515] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
W20260318 02:51:17.832213 698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260318 02:51:17.832680 698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
I20260318 02:51:17.832758 609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "971baf5b9e4644c990dbf4d4fc7ba900"
W20260318 02:51:17.832881 698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260318 02:51:17.832820 537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8b701993861d4c11b3394a2d6588b3b7"
I20260318 02:51:17.833051 537 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 1 FOLLOWER]: Advancing to term 2
I20260318 02:51:17.833498 703 leader_election.cc:290] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [CANDIDATE]: Term 2 election: Requested vote from peers 8b701993861d4c11b3394a2d6588b3b7 (127.0.104.189:45933), 971baf5b9e4644c990dbf4d4fc7ba900 (127.0.104.188:41593)
I20260318 02:51:17.835974 537 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee6aa91804a2401fa0ceb31b196ec40a in term 2.
I20260318 02:51:17.836567 441 leader_election.cc:304] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b701993861d4c11b3394a2d6588b3b7, ee6aa91804a2401fa0ceb31b196ec40a; no voters: 971baf5b9e4644c990dbf4d4fc7ba900
I20260318 02:51:17.836977 703 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [term 2 FOLLOWER]: Leader election won for term 2
I20260318 02:51:17.837606 703 raft_consensus.cc:697] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [term 2 LEADER]: Becoming Leader. State: Replica: ee6aa91804a2401fa0ceb31b196ec40a, State: Running, Role: LEADER
I20260318 02:51:17.838227 703 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:17.840394 705 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee6aa91804a2401fa0ceb31b196ec40a. Latest consensus state: current_term: 2 leader_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:17.840610 705 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: This master's current role is: LEADER
I20260318 02:51:17.841416 706 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260318 02:51:17.844321 706 catalog_manager.cc:1494] Initializing Kudu cluster ID...
W20260318 02:51:17.845968 698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
I20260318 02:51:17.846076 706 catalog_manager.cc:1269] Loaded cluster ID: 97dfc1ee825e4087980ac883e1ff8527
I20260318 02:51:17.846213 706 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
W20260318 02:51:17.846212 698 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.104.129
I20260318 02:51:17.850008 706 catalog_manager.cc:1514] Loading token signing keys...
I20260318 02:51:17.851490 706 catalog_manager.cc:6055] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Loaded TSK: 0
I20260318 02:51:17.853255 706 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260318 02:51:17.859181 698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.104.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.104.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.104.129
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.104.190:39451,127.0.104.189:45933,127.0.104.188:41593
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.104.129
--log_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type FASTDEBUG
built by None at 18 Mar 2026 02:43:20 UTC on bdcb31816ec0
build id 10982
ASAN enabled
I20260318 02:51:17.861135 698 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260318 02:51:17.863293 698 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260318 02:51:17.873608 709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260318 02:51:17.873621 708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260318 02:51:17.874562 711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260318 02:51:17.875265 698 server_base.cc:1060] running on GCE node
I20260318 02:51:17.875977 698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260318 02:51:17.877007 698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260318 02:51:17.878233 698 hybrid_clock.cc:648] HybridClock initialized: now 1773802277878181 us; error 38 us; skew 500 ppm
I20260318 02:51:17.878576 698 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260318 02:51:17.880872 698 webserver.cc:492] Webserver started at http://127.0.104.129:35237/ using document root <none> and password file <none>
I20260318 02:51:17.881668 698 fs_manager.cc:362] Metadata directory not provided
I20260318 02:51:17.881758 698 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260318 02:51:17.882123 698 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260318 02:51:17.884635 698 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/data/instance:
uuid: "6a903d876086423b8016d705b98895ad"
format_stamp: "Formatted at 2026-03-18 02:51:17 on dist-test-slave-km68"
I20260318 02:51:17.885502 698 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/instance:
uuid: "6a903d876086423b8016d705b98895ad"
format_stamp: "Formatted at 2026-03-18 02:51:17 on dist-test-slave-km68"
I20260318 02:51:17.891276 698 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260318 02:51:17.895015 717 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260318 02:51:17.896768 698 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260318 02:51:17.896960 698 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal
uuid: "6a903d876086423b8016d705b98895ad"
format_stamp: "Formatted at 2026-03-18 02:51:17 on dist-test-slave-km68"
I20260318 02:51:17.897188 698 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260318 02:51:17.898372 537 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 2 FOLLOWER]: Rejecting Update request from peer 971baf5b9e4644c990dbf4d4fc7ba900 for earlier term 1. Current term is 2. Ops: []
I20260318 02:51:17.899048 704 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260318 02:51:17.899590 718 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 1 LEADER]: Stepping down as leader of term 1
I20260318 02:51:17.899680 718 raft_consensus.cc:740] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 971baf5b9e4644c990dbf4d4fc7ba900, State: Running, Role: LEADER
I20260318 02:51:17.899976 718 consensus_queue.cc:260] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:17.900400 718 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 1 FOLLOWER]: Advancing to term 2
I20260318 02:51:17.929988 698 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260318 02:51:17.930933 698 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260318 02:51:17.931187 698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260318 02:51:17.932607 698 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260318 02:51:17.934369 698 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260318 02:51:17.934459 698 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260318 02:51:17.934566 698 ts_tablet_manager.cc:616] Registered 0 tablets
I20260318 02:51:17.934648 698 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260318 02:51:17.974844 698 rpc_server.cc:307] RPC server started. Bound to: 127.0.104.129:46711
I20260318 02:51:17.974903 830 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.104.129:46711 every 8 connection(s)
I20260318 02:51:17.976325 698 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/data/info.pb
I20260318 02:51:17.980893 418 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu as pid 698
I20260318 02:51:17.981149 418 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/instance
I20260318 02:51:17.992858 418 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu
/tmp/dist-test-taskvjTIu6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.104.130:0
--local_ip_for_outbound_sockets=127.0.104.130
--webserver_interface=127.0.104.130
--webserver_port=0
--tserver_master_addrs=127.0.104.190:39451,127.0.104.189:45933,127.0.104.188:41593
--builtin_ntp_servers=127.0.104.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260318 02:51:18.014238 831 heartbeater.cc:344] Connected to a master server at 127.0.104.188:41593
I20260318 02:51:18.014642 831 heartbeater.cc:461] Registering TS with master...
I20260318 02:51:18.015533 831 heartbeater.cc:507] Master 127.0.104.188:41593 requested a full tablet report, sending...
I20260318 02:51:18.016253 832 heartbeater.cc:344] Connected to a master server at 127.0.104.190:39451
I20260318 02:51:18.016410 832 heartbeater.cc:461] Registering TS with master...
I20260318 02:51:18.016970 832 heartbeater.cc:507] Master 127.0.104.190:39451 requested a full tablet report, sending...
I20260318 02:51:18.018814 456 ts_manager.cc:194] Registered new tserver with Master: 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:18.021067 833 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:18.021106 456 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.104.129:41665
I20260318 02:51:18.021229 833 heartbeater.cc:461] Registering TS with master...
I20260318 02:51:18.021733 833 heartbeater.cc:507] Master 127.0.104.189:45933 requested a full tablet report, sending...
I20260318 02:51:18.023554 528 ts_manager.cc:194] Registered new tserver with Master: 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:18.025591 599 ts_manager.cc:194] Registered new tserver with Master: 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:18.054239 668 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260318 02:51:18.271872 537 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 2 FOLLOWER]: Refusing update from remote peer ee6aa91804a2401fa0ceb31b196ec40a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260318 02:51:18.272617 705 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260318 02:51:18.274235 699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee6aa91804a2401fa0ceb31b196ec40a. Latest consensus state: current_term: 2 leader_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:18.274434 699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260318 02:51:18.276082 705 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:18.276326 705 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: This master's current role is: LEADER
I20260318 02:51:18.277180 699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:18.277371 699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260318 02:51:18.277478 609 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 2 FOLLOWER]: Refusing update from remote peer ee6aa91804a2401fa0ceb31b196ec40a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260318 02:51:18.278151 705 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [LEADER]: Connected to new peer: Peer: permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260318 02:51:18.280653 704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:18.280916 704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [sys.catalog]: This master's current role is: FOLLOWER
I20260318 02:51:18.281237 718 sys_catalog.cc:455] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee6aa91804a2401fa0ceb31b196ec40a. Latest consensus state: current_term: 2 leader_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:18.281365 718 sys_catalog.cc:458] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [sys.catalog]: This master's current role is: FOLLOWER
W20260318 02:51:18.376518 841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260318 02:51:18.376932 841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260318 02:51:18.377044 841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260318 02:51:18.386207 841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260318 02:51:18.386397 841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.104.130
I20260318 02:51:18.396567 841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.104.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.104.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.104.130
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.104.190:39451,127.0.104.189:45933,127.0.104.188:41593
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.104.130
--log_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type FASTDEBUG
built by None at 18 Mar 2026 02:43:20 UTC on bdcb31816ec0
build id 10982
ASAN enabled
I20260318 02:51:18.398694 841 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260318 02:51:18.400534 841 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260318 02:51:18.409785 850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260318 02:51:18.410490 851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260318 02:51:18.411409 853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260318 02:51:18.412019 841 server_base.cc:1060] running on GCE node
I20260318 02:51:18.412581 841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260318 02:51:18.413664 841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260318 02:51:18.414896 841 hybrid_clock.cc:648] HybridClock initialized: now 1773802278414807 us; error 69 us; skew 500 ppm
I20260318 02:51:18.415227 841 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260318 02:51:18.418133 841 webserver.cc:492] Webserver started at http://127.0.104.130:40663/ using document root <none> and password file <none>
I20260318 02:51:18.418926 841 fs_manager.cc:362] Metadata directory not provided
I20260318 02:51:18.419023 841 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260318 02:51:18.419386 841 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260318 02:51:18.421958 841 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/data/instance:
uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
format_stamp: "Formatted at 2026-03-18 02:51:18 on dist-test-slave-km68"
I20260318 02:51:18.422713 841 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/instance:
uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
format_stamp: "Formatted at 2026-03-18 02:51:18 on dist-test-slave-km68"
I20260318 02:51:18.428442 841 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260318 02:51:18.432238 859 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260318 02:51:18.433868 841 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260318 02:51:18.434028 841 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal
uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
format_stamp: "Formatted at 2026-03-18 02:51:18 on dist-test-slave-km68"
I20260318 02:51:18.434237 841 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260318 02:51:18.448261 841 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260318 02:51:18.449263 841 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260318 02:51:18.449535 841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260318 02:51:18.450508 841 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260318 02:51:18.452278 841 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260318 02:51:18.452380 841 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260318 02:51:18.452492 841 ts_tablet_manager.cc:616] Registered 0 tablets
I20260318 02:51:18.452560 841 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260318 02:51:18.490221 841 rpc_server.cc:307] RPC server started. Bound to: 127.0.104.130:37443
I20260318 02:51:18.490340 971 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.104.130:37443 every 8 connection(s)
I20260318 02:51:18.491868 841 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/data/info.pb
I20260318 02:51:18.496047 418 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu as pid 841
I20260318 02:51:18.496229 418 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/instance
I20260318 02:51:18.500981 418 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu
/tmp/dist-test-taskvjTIu6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.104.131:0
--local_ip_for_outbound_sockets=127.0.104.131
--webserver_interface=127.0.104.131
--webserver_port=0
--tserver_master_addrs=127.0.104.190:39451,127.0.104.189:45933,127.0.104.188:41593
--builtin_ntp_servers=127.0.104.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260318 02:51:18.512806 974 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:18.512980 973 heartbeater.cc:344] Connected to a master server at 127.0.104.190:39451
I20260318 02:51:18.513263 973 heartbeater.cc:461] Registering TS with master...
I20260318 02:51:18.513270 974 heartbeater.cc:461] Registering TS with master...
I20260318 02:51:18.512866 972 heartbeater.cc:344] Connected to a master server at 127.0.104.188:41593
I20260318 02:51:18.513461 972 heartbeater.cc:461] Registering TS with master...
I20260318 02:51:18.514729 972 heartbeater.cc:507] Master 127.0.104.188:41593 requested a full tablet report, sending...
I20260318 02:51:18.514781 974 heartbeater.cc:507] Master 127.0.104.189:45933 requested a full tablet report, sending...
I20260318 02:51:18.514809 973 heartbeater.cc:507] Master 127.0.104.190:39451 requested a full tablet report, sending...
I20260318 02:51:18.516970 599 ts_manager.cc:194] Registered new tserver with Master: b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:18.516997 528 ts_manager.cc:194] Registered new tserver with Master: b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:18.517114 456 ts_manager.cc:194] Registered new tserver with Master: b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:18.518151 456 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.104.130:50003
I20260318 02:51:18.524950 832 heartbeater.cc:499] Master 127.0.104.190:39451 was elected leader, sending a full tablet report...
I20260318 02:51:18.780349 718 raft_consensus.cc:493] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6aa91804a2401fa0ceb31b196ec40a)
I20260318 02:51:18.780560 718 raft_consensus.cc:515] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:18.781435 718 leader_election.cc:290] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6aa91804a2401fa0ceb31b196ec40a (127.0.104.190:39451), 8b701993861d4c11b3394a2d6588b3b7 (127.0.104.189:45933)
I20260318 02:51:18.781901 466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" is_pre_election: true
I20260318 02:51:18.782025 537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8b701993861d4c11b3394a2d6588b3b7" is_pre_election: true
I20260318 02:51:18.782680 586 leader_election.cc:304] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 971baf5b9e4644c990dbf4d4fc7ba900; no voters: 8b701993861d4c11b3394a2d6588b3b7, ee6aa91804a2401fa0ceb31b196ec40a
I20260318 02:51:18.782944 718 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260318 02:51:18.819844 843 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:18.820130 843 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: This master's current role is: LEADER
W20260318 02:51:18.860008 979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260318 02:51:18.860349 979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260318 02:51:18.860474 979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260318 02:51:18.869985 979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260318 02:51:18.870201 979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.104.131
I20260318 02:51:18.881120 979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.104.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.104.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.104.131
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.104.190:39451,127.0.104.189:45933,127.0.104.188:41593
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.104.131
--log_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type FASTDEBUG
built by None at 18 Mar 2026 02:43:20 UTC on bdcb31816ec0
build id 10982
ASAN enabled
I20260318 02:51:18.883049 979 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260318 02:51:18.884968 979 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260318 02:51:18.894682 987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260318 02:51:18.895110 988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260318 02:51:18.895463 990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260318 02:51:18.895717 979 server_base.cc:1060] running on GCE node
I20260318 02:51:18.896363 979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260318 02:51:18.897370 979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260318 02:51:18.898625 979 hybrid_clock.cc:648] HybridClock initialized: now 1773802278898568 us; error 50 us; skew 500 ppm
I20260318 02:51:18.898998 979 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260318 02:51:18.901850 979 webserver.cc:492] Webserver started at http://127.0.104.131:33075/ using document root <none> and password file <none>
I20260318 02:51:18.902634 979 fs_manager.cc:362] Metadata directory not provided
I20260318 02:51:18.902740 979 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260318 02:51:18.903141 979 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260318 02:51:18.905727 979 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/data/instance:
uuid: "9422bb7011f342b08be0b073a88c4c4d"
format_stamp: "Formatted at 2026-03-18 02:51:18 on dist-test-slave-km68"
I20260318 02:51:18.906499 979 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/instance:
uuid: "9422bb7011f342b08be0b073a88c4c4d"
format_stamp: "Formatted at 2026-03-18 02:51:18 on dist-test-slave-km68"
I20260318 02:51:18.912156 979 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260318 02:51:18.915942 996 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260318 02:51:18.917610 979 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260318 02:51:18.917785 979 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal
uuid: "9422bb7011f342b08be0b073a88c4c4d"
format_stamp: "Formatted at 2026-03-18 02:51:18 on dist-test-slave-km68"
I20260318 02:51:18.917990 979 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260318 02:51:18.948889 979 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260318 02:51:18.949960 979 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260318 02:51:18.950255 979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260318 02:51:18.951390 979 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260318 02:51:18.953541 979 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260318 02:51:18.953646 979 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260318 02:51:18.953754 979 ts_tablet_manager.cc:616] Registered 0 tablets
I20260318 02:51:18.953821 979 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260318 02:51:18.991369 979 rpc_server.cc:307] RPC server started. Bound to: 127.0.104.131:37025
I20260318 02:51:18.991425 1108 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.104.131:37025 every 8 connection(s)
I20260318 02:51:18.992892 979 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/data/info.pb
I20260318 02:51:19.002352 418 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu as pid 979
I20260318 02:51:19.002650 418 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/instance
I20260318 02:51:19.013274 1111 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:19.013726 1111 heartbeater.cc:461] Registering TS with master...
I20260318 02:51:19.013770 1109 heartbeater.cc:344] Connected to a master server at 127.0.104.188:41593
I20260318 02:51:19.014004 1109 heartbeater.cc:461] Registering TS with master...
I20260318 02:51:19.014768 1110 heartbeater.cc:344] Connected to a master server at 127.0.104.190:39451
I20260318 02:51:19.014874 1111 heartbeater.cc:507] Master 127.0.104.189:45933 requested a full tablet report, sending...
I20260318 02:51:19.014925 1110 heartbeater.cc:461] Registering TS with master...
I20260318 02:51:19.015019 1109 heartbeater.cc:507] Master 127.0.104.188:41593 requested a full tablet report, sending...
I20260318 02:51:19.015475 1110 heartbeater.cc:507] Master 127.0.104.190:39451 requested a full tablet report, sending...
I20260318 02:51:19.016690 456 ts_manager.cc:194] Registered new tserver with Master: 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:19.016768 599 ts_manager.cc:194] Registered new tserver with Master: 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:19.016813 528 ts_manager.cc:194] Registered new tserver with Master: 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:19.017851 456 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.104.131:39605
I20260318 02:51:19.020860 973 heartbeater.cc:499] Master 127.0.104.190:39451 was elected leader, sending a full tablet report...
I20260318 02:51:19.033267 418 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20260318 02:51:19.069787 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_50c3c4152ac149f0844e9077bdf97bd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:19.070339 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_04bf9d6cebd84bbeb47408e2c11fac9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:19.070604 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f0188619963c470b80bdc5db6156a34f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:19.070988 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a7289aa093244ea69889eb8468021450"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.071738 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7289aa093244ea69889eb8468021450 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:19.071799 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50c3c4152ac149f0844e9077bdf97bd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:19.072463 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0188619963c470b80bdc5db6156a34f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:19.071758 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04bf9d6cebd84bbeb47408e2c11fac9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.074200 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_977832951e404a1f92564d25c661df24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.074852 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_977832951e404a1f92564d25c661df24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.069806 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_eb6cba370f51447c8302900ff8f659b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.077297 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb6cba370f51447c8302900ff8f659b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.081400 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c27ca61aaf5045caa804b51fe6dbe734"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.082165 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c27ca61aaf5045caa804b51fe6dbe734 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.083406 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_89dba0067c9f4bd188e5d8f8ccea3011"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:19.084199 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c74e13072a9f4bdfadf27968ecb54326"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.085016 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89dba0067c9f4bd188e5d8f8ccea3011 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:19.086018 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c74e13072a9f4bdfadf27968ecb54326 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.088413 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_28688b24f5814326b2a05007a7dd0a30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.089898 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28688b24f5814326b2a05007a7dd0a30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.122195 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f0188619963c470b80bdc5db6156a34f" } new_table_name: "default.Table_0645d25ceb3b4b0ab4e4945ee5ae16e7" modify_external_catalogs: true
I20260318 02:51:19.122220 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_04bf9d6cebd84bbeb47408e2c11fac9d" } new_table_name: "default.Table_3d5d8ced462a4e8fbde8382a07f71579" modify_external_catalogs: true
I20260318 02:51:19.125012 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_50c3c4152ac149f0844e9077bdf97bd5" } new_table_name: "default.Table_ae6b2701736a4806bbf56058474af6ec" modify_external_catalogs: true
I20260318 02:51:19.134891 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_977832951e404a1f92564d25c661df24" } new_table_name: "default.Table_bc6474b60c234029a6004ad369287b54" modify_external_catalogs: true
I20260318 02:51:19.135607 418 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu pid 565
I20260318 02:51:19.137137 629 generic_service.cc:196] Checking for leaks (request via RPC)
I20260318 02:51:19.137934 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a7289aa093244ea69889eb8468021450" } new_table_name: "default.Table_acccfc03f0334617954d9eafd0874cc5" modify_external_catalogs: true
I20260318 02:51:19.142786 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_eb6cba370f51447c8302900ff8f659b8" } modify_external_catalogs: true
I20260318 02:51:19.142829 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_89dba0067c9f4bd188e5d8f8ccea3011" } modify_external_catalogs: true
I20260318 02:51:19.143035 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_eb6cba370f51447c8302900ff8f659b8" } modify_external_catalogs: true
I20260318 02:51:19.143043 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_89dba0067c9f4bd188e5d8f8ccea3011" } modify_external_catalogs: true
I20260318 02:51:19.153971 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c74e13072a9f4bdfadf27968ecb54326" } modify_external_catalogs: true
I20260318 02:51:19.155328 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c74e13072a9f4bdfadf27968ecb54326" } modify_external_catalogs: true
W20260318 02:51:19.158620 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98f618bc041a4c889af992f077a9f3da has no consensus state
I20260318 02:51:19.160349 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_28688b24f5814326b2a05007a7dd0a30" } modify_external_catalogs: true
I20260318 02:51:19.160588 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_28688b24f5814326b2a05007a7dd0a30" } modify_external_catalogs: true
I20260318 02:51:19.162071 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c27ca61aaf5045caa804b51fe6dbe734" } modify_external_catalogs: true
I20260318 02:51:19.162276 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c27ca61aaf5045caa804b51fe6dbe734" } modify_external_catalogs: true
W20260318 02:51:19.168605 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4fce8e19ff3a447e8be74547003ea0ff has no consensus state
W20260318 02:51:19.168646 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 593d63ceb81445abb780c71bcb639fbf has no consensus state
W20260318 02:51:19.168607 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a5a80127d3374812b312fca720505286 has no consensus state
W20260318 02:51:19.176220 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e1f58b1954a49b99871f965ec470a3b has no consensus state
I20260318 02:51:19.176892 457 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 9b3a24c51e1643a6b515cc3d272c22e6
I20260318 02:51:19.178264 449 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 738d9807075749b1bc4165a8ea35b657
I20260318 02:51:19.195547 450 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet b355c7fd88774e1893f72aa64a0d8a8c
I20260318 02:51:19.198119 448 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet cbb1eec5037f4fd18be5b29070c8f90a
I20260318 02:51:19.198397 455 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 9592058717dd4687bcb25bbef08f3dbe
W20260318 02:51:19.198619 444 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 4fce8e19ff3a447e8be74547003ea0ff (table default.Table_ae6b2701736a4806bbf56058474af6ec [id=f62386b6ad9441eeafff054f00ee0423], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4fce8e19ff3a447e8be74547003ea0ff consensus state has no leader
I20260318 02:51:19.217682 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 4fce8e19ff3a447e8be74547003ea0ff (DEFAULT_TABLE table=default.Table_ae6b2701736a4806bbf56058474af6ec [id=f62386b6ad9441eeafff054f00ee0423]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.218000 766 tablet_service.cc:1511] Processing CreateTablet for tablet 4fce8e19ff3a447e8be74547003ea0ff (DEFAULT_TABLE table=default.Table_ae6b2701736a4806bbf56058474af6ec [id=f62386b6ad9441eeafff054f00ee0423]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.219048 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fce8e19ff3a447e8be74547003ea0ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.219487 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fce8e19ff3a447e8be74547003ea0ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.221184 765 tablet_service.cc:1511] Processing CreateTablet for tablet 98f618bc041a4c889af992f077a9f3da (DEFAULT_TABLE table=default.Table_3d5d8ced462a4e8fbde8382a07f71579 [id=18eb38b85d0c4dd3b8d945c444ffadfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.221249 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 593d63ceb81445abb780c71bcb639fbf (DEFAULT_TABLE table=default.Table_bc6474b60c234029a6004ad369287b54 [id=433e7aa77412424ebb38784bb073d1fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.221333 1042 tablet_service.cc:1511] Processing CreateTablet for tablet a5a80127d3374812b312fca720505286 (DEFAULT_TABLE table=default.Table_0645d25ceb3b4b0ab4e4945ee5ae16e7 [id=0bd115a0960941ff9d49b4566fe1c666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.221683 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f618bc041a4c889af992f077a9f3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.221853 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 593d63ceb81445abb780c71bcb639fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.221909 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1f58b1954a49b99871f965ec470a3b (DEFAULT_TABLE table=default.Table_acccfc03f0334617954d9eafd0874cc5 [id=0c04457e82e54a229437db0c3f90811b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.223595 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1f58b1954a49b99871f965ec470a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.224362 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 98f618bc041a4c889af992f077a9f3da (DEFAULT_TABLE table=default.Table_3d5d8ced462a4e8fbde8382a07f71579 [id=18eb38b85d0c4dd3b8d945c444ffadfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.224900 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f618bc041a4c889af992f077a9f3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.225363 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a80127d3374812b312fca720505286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.225819 762 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1f58b1954a49b99871f965ec470a3b (DEFAULT_TABLE table=default.Table_acccfc03f0334617954d9eafd0874cc5 [id=0c04457e82e54a229437db0c3f90811b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.226353 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1f58b1954a49b99871f965ec470a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.229157 763 tablet_service.cc:1511] Processing CreateTablet for tablet 593d63ceb81445abb780c71bcb639fbf (DEFAULT_TABLE table=default.Table_bc6474b60c234029a6004ad369287b54 [id=433e7aa77412424ebb38784bb073d1fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.229663 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 593d63ceb81445abb780c71bcb639fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.231467 764 tablet_service.cc:1511] Processing CreateTablet for tablet a5a80127d3374812b312fca720505286 (DEFAULT_TABLE table=default.Table_0645d25ceb3b4b0ab4e4945ee5ae16e7 [id=0bd115a0960941ff9d49b4566fe1c666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.231702 904 tablet_service.cc:1511] Processing CreateTablet for tablet 593d63ceb81445abb780c71bcb639fbf (DEFAULT_TABLE table=default.Table_bc6474b60c234029a6004ad369287b54 [id=433e7aa77412424ebb38784bb073d1fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.232033 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a80127d3374812b312fca720505286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.231971 906 tablet_service.cc:1511] Processing CreateTablet for tablet 98f618bc041a4c889af992f077a9f3da (DEFAULT_TABLE table=default.Table_3d5d8ced462a4e8fbde8382a07f71579 [id=18eb38b85d0c4dd3b8d945c444ffadfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.232434 903 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1f58b1954a49b99871f965ec470a3b (DEFAULT_TABLE table=default.Table_acccfc03f0334617954d9eafd0874cc5 [id=0c04457e82e54a229437db0c3f90811b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.233012 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f618bc041a4c889af992f077a9f3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.233100 907 tablet_service.cc:1511] Processing CreateTablet for tablet 4fce8e19ff3a447e8be74547003ea0ff (DEFAULT_TABLE table=default.Table_ae6b2701736a4806bbf56058474af6ec [id=f62386b6ad9441eeafff054f00ee0423]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.233582 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fce8e19ff3a447e8be74547003ea0ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.234375 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1f58b1954a49b99871f965ec470a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.231284 905 tablet_service.cc:1511] Processing CreateTablet for tablet a5a80127d3374812b312fca720505286 (DEFAULT_TABLE table=default.Table_0645d25ceb3b4b0ab4e4945ee5ae16e7 [id=0bd115a0960941ff9d49b4566fe1c666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.235433 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a80127d3374812b312fca720505286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.236938 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 593d63ceb81445abb780c71bcb639fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.254503 1172 tablet_bootstrap.cc:492] T 0e1f58b1954a49b99871f965ec470a3b P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:19.258666 455 master_service.cc:954] ReplaceTablet: received request to replace tablet a5a80127d3374812b312fca720505286 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:19.267109 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet a5a80127d3374812b312fca720505286
I20260318 02:51:19.267827 455 catalog_manager.cc:6741] ReplaceTablet: tablet a5a80127d3374812b312fca720505286 deleted and replaced by tablet 47a94514cba846e19dd6934f371acbe7
I20260318 02:51:19.268685 1172 tablet_bootstrap.cc:654] T 0e1f58b1954a49b99871f965ec470a3b P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.269133 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet a5a80127d3374812b312fca720505286 with delete_type TABLET_DATA_DELETED (replaced by tablet 47a94514cba846e19dd6934f371acbe7) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.269941 906 tablet_service.cc:1558] Processing DeleteTablet for tablet a5a80127d3374812b312fca720505286 with delete_type TABLET_DATA_DELETED (replaced by tablet 47a94514cba846e19dd6934f371acbe7) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:19.274667 762 tablet_service.cc:1558] Processing DeleteTablet for tablet a5a80127d3374812b312fca720505286 with delete_type TABLET_DATA_DELETED (replaced by tablet 47a94514cba846e19dd6934f371acbe7) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:19.277622 1173 tablet_bootstrap.cc:492] T a5a80127d3374812b312fca720505286 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:19.282080 1173 tablet_bootstrap.cc:654] T a5a80127d3374812b312fca720505286 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.282423 455 master_service.cc:954] ReplaceTablet: received request to replace tablet a5a80127d3374812b312fca720505286 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:19.282713 448 master_service.cc:954] ReplaceTablet: received request to replace tablet 593d63ceb81445abb780c71bcb639fbf from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:19.291639 450 master_service.cc:954] ReplaceTablet: received request to replace tablet 98f618bc041a4c889af992f077a9f3da from {username='slave'} at 127.0.0.1:47158
W20260318 02:51:19.292797 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet a5a80127d3374812b312fca720505286 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5a80127d3374812b312fca720505286 already in progress: creating tablet
I20260318 02:51:19.293493 1173 log.cc:826] T a5a80127d3374812b312fca720505286 P b25f4f05e0c94c8db825d5afa0b8bf18: Log is configured to *not* fsync() on all Append() calls
I20260318 02:51:19.293562 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 593d63ceb81445abb780c71bcb639fbf
I20260318 02:51:19.293942 1174 tablet_bootstrap.cc:492] T 593d63ceb81445abb780c71bcb639fbf P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:19.294030 448 catalog_manager.cc:6741] ReplaceTablet: tablet 593d63ceb81445abb780c71bcb639fbf deleted and replaced by tablet 07f5a93764eb444d8472cc51bf0d3b88
I20260318 02:51:19.294898 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 593d63ceb81445abb780c71bcb639fbf with delete_type TABLET_DATA_DELETED (replaced by tablet 07f5a93764eb444d8472cc51bf0d3b88) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:19.294989 455 master_service.cc:954] ReplaceTablet: received request to replace tablet 593d63ceb81445abb780c71bcb639fbf from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:19.296211 905 tablet_service.cc:1558] Processing DeleteTablet for tablet 593d63ceb81445abb780c71bcb639fbf with delete_type TABLET_DATA_DELETED (replaced by tablet 07f5a93764eb444d8472cc51bf0d3b88) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:19.296250 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 593d63ceb81445abb780c71bcb639fbf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 593d63ceb81445abb780c71bcb639fbf already in progress: creating tablet
I20260318 02:51:19.300369 1174 tablet_bootstrap.cc:654] T 593d63ceb81445abb780c71bcb639fbf P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.301949 1174 log.cc:826] T 593d63ceb81445abb780c71bcb639fbf P 6a903d876086423b8016d705b98895ad: Log is configured to *not* fsync() on all Append() calls
I20260318 02:51:19.302920 1173 tablet_bootstrap.cc:492] T a5a80127d3374812b312fca720505286 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:19.303377 1173 ts_tablet_manager.cc:1403] T a5a80127d3374812b312fca720505286 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.009s
I20260318 02:51:19.304363 763 tablet_service.cc:1511] Processing CreateTablet for tablet 47a94514cba846e19dd6934f371acbe7 (DEFAULT_TABLE table=default.Table_0645d25ceb3b4b0ab4e4945ee5ae16e7 [id=0bd115a0960941ff9d49b4566fe1c666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.304894 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a94514cba846e19dd6934f371acbe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.309991 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 98f618bc041a4c889af992f077a9f3da
I20260318 02:51:19.310520 450 catalog_manager.cc:6741] ReplaceTablet: tablet 98f618bc041a4c889af992f077a9f3da deleted and replaced by tablet 8a9b110d58f647778667befe0d24f590
I20260318 02:51:19.311501 905 tablet_service.cc:1511] Processing CreateTablet for tablet 47a94514cba846e19dd6934f371acbe7 (DEFAULT_TABLE table=default.Table_0645d25ceb3b4b0ab4e4945ee5ae16e7 [id=0bd115a0960941ff9d49b4566fe1c666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.311995 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a94514cba846e19dd6934f371acbe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.311954 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f618bc041a4c889af992f077a9f3da with delete_type TABLET_DATA_DELETED (replaced by tablet 8a9b110d58f647778667befe0d24f590) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:19.316460 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_737bd9edac1b45d68b210a423b0e17ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:19.316908 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f618bc041a4c889af992f077a9f3da with delete_type TABLET_DATA_DELETED (replaced by tablet 8a9b110d58f647778667befe0d24f590) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:19.317183 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_737bd9edac1b45d68b210a423b0e17ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:19.318563 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 98f618bc041a4c889af992f077a9f3da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98f618bc041a4c889af992f077a9f3da already in progress: creating tablet
I20260318 02:51:19.318535 1173 raft_consensus.cc:359] T a5a80127d3374812b312fca720505286 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.319204 1173 raft_consensus.cc:385] T a5a80127d3374812b312fca720505286 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.319370 1173 raft_consensus.cc:740] T a5a80127d3374812b312fca720505286 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.319286 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_acfe3d2a5e3743fbbd251afffb5d9868"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.320050 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_acfe3d2a5e3743fbbd251afffb5d9868 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.321319 1173 consensus_queue.cc:260] T a5a80127d3374812b312fca720505286 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.324371 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_24ce07068f334794aa4027d9abd40855"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.325170 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24ce07068f334794aa4027d9abd40855 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.331157 1174 tablet_bootstrap.cc:492] T 593d63ceb81445abb780c71bcb639fbf P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:19.331452 1174 ts_tablet_manager.cc:1403] T 593d63ceb81445abb780c71bcb639fbf P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.004s
I20260318 02:51:19.334686 763 tablet_service.cc:1511] Processing CreateTablet for tablet 07f5a93764eb444d8472cc51bf0d3b88 (DEFAULT_TABLE table=default.Table_bc6474b60c234029a6004ad369287b54 [id=433e7aa77412424ebb38784bb073d1fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.334918 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9f3caaf4accf437894abd4d1e00a4a27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:19.335246 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07f5a93764eb444d8472cc51bf0d3b88. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:19.335588 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f3caaf4accf437894abd4d1e00a4a27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.337417 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_03aaf4431dfd43c68ba5989233fc3653"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.338070 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03aaf4431dfd43c68ba5989233fc3653 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.338536 1174 raft_consensus.cc:359] T 593d63ceb81445abb780c71bcb639fbf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.339041 1174 raft_consensus.cc:385] T 593d63ceb81445abb780c71bcb639fbf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.339206 1174 raft_consensus.cc:740] T 593d63ceb81445abb780c71bcb639fbf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.339988 1174 consensus_queue.cc:260] T 593d63ceb81445abb780c71bcb639fbf P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.342514 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f67addd8f38f4271add412674873ccbb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.343170 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f67addd8f38f4271add412674873ccbb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.344929 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e12531399635425b8057086bfa69d948"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.345494 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e12531399635425b8057086bfa69d948 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.349905 905 tablet_service.cc:1511] Processing CreateTablet for tablet 07f5a93764eb444d8472cc51bf0d3b88 (DEFAULT_TABLE table=default.Table_bc6474b60c234029a6004ad369287b54 [id=433e7aa77412424ebb38784bb073d1fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.350498 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07f5a93764eb444d8472cc51bf0d3b88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.353307 1174 ts_tablet_manager.cc:1434] T 593d63ceb81445abb780c71bcb639fbf P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.022s user 0.010s sys 0.007s
I20260318 02:51:19.353796 1174 tablet_bootstrap.cc:492] T 4fce8e19ff3a447e8be74547003ea0ff P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:19.353987 1173 ts_tablet_manager.cc:1434] T a5a80127d3374812b312fca720505286 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.050s user 0.008s sys 0.002s
I20260318 02:51:19.354507 1173 tablet_bootstrap.cc:492] T 4fce8e19ff3a447e8be74547003ea0ff P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:19.355486 1174 tablet_bootstrap.cc:654] T 4fce8e19ff3a447e8be74547003ea0ff P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.356505 1173 tablet_bootstrap.cc:654] T 4fce8e19ff3a447e8be74547003ea0ff P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.363924 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_972c817365f34677a65da0c3b3b70e30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.364557 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_972c817365f34677a65da0c3b3b70e30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.365218 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_22e31048ee2346f5a84783b1ccd53d17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.365772 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22e31048ee2346f5a84783b1ccd53d17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.367273 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f618bc041a4c889af992f077a9f3da with delete_type TABLET_DATA_DELETED (replaced by tablet 8a9b110d58f647778667befe0d24f590) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.368809 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 47a94514cba846e19dd6934f371acbe7 (DEFAULT_TABLE table=default.Table_0645d25ceb3b4b0ab4e4945ee5ae16e7 [id=0bd115a0960941ff9d49b4566fe1c666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.369335 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a94514cba846e19dd6934f371acbe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.370889 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b8d82a9b0251407c8d08dd34a1f94c22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.371537 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8d82a9b0251407c8d08dd34a1f94c22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.373306 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 593d63ceb81445abb780c71bcb639fbf with delete_type TABLET_DATA_DELETED (replaced by tablet 07f5a93764eb444d8472cc51bf0d3b88) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:19.373416 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_acccfc03f0334617954d9eafd0874cc5" } new_table_name: "default.Table_6af85649647147de89f83ff7996f485f" modify_external_catalogs: true
I20260318 02:51:19.373647 1176 tablet_replica.cc:333] T 593d63ceb81445abb780c71bcb639fbf P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:19.374151 1176 raft_consensus.cc:2243] T 593d63ceb81445abb780c71bcb639fbf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.374569 1176 raft_consensus.cc:2272] T 593d63ceb81445abb780c71bcb639fbf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.375741 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ae6b2701736a4806bbf56058474af6ec" } new_table_name: "default.Table_6d1c07d8eced44aa8431a666a70ae5ea" modify_external_catalogs: true
I20260318 02:51:19.376367 1176 ts_tablet_manager.cc:1916] T 593d63ceb81445abb780c71bcb639fbf P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.376967 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 593d63ceb81445abb780c71bcb639fbf with delete_type TABLET_DATA_DELETED (replaced by tablet 07f5a93764eb444d8472cc51bf0d3b88) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.377513 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 07f5a93764eb444d8472cc51bf0d3b88 (DEFAULT_TABLE table=default.Table_bc6474b60c234029a6004ad369287b54 [id=433e7aa77412424ebb38784bb073d1fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.377995 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07f5a93764eb444d8472cc51bf0d3b88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.383536 1176 ts_tablet_manager.cc:1929] T 593d63ceb81445abb780c71bcb639fbf P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.383718 1176 log.cc:1199] T 593d63ceb81445abb780c71bcb639fbf P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/593d63ceb81445abb780c71bcb639fbf
I20260318 02:51:19.384264 1176 ts_tablet_manager.cc:1950] T 593d63ceb81445abb780c71bcb639fbf P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:19.390550 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 593d63ceb81445abb780c71bcb639fbf (table default.Table_bc6474b60c234029a6004ad369287b54 [id=433e7aa77412424ebb38784bb073d1fb]) successfully deleted
I20260318 02:51:19.390753 1173 tablet_bootstrap.cc:492] T 4fce8e19ff3a447e8be74547003ea0ff P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:19.390928 1173 ts_tablet_manager.cc:1403] T 4fce8e19ff3a447e8be74547003ea0ff P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.037s user 0.005s sys 0.001s
I20260318 02:51:19.392035 1173 raft_consensus.cc:359] T 4fce8e19ff3a447e8be74547003ea0ff P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.392264 1173 raft_consensus.cc:385] T 4fce8e19ff3a447e8be74547003ea0ff P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.392351 1173 raft_consensus.cc:740] T 4fce8e19ff3a447e8be74547003ea0ff P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.392604 1173 consensus_queue.cc:260] T 4fce8e19ff3a447e8be74547003ea0ff P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.393157 1173 ts_tablet_manager.cc:1434] T 4fce8e19ff3a447e8be74547003ea0ff P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:19.393486 1173 tablet_bootstrap.cc:492] T 593d63ceb81445abb780c71bcb639fbf P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:19.393828 1172 log.cc:826] T 0e1f58b1954a49b99871f965ec470a3b P 9422bb7011f342b08be0b073a88c4c4d: Log is configured to *not* fsync() on all Append() calls
I20260318 02:51:19.395074 1174 tablet_bootstrap.cc:492] T 4fce8e19ff3a447e8be74547003ea0ff P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:19.395231 1174 ts_tablet_manager.cc:1403] T 4fce8e19ff3a447e8be74547003ea0ff P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.042s user 0.006s sys 0.003s
I20260318 02:51:19.395325 1173 tablet_bootstrap.cc:654] T 593d63ceb81445abb780c71bcb639fbf P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:19.396080 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet a5a80127d3374812b312fca720505286 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5a80127d3374812b312fca720505286 already in progress: creating tablet
I20260318 02:51:19.396091 1174 raft_consensus.cc:359] T 4fce8e19ff3a447e8be74547003ea0ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.396281 1174 raft_consensus.cc:385] T 4fce8e19ff3a447e8be74547003ea0ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.396363 1174 raft_consensus.cc:740] T 4fce8e19ff3a447e8be74547003ea0ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.396638 1174 consensus_queue.cc:260] T 4fce8e19ff3a447e8be74547003ea0ff P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.397185 1174 ts_tablet_manager.cc:1434] T 4fce8e19ff3a447e8be74547003ea0ff P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:19.397482 1174 tablet_bootstrap.cc:492] T 0e1f58b1954a49b99871f965ec470a3b P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:19.398908 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 98f618bc041a4c889af992f077a9f3da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98f618bc041a4c889af992f077a9f3da already in progress: creating tablet
I20260318 02:51:19.399351 1174 tablet_bootstrap.cc:654] T 0e1f58b1954a49b99871f965ec470a3b P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:19.399852 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 593d63ceb81445abb780c71bcb639fbf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 593d63ceb81445abb780c71bcb639fbf already in progress: creating tablet
I20260318 02:51:19.406329 1172 tablet_bootstrap.cc:492] T 0e1f58b1954a49b99871f965ec470a3b P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:19.406685 1172 ts_tablet_manager.cc:1403] T 0e1f58b1954a49b99871f965ec470a3b P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.152s user 0.004s sys 0.004s
I20260318 02:51:19.408629 1175 tablet_replica.cc:333] T a5a80127d3374812b312fca720505286 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:19.409318 1175 raft_consensus.cc:2243] T a5a80127d3374812b312fca720505286 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.410166 1175 raft_consensus.cc:2272] T a5a80127d3374812b312fca720505286 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.410660 1173 tablet_bootstrap.cc:492] T 593d63ceb81445abb780c71bcb639fbf P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:19.410840 1173 ts_tablet_manager.cc:1403] T 593d63ceb81445abb780c71bcb639fbf P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.001s
I20260318 02:51:19.411588 1173 raft_consensus.cc:359] T 593d63ceb81445abb780c71bcb639fbf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.411790 1173 raft_consensus.cc:385] T 593d63ceb81445abb780c71bcb639fbf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.411868 1173 raft_consensus.cc:740] T 593d63ceb81445abb780c71bcb639fbf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.412004 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bc6474b60c234029a6004ad369287b54" } new_table_name: "default.Table_fc7dabc5acc94276bc2f0ede2f8e39a6" modify_external_catalogs: true
I20260318 02:51:19.412103 1173 consensus_queue.cc:260] T 593d63ceb81445abb780c71bcb639fbf P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.412302 1174 tablet_bootstrap.cc:492] T 0e1f58b1954a49b99871f965ec470a3b P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:19.412473 1174 ts_tablet_manager.cc:1403] T 0e1f58b1954a49b99871f965ec470a3b P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.000s
I20260318 02:51:19.412560 1173 ts_tablet_manager.cc:1434] T 593d63ceb81445abb780c71bcb639fbf P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:19.413703 1173 tablet_bootstrap.cc:492] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:19.414242 1174 raft_consensus.cc:359] T 0e1f58b1954a49b99871f965ec470a3b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.414445 1174 raft_consensus.cc:385] T 0e1f58b1954a49b99871f965ec470a3b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.414628 1174 raft_consensus.cc:740] T 0e1f58b1954a49b99871f965ec470a3b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.414661 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0645d25ceb3b4b0ab4e4945ee5ae16e7" } new_table_name: "default.Table_2e46b43241344980bca723c247d7dccf" modify_external_catalogs: true
I20260318 02:51:19.414947 1174 consensus_queue.cc:260] T 0e1f58b1954a49b99871f965ec470a3b P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.415437 1173 tablet_bootstrap.cc:654] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.415652 1175 ts_tablet_manager.cc:1916] T a5a80127d3374812b312fca720505286 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.415848 1174 ts_tablet_manager.cc:1434] T 0e1f58b1954a49b99871f965ec470a3b P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:19.416201 1174 tablet_bootstrap.cc:492] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:19.417564 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_24ce07068f334794aa4027d9abd40855" } new_table_name: "default.Table_541a8f0af72c48529db5904e9400919f" modify_external_catalogs: true
I20260318 02:51:19.417960 1174 tablet_bootstrap.cc:654] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.423432 1172 raft_consensus.cc:359] T 0e1f58b1954a49b99871f965ec470a3b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.423908 1172 raft_consensus.cc:385] T 0e1f58b1954a49b99871f965ec470a3b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.424017 1172 raft_consensus.cc:740] T 0e1f58b1954a49b99871f965ec470a3b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.424870 1172 consensus_queue.cc:260] T 0e1f58b1954a49b99871f965ec470a3b P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.425033 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3d5d8ced462a4e8fbde8382a07f71579" } modify_external_catalogs: true
I20260318 02:51:19.425268 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3d5d8ced462a4e8fbde8382a07f71579" } modify_external_catalogs: true
W20260318 02:51:19.425931 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0e1f58b1954a49b99871f965ec470a3b consensus state has no leader
I20260318 02:51:19.426309 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_acfe3d2a5e3743fbbd251afffb5d9868" } modify_external_catalogs: true
I20260318 02:51:19.426450 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_acfe3d2a5e3743fbbd251afffb5d9868" } modify_external_catalogs: true
I20260318 02:51:19.426568 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_03aaf4431dfd43c68ba5989233fc3653" } modify_external_catalogs: true
I20260318 02:51:19.426808 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_03aaf4431dfd43c68ba5989233fc3653" } modify_external_catalogs: true
I20260318 02:51:19.428392 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f67addd8f38f4271add412674873ccbb" } modify_external_catalogs: true
I20260318 02:51:19.428589 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f67addd8f38f4271add412674873ccbb" } modify_external_catalogs: true
I20260318 02:51:19.431126 1174 tablet_bootstrap.cc:492] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:19.431288 1174 ts_tablet_manager.cc:1403] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260318 02:51:19.432569 1174 raft_consensus.cc:359] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.432832 1174 raft_consensus.cc:385] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.432929 1174 raft_consensus.cc:740] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.433171 457 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 4fce8e19ff3a447e8be74547003ea0ff (table default.Table_ae6b2701736a4806bbf56058474af6ec [id=f62386b6ad9441eeafff054f00ee0423]). Expected version 1 got 0
I20260318 02:51:19.433153 1174 consensus_queue.cc:260] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.433647 1174 ts_tablet_manager.cc:1434] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:19.433936 1174 tablet_bootstrap.cc:492] T 98f618bc041a4c889af992f077a9f3da P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:19.433894 453 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 4fce8e19ff3a447e8be74547003ea0ff (table default.Table_ae6b2701736a4806bbf56058474af6ec [id=f62386b6ad9441eeafff054f00ee0423]). Expected version 1 got 0
I20260318 02:51:19.435668 1174 tablet_bootstrap.cc:654] T 98f618bc041a4c889af992f077a9f3da P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.436133 763 tablet_service.cc:1511] Processing CreateTablet for tablet 8a9b110d58f647778667befe0d24f590 (DEFAULT_TABLE table=default.Table_3d5d8ced462a4e8fbde8382a07f71579 [id=18eb38b85d0c4dd3b8d945c444ffadfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.436565 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a9b110d58f647778667befe0d24f590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.436904 1172 ts_tablet_manager.cc:1434] T 0e1f58b1954a49b99871f965ec470a3b P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.030s user 0.012s sys 0.007s
I20260318 02:51:19.437742 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 8a9b110d58f647778667befe0d24f590 (DEFAULT_TABLE table=default.Table_3d5d8ced462a4e8fbde8382a07f71579 [id=18eb38b85d0c4dd3b8d945c444ffadfa]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:19.437932 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4fce8e19ff3a447e8be74547003ea0ff consensus state has no leader
I20260318 02:51:19.438171 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a9b110d58f647778667befe0d24f590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.438176 1174 tablet_bootstrap.cc:492] T 98f618bc041a4c889af992f077a9f3da P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:19.438340 1174 ts_tablet_manager.cc:1403] T 98f618bc041a4c889af992f077a9f3da P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260318 02:51:19.438303 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e12531399635425b8057086bfa69d948" } modify_external_catalogs: true
I20260318 02:51:19.438464 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e12531399635425b8057086bfa69d948" } modify_external_catalogs: true
I20260318 02:51:19.439118 1174 raft_consensus.cc:359] T 98f618bc041a4c889af992f077a9f3da P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.439312 1174 raft_consensus.cc:385] T 98f618bc041a4c889af992f077a9f3da P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.439380 1174 raft_consensus.cc:740] T 98f618bc041a4c889af992f077a9f3da P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.439705 1174 consensus_queue.cc:260] T 98f618bc041a4c889af992f077a9f3da P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.440297 1174 ts_tablet_manager.cc:1434] T 98f618bc041a4c889af992f077a9f3da P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260318 02:51:19.440653 1174 tablet_bootstrap.cc:492] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:19.442013 906 tablet_service.cc:1511] Processing CreateTablet for tablet 8a9b110d58f647778667befe0d24f590 (DEFAULT_TABLE table=default.Table_3d5d8ced462a4e8fbde8382a07f71579 [id=18eb38b85d0c4dd3b8d945c444ffadfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.442425 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a9b110d58f647778667befe0d24f590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.442768 1174 tablet_bootstrap.cc:654] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.445462 1175 ts_tablet_manager.cc:1929] T a5a80127d3374812b312fca720505286 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.445719 1175 log.cc:1199] T a5a80127d3374812b312fca720505286 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/a5a80127d3374812b312fca720505286
I20260318 02:51:19.446182 1175 ts_tablet_manager.cc:1950] T a5a80127d3374812b312fca720505286 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
W20260318 02:51:19.448757 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 07f5a93764eb444d8472cc51bf0d3b88 consensus state has no leader
W20260318 02:51:19.449278 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47a94514cba846e19dd6934f371acbe7 consensus state has no leader
I20260318 02:51:19.450845 1174 tablet_bootstrap.cc:492] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:19.451009 1174 ts_tablet_manager.cc:1403] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.007s
W20260318 02:51:19.451639 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7a81d51587eb4e5cab9fb61bf7f524a1 has no consensus state
I20260318 02:51:19.451846 1174 raft_consensus.cc:359] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.452062 1174 raft_consensus.cc:385] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.452157 1174 raft_consensus.cc:740] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.452989 1174 consensus_queue.cc:260] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.454185 452 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet dc89147cbdcd44478301f1e230ccb771
I20260318 02:51:19.455135 451 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet c6d6e24fa37e45cbaa3efb027c068f2c
I20260318 02:51:19.455461 448 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 74e57af70f4947eba875d07feb57f784
I20260318 02:51:19.456195 1174 ts_tablet_manager.cc:1434] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260318 02:51:19.456540 1173 tablet_bootstrap.cc:492] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:19.456689 1173 ts_tablet_manager.cc:1403] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.002s
I20260318 02:51:19.457675 1173 raft_consensus.cc:359] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.457882 1173 raft_consensus.cc:385] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.457981 1173 raft_consensus.cc:740] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.458252 1173 consensus_queue.cc:260] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.458632 1180 raft_consensus.cc:493] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:19.458842 1180 raft_consensus.cc:515] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.460933 1180 leader_election.cc:290] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:19.461437 1173 ts_tablet_manager.cc:1434] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:19.461962 1110 heartbeater.cc:499] Master 127.0.104.190:39451 was elected leader, sending a full tablet report...
I20260318 02:51:19.463506 1173 tablet_bootstrap.cc:492] T 98f618bc041a4c889af992f077a9f3da P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:19.466509 1172 tablet_bootstrap.cc:492] T 98f618bc041a4c889af992f077a9f3da P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:19.468284 1174 tablet_bootstrap.cc:492] T 07f5a93764eb444d8472cc51bf0d3b88 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:19.468395 1173 tablet_bootstrap.cc:654] T 98f618bc041a4c889af992f077a9f3da P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.470732 1174 tablet_bootstrap.cc:654] T 07f5a93764eb444d8472cc51bf0d3b88 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.470950 1172 tablet_bootstrap.cc:654] T 98f618bc041a4c889af992f077a9f3da P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.472460 452 master_service.cc:954] ReplaceTablet: received request to replace tablet 0e1f58b1954a49b99871f965ec470a3b from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:19.475911 457 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 0e1f58b1954a49b99871f965ec470a3b (table default.Table_6af85649647147de89f83ff7996f485f [id=0c04457e82e54a229437db0c3f90811b]). Expected version 2 got 0
I20260318 02:51:19.476222 457 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 4fce8e19ff3a447e8be74547003ea0ff (table default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]). Expected version 2 got 0
I20260318 02:51:19.476933 448 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 0e1f58b1954a49b99871f965ec470a3b (table default.Table_6af85649647147de89f83ff7996f485f [id=0c04457e82e54a229437db0c3f90811b]). Expected version 2 got 0
I20260318 02:51:19.481251 451 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 47a94514cba846e19dd6934f371acbe7 (table default.Table_2e46b43241344980bca723c247d7dccf [id=0bd115a0960941ff9d49b4566fe1c666]). Expected version 2 got 0
I20260318 02:51:19.481532 451 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 4fce8e19ff3a447e8be74547003ea0ff (table default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]). Expected version 2 got 0
I20260318 02:51:19.481683 451 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 07f5a93764eb444d8472cc51bf0d3b88 (table default.Table_fc7dabc5acc94276bc2f0ede2f8e39a6 [id=433e7aa77412424ebb38784bb073d1fb]). Expected version 2 got 0
I20260318 02:51:19.481846 451 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 0e1f58b1954a49b99871f965ec470a3b (table default.Table_6af85649647147de89f83ff7996f485f [id=0c04457e82e54a229437db0c3f90811b]). Expected version 2 got 0
I20260318 02:51:19.483852 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 8a9b110d58f647778667befe0d24f590
W20260318 02:51:19.484584 834 tablet.cc:2379] T 0e1f58b1954a49b99871f965ec470a3b P 6a903d876086423b8016d705b98895ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260318 02:51:19.485081 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a9b110d58f647778667befe0d24f590 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:19.485765 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 8a9b110d58f647778667befe0d24f590 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a9b110d58f647778667befe0d24f590 already in progress: creating tablet
I20260318 02:51:19.486658 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f618bc041a4c889af992f077a9f3da with delete_type TABLET_DATA_DELETED (replaced by tablet 8a9b110d58f647778667befe0d24f590) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:19.486708 906 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a9b110d58f647778667befe0d24f590 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:19.486955 1176 tablet_replica.cc:333] T 98f618bc041a4c889af992f077a9f3da P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:19.487123 762 tablet_service.cc:1558] Processing DeleteTablet for tablet a5a80127d3374812b312fca720505286 with delete_type TABLET_DATA_DELETED (replaced by tablet 47a94514cba846e19dd6934f371acbe7) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:19.487112 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a9b110d58f647778667befe0d24f590 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.487175 1176 raft_consensus.cc:2243] T 98f618bc041a4c889af992f077a9f3da P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.487345 1176 raft_consensus.cc:2272] T 98f618bc041a4c889af992f077a9f3da P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:19.487772 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 8a9b110d58f647778667befe0d24f590 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a9b110d58f647778667befe0d24f590 already in progress: creating tablet
I20260318 02:51:19.488215 1176 ts_tablet_manager.cc:1916] T 98f618bc041a4c889af992f077a9f3da P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.488497 456 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 47a94514cba846e19dd6934f371acbe7 (table default.Table_2e46b43241344980bca723c247d7dccf [id=0bd115a0960941ff9d49b4566fe1c666]). Expected version 2 got 0
W20260318 02:51:19.494877 975 tablet.cc:2379] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260318 02:51:19.495326 1176 ts_tablet_manager.cc:1929] T 98f618bc041a4c889af992f077a9f3da P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.495477 1176 log.cc:1199] T 98f618bc041a4c889af992f077a9f3da P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/98f618bc041a4c889af992f077a9f3da
I20260318 02:51:19.495870 1176 ts_tablet_manager.cc:1950] T 98f618bc041a4c889af992f077a9f3da P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:19.496994 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 98f618bc041a4c889af992f077a9f3da (table default.Table_3d5d8ced462a4e8fbde8382a07f71579 [id=18eb38b85d0c4dd3b8d945c444ffadfa]) successfully deleted
I20260318 02:51:19.497395 1176 tablet_replica.cc:333] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:19.497581 1176 raft_consensus.cc:2243] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.497756 1176 raft_consensus.cc:2272] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:19.498091 1112 tablet.cc:2379] T 0e1f58b1954a49b99871f965ec470a3b P 9422bb7011f342b08be0b073a88c4c4d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260318 02:51:19.498548 1176 ts_tablet_manager.cc:1916] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.501829 457 master_service.cc:954] ReplaceTablet: received request to replace tablet 4fce8e19ff3a447e8be74547003ea0ff from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:19.505005 1173 tablet_bootstrap.cc:492] T 98f618bc041a4c889af992f077a9f3da P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:19.505282 1173 ts_tablet_manager.cc:1403] T 98f618bc041a4c889af992f077a9f3da P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.002s
I20260318 02:51:19.505434 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3
I20260318 02:51:19.506196 1173 raft_consensus.cc:359] T 98f618bc041a4c889af992f077a9f3da P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.506533 1173 raft_consensus.cc:385] T 98f618bc041a4c889af992f077a9f3da P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.506773 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:19.507025 1173 raft_consensus.cc:740] T 98f618bc041a4c889af992f077a9f3da P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.507431 1173 consensus_queue.cc:260] T 98f618bc041a4c889af992f077a9f3da P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.507947 1174 tablet_bootstrap.cc:492] T 07f5a93764eb444d8472cc51bf0d3b88 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:19.508117 1174 ts_tablet_manager.cc:1403] T 07f5a93764eb444d8472cc51bf0d3b88 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.000s
I20260318 02:51:19.508944 1174 raft_consensus.cc:359] T 07f5a93764eb444d8472cc51bf0d3b88 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.509130 1174 raft_consensus.cc:385] T 07f5a93764eb444d8472cc51bf0d3b88 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.509198 1174 raft_consensus.cc:740] T 07f5a93764eb444d8472cc51bf0d3b88 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.509454 1174 consensus_queue.cc:260] T 07f5a93764eb444d8472cc51bf0d3b88 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.510707 1173 ts_tablet_manager.cc:1434] T 98f618bc041a4c889af992f077a9f3da P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260318 02:51:19.512071 455 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 07f5a93764eb444d8472cc51bf0d3b88 (table default.Table_fc7dabc5acc94276bc2f0ede2f8e39a6 [id=433e7aa77412424ebb38784bb073d1fb]). Expected version 2 got 0
I20260318 02:51:19.513123 1173 tablet_bootstrap.cc:492] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:19.513572 906 tablet_service.cc:1558] Processing DeleteTablet for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:19.514264 1174 ts_tablet_manager.cc:1434] T 07f5a93764eb444d8472cc51bf0d3b88 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260318 02:51:19.514572 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet 593d63ceb81445abb780c71bcb639fbf with delete_type TABLET_DATA_DELETED (replaced by tablet 07f5a93764eb444d8472cc51bf0d3b88) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.514847 1043 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f618bc041a4c889af992f077a9f3da with delete_type TABLET_DATA_DELETED (replaced by tablet 8a9b110d58f647778667befe0d24f590) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.515027 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a9b110d58f647778667befe0d24f590 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.515192 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet a5a80127d3374812b312fca720505286 with delete_type TABLET_DATA_DELETED (replaced by tablet 47a94514cba846e19dd6934f371acbe7) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.515339 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.520071 456 master_service.cc:954] ReplaceTablet: received request to replace tablet 0e1f58b1954a49b99871f965ec470a3b from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:19.520236 450 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 07f5a93764eb444d8472cc51bf0d3b88 (table default.Table_fc7dabc5acc94276bc2f0ede2f8e39a6 [id=433e7aa77412424ebb38784bb073d1fb]). Expected version 2 got 0
I20260318 02:51:19.523229 1174 tablet_bootstrap.cc:492] T 8a9b110d58f647778667befe0d24f590 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:19.525501 455 master_service.cc:954] ReplaceTablet: received request to replace tablet 98f618bc041a4c889af992f077a9f3da from {username='slave'} at 127.0.0.1:47158
W20260318 02:51:19.526553 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 593d63ceb81445abb780c71bcb639fbf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 593d63ceb81445abb780c71bcb639fbf already in progress: creating tablet
I20260318 02:51:19.527752 418 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu with pid 565
W20260318 02:51:19.530004 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 98f618bc041a4c889af992f077a9f3da because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98f618bc041a4c889af992f077a9f3da already in progress: creating tablet
W20260318 02:51:19.530289 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 8a9b110d58f647778667befe0d24f590 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a9b110d58f647778667befe0d24f590 already in progress: creating tablet
W20260318 02:51:19.530514 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet a5a80127d3374812b312fca720505286 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a5a80127d3374812b312fca720505286 already in progress: creating tablet
W20260318 02:51:19.530761 441 catalog_manager.cc:4969] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 because the tablet was not found. No further retry: Not found: Tablet not found: 37cccad81a6a48bb8e2b0c4cbd5dfba3
I20260318 02:51:19.531612 1174 tablet_bootstrap.cc:654] T 8a9b110d58f647778667befe0d24f590 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:19.526265 719 leader_election.cc:343] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: a5a80127d3374812b312fca720505286
I20260318 02:51:19.532924 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 0e1f58b1954a49b99871f965ec470a3b
I20260318 02:51:19.533061 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e1f58b1954a49b99871f965ec470a3b with delete_type TABLET_DATA_DELETED (replaced by tablet deba6669348248d6a1f1111122e7ad32) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.533004 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a80127d3374812b312fca720505286" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:19.533399 1184 tablet_replica.cc:333] T 0e1f58b1954a49b99871f965ec470a3b P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:19.533762 1173 tablet_bootstrap.cc:654] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.533751 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e1f58b1954a49b99871f965ec470a3b with delete_type TABLET_DATA_DELETED (replaced by tablet deba6669348248d6a1f1111122e7ad32) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:19.533869 1184 raft_consensus.cc:2243] T 0e1f58b1954a49b99871f965ec470a3b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.534287 1184 raft_consensus.cc:2272] T 0e1f58b1954a49b99871f965ec470a3b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:19.534266 719 leader_election.cc:343] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:19.534585 719 leader_election.cc:304] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:19.535022 719 raft_consensus.cc:2686] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260318 02:51:19.536266 1184 ts_tablet_manager.cc:1916] T 0e1f58b1954a49b99871f965ec470a3b P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.537508 452 catalog_manager.cc:6741] ReplaceTablet: tablet 0e1f58b1954a49b99871f965ec470a3b deleted and replaced by tablet deba6669348248d6a1f1111122e7ad32
I20260318 02:51:19.539760 655 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3
I20260318 02:51:19.540742 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:19.541908 762 tablet_service.cc:1511] Processing CreateTablet for tablet 1766ce95009b4c3f9940ebcf10503c7f (DEFAULT_TABLE table=default.Table_b8d82a9b0251407c8d08dd34a1f94c22 [id=1c0082e294dd43cdb2eb4ed335ff3c06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.542289 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e1f58b1954a49b99871f965ec470a3b with delete_type TABLET_DATA_DELETED (replaced by tablet deba6669348248d6a1f1111122e7ad32) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.542389 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1766ce95009b4c3f9940ebcf10503c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.543655 1176 ts_tablet_manager.cc:1929] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.543814 1176 log.cc:1199] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/a5a80127d3374812b312fca720505286
I20260318 02:51:19.544018 763 tablet_service.cc:1511] Processing CreateTablet for tablet 9593cb3d940c42918056a222313c7adb (DEFAULT_TABLE table=default.Table_737bd9edac1b45d68b210a423b0e17ee [id=97e9a124fd8d4b279d8db98ee802ede4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.544435 906 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e1f58b1954a49b99871f965ec470a3b with delete_type TABLET_DATA_DELETED (replaced by tablet deba6669348248d6a1f1111122e7ad32) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:19.544453 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.545246 906 tablet_service.cc:1558] Processing DeleteTablet for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:19.545508 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 1766ce95009b4c3f9940ebcf10503c7f (DEFAULT_TABLE table=default.Table_b8d82a9b0251407c8d08dd34a1f94c22 [id=1c0082e294dd43cdb2eb4ed335ff3c06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.545949 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1766ce95009b4c3f9940ebcf10503c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.546162 1173 tablet_bootstrap.cc:492] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:19.546351 1173 ts_tablet_manager.cc:1403] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.002s
I20260318 02:51:19.547365 1173 raft_consensus.cc:359] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.547647 1173 raft_consensus.cc:385] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.547649 1184 ts_tablet_manager.cc:1929] T 0e1f58b1954a49b99871f965ec470a3b P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.547837 1184 log.cc:1199] T 0e1f58b1954a49b99871f965ec470a3b P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/0e1f58b1954a49b99871f965ec470a3b
I20260318 02:51:19.547838 1173 raft_consensus.cc:740] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.548287 1184 ts_tablet_manager.cc:1950] T 0e1f58b1954a49b99871f965ec470a3b P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:19.548204 1173 consensus_queue.cc:260] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.551692 906 tablet_service.cc:1511] Processing CreateTablet for tablet 1766ce95009b4c3f9940ebcf10503c7f (DEFAULT_TABLE table=default.Table_b8d82a9b0251407c8d08dd34a1f94c22 [id=1c0082e294dd43cdb2eb4ed335ff3c06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.552173 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1766ce95009b4c3f9940ebcf10503c7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.552179 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 9593cb3d940c42918056a222313c7adb (DEFAULT_TABLE table=default.Table_737bd9edac1b45d68b210a423b0e17ee [id=97e9a124fd8d4b279d8db98ee802ede4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.552536 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9593cb3d940c42918056a222313c7adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.555825 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9593cb3d940c42918056a222313c7adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.557147 456 master_service.cc:954] ReplaceTablet: received request to replace tablet 07f5a93764eb444d8472cc51bf0d3b88 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:19.559613 766 tablet_service.cc:1511] Processing CreateTablet for tablet 2d254c168b5746b59ee57a816b53ba69 (DEFAULT_TABLE table=default.Table_22e31048ee2346f5a84783b1ccd53d17 [id=789fd6a65c0c481494430f1ba4c574f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.560127 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d254c168b5746b59ee57a816b53ba69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.561232 1173 ts_tablet_manager.cc:1434] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260318 02:51:19.562546 1176 ts_tablet_manager.cc:1950] T a5a80127d3374812b312fca720505286 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:19.563655 1176 tablet_replica.cc:333] T 0e1f58b1954a49b99871f965ec470a3b P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:19.563879 1176 raft_consensus.cc:2243] T 0e1f58b1954a49b99871f965ec470a3b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.564088 1176 raft_consensus.cc:2272] T 0e1f58b1954a49b99871f965ec470a3b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.565809 1173 tablet_bootstrap.cc:492] T 07f5a93764eb444d8472cc51bf0d3b88 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:19.566279 765 tablet_service.cc:1511] Processing CreateTablet for tablet ee07c93213d44d9bb156d9ad7937facf (DEFAULT_TABLE table=default.Table_9f3caaf4accf437894abd4d1e00a4a27 [id=46bae779de56403ab810fc4dcde25233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.566362 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet a5a80127d3374812b312fca720505286 (table default.Table_2e46b43241344980bca723c247d7dccf [id=0bd115a0960941ff9d49b4566fe1c666]) successfully deleted
W20260318 02:51:19.566640 443 catalog_manager.cc:4969] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 because the tablet was not found. No further retry: Not found: Tablet not found: 37cccad81a6a48bb8e2b0c4cbd5dfba3
I20260318 02:51:19.566704 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee07c93213d44d9bb156d9ad7937facf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.567099 448 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 47a94514cba846e19dd6934f371acbe7 (table default.Table_2e46b43241344980bca723c247d7dccf [id=0bd115a0960941ff9d49b4566fe1c666]). Expected version 2 got 0
I20260318 02:51:19.569130 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 4fce8e19ff3a447e8be74547003ea0ff
I20260318 02:51:19.569092 764 tablet_service.cc:1511] Processing CreateTablet for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 (DEFAULT_TABLE table=default.Table_e12531399635425b8057086bfa69d948 [id=a0142bdf340a4928b1ec18479e8bc674]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.569484 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.569605 457 catalog_manager.cc:6741] ReplaceTablet: tablet 4fce8e19ff3a447e8be74547003ea0ff deleted and replaced by tablet 5955a2ce20e64b0989f26dec7e439792
I20260318 02:51:19.570353 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fce8e19ff3a447e8be74547003ea0ff with delete_type TABLET_DATA_DELETED (replaced by tablet 5955a2ce20e64b0989f26dec7e439792) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:19.571728 762 tablet_service.cc:1511] Processing CreateTablet for tablet da240bc0d5b043b89232fdf646f4f344 (DEFAULT_TABLE table=default.Table_972c817365f34677a65da0c3b3b70e30 [id=d7f85dc897794d14af2f182a59150e92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.572297 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da240bc0d5b043b89232fdf646f4f344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.576021 1176 ts_tablet_manager.cc:1916] T 0e1f58b1954a49b99871f965ec470a3b P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.582017 763 tablet_service.cc:1511] Processing CreateTablet for tablet 7a81d51587eb4e5cab9fb61bf7f524a1 (DEFAULT_TABLE table=default.Table_541a8f0af72c48529db5904e9400919f [id=5e3dec62fd1942a5b64c954901219b4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.582480 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a81d51587eb4e5cab9fb61bf7f524a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.582481 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 0e1f58b1954a49b99871f965ec470a3b (table default.Table_6af85649647147de89f83ff7996f485f [id=0c04457e82e54a229437db0c3f90811b]) successfully deleted
I20260318 02:51:19.582651 1176 ts_tablet_manager.cc:1929] T 0e1f58b1954a49b99871f965ec470a3b P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260318 02:51:19.582757 441 catalog_manager.cc:4969] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 0e1f58b1954a49b99871f965ec470a3b because the tablet was not found. No further retry: Not found: Tablet not found: 0e1f58b1954a49b99871f965ec470a3b
I20260318 02:51:19.582813 1176 log.cc:1199] T 0e1f58b1954a49b99871f965ec470a3b P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/0e1f58b1954a49b99871f965ec470a3b
W20260318 02:51:19.583006 441 catalog_manager.cc:4969] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 because the tablet was not found. No further retry: Not found: Tablet not found: 37cccad81a6a48bb8e2b0c4cbd5dfba3
I20260318 02:51:19.583146 1176 ts_tablet_manager.cc:1950] T 0e1f58b1954a49b99871f965ec470a3b P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:19.585403 1176 tablet_replica.cc:333] T 4fce8e19ff3a447e8be74547003ea0ff P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:19.585685 1176 raft_consensus.cc:2243] T 4fce8e19ff3a447e8be74547003ea0ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.585667 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fce8e19ff3a447e8be74547003ea0ff with delete_type TABLET_DATA_DELETED (replaced by tablet 5955a2ce20e64b0989f26dec7e439792) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.585891 1176 raft_consensus.cc:2272] T 4fce8e19ff3a447e8be74547003ea0ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.585938 457 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 47a94514cba846e19dd6934f371acbe7 (table default.Table_2e46b43241344980bca723c247d7dccf [id=0bd115a0960941ff9d49b4566fe1c666]). Expected version 2 got 0
W20260318 02:51:19.586813 1109 heartbeater.cc:646] Failed to heartbeat to 127.0.104.188:41593 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.0.104.188:41593 (error 108)
I20260318 02:51:19.586895 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 2d254c168b5746b59ee57a816b53ba69 (DEFAULT_TABLE table=default.Table_22e31048ee2346f5a84783b1ccd53d17 [id=789fd6a65c0c481494430f1ba4c574f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.587318 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d254c168b5746b59ee57a816b53ba69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.585430 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 (DEFAULT_TABLE table=default.Table_e12531399635425b8057086bfa69d948 [id=a0142bdf340a4928b1ec18479e8bc674]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.588035 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:19.588402 831 heartbeater.cc:646] Failed to heartbeat to 127.0.104.188:41593 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.0.104.188:41593 (error 108)
I20260318 02:51:19.588619 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet a5a80127d3374812b312fca720505286 (table default.Table_2e46b43241344980bca723c247d7dccf [id=0bd115a0960941ff9d49b4566fe1c666]) successfully deleted
I20260318 02:51:19.589030 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 7a81d51587eb4e5cab9fb61bf7f524a1 (DEFAULT_TABLE table=default.Table_541a8f0af72c48529db5904e9400919f [id=5e3dec62fd1942a5b64c954901219b4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.589419 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a81d51587eb4e5cab9fb61bf7f524a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.589417 1042 tablet_service.cc:1511] Processing CreateTablet for tablet ee07c93213d44d9bb156d9ad7937facf (DEFAULT_TABLE table=default.Table_9f3caaf4accf437894abd4d1e00a4a27 [id=46bae779de56403ab810fc4dcde25233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.589759 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee07c93213d44d9bb156d9ad7937facf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.590929 1176 ts_tablet_manager.cc:1916] T 4fce8e19ff3a447e8be74547003ea0ff P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.593282 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e3ecfc06a52040e6902adbf96eff2ea8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.593979 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3ecfc06a52040e6902adbf96eff2ea8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.595383 1172 tablet_bootstrap.cc:492] T 98f618bc041a4c889af992f077a9f3da P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:19.595399 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 0e1f58b1954a49b99871f965ec470a3b (table default.Table_6af85649647147de89f83ff7996f485f [id=0c04457e82e54a229437db0c3f90811b]) successfully deleted
I20260318 02:51:19.595532 1172 ts_tablet_manager.cc:1403] T 98f618bc041a4c889af992f077a9f3da P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.129s user 0.018s sys 0.033s
W20260318 02:51:19.595640 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 already in progress: creating tablet
I20260318 02:51:19.596423 1172 raft_consensus.cc:359] T 98f618bc041a4c889af992f077a9f3da P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.596637 1172 raft_consensus.cc:385] T 98f618bc041a4c889af992f077a9f3da P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.596812 1172 raft_consensus.cc:740] T 98f618bc041a4c889af992f077a9f3da P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.597090 1172 consensus_queue.cc:260] T 98f618bc041a4c889af992f077a9f3da P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.597676 1172 ts_tablet_manager.cc:1434] T 98f618bc041a4c889af992f077a9f3da P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:19.600067 1172 tablet_bootstrap.cc:492] T a5a80127d3374812b312fca720505286 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:19.600584 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_4285d188a85b436894c35f7c097232d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.601280 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4285d188a85b436894c35f7c097232d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.601922 1172 tablet_bootstrap.cc:654] T a5a80127d3374812b312fca720505286 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.602764 1041 tablet_service.cc:1511] Processing CreateTablet for tablet da240bc0d5b043b89232fdf646f4f344 (DEFAULT_TABLE table=default.Table_972c817365f34677a65da0c3b3b70e30 [id=d7f85dc897794d14af2f182a59150e92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.603156 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da240bc0d5b043b89232fdf646f4f344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.604260 1174 tablet_bootstrap.cc:492] T 8a9b110d58f647778667befe0d24f590 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:19.604427 1174 ts_tablet_manager.cc:1403] T 8a9b110d58f647778667befe0d24f590 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.081s user 0.003s sys 0.001s
I20260318 02:51:19.605317 1174 raft_consensus.cc:359] T 8a9b110d58f647778667befe0d24f590 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.605564 1174 raft_consensus.cc:385] T 8a9b110d58f647778667befe0d24f590 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.605661 1174 raft_consensus.cc:740] T 8a9b110d58f647778667befe0d24f590 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.607966 1174 consensus_queue.cc:260] T 8a9b110d58f647778667befe0d24f590 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.584249 903 tablet_service.cc:1511] Processing CreateTablet for tablet 2d254c168b5746b59ee57a816b53ba69 (DEFAULT_TABLE table=default.Table_22e31048ee2346f5a84783b1ccd53d17 [id=789fd6a65c0c481494430f1ba4c574f4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:19.608446 1193 negotiation.cc:337] Failed RPC negotiation. Trace:
0318 02:51:19.589184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.104.188:41593 (local address 127.0.104.129:50153)
0318 02:51:19.589412 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0318 02:51:19.589448 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0318 02:51:19.589558 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0318 02:51:19.607311 (+ 17753us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":118}
I20260318 02:51:19.608922 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d254c168b5746b59ee57a816b53ba69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.610333 1173 tablet_bootstrap.cc:654] T 07f5a93764eb444d8472cc51bf0d3b88 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:19.611111 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 4fce8e19ff3a447e8be74547003ea0ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4fce8e19ff3a447e8be74547003ea0ff already in progress: creating tablet
I20260318 02:51:19.586481 1175 tablet_replica.cc:333] T 593d63ceb81445abb780c71bcb639fbf P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:19.611981 1175 raft_consensus.cc:2243] T 593d63ceb81445abb780c71bcb639fbf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.612150 1175 raft_consensus.cc:2272] T 593d63ceb81445abb780c71bcb639fbf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.584619 907 tablet_service.cc:1511] Processing CreateTablet for tablet ee07c93213d44d9bb156d9ad7937facf (DEFAULT_TABLE table=default.Table_9f3caaf4accf437894abd4d1e00a4a27 [id=46bae779de56403ab810fc4dcde25233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.612735 1174 ts_tablet_manager.cc:1434] T 8a9b110d58f647778667befe0d24f590 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260318 02:51:19.613724 1172 tablet_bootstrap.cc:492] T a5a80127d3374812b312fca720505286 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:19.613909 1172 ts_tablet_manager.cc:1403] T a5a80127d3374812b312fca720505286 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.004s
I20260318 02:51:19.584838 904 tablet_service.cc:1511] Processing CreateTablet for tablet 7a81d51587eb4e5cab9fb61bf7f524a1 (DEFAULT_TABLE table=default.Table_541a8f0af72c48529db5904e9400919f [id=5e3dec62fd1942a5b64c954901219b4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.584932 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fce8e19ff3a447e8be74547003ea0ff with delete_type TABLET_DATA_DELETED (replaced by tablet 5955a2ce20e64b0989f26dec7e439792) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:19.614964 1172 raft_consensus.cc:359] T a5a80127d3374812b312fca720505286 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.615198 1172 raft_consensus.cc:385] T a5a80127d3374812b312fca720505286 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.615281 1172 raft_consensus.cc:740] T a5a80127d3374812b312fca720505286 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.586464 902 tablet_service.cc:1511] Processing CreateTablet for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 (DEFAULT_TABLE table=default.Table_e12531399635425b8057086bfa69d948 [id=a0142bdf340a4928b1ec18479e8bc674]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:19.587641 972 heartbeater.cc:646] Failed to heartbeat to 127.0.104.188:41593 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv got EOF from 127.0.104.188:41593 (error 108)
I20260318 02:51:19.615607 1172 consensus_queue.cc:260] T a5a80127d3374812b312fca720505286 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.589020 905 tablet_service.cc:1511] Processing CreateTablet for tablet da240bc0d5b043b89232fdf646f4f344 (DEFAULT_TABLE table=default.Table_972c817365f34677a65da0c3b3b70e30 [id=d7f85dc897794d14af2f182a59150e92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.616757 1172 ts_tablet_manager.cc:1434] T a5a80127d3374812b312fca720505286 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260318 02:51:19.617017 1175 ts_tablet_manager.cc:1916] T 593d63ceb81445abb780c71bcb639fbf P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.617174 1172 tablet_bootstrap.cc:492] T 4fce8e19ff3a447e8be74547003ea0ff P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:19.618271 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee07c93213d44d9bb156d9ad7937facf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.618747 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da240bc0d5b043b89232fdf646f4f344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.619706 1172 tablet_bootstrap.cc:654] T 4fce8e19ff3a447e8be74547003ea0ff P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.620847 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a81d51587eb4e5cab9fb61bf7f524a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.621412 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.623926 1174 tablet_bootstrap.cc:492] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:19.626184 1174 tablet_bootstrap.cc:654] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.603147 906 tablet_service.cc:1511] Processing CreateTablet for tablet 9593cb3d940c42918056a222313c7adb (DEFAULT_TABLE table=default.Table_737bd9edac1b45d68b210a423b0e17ee [id=97e9a124fd8d4b279d8db98ee802ede4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.633381 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9593cb3d940c42918056a222313c7adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.635224 1172 tablet_bootstrap.cc:492] T 4fce8e19ff3a447e8be74547003ea0ff P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:19.635474 1172 ts_tablet_manager.cc:1403] T 4fce8e19ff3a447e8be74547003ea0ff P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.004s
I20260318 02:51:19.636445 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a9b110d58f647778667befe0d24f590 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:19.636636 1172 raft_consensus.cc:359] T 4fce8e19ff3a447e8be74547003ea0ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.637022 1172 raft_consensus.cc:385] T 4fce8e19ff3a447e8be74547003ea0ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.637173 1172 raft_consensus.cc:740] T 4fce8e19ff3a447e8be74547003ea0ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.637519 1172 consensus_queue.cc:260] T 4fce8e19ff3a447e8be74547003ea0ff P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:19.639238 443 consensus_peers.cc:597] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a -> Peer 971baf5b9e4644c990dbf4d4fc7ba900 (127.0.104.188:41593): Couldn't send request to peer 971baf5b9e4644c990dbf4d4fc7ba900. Status: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:19.640309 1172 ts_tablet_manager.cc:1434] T 4fce8e19ff3a447e8be74547003ea0ff P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:19.641544 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 98f618bc041a4c889af992f077a9f3da with delete_type TABLET_DATA_DELETED (replaced by tablet 8a9b110d58f647778667befe0d24f590) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.641940 1184 tablet_replica.cc:333] T 98f618bc041a4c889af992f077a9f3da P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:19.642135 1184 raft_consensus.cc:2243] T 98f618bc041a4c889af992f077a9f3da P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.642316 1184 raft_consensus.cc:2272] T 98f618bc041a4c889af992f077a9f3da P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.642704 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_81978fc781014c4e9a71dc85a7ac0daf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.643289 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81978fc781014c4e9a71dc85a7ac0daf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.643900 1172 tablet_bootstrap.cc:492] T 593d63ceb81445abb780c71bcb639fbf P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:19.644451 1201 negotiation.cc:337] Failed RPC negotiation. Trace:
0318 02:51:19.598246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.104.188:41593 (local address 127.0.104.131:42343)
0318 02:51:19.607082 (+ 8836us) negotiation.cc:107] Waiting for socket to connect
0318 02:51:19.607103 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0318 02:51:19.607233 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0318 02:51:19.638440 (+ 31207us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":8711,"thread_start_us":8606,"threads_started":1}
I20260318 02:51:19.644891 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_cd18ea9af8074f5398e9d37d53332f19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:19.645125 1184 ts_tablet_manager.cc:1916] T 98f618bc041a4c889af992f077a9f3da P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:19.645458 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd18ea9af8074f5398e9d37d53332f19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.646905 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5c99a11fc34d4ab9920aed8d53bf584c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.647541 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c99a11fc34d4ab9920aed8d53bf584c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.647655 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet a5a80127d3374812b312fca720505286 with delete_type TABLET_DATA_DELETED (replaced by tablet 47a94514cba846e19dd6934f371acbe7) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.648173 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fce8e19ff3a447e8be74547003ea0ff with delete_type TABLET_DATA_DELETED (replaced by tablet 5955a2ce20e64b0989f26dec7e439792) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.648923 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e635a0a24db84a149bb743edac8c1629"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:19.648849 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_36b6d1aa86234cc8a3a80dc5fe002f0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.649443 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36b6d1aa86234cc8a3a80dc5fe002f0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.649639 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_22e31048ee2346f5a84783b1ccd53d17" } new_table_name: "default.Table_1d973c441e874933af10ea309f9786d2" modify_external_catalogs: true
I20260318 02:51:19.650429 1176 ts_tablet_manager.cc:1929] T 4fce8e19ff3a447e8be74547003ea0ff P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.650695 1176 log.cc:1199] T 4fce8e19ff3a447e8be74547003ea0ff P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/4fce8e19ff3a447e8be74547003ea0ff
I20260318 02:51:19.650799 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5f19fbe9c1f94632833382d5ff0c71c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:19.651098 1176 ts_tablet_manager.cc:1950] T 4fce8e19ff3a447e8be74547003ea0ff P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
W20260318 02:51:19.651196 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f19fbe9c1f94632833382d5ff0c71c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:19.649444 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e635a0a24db84a149bb743edac8c1629 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.653630 1173 tablet_bootstrap.cc:492] T 07f5a93764eb444d8472cc51bf0d3b88 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:19.653893 1173 ts_tablet_manager.cc:1403] T 07f5a93764eb444d8472cc51bf0d3b88 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.088s user 0.012s sys 0.004s
I20260318 02:51:19.654016 1172 tablet_bootstrap.cc:654] T 593d63ceb81445abb780c71bcb639fbf P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.654233 1176 tablet_replica.cc:333] T 8a9b110d58f647778667befe0d24f590 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:19.654440 1176 raft_consensus.cc:2243] T 8a9b110d58f647778667befe0d24f590 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.654655 1176 raft_consensus.cc:2272] T 8a9b110d58f647778667befe0d24f590 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.655081 1174 tablet_bootstrap.cc:492] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:19.655288 1174 ts_tablet_manager.cc:1403] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.003s
I20260318 02:51:19.655427 1176 ts_tablet_manager.cc:1916] T 8a9b110d58f647778667befe0d24f590 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.656239 1174 raft_consensus.cc:359] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.656522 1174 raft_consensus.cc:385] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.656639 1174 raft_consensus.cc:740] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.657008 1174 consensus_queue.cc:260] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.657428 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 07f5a93764eb444d8472cc51bf0d3b88
I20260318 02:51:19.657910 456 catalog_manager.cc:6741] ReplaceTablet: tablet 07f5a93764eb444d8472cc51bf0d3b88 deleted and replaced by tablet 1af760ed8ff14a498e751e67550cb1ac
I20260318 02:51:19.659736 906 tablet_service.cc:1558] Processing DeleteTablet for tablet 07f5a93764eb444d8472cc51bf0d3b88 with delete_type TABLET_DATA_DELETED (replaced by tablet 1af760ed8ff14a498e751e67550cb1ac) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:19.660351 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 07f5a93764eb444d8472cc51bf0d3b88 with delete_type TABLET_DATA_DELETED (replaced by tablet 1af760ed8ff14a498e751e67550cb1ac) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.663368 1176 ts_tablet_manager.cc:1929] T 8a9b110d58f647778667befe0d24f590 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.663431 1174 ts_tablet_manager.cc:1434] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260318 02:51:19.664012 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0d969a129e064d118a5bd11a6f34b8f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:19.663655 1176 log.cc:1199] T 8a9b110d58f647778667befe0d24f590 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/8a9b110d58f647778667befe0d24f590
W20260318 02:51:19.664750 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d969a129e064d118a5bd11a6f34b8f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.665109 1176 ts_tablet_manager.cc:1950] T 8a9b110d58f647778667befe0d24f590 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:19.665897 1174 tablet_bootstrap.cc:492] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:19.666397 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f89bbd2163914385916f490a3e147bd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.667172 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f89bbd2163914385916f490a3e147bd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.667846 1174 tablet_bootstrap.cc:654] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.669461 1173 raft_consensus.cc:359] T 07f5a93764eb444d8472cc51bf0d3b88 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.669656 1173 raft_consensus.cc:385] T 07f5a93764eb444d8472cc51bf0d3b88 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.669737 1173 raft_consensus.cc:740] T 07f5a93764eb444d8472cc51bf0d3b88 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.670183 1173 consensus_queue.cc:260] T 07f5a93764eb444d8472cc51bf0d3b88 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.672211 1173 ts_tablet_manager.cc:1434] T 07f5a93764eb444d8472cc51bf0d3b88 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:19.672580 1173 tablet_bootstrap.cc:492] T 8a9b110d58f647778667befe0d24f590 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:19.673327 1184 ts_tablet_manager.cc:1929] T 98f618bc041a4c889af992f077a9f3da P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.674379 1173 tablet_bootstrap.cc:654] T 8a9b110d58f647778667befe0d24f590 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.653925 1175 ts_tablet_manager.cc:1929] T 593d63ceb81445abb780c71bcb639fbf P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.675578 1175 log.cc:1199] T 593d63ceb81445abb780c71bcb639fbf P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/593d63ceb81445abb780c71bcb639fbf
I20260318 02:51:19.675575 1184 log.cc:1199] T 98f618bc041a4c889af992f077a9f3da P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/98f618bc041a4c889af992f077a9f3da
I20260318 02:51:19.675973 1184 ts_tablet_manager.cc:1950] T 98f618bc041a4c889af992f077a9f3da P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:19.676026 1175 ts_tablet_manager.cc:1950] T 593d63ceb81445abb780c71bcb639fbf P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:19.652310 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 4fce8e19ff3a447e8be74547003ea0ff (table default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]) successfully deleted
I20260318 02:51:19.677541 1174 tablet_bootstrap.cc:492] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:19.677641 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 8a9b110d58f647778667befe0d24f590 (table default.Table_3d5d8ced462a4e8fbde8382a07f71579 [id=18eb38b85d0c4dd3b8d945c444ffadfa]) successfully deleted
I20260318 02:51:19.677719 1174 ts_tablet_manager.cc:1403] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.003s
I20260318 02:51:19.677927 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 07f5a93764eb444d8472cc51bf0d3b88 with delete_type TABLET_DATA_DELETED (replaced by tablet 1af760ed8ff14a498e751e67550cb1ac) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:19.678359 1176 tablet_replica.cc:333] T 07f5a93764eb444d8472cc51bf0d3b88 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:19.678601 1176 raft_consensus.cc:2243] T 07f5a93764eb444d8472cc51bf0d3b88 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.678803 1175 tablet_replica.cc:333] T 98f618bc041a4c889af992f077a9f3da P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:19.678843 1176 raft_consensus.cc:2272] T 07f5a93764eb444d8472cc51bf0d3b88 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.678603 1174 raft_consensus.cc:359] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.679149 1174 raft_consensus.cc:385] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.679262 1184 tablet_replica.cc:333] T a5a80127d3374812b312fca720505286 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:19.679281 1174 raft_consensus.cc:740] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.679543 1184 raft_consensus.cc:2243] T a5a80127d3374812b312fca720505286 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.679634 1176 ts_tablet_manager.cc:1916] T 07f5a93764eb444d8472cc51bf0d3b88 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.679560 1174 consensus_queue.cc:260] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.679920 1175 raft_consensus.cc:2243] T 98f618bc041a4c889af992f077a9f3da P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.680066 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 98f618bc041a4c889af992f077a9f3da (table default.Table_3d5d8ced462a4e8fbde8382a07f71579 [id=18eb38b85d0c4dd3b8d945c444ffadfa]) successfully deleted
I20260318 02:51:19.680343 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 593d63ceb81445abb780c71bcb639fbf (table default.Table_fc7dabc5acc94276bc2f0ede2f8e39a6 [id=433e7aa77412424ebb38784bb073d1fb]) successfully deleted
I20260318 02:51:19.681205 1184 raft_consensus.cc:2272] T a5a80127d3374812b312fca720505286 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.682760 1184 ts_tablet_manager.cc:1916] T a5a80127d3374812b312fca720505286 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.684183 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_fc7dabc5acc94276bc2f0ede2f8e39a6" } new_table_name: "default.Table_15d77c88756044738d0703683131c8d4" modify_external_catalogs: true
I20260318 02:51:19.688266 1172 tablet_bootstrap.cc:492] T 593d63ceb81445abb780c71bcb639fbf P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:19.688474 1172 ts_tablet_manager.cc:1403] T 593d63ceb81445abb780c71bcb639fbf P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.045s user 0.018s sys 0.008s
I20260318 02:51:19.689345 1172 raft_consensus.cc:359] T 593d63ceb81445abb780c71bcb639fbf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.689561 1172 raft_consensus.cc:385] T 593d63ceb81445abb780c71bcb639fbf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.689636 1172 raft_consensus.cc:740] T 593d63ceb81445abb780c71bcb639fbf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.689908 1172 consensus_queue.cc:260] T 593d63ceb81445abb780c71bcb639fbf P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.690618 1174 ts_tablet_manager.cc:1434] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.013s user 0.001s sys 0.002s
I20260318 02:51:19.688748 1175 raft_consensus.cc:2272] T 98f618bc041a4c889af992f077a9f3da P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.691915 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2e46b43241344980bca723c247d7dccf" } new_table_name: "default.Table_aa09b8ff832f4507b7a423914cc89b1f" modify_external_catalogs: true
I20260318 02:51:19.692474 1176 ts_tablet_manager.cc:1929] T 07f5a93764eb444d8472cc51bf0d3b88 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.693176 1176 log.cc:1199] T 07f5a93764eb444d8472cc51bf0d3b88 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/07f5a93764eb444d8472cc51bf0d3b88
I20260318 02:51:19.693593 1176 ts_tablet_manager.cc:1950] T 07f5a93764eb444d8472cc51bf0d3b88 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:19.693527 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_972c817365f34677a65da0c3b3b70e30" } new_table_name: "default.Table_9d3b7f637fea4430a10035ec55bfb542" modify_external_catalogs: true
I20260318 02:51:19.694664 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 07f5a93764eb444d8472cc51bf0d3b88 (table default.Table_fc7dabc5acc94276bc2f0ede2f8e39a6 [id=433e7aa77412424ebb38784bb073d1fb]) successfully deleted
W20260318 02:51:19.694913 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d254c168b5746b59ee57a816b53ba69 consensus state has no leader
I20260318 02:51:19.693183 1174 tablet_bootstrap.cc:492] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:19.695770 1172 ts_tablet_manager.cc:1434] T 593d63ceb81445abb780c71bcb639fbf P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260318 02:51:19.696113 1172 tablet_bootstrap.cc:492] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:19.696070 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6af85649647147de89f83ff7996f485f" } new_table_name: "default.Table_63ea580c95a14a2f85b3ca002a8b1399" modify_external_catalogs: true
I20260318 02:51:19.696606 1173 tablet_bootstrap.cc:492] T 8a9b110d58f647778667befe0d24f590 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:19.696775 1173 ts_tablet_manager.cc:1403] T 8a9b110d58f647778667befe0d24f590 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s
I20260318 02:51:19.697618 1173 raft_consensus.cc:359] T 8a9b110d58f647778667befe0d24f590 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.697803 1173 raft_consensus.cc:385] T 8a9b110d58f647778667befe0d24f590 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.697887 1173 raft_consensus.cc:740] T 8a9b110d58f647778667befe0d24f590 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.697933 1172 tablet_bootstrap.cc:654] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.697999 1174 tablet_bootstrap.cc:654] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.698119 1173 consensus_queue.cc:260] T 8a9b110d58f647778667befe0d24f590 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.698603 1173 ts_tablet_manager.cc:1434] T 8a9b110d58f647778667befe0d24f590 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:19.698959 1173 tablet_bootstrap.cc:492] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:19.700989 1173 tablet_bootstrap.cc:654] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.701478 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_541a8f0af72c48529db5904e9400919f" } modify_external_catalogs: true
I20260318 02:51:19.701694 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_541a8f0af72c48529db5904e9400919f" } modify_external_catalogs: true
I20260318 02:51:19.705578 1184 ts_tablet_manager.cc:1929] T a5a80127d3374812b312fca720505286 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.705716 1184 log.cc:1199] T a5a80127d3374812b312fca720505286 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/a5a80127d3374812b312fca720505286
I20260318 02:51:19.706090 1184 ts_tablet_manager.cc:1950] T a5a80127d3374812b312fca720505286 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:19.706835 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_737bd9edac1b45d68b210a423b0e17ee" } modify_external_catalogs: true
I20260318 02:51:19.707017 1184 tablet_replica.cc:333] T 4fce8e19ff3a447e8be74547003ea0ff P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:19.707023 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_737bd9edac1b45d68b210a423b0e17ee" } modify_external_catalogs: true
I20260318 02:51:19.707211 1184 raft_consensus.cc:2243] T 4fce8e19ff3a447e8be74547003ea0ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.707356 1184 raft_consensus.cc:2272] T 4fce8e19ff3a447e8be74547003ea0ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.707548 1180 raft_consensus.cc:493] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:19.707719 1180 raft_consensus.cc:515] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.708351 1180 leader_election.cc:290] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:19.708433 1184 ts_tablet_manager.cc:1916] T 4fce8e19ff3a447e8be74547003ea0ff P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.709399 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9593cb3d940c42918056a222313c7adb" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:19.709990 719 leader_election.cc:343] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:19.710677 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9593cb3d940c42918056a222313c7adb" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:19.711568 719 leader_election.cc:343] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:19.711714 719 leader_election.cc:304] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:19.712491 1180 raft_consensus.cc:2749] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:19.713388 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4285d188a85b436894c35f7c097232d6" } modify_external_catalogs: true
I20260318 02:51:19.713580 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4285d188a85b436894c35f7c097232d6" } modify_external_catalogs: true
I20260318 02:51:19.713920 906 tablet_service.cc:1511] Processing CreateTablet for tablet deba6669348248d6a1f1111122e7ad32 (DEFAULT_TABLE table=default.Table_6af85649647147de89f83ff7996f485f [id=0c04457e82e54a229437db0c3f90811b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.714339 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deba6669348248d6a1f1111122e7ad32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.715281 1184 ts_tablet_manager.cc:1929] T 4fce8e19ff3a447e8be74547003ea0ff P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.715816 1184 log.cc:1199] T 4fce8e19ff3a447e8be74547003ea0ff P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/4fce8e19ff3a447e8be74547003ea0ff
I20260318 02:51:19.716223 1184 ts_tablet_manager.cc:1950] T 4fce8e19ff3a447e8be74547003ea0ff P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:19.717132 1174 tablet_bootstrap.cc:492] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:19.717331 1174 ts_tablet_manager.cc:1403] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.002s
I20260318 02:51:19.718035 1041 tablet_service.cc:1511] Processing CreateTablet for tablet deba6669348248d6a1f1111122e7ad32 (DEFAULT_TABLE table=default.Table_6af85649647147de89f83ff7996f485f [id=0c04457e82e54a229437db0c3f90811b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.718381 763 tablet_service.cc:1511] Processing CreateTablet for tablet deba6669348248d6a1f1111122e7ad32 (DEFAULT_TABLE table=default.Table_6af85649647147de89f83ff7996f485f [id=0c04457e82e54a229437db0c3f90811b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.718683 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deba6669348248d6a1f1111122e7ad32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.718828 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deba6669348248d6a1f1111122e7ad32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.721338 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet a5a80127d3374812b312fca720505286 (table default.Table_2e46b43241344980bca723c247d7dccf [id=0bd115a0960941ff9d49b4566fe1c666]) successfully deleted
I20260318 02:51:19.722038 1175 ts_tablet_manager.cc:1916] T 98f618bc041a4c889af992f077a9f3da P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.725483 1174 raft_consensus.cc:359] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.725747 1174 raft_consensus.cc:385] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.725900 1174 raft_consensus.cc:740] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.726217 1174 consensus_queue.cc:260] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.727118 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 4fce8e19ff3a447e8be74547003ea0ff (table default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]) successfully deleted
W20260318 02:51:19.728224 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1af760ed8ff14a498e751e67550cb1ac has no consensus state
I20260318 02:51:19.728823 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_cd18ea9af8074f5398e9d37d53332f19" } modify_external_catalogs: true
W20260318 02:51:19.728991 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 07f5a93764eb444d8472cc51bf0d3b88 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07f5a93764eb444d8472cc51bf0d3b88 already in progress: creating tablet
I20260318 02:51:19.732244 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_cd18ea9af8074f5398e9d37d53332f19" } modify_external_catalogs: true
I20260318 02:51:19.732793 1175 ts_tablet_manager.cc:1929] T 98f618bc041a4c889af992f077a9f3da P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.732936 1175 log.cc:1199] T 98f618bc041a4c889af992f077a9f3da P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/98f618bc041a4c889af992f077a9f3da
W20260318 02:51:19.733146 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47a94514cba846e19dd6934f371acbe7 consensus state has no leader
I20260318 02:51:19.733300 1175 ts_tablet_manager.cc:1950] T 98f618bc041a4c889af992f077a9f3da P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:19.733512 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_81978fc781014c4e9a71dc85a7ac0daf" } modify_external_catalogs: true
I20260318 02:51:19.734498 1175 tablet_replica.cc:333] T 8a9b110d58f647778667befe0d24f590 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:19.734704 1175 raft_consensus.cc:2243] T 8a9b110d58f647778667befe0d24f590 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.734879 1175 raft_consensus.cc:2272] T 8a9b110d58f647778667befe0d24f590 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.735003 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_81978fc781014c4e9a71dc85a7ac0daf" } modify_external_catalogs: true
W20260318 02:51:19.735949 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da240bc0d5b043b89232fdf646f4f344 consensus state has no leader
I20260318 02:51:19.736416 1174 ts_tablet_manager.cc:1434] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.019s user 0.000s sys 0.003s
I20260318 02:51:19.738073 1174 tablet_bootstrap.cc:492] T 2d254c168b5746b59ee57a816b53ba69 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:19.740409 1174 tablet_bootstrap.cc:654] T 2d254c168b5746b59ee57a816b53ba69 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.741876 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 593d63ceb81445abb780c71bcb639fbf with delete_type TABLET_DATA_DELETED (replaced by tablet 07f5a93764eb444d8472cc51bf0d3b88) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:19.742687 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet deba6669348248d6a1f1111122e7ad32 consensus state has no leader
I20260318 02:51:19.742926 1172 tablet_bootstrap.cc:492] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:19.743075 1172 ts_tablet_manager.cc:1403] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.047s user 0.006s sys 0.017s
I20260318 02:51:19.744050 1184 tablet_replica.cc:333] T 593d63ceb81445abb780c71bcb639fbf P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:19.743934 1172 raft_consensus.cc:359] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.744208 1172 raft_consensus.cc:385] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.744303 1172 raft_consensus.cc:740] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.744443 1184 raft_consensus.cc:2243] T 593d63ceb81445abb780c71bcb639fbf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.744658 1184 raft_consensus.cc:2272] T 593d63ceb81445abb780c71bcb639fbf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.744578 1172 consensus_queue.cc:260] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.744984 455 master_service.cc:954] ReplaceTablet: received request to replace tablet 47a94514cba846e19dd6934f371acbe7 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:19.745159 1172 ts_tablet_manager.cc:1434] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:19.745860 1172 tablet_bootstrap.cc:492] T 07f5a93764eb444d8472cc51bf0d3b88 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:19.751161 1172 tablet_bootstrap.cc:654] T 07f5a93764eb444d8472cc51bf0d3b88 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.751967 453 master_service.cc:954] ReplaceTablet: received request to replace tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:19.752233 450 master_service.cc:954] ReplaceTablet: received request to replace tablet 8a9b110d58f647778667befe0d24f590 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:19.754068 1184 ts_tablet_manager.cc:1916] T 593d63ceb81445abb780c71bcb639fbf P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.759327 1172 tablet_bootstrap.cc:492] T 07f5a93764eb444d8472cc51bf0d3b88 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:19.741420 1173 tablet_bootstrap.cc:492] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:19.759761 1173 ts_tablet_manager.cc:1403] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.013s
I20260318 02:51:19.760578 1173 raft_consensus.cc:359] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.760816 1173 raft_consensus.cc:385] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.760881 1173 raft_consensus.cc:740] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.761135 1173 consensus_queue.cc:260] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.761463 1184 ts_tablet_manager.cc:1929] T 593d63ceb81445abb780c71bcb639fbf P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.761585 1184 log.cc:1199] T 593d63ceb81445abb780c71bcb639fbf P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/593d63ceb81445abb780c71bcb639fbf
I20260318 02:51:19.761695 1173 ts_tablet_manager.cc:1434] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:19.761942 1184 ts_tablet_manager.cc:1950] T 593d63ceb81445abb780c71bcb639fbf P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:19.762048 1173 tablet_bootstrap.cc:492] T 7a81d51587eb4e5cab9fb61bf7f524a1 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:19.763098 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 593d63ceb81445abb780c71bcb639fbf (table default.Table_15d77c88756044738d0703683131c8d4 [id=433e7aa77412424ebb38784bb073d1fb]) successfully deleted
I20260318 02:51:19.763871 1173 tablet_bootstrap.cc:654] T 7a81d51587eb4e5cab9fb61bf7f524a1 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.764819 1172 ts_tablet_manager.cc:1403] T 07f5a93764eb444d8472cc51bf0d3b88 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.004s
I20260318 02:51:19.765599 1172 raft_consensus.cc:359] T 07f5a93764eb444d8472cc51bf0d3b88 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.765810 1172 raft_consensus.cc:385] T 07f5a93764eb444d8472cc51bf0d3b88 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.765875 1172 raft_consensus.cc:740] T 07f5a93764eb444d8472cc51bf0d3b88 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.766113 1172 consensus_queue.cc:260] T 07f5a93764eb444d8472cc51bf0d3b88 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.766600 1172 ts_tablet_manager.cc:1434] T 07f5a93764eb444d8472cc51bf0d3b88 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:19.766932 1172 tablet_bootstrap.cc:492] T 8a9b110d58f647778667befe0d24f590 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:19.735872 1175 ts_tablet_manager.cc:1916] T 8a9b110d58f647778667befe0d24f590 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.773197 763 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef71cea07cf42dea6cf96a5341542b3 (DEFAULT_TABLE table=default.Table_e635a0a24db84a149bb743edac8c1629 [id=b6fccf21c9f04af3a55c534a5f223bf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.773742 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef71cea07cf42dea6cf96a5341542b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.774796 1172 tablet_bootstrap.cc:654] T 8a9b110d58f647778667befe0d24f590 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.782296 1175 ts_tablet_manager.cc:1929] T 8a9b110d58f647778667befe0d24f590 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.782451 762 tablet_service.cc:1511] Processing CreateTablet for tablet cc99bc3332eb48f7a4980533ee71f581 (DEFAULT_TABLE table=default.Table_cd18ea9af8074f5398e9d37d53332f19 [id=635bb52ee26d4a95865a9039f6a1a0ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.782971 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc99bc3332eb48f7a4980533ee71f581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.785353 1180 raft_consensus.cc:493] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:19.785576 1180 raft_consensus.cc:515] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.786007 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef71cea07cf42dea6cf96a5341542b3 (DEFAULT_TABLE table=default.Table_e635a0a24db84a149bb743edac8c1629 [id=b6fccf21c9f04af3a55c534a5f223bf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.786396 1180 leader_election.cc:290] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:19.786456 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef71cea07cf42dea6cf96a5341542b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.786825 1044 tablet_service.cc:1511] Processing CreateTablet for tablet cc99bc3332eb48f7a4980533ee71f581 (DEFAULT_TABLE table=default.Table_cd18ea9af8074f5398e9d37d53332f19 [id=635bb52ee26d4a95865a9039f6a1a0ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.787318 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc99bc3332eb48f7a4980533ee71f581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.787238 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a94514cba846e19dd6934f371acbe7" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:19.787618 1064 raft_consensus.cc:2468] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 0.
I20260318 02:51:19.788793 719 leader_election.cc:304] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:19.789037 1043 tablet_service.cc:1511] Processing CreateTablet for tablet f96e77189d37484289fc83285f23e80d (DEFAULT_TABLE table=default.Table_81978fc781014c4e9a71dc85a7ac0daf [id=6a8a3c65c0994085a0b5ba207107d287]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.789166 1180 raft_consensus.cc:2804] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:19.789263 1180 raft_consensus.cc:493] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:19.789378 1180 raft_consensus.cc:3060] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:19.789518 1042 tablet_service.cc:1511] Processing CreateTablet for tablet b176363ce948489ab05178e5875f2ccd (DEFAULT_TABLE table=default.Table_36b6d1aa86234cc8a3a80dc5fe002f0a [id=f6d13c14fec24bc8894ebd60b88fca77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.789837 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 1af760ed8ff14a498e751e67550cb1ac (DEFAULT_TABLE table=default.Table_15d77c88756044738d0703683131c8d4 [id=433e7aa77412424ebb38784bb073d1fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.790086 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3491e419434075ac4e6fa5881ec537 (DEFAULT_TABLE table=default.Table_e3ecfc06a52040e6902adbf96eff2ea8 [id=06e124bab0a04572bab0c3c008b7d218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.790472 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 5955a2ce20e64b0989f26dec7e439792 (DEFAULT_TABLE table=default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.789523 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96e77189d37484289fc83285f23e80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.782786 906 tablet_service.cc:1511] Processing CreateTablet for tablet 0ef71cea07cf42dea6cf96a5341542b3 (DEFAULT_TABLE table=default.Table_e635a0a24db84a149bb743edac8c1629 [id=b6fccf21c9f04af3a55c534a5f223bf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.791653 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ef71cea07cf42dea6cf96a5341542b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.792147 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af760ed8ff14a498e751e67550cb1ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.792258 1180 raft_consensus.cc:515] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.793525 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a94514cba846e19dd6934f371acbe7" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:19.793905 926 raft_consensus.cc:3060] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:19.794088 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5955a2ce20e64b0989f26dec7e439792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.795992 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3491e419434075ac4e6fa5881ec537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.783213 903 tablet_service.cc:1511] Processing CreateTablet for tablet cc99bc3332eb48f7a4980533ee71f581 (DEFAULT_TABLE table=default.Table_cd18ea9af8074f5398e9d37d53332f19 [id=635bb52ee26d4a95865a9039f6a1a0ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.796727 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc99bc3332eb48f7a4980533ee71f581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.797014 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b176363ce948489ab05178e5875f2ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.797521 926 raft_consensus.cc:2468] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 1.
I20260318 02:51:19.798205 719 leader_election.cc:304] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:19.799368 1180 leader_election.cc:290] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:19.799610 1180 raft_consensus.cc:2804] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:19.799803 1180 raft_consensus.cc:697] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Becoming Leader. State: Replica: 6a903d876086423b8016d705b98895ad, State: Running, Role: LEADER
I20260318 02:51:19.800330 1180 consensus_queue.cc:237] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.783965 907 tablet_service.cc:1511] Processing CreateTablet for tablet f96e77189d37484289fc83285f23e80d (DEFAULT_TABLE table=default.Table_81978fc781014c4e9a71dc85a7ac0daf [id=6a8a3c65c0994085a0b5ba207107d287]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.801033 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96e77189d37484289fc83285f23e80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.801081 450 master_service.cc:954] ReplaceTablet: received request to replace tablet 9593cb3d940c42918056a222313c7adb from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:19.802331 765 tablet_service.cc:1511] Processing CreateTablet for tablet f96e77189d37484289fc83285f23e80d (DEFAULT_TABLE table=default.Table_81978fc781014c4e9a71dc85a7ac0daf [id=6a8a3c65c0994085a0b5ba207107d287]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.802716 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96e77189d37484289fc83285f23e80d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.784350 905 tablet_service.cc:1511] Processing CreateTablet for tablet b176363ce948489ab05178e5875f2ccd (DEFAULT_TABLE table=default.Table_36b6d1aa86234cc8a3a80dc5fe002f0a [id=f6d13c14fec24bc8894ebd60b88fca77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.805105 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b176363ce948489ab05178e5875f2ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.805590 766 tablet_service.cc:1511] Processing CreateTablet for tablet b176363ce948489ab05178e5875f2ccd (DEFAULT_TABLE table=default.Table_36b6d1aa86234cc8a3a80dc5fe002f0a [id=f6d13c14fec24bc8894ebd60b88fca77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.805675 901 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3491e419434075ac4e6fa5881ec537 (DEFAULT_TABLE table=default.Table_e3ecfc06a52040e6902adbf96eff2ea8 [id=06e124bab0a04572bab0c3c008b7d218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.806056 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b176363ce948489ab05178e5875f2ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.806288 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3491e419434075ac4e6fa5881ec537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.784802 904 tablet_service.cc:1511] Processing CreateTablet for tablet 1af760ed8ff14a498e751e67550cb1ac (DEFAULT_TABLE table=default.Table_15d77c88756044738d0703683131c8d4 [id=433e7aa77412424ebb38784bb073d1fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.788252 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a94514cba846e19dd6934f371acbe7" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:19.789104 902 tablet_service.cc:1511] Processing CreateTablet for tablet 5955a2ce20e64b0989f26dec7e439792 (DEFAULT_TABLE table=default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.808984 927 raft_consensus.cc:2376] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6a903d876086423b8016d705b98895ad in term 1. Re-sending same reply.
I20260318 02:51:19.809137 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5955a2ce20e64b0989f26dec7e439792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.812997 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af760ed8ff14a498e751e67550cb1ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.817876 900 tablet_service.cc:1511] Processing CreateTablet for tablet 2ff8e4571d0a47ae984a918f17ba1d6b (DEFAULT_TABLE table=default.Table_5c99a11fc34d4ab9920aed8d53bf584c [id=50ab4db1dbeb4c6a90b33535047daa51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.818002 764 tablet_service.cc:1511] Processing CreateTablet for tablet 1af760ed8ff14a498e751e67550cb1ac (DEFAULT_TABLE table=default.Table_15d77c88756044738d0703683131c8d4 [id=433e7aa77412424ebb38784bb073d1fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.818411 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af760ed8ff14a498e751e67550cb1ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.818454 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff8e4571d0a47ae984a918f17ba1d6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.819125 907 tablet_service.cc:1511] Processing CreateTablet for tablet 41c97f254ae94de3bb0c03db72fb7df0 (DEFAULT_TABLE table=default.Table_4285d188a85b436894c35f7c097232d6 [id=431159d5b4774b2a8dd9de63bd2d1923]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.819538 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c97f254ae94de3bb0c03db72fb7df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.823369 761 tablet_service.cc:1511] Processing CreateTablet for tablet 5955a2ce20e64b0989f26dec7e439792 (DEFAULT_TABLE table=default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.823876 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5955a2ce20e64b0989f26dec7e439792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.824226 1175 log.cc:1199] T 8a9b110d58f647778667befe0d24f590 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/8a9b110d58f647778667befe0d24f590
I20260318 02:51:19.826565 1175 ts_tablet_manager.cc:1950] T 8a9b110d58f647778667befe0d24f590 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:19.827706 1179 raft_consensus.cc:493] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:19.827896 1179 raft_consensus.cc:515] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.828814 1175 tablet_replica.cc:333] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:19.829005 1175 raft_consensus.cc:2243] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.829170 1175 raft_consensus.cc:2272] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.830032 1179 leader_election.cc:290] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:19.837837 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 8a9b110d58f647778667befe0d24f590 (table default.Table_3d5d8ced462a4e8fbde8382a07f71579 [id=18eb38b85d0c4dd3b8d945c444ffadfa]) successfully deleted
W20260318 02:51:19.838699 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 already in progress: creating tablet
I20260318 02:51:19.845316 843 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:19.845572 843 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: This master's current role is: LEADER
I20260318 02:51:19.848574 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 41c97f254ae94de3bb0c03db72fb7df0 (DEFAULT_TABLE table=default.Table_4285d188a85b436894c35f7c097232d6 [id=431159d5b4774b2a8dd9de63bd2d1923]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.849771 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a94514cba846e19dd6934f371acbe7" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:19.852459 1064 raft_consensus.cc:3060] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:19.853196 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c97f254ae94de3bb0c03db72fb7df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.849673 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 2ff8e4571d0a47ae984a918f17ba1d6b (DEFAULT_TABLE table=default.Table_5c99a11fc34d4ab9920aed8d53bf584c [id=50ab4db1dbeb4c6a90b33535047daa51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.853582 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 41c97f254ae94de3bb0c03db72fb7df0
I20260318 02:51:19.856531 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 41c97f254ae94de3bb0c03db72fb7df0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:19.857117 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 7a81d51587eb4e5cab9fb61bf7f524a1
I20260318 02:51:19.857769 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 41c97f254ae94de3bb0c03db72fb7df0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.858341 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a81d51587eb4e5cab9fb61bf7f524a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:19.858518 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff8e4571d0a47ae984a918f17ba1d6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.858589 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a81d51587eb4e5cab9fb61bf7f524a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:19.859440 443 catalog_manager.cc:4969] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 41c97f254ae94de3bb0c03db72fb7df0 because the tablet was not found. No further retry: Not found: Tablet not found: 41c97f254ae94de3bb0c03db72fb7df0
W20260318 02:51:19.859741 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 7a81d51587eb4e5cab9fb61bf7f524a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a81d51587eb4e5cab9fb61bf7f524a1 already in progress: creating tablet
I20260318 02:51:19.861766 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 9593cb3d940c42918056a222313c7adb
I20260318 02:51:19.864390 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet cc99bc3332eb48f7a4980533ee71f581
I20260318 02:51:19.866389 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 9593cb3d940c42918056a222313c7adb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:19.866394 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 9593cb3d940c42918056a222313c7adb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:19.866772 1176 tablet_replica.cc:333] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:19.866976 1176 raft_consensus.cc:2243] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.867142 1176 raft_consensus.cc:2272] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.867686 907 tablet_service.cc:1558] Processing DeleteTablet for tablet cc99bc3332eb48f7a4980533ee71f581 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:19.868826 454 master_service.cc:954] ReplaceTablet: received request to replace tablet deba6669348248d6a1f1111122e7ad32 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:19.868888 761 tablet_service.cc:1558] Processing DeleteTablet for tablet cc99bc3332eb48f7a4980533ee71f581 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:19.869141 1176 ts_tablet_manager.cc:1916] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.869385 766 tablet_service.cc:1511] Processing CreateTablet for tablet 41c97f254ae94de3bb0c03db72fb7df0 (DEFAULT_TABLE table=default.Table_4285d188a85b436894c35f7c097232d6 [id=431159d5b4774b2a8dd9de63bd2d1923]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.869879 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c97f254ae94de3bb0c03db72fb7df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.871304 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a81d51587eb4e5cab9fb61bf7f524a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:19.871644 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 41c97f254ae94de3bb0c03db72fb7df0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:19.873495 441 catalog_manager.cc:4969] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 41c97f254ae94de3bb0c03db72fb7df0 because the tablet was not found. No further retry: Not found: Tablet not found: 41c97f254ae94de3bb0c03db72fb7df0
I20260318 02:51:19.874128 764 tablet_service.cc:1511] Processing CreateTablet for tablet 2ff8e4571d0a47ae984a918f17ba1d6b (DEFAULT_TABLE table=default.Table_5c99a11fc34d4ab9920aed8d53bf584c [id=50ab4db1dbeb4c6a90b33535047daa51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.876366 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff8e4571d0a47ae984a918f17ba1d6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.877086 1173 tablet_bootstrap.cc:492] T 7a81d51587eb4e5cab9fb61bf7f524a1 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:19.877333 1173 ts_tablet_manager.cc:1403] T 7a81d51587eb4e5cab9fb61bf7f524a1 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.115s user 0.016s sys 0.017s
I20260318 02:51:19.875851 762 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3491e419434075ac4e6fa5881ec537 (DEFAULT_TABLE table=default.Table_e3ecfc06a52040e6902adbf96eff2ea8 [id=06e124bab0a04572bab0c3c008b7d218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.877923 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3491e419434075ac4e6fa5881ec537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.877965 1175 ts_tablet_manager.cc:1916] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.878501 1173 raft_consensus.cc:359] T 7a81d51587eb4e5cab9fb61bf7f524a1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.878777 1173 raft_consensus.cc:385] T 7a81d51587eb4e5cab9fb61bf7f524a1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.878871 1176 ts_tablet_manager.cc:1929] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.878914 1173 raft_consensus.cc:740] T 7a81d51587eb4e5cab9fb61bf7f524a1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.879025 1176 log.cc:1199] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/9593cb3d940c42918056a222313c7adb
I20260318 02:51:19.879400 1176 ts_tablet_manager.cc:1950] T 9593cb3d940c42918056a222313c7adb P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:19.879325 1173 consensus_queue.cc:260] T 7a81d51587eb4e5cab9fb61bf7f524a1 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.884169 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 9593cb3d940c42918056a222313c7adb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.873651 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7302de3324f84feea6928392c6067ecb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.885072 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 7a81d51587eb4e5cab9fb61bf7f524a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a81d51587eb4e5cab9fb61bf7f524a1 already in progress: creating tablet
W20260318 02:51:19.885540 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7302de3324f84feea6928392c6067ecb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.874090 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_bbda0f6b8794401899207ea245bdbc25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.887190 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbda0f6b8794401899207ea245bdbc25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.888236 1043 tablet_service.cc:1558] Processing DeleteTablet for tablet cc99bc3332eb48f7a4980533ee71f581 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.889233 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f0f6be3d63b9474b992b607498ab7508"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.889837 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0f6be3d63b9474b992b607498ab7508 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.890369 1064 raft_consensus.cc:2468] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 1.
I20260318 02:51:19.890571 1173 ts_tablet_manager.cc:1434] T 7a81d51587eb4e5cab9fb61bf7f524a1 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
W20260318 02:51:19.891893 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 9593cb3d940c42918056a222313c7adb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9593cb3d940c42918056a222313c7adb already in progress: creating tablet
I20260318 02:51:19.892390 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3078ea8f226c4adc8743e3a9371f2a97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.893227 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3078ea8f226c4adc8743e3a9371f2a97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.893704 1173 tablet_bootstrap.cc:492] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:19.895545 1173 tablet_bootstrap.cc:654] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.880733 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 9593cb3d940c42918056a222313c7adb (table default.Table_737bd9edac1b45d68b210a423b0e17ee [id=97e9a124fd8d4b279d8db98ee802ede4]) successfully deleted
W20260318 02:51:19.896834 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet cc99bc3332eb48f7a4980533ee71f581 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc99bc3332eb48f7a4980533ee71f581 already in progress: creating tablet
W20260318 02:51:19.897169 441 catalog_manager.cc:4969] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet cc99bc3332eb48f7a4980533ee71f581 because the tablet was not found. No further retry: Not found: Tablet not found: cc99bc3332eb48f7a4980533ee71f581
I20260318 02:51:19.898463 1174 tablet_bootstrap.cc:492] T 2d254c168b5746b59ee57a816b53ba69 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:19.898692 1174 ts_tablet_manager.cc:1403] T 2d254c168b5746b59ee57a816b53ba69 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.161s user 0.008s sys 0.043s
I20260318 02:51:19.899596 1174 raft_consensus.cc:359] T 2d254c168b5746b59ee57a816b53ba69 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.899860 1174 raft_consensus.cc:385] T 2d254c168b5746b59ee57a816b53ba69 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.899991 1174 raft_consensus.cc:740] T 2d254c168b5746b59ee57a816b53ba69 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.900313 1174 consensus_queue.cc:260] T 2d254c168b5746b59ee57a816b53ba69 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.901185 1174 ts_tablet_manager.cc:1434] T 2d254c168b5746b59ee57a816b53ba69 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:19.901518 1174 tablet_bootstrap.cc:492] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:19.903429 1174 tablet_bootstrap.cc:654] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:19.907938 862 leader_election.cc:343] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 0e1f58b1954a49b99871f965ec470a3b
I20260318 02:51:19.908159 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 47a94514cba846e19dd6934f371acbe7
I20260318 02:51:19.908360 1173 tablet_bootstrap.cc:492] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:19.908528 1173 ts_tablet_manager.cc:1403] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.004s
I20260318 02:51:19.908607 455 catalog_manager.cc:6741] ReplaceTablet: tablet 47a94514cba846e19dd6934f371acbe7 deleted and replaced by tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d
I20260318 02:51:19.909322 1173 raft_consensus.cc:359] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.909495 1173 raft_consensus.cc:385] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.909621 1173 raft_consensus.cc:740] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.909868 1173 consensus_queue.cc:260] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.910570 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 47a94514cba846e19dd6934f371acbe7 with delete_type TABLET_DATA_DELETED (replaced by tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:19.911339 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 47a94514cba846e19dd6934f371acbe7 with delete_type TABLET_DATA_DELETED (replaced by tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:19.911656 860 leader_election.cc:343] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 0e1f58b1954a49b99871f965ec470a3b
I20260318 02:51:19.911805 860 leader_election.cc:304] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
W20260318 02:51:19.912222 860 raft_consensus.cc:2686] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260318 02:51:19.912827 1184 tablet_replica.cc:333] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:19.913061 1184 raft_consensus.cc:2243] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.913261 1184 raft_consensus.cc:2272] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.914697 1173 ts_tablet_manager.cc:1434] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260318 02:51:19.915750 1184 ts_tablet_manager.cc:1916] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.916044 1173 tablet_bootstrap.cc:492] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:19.916141 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 47a94514cba846e19dd6934f371acbe7 with delete_type TABLET_DATA_DELETED (replaced by tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:19.916411 1176 tablet_replica.cc:333] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:19.916603 1176 raft_consensus.cc:2243] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:19.917097 1176 pending_rounds.cc:70] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad: Trying to abort 1 pending ops.
I20260318 02:51:19.917335 1176 pending_rounds.cc:77] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494138078158848 op_type: NO_OP noop_request { }
I20260318 02:51:19.917557 1176 raft_consensus.cc:2889] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:19.917690 1176 raft_consensus.cc:2272] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.918130 1173 tablet_bootstrap.cc:654] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.918650 1179 raft_consensus.cc:493] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:19.918800 1179 raft_consensus.cc:515] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.918937 1176 ts_tablet_manager.cc:1916] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.919340 1179 leader_election.cc:290] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:19.919955 786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1766ce95009b4c3f9940ebcf10503c7f" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:19.920291 786 raft_consensus.cc:2468] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:19.920848 862 leader_election.cc:304] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:19.920966 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1766ce95009b4c3f9940ebcf10503c7f" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:19.921165 1179 raft_consensus.cc:2804] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:19.921262 1179 raft_consensus.cc:493] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:19.921372 1179 raft_consensus.cc:3060] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:19.921669 860 leader_election.cc:343] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:19.924213 1179 raft_consensus.cc:515] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.924218 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6b0fdcb080ea4a6b97f51308598362be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.924892 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b0fdcb080ea4a6b97f51308598362be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.925401 786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1766ce95009b4c3f9940ebcf10503c7f" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:19.925491 1176 ts_tablet_manager.cc:1929] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:19.925603 786 raft_consensus.cc:3060] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:19.925639 1176 log.cc:1199] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/47a94514cba846e19dd6934f371acbe7
I20260318 02:51:19.926115 1176 ts_tablet_manager.cc:1950] T 47a94514cba846e19dd6934f371acbe7 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:19.926520 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e3ecfc06a52040e6902adbf96eff2ea8" } new_table_name: "default.Table_bbf2210842004e098c3fe633c4f2f7d0" modify_external_catalogs: true
I20260318 02:51:19.928511 786 raft_consensus.cc:2468] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:19.928835 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b2b84cb26868440ca83042602d382c10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:19.929028 862 leader_election.cc:304] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
W20260318 02:51:19.929365 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2b84cb26868440ca83042602d382c10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.929442 1179 leader_election.cc:290] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:19.929633 1179 raft_consensus.cc:2804] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:19.929802 1179 raft_consensus.cc:697] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:19.930155 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1766ce95009b4c3f9940ebcf10503c7f" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:19.930251 1179 consensus_queue.cc:237] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:19.930747 860 leader_election.cc:343] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:19.931120 1174 tablet_bootstrap.cc:492] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:19.931285 1174 ts_tablet_manager.cc:1403] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.003s
I20260318 02:51:19.931932 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f96e77189d37484289fc83285f23e80d
I20260318 02:51:19.932066 1174 raft_consensus.cc:359] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.932238 1174 raft_consensus.cc:385] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.932312 1174 raft_consensus.cc:740] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.932583 1174 consensus_queue.cc:260] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.932953 904 tablet_service.cc:1558] Processing DeleteTablet for tablet f96e77189d37484289fc83285f23e80d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:19.933133 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet f96e77189d37484289fc83285f23e80d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.934032 1172 tablet_bootstrap.cc:492] T 8a9b110d58f647778667befe0d24f590 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:19.934157 1174 ts_tablet_manager.cc:1434] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:19.934178 1172 ts_tablet_manager.cc:1403] T 8a9b110d58f647778667befe0d24f590 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.167s user 0.018s sys 0.014s
I20260318 02:51:19.934466 1174 tablet_bootstrap.cc:492] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:19.934916 1172 raft_consensus.cc:359] T 8a9b110d58f647778667befe0d24f590 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.935086 1172 raft_consensus.cc:385] T 8a9b110d58f647778667befe0d24f590 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.934227 766 tablet_service.cc:1558] Processing DeleteTablet for tablet f96e77189d37484289fc83285f23e80d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:19.935169 1172 raft_consensus.cc:740] T 8a9b110d58f647778667befe0d24f590 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.935424 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 47a94514cba846e19dd6934f371acbe7 (table default.Table_aa09b8ff832f4507b7a423914cc89b1f [id=0bd115a0960941ff9d49b4566fe1c666]) successfully deleted
I20260318 02:51:19.935401 1172 consensus_queue.cc:260] T 8a9b110d58f647778667befe0d24f590 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:19.937952 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet deba6669348248d6a1f1111122e7ad32
I20260318 02:51:19.938431 454 catalog_manager.cc:6741] ReplaceTablet: tablet deba6669348248d6a1f1111122e7ad32 deleted and replaced by tablet 53502a8e2d184b7ea7fa575d4836f0ea
I20260318 02:51:19.938786 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d4cb7a1606894513a0f1074bedc22ef9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:19.939080 1175 ts_tablet_manager.cc:1929] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.939208 1175 log.cc:1199] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/0e1f58b1954a49b99871f965ec470a3b
I20260318 02:51:19.939215 1172 ts_tablet_manager.cc:1434] T 8a9b110d58f647778667befe0d24f590 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260318 02:51:19.939352 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_55055e0c8594404ba26ad75b0c9eeced"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:19.939580 1175 ts_tablet_manager.cc:1950] T 0e1f58b1954a49b99871f965ec470a3b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:19.940819 1174 tablet_bootstrap.cc:654] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:19.940866 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55055e0c8594404ba26ad75b0c9eeced in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.941859 1175 tablet_replica.cc:333] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:19.942124 1175 raft_consensus.cc:2243] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.942157 1172 tablet_bootstrap.cc:492] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:19.939359 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4cb7a1606894513a0f1074bedc22ef9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.942438 1175 raft_consensus.cc:2272] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.943257 1175 ts_tablet_manager.cc:1916] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.943288 766 tablet_service.cc:1558] Processing DeleteTablet for tablet deba6669348248d6a1f1111122e7ad32 with delete_type TABLET_DATA_DELETED (replaced by tablet 53502a8e2d184b7ea7fa575d4836f0ea) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:19.943883 1172 tablet_bootstrap.cc:654] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.943883 904 tablet_service.cc:1558] Processing DeleteTablet for tablet deba6669348248d6a1f1111122e7ad32 with delete_type TABLET_DATA_DELETED (replaced by tablet 53502a8e2d184b7ea7fa575d4836f0ea) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:19.944692 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 0e1f58b1954a49b99871f965ec470a3b (table default.Table_63ea580c95a14a2f85b3ca002a8b1399 [id=0c04457e82e54a229437db0c3f90811b]) successfully deleted
I20260318 02:51:19.945523 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet deba6669348248d6a1f1111122e7ad32 with delete_type TABLET_DATA_DELETED (replaced by tablet 53502a8e2d184b7ea7fa575d4836f0ea) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.945780 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 07f5a93764eb444d8472cc51bf0d3b88 with delete_type TABLET_DATA_DELETED (replaced by tablet 1af760ed8ff14a498e751e67550cb1ac) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:19.949043 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f96e77189d37484289fc83285f23e80d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f96e77189d37484289fc83285f23e80d already in progress: creating tablet
W20260318 02:51:19.951771 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet deba6669348248d6a1f1111122e7ad32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet deba6669348248d6a1f1111122e7ad32 already in progress: creating tablet
I20260318 02:51:19.958611 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b8d82a9b0251407c8d08dd34a1f94c22" } new_table_name: "default.Table_96ebc14af9534f3e97d9d4e731264282" modify_external_catalogs: true
I20260318 02:51:19.958712 1175 ts_tablet_manager.cc:1929] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.959367 1175 log.cc:1199] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/37cccad81a6a48bb8e2b0c4cbd5dfba3
I20260318 02:51:19.959849 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e88f9eedc9d549e7bd8e8fb34e721a44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:19.960016 1175 ts_tablet_manager.cc:1950] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:19.960019 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f4fca199c1dd4b0db4688f81d015e413"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:19.960444 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e88f9eedc9d549e7bd8e8fb34e721a44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:19.960520 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4fca199c1dd4b0db4688f81d015e413 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:19.961333 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 (table default.Table_e12531399635425b8057086bfa69d948 [id=a0142bdf340a4928b1ec18479e8bc674]) successfully deleted
I20260318 02:51:19.961634 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a9b110d58f647778667befe0d24f590 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:19.962082 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_36b6d1aa86234cc8a3a80dc5fe002f0a" } new_table_name: "default.Table_e56aadd2977f4c5e816768f78d70ba61" modify_external_catalogs: true
I20260318 02:51:19.962414 1175 tablet_replica.cc:333] T 4fce8e19ff3a447e8be74547003ea0ff P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:19.962615 1175 raft_consensus.cc:2243] T 4fce8e19ff3a447e8be74547003ea0ff P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.962819 1175 raft_consensus.cc:2272] T 4fce8e19ff3a447e8be74547003ea0ff P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.963385 1175 ts_tablet_manager.cc:1916] T 4fce8e19ff3a447e8be74547003ea0ff P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.964457 1184 ts_tablet_manager.cc:1929] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.964622 1184 log.cc:1199] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/47a94514cba846e19dd6934f371acbe7
W20260318 02:51:19.969545 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6a3491e419434075ac4e6fa5881ec537 consensus state has no leader
I20260318 02:51:19.971483 1173 tablet_bootstrap.cc:492] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:19.971674 1173 ts_tablet_manager.cc:1403] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.056s user 0.002s sys 0.003s
I20260318 02:51:19.972493 1173 raft_consensus.cc:359] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.972755 1173 raft_consensus.cc:385] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.972874 1173 raft_consensus.cc:740] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.978013 1175 ts_tablet_manager.cc:1929] T 4fce8e19ff3a447e8be74547003ea0ff P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:19.980576 1175 log.cc:1199] T 4fce8e19ff3a447e8be74547003ea0ff P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/4fce8e19ff3a447e8be74547003ea0ff
I20260318 02:51:19.981282 1175 ts_tablet_manager.cc:1950] T 4fce8e19ff3a447e8be74547003ea0ff P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:19.981220 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_15d77c88756044738d0703683131c8d4" } new_table_name: "default.Table_0c5e75f8ad484c6d87b15a8f88667a0b" modify_external_catalogs: true
I20260318 02:51:19.982820 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9d3b7f637fea4430a10035ec55bfb542" } new_table_name: "default.Table_d7429a91cdb142b99d2f341a75bc82bf" modify_external_catalogs: true
I20260318 02:51:19.983592 1175 tablet_replica.cc:333] T 07f5a93764eb444d8472cc51bf0d3b88 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:19.983783 1175 raft_consensus.cc:2243] T 07f5a93764eb444d8472cc51bf0d3b88 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:19.983952 1175 raft_consensus.cc:2272] T 07f5a93764eb444d8472cc51bf0d3b88 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:19.984846 449 master_service.cc:954] ReplaceTablet: received request to replace tablet 2ff8e4571d0a47ae984a918f17ba1d6b from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:19.985011 457 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 2d254c168b5746b59ee57a816b53ba69 (table default.Table_1d973c441e874933af10ea309f9786d2 [id=789fd6a65c0c481494430f1ba4c574f4]). Expected version 1 got 0
I20260318 02:51:19.984926 1173 consensus_queue.cc:260] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.985459 1175 ts_tablet_manager.cc:1916] T 07f5a93764eb444d8472cc51bf0d3b88 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:19.985699 457 master_service.cc:954] ReplaceTablet: received request to replace tablet cc99bc3332eb48f7a4980533ee71f581 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:19.985549 1173 ts_tablet_manager.cc:1434] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20260318 02:51:19.987599 766 tablet_service.cc:1511] Processing CreateTablet for tablet b9fe7de28b0646b9b2b96fc46962df9e (DEFAULT_TABLE table=default.Table_f89bbd2163914385916f490a3e147bd8 [id=3503ad3a2305498f97378035b06f06b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.988082 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9fe7de28b0646b9b2b96fc46962df9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.988265 762 tablet_service.cc:1511] Processing CreateTablet for tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 (DEFAULT_TABLE table=default.Table_0d969a129e064d118a5bd11a6f34b8f1 [id=c8d7ee2f33154a1fbc8d7c7f6fb7e3a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.988652 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10aafa9bf1c44b95b0263d9a76b8b1b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.988819 1173 tablet_bootstrap.cc:492] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:19.990082 1172 tablet_bootstrap.cc:492] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:19.990252 1172 ts_tablet_manager.cc:1403] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.003s
I20260318 02:51:19.990576 1173 tablet_bootstrap.cc:654] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:19.987599 764 tablet_service.cc:1511] Processing CreateTablet for tablet 92f95f7591b84ebbba033ec0e0cfc8b3 (DEFAULT_TABLE table=default.Table_5f19fbe9c1f94632833382d5ff0c71c8 [id=5237c0e4bebf4b26a0bb902002016ac7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.993997 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f95f7591b84ebbba033ec0e0cfc8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.996174 1044 tablet_service.cc:1511] Processing CreateTablet for tablet b9fe7de28b0646b9b2b96fc46962df9e (DEFAULT_TABLE table=default.Table_f89bbd2163914385916f490a3e147bd8 [id=3503ad3a2305498f97378035b06f06b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:19.996388 1172 raft_consensus.cc:359] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:19.996606 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9fe7de28b0646b9b2b96fc46962df9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:19.996630 1172 raft_consensus.cc:385] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:19.996726 1172 raft_consensus.cc:740] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:19.997242 1184 ts_tablet_manager.cc:1950] T 47a94514cba846e19dd6934f371acbe7 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:19.998432 1172 consensus_queue.cc:260] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.002521 1172 ts_tablet_manager.cc:1434] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
W20260318 02:51:20.002962 862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.129:46711, user_credentials={real_user=slave}} blocked reactor thread for 73938.7us
I20260318 02:51:20.004057 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 92f95f7591b84ebbba033ec0e0cfc8b3 (DEFAULT_TABLE table=default.Table_5f19fbe9c1f94632833382d5ff0c71c8 [id=5237c0e4bebf4b26a0bb902002016ac7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.004142 904 tablet_service.cc:1511] Processing CreateTablet for tablet b9fe7de28b0646b9b2b96fc46962df9e (DEFAULT_TABLE table=default.Table_f89bbd2163914385916f490a3e147bd8 [id=3503ad3a2305498f97378035b06f06b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.004480 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f95f7591b84ebbba033ec0e0cfc8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.004647 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9fe7de28b0646b9b2b96fc46962df9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.011585 904 tablet_service.cc:1511] Processing CreateTablet for tablet 92f95f7591b84ebbba033ec0e0cfc8b3 (DEFAULT_TABLE table=default.Table_5f19fbe9c1f94632833382d5ff0c71c8 [id=5237c0e4bebf4b26a0bb902002016ac7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.012037 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f95f7591b84ebbba033ec0e0cfc8b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.014305 1219 raft_consensus.cc:493] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:20.014503 1219 raft_consensus.cc:515] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.015419 1219 leader_election.cc:290] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:20.016572 1175 ts_tablet_manager.cc:1929] T 07f5a93764eb444d8472cc51bf0d3b88 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.016614 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee07c93213d44d9bb156d9ad7937facf" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:20.017342 719 leader_election.cc:343] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:20.017500 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 (DEFAULT_TABLE table=default.Table_0d969a129e064d118a5bd11a6f34b8f1 [id=c8d7ee2f33154a1fbc8d7c7f6fb7e3a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.017776 902 tablet_service.cc:1511] Processing CreateTablet for tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 (DEFAULT_TABLE table=default.Table_0d969a129e064d118a5bd11a6f34b8f1 [id=c8d7ee2f33154a1fbc8d7c7f6fb7e3a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.017953 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10aafa9bf1c44b95b0263d9a76b8b1b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.018167 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10aafa9bf1c44b95b0263d9a76b8b1b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.017896 1175 log.cc:1199] T 07f5a93764eb444d8472cc51bf0d3b88 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/07f5a93764eb444d8472cc51bf0d3b88
I20260318 02:51:20.018911 1175 ts_tablet_manager.cc:1950] T 07f5a93764eb444d8472cc51bf0d3b88 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:20.024250 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.024573 1176 tablet_replica.cc:333] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:20.024816 1176 raft_consensus.cc:2243] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.025164 1176 raft_consensus.cc:2272] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.025144 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 4fce8e19ff3a447e8be74547003ea0ff (table default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]) successfully deleted
I20260318 02:51:20.025542 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 07f5a93764eb444d8472cc51bf0d3b88 (table default.Table_15d77c88756044738d0703683131c8d4 [id=433e7aa77412424ebb38784bb073d1fb]) successfully deleted
I20260318 02:51:20.025789 1172 tablet_bootstrap.cc:492] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:20.025774 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 9593cb3d940c42918056a222313c7adb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9593cb3d940c42918056a222313c7adb already in progress: creating tablet
I20260318 02:51:20.025731 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee07c93213d44d9bb156d9ad7937facf" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:20.025955 927 raft_consensus.cc:2468] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 0.
I20260318 02:51:20.026738 1176 ts_tablet_manager.cc:1916] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.027643 1172 tablet_bootstrap.cc:654] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.028985 719 leader_election.cc:304] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:20.029423 1219 raft_consensus.cc:2804] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:20.029548 1219 raft_consensus.cc:493] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:20.029640 1219 raft_consensus.cc:3060] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:20.032063 1184 tablet_replica.cc:333] T 07f5a93764eb444d8472cc51bf0d3b88 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:20.032250 1184 raft_consensus.cc:2243] T 07f5a93764eb444d8472cc51bf0d3b88 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.032440 1184 raft_consensus.cc:2272] T 07f5a93764eb444d8472cc51bf0d3b88 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.032361 1219 raft_consensus.cc:515] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.033059 1219 leader_election.cc:290] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:20.033363 1184 ts_tablet_manager.cc:1916] T 07f5a93764eb444d8472cc51bf0d3b88 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.033675 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee07c93213d44d9bb156d9ad7937facf" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:20.033738 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee07c93213d44d9bb156d9ad7937facf" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:20.033950 927 raft_consensus.cc:3060] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:20.034220 719 leader_election.cc:343] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:20.035501 1190 raft_consensus.cc:493] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:20.035692 1190 raft_consensus.cc:515] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.036901 927 raft_consensus.cc:2468] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 1.
I20260318 02:51:20.037451 719 leader_election.cc:304] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:20.037794 1219 raft_consensus.cc:2804] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:20.037838 1190 leader_election.cc:290] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:20.038008 1219 raft_consensus.cc:697] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Becoming Leader. State: Replica: 6a903d876086423b8016d705b98895ad, State: Running, Role: LEADER
I20260318 02:51:20.038302 1219 consensus_queue.cc:237] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:20.048234 999 leader_election.cc:343] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 9593cb3d940c42918056a222313c7adb
I20260318 02:51:20.050246 1172 tablet_bootstrap.cc:492] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:20.050275 1174 tablet_bootstrap.cc:492] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.050434 1172 ts_tablet_manager.cc:1403] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.002s
I20260318 02:51:20.050439 1174 ts_tablet_manager.cc:1403] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.116s user 0.011s sys 0.019s
I20260318 02:51:20.051151 1174 raft_consensus.cc:359] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.051312 1174 raft_consensus.cc:385] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.051401 1174 raft_consensus.cc:740] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.051329 1172 raft_consensus.cc:359] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.051549 1172 raft_consensus.cc:385] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.051641 1172 raft_consensus.cc:740] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.051875 1172 consensus_queue.cc:260] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:20.052804 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet cc99bc3332eb48f7a4980533ee71f581 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc99bc3332eb48f7a4980533ee71f581 already in progress: creating tablet
I20260318 02:51:20.053297 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 47a94514cba846e19dd6934f371acbe7 (table default.Table_aa09b8ff832f4507b7a423914cc89b1f [id=0bd115a0960941ff9d49b4566fe1c666]) successfully deleted
I20260318 02:51:20.053360 1174 consensus_queue.cc:260] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.055898 1174 ts_tablet_manager.cc:1434] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260318 02:51:20.057816 1174 tablet_bootstrap.cc:492] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.059195 1174 tablet_bootstrap.cc:654] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:20.060815 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f96e77189d37484289fc83285f23e80d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f96e77189d37484289fc83285f23e80d already in progress: creating tablet
I20260318 02:51:20.060997 1176 ts_tablet_manager.cc:1929] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.061110 1176 log.cc:1199] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/37cccad81a6a48bb8e2b0c4cbd5dfba3
I20260318 02:51:20.061429 1176 ts_tablet_manager.cc:1950] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:20.062397 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 (table default.Table_e12531399635425b8057086bfa69d948 [id=a0142bdf340a4928b1ec18479e8bc674]) successfully deleted
I20260318 02:51:20.062744 1175 tablet_replica.cc:333] T 7a81d51587eb4e5cab9fb61bf7f524a1 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:20.062942 1175 raft_consensus.cc:2243] T 7a81d51587eb4e5cab9fb61bf7f524a1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.063133 1175 raft_consensus.cc:2272] T 7a81d51587eb4e5cab9fb61bf7f524a1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.063817 1175 ts_tablet_manager.cc:1916] T 7a81d51587eb4e5cab9fb61bf7f524a1 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.063900 1173 tablet_bootstrap.cc:492] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:20.064073 1173 ts_tablet_manager.cc:1403] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.075s user 0.000s sys 0.010s
I20260318 02:51:20.065081 1173 raft_consensus.cc:359] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.065320 1173 raft_consensus.cc:385] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.065403 1173 raft_consensus.cc:740] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.065676 1173 consensus_queue.cc:260] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.066682 1174 tablet_bootstrap.cc:492] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.069279 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 9593cb3d940c42918056a222313c7adb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.069789 1173 ts_tablet_manager.cc:1434] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260318 02:51:20.070112 1173 tablet_bootstrap.cc:492] T 2d254c168b5746b59ee57a816b53ba69 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:20.070385 1175 ts_tablet_manager.cc:1929] T 7a81d51587eb4e5cab9fb61bf7f524a1 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.070504 1175 log.cc:1199] T 7a81d51587eb4e5cab9fb61bf7f524a1 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/7a81d51587eb4e5cab9fb61bf7f524a1
I20260318 02:51:20.070932 1175 ts_tablet_manager.cc:1950] T 7a81d51587eb4e5cab9fb61bf7f524a1 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:20.071976 1173 tablet_bootstrap.cc:654] T 2d254c168b5746b59ee57a816b53ba69 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.072243 1174 ts_tablet_manager.cc:1403] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.002s
I20260318 02:51:20.074435 1174 raft_consensus.cc:359] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.074728 1174 raft_consensus.cc:385] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.074860 1174 raft_consensus.cc:740] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.075201 1174 consensus_queue.cc:260] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:20.075678 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet deba6669348248d6a1f1111122e7ad32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet deba6669348248d6a1f1111122e7ad32 already in progress: creating tablet
I20260318 02:51:20.075934 1174 ts_tablet_manager.cc:1434] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:20.073900 1172 ts_tablet_manager.cc:1434] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260318 02:51:20.076344 1174 tablet_bootstrap.cc:492] T deba6669348248d6a1f1111122e7ad32 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.076552 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 7a81d51587eb4e5cab9fb61bf7f524a1 (table default.Table_541a8f0af72c48529db5904e9400919f [id=5e3dec62fd1942a5b64c954901219b4c]) successfully deleted
W20260318 02:51:20.076915 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 41c97f254ae94de3bb0c03db72fb7df0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41c97f254ae94de3bb0c03db72fb7df0 already in progress: creating tablet
I20260318 02:51:20.078365 1174 tablet_bootstrap.cc:654] T deba6669348248d6a1f1111122e7ad32 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.078768 1172 tablet_bootstrap.cc:492] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:20.080523 1172 tablet_bootstrap.cc:654] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.081426 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9593cb3d940c42918056a222313c7adb" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:20.082134 1175 tablet_replica.cc:333] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
W20260318 02:51:20.082149 997 leader_election.cc:343] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:20.082347 1175 raft_consensus.cc:2243] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.082299 997 leader_election.cc:304] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:20.082521 1175 raft_consensus.cc:2272] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.082782 1190 raft_consensus.cc:2749] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:20.083102 1175 ts_tablet_manager.cc:1916] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.088814 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5f19fbe9c1f94632833382d5ff0c71c8" } modify_external_catalogs: true
I20260318 02:51:20.089064 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5f19fbe9c1f94632833382d5ff0c71c8" } modify_external_catalogs: true
I20260318 02:51:20.089886 1174 tablet_bootstrap.cc:492] T deba6669348248d6a1f1111122e7ad32 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.090112 1174 ts_tablet_manager.cc:1403] T deba6669348248d6a1f1111122e7ad32 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.001s
I20260318 02:51:20.090474 1184 ts_tablet_manager.cc:1929] T 07f5a93764eb444d8472cc51bf0d3b88 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.090610 1184 log.cc:1199] T 07f5a93764eb444d8472cc51bf0d3b88 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/07f5a93764eb444d8472cc51bf0d3b88
I20260318 02:51:20.090982 1184 ts_tablet_manager.cc:1950] T 07f5a93764eb444d8472cc51bf0d3b88 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:20.091133 1174 raft_consensus.cc:359] T deba6669348248d6a1f1111122e7ad32 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:20.091363 1174 raft_consensus.cc:385] T deba6669348248d6a1f1111122e7ad32 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.091490 1174 raft_consensus.cc:740] T deba6669348248d6a1f1111122e7ad32 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.091792 1174 consensus_queue.cc:260] T deba6669348248d6a1f1111122e7ad32 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:20.091931 1184 tablet_replica.cc:333] T 8a9b110d58f647778667befe0d24f590 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:20.092128 1184 raft_consensus.cc:2243] T 8a9b110d58f647778667befe0d24f590 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:20.092298 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da240bc0d5b043b89232fdf646f4f344 consensus state has no leader
I20260318 02:51:20.092303 1184 raft_consensus.cc:2272] T 8a9b110d58f647778667befe0d24f590 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.093432 1174 ts_tablet_manager.cc:1434] T deba6669348248d6a1f1111122e7ad32 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:20.093554 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2ff8e4571d0a47ae984a918f17ba1d6b
I20260318 02:51:20.093770 1174 tablet_bootstrap.cc:492] T 0ef71cea07cf42dea6cf96a5341542b3 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.094200 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b2b84cb26868440ca83042602d382c10" } modify_external_catalogs: true
I20260318 02:51:20.094383 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b2b84cb26868440ca83042602d382c10" } modify_external_catalogs: true
W20260318 02:51:20.094900 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b176363ce948489ab05178e5875f2ccd consensus state has no leader
I20260318 02:51:20.095201 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6b0fdcb080ea4a6b97f51308598362be" } modify_external_catalogs: true
I20260318 02:51:20.095352 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6b0fdcb080ea4a6b97f51308598362be" } modify_external_catalogs: true
I20260318 02:51:20.095585 1174 tablet_bootstrap.cc:654] T 0ef71cea07cf42dea6cf96a5341542b3 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:20.095868 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1af760ed8ff14a498e751e67550cb1ac consensus state has no leader
I20260318 02:51:20.096089 453 master_service.cc:954] ReplaceTablet: received request to replace tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:20.096832 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e635a0a24db84a149bb743edac8c1629" } modify_external_catalogs: true
I20260318 02:51:20.096974 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e635a0a24db84a149bb743edac8c1629" } modify_external_catalogs: true
I20260318 02:51:20.097450 1172 tablet_bootstrap.cc:492] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:20.097613 1172 ts_tablet_manager.cc:1403] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.003s
I20260318 02:51:20.098378 1172 raft_consensus.cc:359] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.098562 1172 raft_consensus.cc:385] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.098629 1172 raft_consensus.cc:740] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.098282 451 catalog_manager.cc:5671] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a903d876086423b8016d705b98895ad (127.0.104.129). New cstate: current_term: 1 leader_uuid: "6a903d876086423b8016d705b98895ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:20.098865 1172 consensus_queue.cc:260] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.099679 1184 ts_tablet_manager.cc:1916] T 8a9b110d58f647778667befe0d24f590 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.100291 449 catalog_manager.cc:6741] ReplaceTablet: tablet 2ff8e4571d0a47ae984a918f17ba1d6b deleted and replaced by tablet f1ed26420c64492a94e8920d8c753fc3
I20260318 02:51:20.101052 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ff8e4571d0a47ae984a918f17ba1d6b with delete_type TABLET_DATA_DELETED (replaced by tablet f1ed26420c64492a94e8920d8c753fc3) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.101893 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ff8e4571d0a47ae984a918f17ba1d6b with delete_type TABLET_DATA_DELETED (replaced by tablet f1ed26420c64492a94e8920d8c753fc3) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:20.102667 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2ff8e4571d0a47ae984a918f17ba1d6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ff8e4571d0a47ae984a918f17ba1d6b already in progress: creating tablet
I20260318 02:51:20.104808 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 07f5a93764eb444d8472cc51bf0d3b88 (table default.Table_0c5e75f8ad484c6d87b15a8f88667a0b [id=433e7aa77412424ebb38784bb073d1fb]) successfully deleted
I20260318 02:51:20.105509 1172 ts_tablet_manager.cc:1434] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260318 02:51:20.105859 1172 tablet_bootstrap.cc:492] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:20.107594 1172 tablet_bootstrap.cc:654] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.108457 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 92f95f7591b84ebbba033ec0e0cfc8b3
I20260318 02:51:20.108623 1175 ts_tablet_manager.cc:1929] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.108877 1175 log.cc:1199] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/47a94514cba846e19dd6934f371acbe7
I20260318 02:51:20.109280 1175 ts_tablet_manager.cc:1950] T 47a94514cba846e19dd6934f371acbe7 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:20.109361 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 92f95f7591b84ebbba033ec0e0cfc8b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:20.110057 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 92f95f7591b84ebbba033ec0e0cfc8b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92f95f7591b84ebbba033ec0e0cfc8b3 already in progress: creating tablet
I20260318 02:51:20.110205 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 92f95f7591b84ebbba033ec0e0cfc8b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.111655 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 47a94514cba846e19dd6934f371acbe7 (table default.Table_aa09b8ff832f4507b7a423914cc89b1f [id=0bd115a0960941ff9d49b4566fe1c666]) successfully deleted
W20260318 02:51:20.112447 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f96e77189d37484289fc83285f23e80d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f96e77189d37484289fc83285f23e80d already in progress: creating tablet
W20260318 02:51:20.113133 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet deba6669348248d6a1f1111122e7ad32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet deba6669348248d6a1f1111122e7ad32 already in progress: creating tablet
W20260318 02:51:20.113823 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2ff8e4571d0a47ae984a918f17ba1d6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ff8e4571d0a47ae984a918f17ba1d6b already in progress: creating tablet
W20260318 02:51:20.114435 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 92f95f7591b84ebbba033ec0e0cfc8b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92f95f7591b84ebbba033ec0e0cfc8b3 already in progress: creating tablet
I20260318 02:51:20.115820 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ff8e4571d0a47ae984a918f17ba1d6b with delete_type TABLET_DATA_DELETED (replaced by tablet f1ed26420c64492a94e8920d8c753fc3) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.116091 454 master_service.cc:954] ReplaceTablet: received request to replace tablet cc99bc3332eb48f7a4980533ee71f581 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:20.116804 1174 tablet_bootstrap.cc:492] T 0ef71cea07cf42dea6cf96a5341542b3 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.116858 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 92f95f7591b84ebbba033ec0e0cfc8b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.116986 1174 ts_tablet_manager.cc:1403] T 0ef71cea07cf42dea6cf96a5341542b3 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.023s user 0.010s sys 0.010s
I20260318 02:51:20.117822 1174 raft_consensus.cc:359] T 0ef71cea07cf42dea6cf96a5341542b3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.118027 1174 raft_consensus.cc:385] T 0ef71cea07cf42dea6cf96a5341542b3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.118108 1174 raft_consensus.cc:740] T 0ef71cea07cf42dea6cf96a5341542b3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.118376 1174 consensus_queue.cc:260] T 0ef71cea07cf42dea6cf96a5341542b3 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.120275 1174 ts_tablet_manager.cc:1434] T 0ef71cea07cf42dea6cf96a5341542b3 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:20.120688 1174 tablet_bootstrap.cc:492] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.122699 1174 tablet_bootstrap.cc:654] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.124573 1174 tablet_bootstrap.cc:492] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.124732 1174 ts_tablet_manager.cc:1403] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260318 02:51:20.125489 1174 raft_consensus.cc:359] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.125669 1174 raft_consensus.cc:385] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.125764 1174 raft_consensus.cc:740] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.125974 1174 consensus_queue.cc:260] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.128383 1174 ts_tablet_manager.cc:1434] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260318 02:51:20.129535 1174 tablet_bootstrap.cc:492] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.130136 1184 ts_tablet_manager.cc:1929] T 8a9b110d58f647778667befe0d24f590 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.130950 1184 log.cc:1199] T 8a9b110d58f647778667befe0d24f590 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/8a9b110d58f647778667befe0d24f590
I20260318 02:51:20.131386 1184 ts_tablet_manager.cc:1950] T 8a9b110d58f647778667befe0d24f590 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:20.131417 1174 tablet_bootstrap.cc:654] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.132025 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 0ef71cea07cf42dea6cf96a5341542b3
I20260318 02:51:20.132798 1184 tablet_replica.cc:333] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:20.132894 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ef71cea07cf42dea6cf96a5341542b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.132992 1184 raft_consensus.cc:2243] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.133162 1184 raft_consensus.cc:2272] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.133420 1176 tablet_replica.cc:333] T 0ef71cea07cf42dea6cf96a5341542b3 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:20.133618 1176 raft_consensus.cc:2243] T 0ef71cea07cf42dea6cf96a5341542b3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.133620 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ef71cea07cf42dea6cf96a5341542b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.133805 1176 raft_consensus.cc:2272] T 0ef71cea07cf42dea6cf96a5341542b3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.134035 1219 raft_consensus.cc:493] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:20.134212 1219 raft_consensus.cc:515] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:20.134326 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 0ef71cea07cf42dea6cf96a5341542b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ef71cea07cf42dea6cf96a5341542b3 already in progress: creating tablet
I20260318 02:51:20.134620 1176 ts_tablet_manager.cc:1916] T 0ef71cea07cf42dea6cf96a5341542b3 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.134819 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1d973c441e874933af10ea309f9786d2" } modify_external_catalogs: true
I20260318 02:51:20.134886 1219 leader_election.cc:290] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:20.134994 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1d973c441e874933af10ea309f9786d2" } modify_external_catalogs: true
I20260318 02:51:20.135628 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81d51587eb4e5cab9fb61bf7f524a1" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:20.136467 719 leader_election.cc:343] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: 7a81d51587eb4e5cab9fb61bf7f524a1
W20260318 02:51:20.136765 719 leader_election.cc:343] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:20.136868 719 leader_election.cc:304] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:20.136962 1184 ts_tablet_manager.cc:1916] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.137264 1219 raft_consensus.cc:2749] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:20.140861 455 catalog_manager.cc:5671] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 reported cstate change: term changed from 0 to 1, leader changed from <none> to b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130). New cstate: current_term: 1 leader_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:20.142783 451 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet da240bc0d5b043b89232fdf646f4f344 (table default.Table_d7429a91cdb142b99d2f341a75bc82bf [id=d7f85dc897794d14af2f182a59150e92]). Expected version 2 got 0
I20260318 02:51:20.144588 1174 tablet_bootstrap.cc:492] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.144790 1174 ts_tablet_manager.cc:1403] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.007s
I20260318 02:51:20.144985 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 10aafa9bf1c44b95b0263d9a76b8b1b2
I20260318 02:51:20.145408 453 catalog_manager.cc:6741] ReplaceTablet: tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 deleted and replaced by tablet 4dadf0fc6e134edd87788dd4ade59dc5
I20260318 02:51:20.145689 1174 raft_consensus.cc:359] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.145895 1174 raft_consensus.cc:385] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.145957 1174 raft_consensus.cc:740] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.146209 1174 consensus_queue.cc:260] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.146248 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 4dadf0fc6e134edd87788dd4ade59dc5) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:20.146981 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 already in progress: creating tablet
I20260318 02:51:20.147758 1174 ts_tablet_manager.cc:1434] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:20.148098 1174 tablet_bootstrap.cc:492] T cc99bc3332eb48f7a4980533ee71f581 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.149816 764 tablet_service.cc:1558] Processing DeleteTablet for tablet deba6669348248d6a1f1111122e7ad32 with delete_type TABLET_DATA_DELETED (replaced by tablet 53502a8e2d184b7ea7fa575d4836f0ea) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.149976 1174 tablet_bootstrap.cc:654] T cc99bc3332eb48f7a4980533ee71f581 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.150066 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 4dadf0fc6e134edd87788dd4ade59dc5) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.150377 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a81d51587eb4e5cab9fb61bf7f524a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.150605 1184 ts_tablet_manager.cc:1929] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.150748 1184 log.cc:1199] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/9593cb3d940c42918056a222313c7adb
I20260318 02:51:20.151129 1184 ts_tablet_manager.cc:1950] T 9593cb3d940c42918056a222313c7adb P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:20.153623 904 tablet_service.cc:1511] Processing CreateTablet for tablet 1ad59f4f5db8424a900b36e060745aa6 (DEFAULT_TABLE table=default.Table_7302de3324f84feea6928392c6067ecb [id=5104d449469a4fdc99dab10843e6c5b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.154119 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad59f4f5db8424a900b36e060745aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.155879 451 master_service.cc:954] ReplaceTablet: received request to replace tablet 5955a2ce20e64b0989f26dec7e439792 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:20.156870 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_68f3e929e48949f1a9f426d64cb46006"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:20.157218 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_480631505a694fa2846e96ba417fcb1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:20.157507 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68f3e929e48949f1a9f426d64cb46006 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:20.157951 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_480631505a694fa2846e96ba417fcb1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.158183 1176 ts_tablet_manager.cc:1929] T 0ef71cea07cf42dea6cf96a5341542b3 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.158350 1176 log.cc:1199] T 0ef71cea07cf42dea6cf96a5341542b3 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/0ef71cea07cf42dea6cf96a5341542b3
I20260318 02:51:20.158797 1176 ts_tablet_manager.cc:1950] T 0ef71cea07cf42dea6cf96a5341542b3 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:20.159888 453 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 1af760ed8ff14a498e751e67550cb1ac (table default.Table_0c5e75f8ad484c6d87b15a8f88667a0b [id=433e7aa77412424ebb38784bb073d1fb]). Expected version 4 got 0
I20260318 02:51:20.160552 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 0ef71cea07cf42dea6cf96a5341542b3 (table default.Table_e635a0a24db84a149bb743edac8c1629 [id=b6fccf21c9f04af3a55c534a5f223bf1]) successfully deleted
I20260318 02:51:20.160921 1176 tablet_replica.cc:333] T deba6669348248d6a1f1111122e7ad32 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:20.161119 1176 raft_consensus.cc:2243] T deba6669348248d6a1f1111122e7ad32 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.161314 1176 raft_consensus.cc:2272] T deba6669348248d6a1f1111122e7ad32 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.162122 1176 ts_tablet_manager.cc:1916] T deba6669348248d6a1f1111122e7ad32 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.168354 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 41a152a453fe47d194766635ab586804
I20260318 02:51:20.168701 1174 tablet_bootstrap.cc:492] T cc99bc3332eb48f7a4980533ee71f581 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.168884 1174 ts_tablet_manager.cc:1403] T cc99bc3332eb48f7a4980533ee71f581 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.012s
I20260318 02:51:20.169173 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d548901cf2e74047a18ea1460ce6fc34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:20.169313 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 41a152a453fe47d194766635ab586804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.169678 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 41a152a453fe47d194766635ab586804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:20.169759 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d548901cf2e74047a18ea1460ce6fc34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.169737 1174 raft_consensus.cc:359] T cc99bc3332eb48f7a4980533ee71f581 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.169890 1174 raft_consensus.cc:385] T cc99bc3332eb48f7a4980533ee71f581 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.169983 1174 raft_consensus.cc:740] T cc99bc3332eb48f7a4980533ee71f581 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.170234 1174 consensus_queue.cc:260] T cc99bc3332eb48f7a4980533ee71f581 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
W20260318 02:51:20.170352 441 catalog_manager.cc:4969] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 41a152a453fe47d194766635ab586804 because the tablet was not found. No further retry: Not found: Tablet not found: 41a152a453fe47d194766635ab586804
I20260318 02:51:20.172425 1174 ts_tablet_manager.cc:1434] T cc99bc3332eb48f7a4980533ee71f581 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:20.172789 1174 tablet_bootstrap.cc:492] T 5955a2ce20e64b0989f26dec7e439792 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.174642 1174 tablet_bootstrap.cc:654] T 5955a2ce20e64b0989f26dec7e439792 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.177546 1176 ts_tablet_manager.cc:1929] T deba6669348248d6a1f1111122e7ad32 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.177688 1176 log.cc:1199] T deba6669348248d6a1f1111122e7ad32 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/deba6669348248d6a1f1111122e7ad32
I20260318 02:51:20.178067 1176 ts_tablet_manager.cc:1950] T deba6669348248d6a1f1111122e7ad32 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:20.178194 453 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet b176363ce948489ab05178e5875f2ccd (table default.Table_e56aadd2977f4c5e816768f78d70ba61 [id=f6d13c14fec24bc8894ebd60b88fca77]). Expected version 1 got 0
I20260318 02:51:20.178998 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_dfa0685fbf9c48549250fd0753f24994"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:20.179183 1176 tablet_replica.cc:333] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:20.179392 1176 raft_consensus.cc:2243] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.179553 1176 raft_consensus.cc:2272] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:20.179576 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfa0685fbf9c48549250fd0753f24994 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.179939 453 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 1766ce95009b4c3f9940ebcf10503c7f (table default.Table_96ebc14af9534f3e97d9d4e731264282 [id=1c0082e294dd43cdb2eb4ed335ff3c06]). Expected version 1 got 0
I20260318 02:51:20.180433 1176 ts_tablet_manager.cc:1916] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.181097 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6da40d0a67f342ff867f3660f2a289ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:20.181635 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6da40d0a67f342ff867f3660f2a289ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.184757 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet deba6669348248d6a1f1111122e7ad32 (table default.Table_63ea580c95a14a2f85b3ca002a8b1399 [id=0c04457e82e54a229437db0c3f90811b]) successfully deleted
W20260318 02:51:20.185030 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 already in progress: creating tablet
I20260318 02:51:20.186079 452 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet da240bc0d5b043b89232fdf646f4f344 (table default.Table_d7429a91cdb142b99d2f341a75bc82bf [id=d7f85dc897794d14af2f182a59150e92]). Expected version 2 got 0
I20260318 02:51:20.189302 762 tablet_service.cc:1511] Processing CreateTablet for tablet 1ad59f4f5db8424a900b36e060745aa6 (DEFAULT_TABLE table=default.Table_7302de3324f84feea6928392c6067ecb [id=5104d449469a4fdc99dab10843e6c5b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.189720 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad59f4f5db8424a900b36e060745aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.189777 766 tablet_service.cc:1511] Processing CreateTablet for tablet 4b07774692544b1c83bc547302b203a5 (DEFAULT_TABLE table=default.Table_f0f6be3d63b9474b992b607498ab7508 [id=da7b89f9dc554a6a9e383537b40ab14e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.190119 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b07774692544b1c83bc547302b203a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.190770 904 tablet_service.cc:1511] Processing CreateTablet for tablet 4b07774692544b1c83bc547302b203a5 (DEFAULT_TABLE table=default.Table_f0f6be3d63b9474b992b607498ab7508 [id=da7b89f9dc554a6a9e383537b40ab14e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.191257 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b07774692544b1c83bc547302b203a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.193006 1176 ts_tablet_manager.cc:1929] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.193156 1176 log.cc:1199] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/7a81d51587eb4e5cab9fb61bf7f524a1
I20260318 02:51:20.193535 1176 ts_tablet_manager.cc:1950] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:20.193626 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 53e66044bfed4b53a1c0bc4dc8de52e6
I20260318 02:51:20.194615 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 7a81d51587eb4e5cab9fb61bf7f524a1 (table default.Table_541a8f0af72c48529db5904e9400919f [id=5e3dec62fd1942a5b64c954901219b4c]) successfully deleted
I20260318 02:51:20.194809 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 53e66044bfed4b53a1c0bc4dc8de52e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.195442 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 53e66044bfed4b53a1c0bc4dc8de52e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:20.196128 441 catalog_manager.cc:4969] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 53e66044bfed4b53a1c0bc4dc8de52e6 because the tablet was not found. No further retry: Not found: Tablet not found: 53e66044bfed4b53a1c0bc4dc8de52e6
I20260318 02:51:20.197753 1174 tablet_bootstrap.cc:492] T 5955a2ce20e64b0989f26dec7e439792 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.197937 1174 ts_tablet_manager.cc:1403] T 5955a2ce20e64b0989f26dec7e439792 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.025s user 0.009s sys 0.000s
W20260318 02:51:20.198117 443 catalog_manager.cc:4969] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 41a152a453fe47d194766635ab586804 because the tablet was not found. No further retry: Not found: Tablet not found: 41a152a453fe47d194766635ab586804
I20260318 02:51:20.198678 786 raft_consensus.cc:1275] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Refusing update from remote peer b25f4f05e0c94c8db825d5afa0b8bf18: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:20.198788 1174 raft_consensus.cc:359] T 5955a2ce20e64b0989f26dec7e439792 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:20.199004 1174 raft_consensus.cc:385] T 5955a2ce20e64b0989f26dec7e439792 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.199172 1174 raft_consensus.cc:740] T 5955a2ce20e64b0989f26dec7e439792 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.199452 1174 consensus_queue.cc:260] T 5955a2ce20e64b0989f26dec7e439792 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:20.199581 1179 consensus_queue.cc:1048] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:20.199900 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f4fca199c1dd4b0db4688f81d015e413" } new_table_name: "default.Table_ac694c873ef141579c82755592552b23" modify_external_catalogs: true
I20260318 02:51:20.201143 1064 raft_consensus.cc:3060] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:20.202270 1174 ts_tablet_manager.cc:1434] T 5955a2ce20e64b0989f26dec7e439792 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:20.202654 1174 tablet_bootstrap.cc:492] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:20.203660 444 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 6a3491e419434075ac4e6fa5881ec537 (table default.Table_bbf2210842004e098c3fe633c4f2f7d0 [id=06e124bab0a04572bab0c3c008b7d218], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6a3491e419434075ac4e6fa5881ec537 consensus state has no leader
I20260318 02:51:20.204339 1064 raft_consensus.cc:1275] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Refusing update from remote peer b25f4f05e0c94c8db825d5afa0b8bf18: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:20.204550 1174 tablet_bootstrap.cc:654] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.205996 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_19fe141c13934c04bd511b36fab6ab36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:20.207204 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19fe141c13934c04bd511b36fab6ab36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:20.206527 443 catalog_manager.cc:4969] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 53e66044bfed4b53a1c0bc4dc8de52e6 because the tablet was not found. No further retry: Not found: Tablet not found: 53e66044bfed4b53a1c0bc4dc8de52e6
I20260318 02:51:20.209022 1179 consensus_queue.cc:1048] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:20.209815 1173 tablet_bootstrap.cc:492] T 2d254c168b5746b59ee57a816b53ba69 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:20.210019 1173 ts_tablet_manager.cc:1403] T 2d254c168b5746b59ee57a816b53ba69 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.140s user 0.006s sys 0.002s
I20260318 02:51:20.210922 1173 raft_consensus.cc:359] T 2d254c168b5746b59ee57a816b53ba69 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.211362 1173 raft_consensus.cc:385] T 2d254c168b5746b59ee57a816b53ba69 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.211526 1173 raft_consensus.cc:740] T 2d254c168b5746b59ee57a816b53ba69 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.213003 1174 tablet_bootstrap.cc:492] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.213171 1174 ts_tablet_manager.cc:1403] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.001s
I20260318 02:51:20.214118 1174 raft_consensus.cc:359] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.214339 1174 raft_consensus.cc:385] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.214440 1174 raft_consensus.cc:740] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.214664 1174 consensus_queue.cc:260] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.214726 766 tablet_service.cc:1558] Processing DeleteTablet for tablet cc99bc3332eb48f7a4980533ee71f581 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.212250 1173 consensus_queue.cc:260] T 2d254c168b5746b59ee57a816b53ba69 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.215071 1176 tablet_replica.cc:333] T cc99bc3332eb48f7a4980533ee71f581 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:20.215240 1176 raft_consensus.cc:2243] T cc99bc3332eb48f7a4980533ee71f581 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.215554 1176 raft_consensus.cc:2272] T cc99bc3332eb48f7a4980533ee71f581 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.216259 1176 ts_tablet_manager.cc:1916] T cc99bc3332eb48f7a4980533ee71f581 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.217120 902 tablet_service.cc:1511] Processing CreateTablet for tablet 53502a8e2d184b7ea7fa575d4836f0ea (DEFAULT_TABLE table=default.Table_63ea580c95a14a2f85b3ca002a8b1399 [id=0c04457e82e54a229437db0c3f90811b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.217568 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53502a8e2d184b7ea7fa575d4836f0ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.220837 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 8a9b110d58f647778667befe0d24f590 (table default.Table_3d5d8ced462a4e8fbde8382a07f71579 [id=18eb38b85d0c4dd3b8d945c444ffadfa]) successfully deleted
I20260318 02:51:20.221355 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 9593cb3d940c42918056a222313c7adb (table default.Table_737bd9edac1b45d68b210a423b0e17ee [id=97e9a124fd8d4b279d8db98ee802ede4]) successfully deleted
W20260318 02:51:20.221891 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2ff8e4571d0a47ae984a918f17ba1d6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ff8e4571d0a47ae984a918f17ba1d6b already in progress: creating tablet
I20260318 02:51:20.221961 1173 ts_tablet_manager.cc:1434] T 2d254c168b5746b59ee57a816b53ba69 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
W20260318 02:51:20.222334 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 92f95f7591b84ebbba033ec0e0cfc8b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92f95f7591b84ebbba033ec0e0cfc8b3 already in progress: creating tablet
I20260318 02:51:20.224027 766 tablet_service.cc:1511] Processing CreateTablet for tablet 53502a8e2d184b7ea7fa575d4836f0ea (DEFAULT_TABLE table=default.Table_63ea580c95a14a2f85b3ca002a8b1399 [id=0c04457e82e54a229437db0c3f90811b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.224495 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53502a8e2d184b7ea7fa575d4836f0ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.224836 907 tablet_service.cc:1511] Processing CreateTablet for tablet 41a152a453fe47d194766635ab586804 (DEFAULT_TABLE table=default.Table_b2b84cb26868440ca83042602d382c10 [id=e0155dac40a44f07885db7ec2d76f271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.225219 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a152a453fe47d194766635ab586804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.227543 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2d254c168b5746b59ee57a816b53ba69
I20260318 02:51:20.228984 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d254c168b5746b59ee57a816b53ba69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.229274 1175 tablet_replica.cc:333] T 2d254c168b5746b59ee57a816b53ba69 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:20.229461 1175 raft_consensus.cc:2243] T 2d254c168b5746b59ee57a816b53ba69 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.229660 1175 raft_consensus.cc:2272] T 2d254c168b5746b59ee57a816b53ba69 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.230122 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8191659006de403a8de64233efbf3486"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:20.224619 1176 ts_tablet_manager.cc:1929] T cc99bc3332eb48f7a4980533ee71f581 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.230557 1176 log.cc:1199] T cc99bc3332eb48f7a4980533ee71f581 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/cc99bc3332eb48f7a4980533ee71f581
W20260318 02:51:20.230823 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8191659006de403a8de64233efbf3486 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.230795 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d254c168b5746b59ee57a816b53ba69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.230937 1176 ts_tablet_manager.cc:1950] T cc99bc3332eb48f7a4980533ee71f581 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:20.231041 1173 tablet_bootstrap.cc:492] T 9593cb3d940c42918056a222313c7adb P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:20.231905 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ef71cea07cf42dea6cf96a5341542b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.231943 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet cc99bc3332eb48f7a4980533ee71f581 (table default.Table_cd18ea9af8074f5398e9d37d53332f19 [id=635bb52ee26d4a95865a9039f6a1a0ec]) successfully deleted
I20260318 02:51:20.232471 1174 ts_tablet_manager.cc:1434] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260318 02:51:20.232725 1173 tablet_bootstrap.cc:654] T 9593cb3d940c42918056a222313c7adb P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.233245 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_edbae2d50973420e97cce96b373081db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:20.233431 1174 tablet_bootstrap.cc:492] T 6a3491e419434075ac4e6fa5881ec537 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.235172 1176 tablet_replica.cc:333] T 2d254c168b5746b59ee57a816b53ba69 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:20.235388 1176 raft_consensus.cc:2243] T 2d254c168b5746b59ee57a816b53ba69 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.235524 1175 ts_tablet_manager.cc:1916] T 2d254c168b5746b59ee57a816b53ba69 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.235569 1176 raft_consensus.cc:2272] T 2d254c168b5746b59ee57a816b53ba69 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.235849 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 1ad59f4f5db8424a900b36e060745aa6 (DEFAULT_TABLE table=default.Table_7302de3324f84feea6928392c6067ecb [id=5104d449469a4fdc99dab10843e6c5b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.236132 1176 ts_tablet_manager.cc:1916] T 2d254c168b5746b59ee57a816b53ba69 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.236281 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ad59f4f5db8424a900b36e060745aa6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:20.235163 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_edbae2d50973420e97cce96b373081db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.239503 1174 tablet_bootstrap.cc:654] T 6a3491e419434075ac4e6fa5881ec537 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.239701 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 4dadf0fc6e134edd87788dd4ade59dc5) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.240001 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 41a152a453fe47d194766635ab586804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.240218 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.240422 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 53e66044bfed4b53a1c0bc4dc8de52e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.240857 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 41a152a453fe47d194766635ab586804 (DEFAULT_TABLE table=default.Table_b2b84cb26868440ca83042602d382c10 [id=e0155dac40a44f07885db7ec2d76f271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.241261 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a152a453fe47d194766635ab586804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.244163 1176 ts_tablet_manager.cc:1929] T 2d254c168b5746b59ee57a816b53ba69 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.244300 1176 log.cc:1199] T 2d254c168b5746b59ee57a816b53ba69 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/2d254c168b5746b59ee57a816b53ba69
I20260318 02:51:20.244607 1176 ts_tablet_manager.cc:1950] T 2d254c168b5746b59ee57a816b53ba69 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:20.244886 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d254c168b5746b59ee57a816b53ba69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.245342 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 53502a8e2d184b7ea7fa575d4836f0ea (DEFAULT_TABLE table=default.Table_63ea580c95a14a2f85b3ca002a8b1399 [id=0c04457e82e54a229437db0c3f90811b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.245833 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53502a8e2d184b7ea7fa575d4836f0ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.246201 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 5955a2ce20e64b0989f26dec7e439792
I20260318 02:51:20.246783 451 catalog_manager.cc:6741] ReplaceTablet: tablet 5955a2ce20e64b0989f26dec7e439792 deleted and replaced by tablet 549b3929ea33417bbe50e749bbfe223d
I20260318 02:51:20.247392 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 5955a2ce20e64b0989f26dec7e439792 with delete_type TABLET_DATA_DELETED (replaced by tablet 549b3929ea33417bbe50e749bbfe223d) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.247817 449 master_service.cc:954] ReplaceTablet: received request to replace tablet f96e77189d37484289fc83285f23e80d from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:20.249533 1184 tablet_replica.cc:333] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:20.249575 1174 tablet_bootstrap.cc:492] T 6a3491e419434075ac4e6fa5881ec537 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.249727 1184 raft_consensus.cc:2243] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.249752 1174 ts_tablet_manager.cc:1403] T 6a3491e419434075ac4e6fa5881ec537 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.002s
I20260318 02:51:20.249899 1184 raft_consensus.cc:2272] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.250509 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 4b07774692544b1c83bc547302b203a5 (DEFAULT_TABLE table=default.Table_f0f6be3d63b9474b992b607498ab7508 [id=da7b89f9dc554a6a9e383537b40ab14e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.250658 1174 raft_consensus.cc:359] T 6a3491e419434075ac4e6fa5881ec537 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.250880 1174 raft_consensus.cc:385] T 6a3491e419434075ac4e6fa5881ec537 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.250906 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b07774692544b1c83bc547302b203a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.250943 1174 raft_consensus.cc:740] T 6a3491e419434075ac4e6fa5881ec537 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.251227 1174 consensus_queue.cc:260] T 6a3491e419434075ac4e6fa5881ec537 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.252010 1174 ts_tablet_manager.cc:1434] T 6a3491e419434075ac4e6fa5881ec537 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:20.252323 1174 tablet_bootstrap.cc:492] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.253412 1184 ts_tablet_manager.cc:1916] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.253975 1174 tablet_bootstrap.cc:654] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:20.254033 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 0ef71cea07cf42dea6cf96a5341542b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ef71cea07cf42dea6cf96a5341542b3 already in progress: creating tablet
I20260318 02:51:20.255103 907 tablet_service.cc:1511] Processing CreateTablet for tablet 7e4e8586673c43058ef00f2f7aef10ee (DEFAULT_TABLE table=default.Table_bbda0f6b8794401899207ea245bdbc25 [id=e8cc0e7ae9214cc6bfcb635c00ae4090]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.255517 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e4e8586673c43058ef00f2f7aef10ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.256650 1174 tablet_bootstrap.cc:492] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.256807 1174 ts_tablet_manager.cc:1403] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260318 02:51:20.257639 1174 raft_consensus.cc:359] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.257826 1174 raft_consensus.cc:385] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.257908 1174 raft_consensus.cc:740] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.258222 1174 consensus_queue.cc:260] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.258805 1174 ts_tablet_manager.cc:1434] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:20.259099 1174 tablet_bootstrap.cc:492] T 41c97f254ae94de3bb0c03db72fb7df0 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.259514 1175 ts_tablet_manager.cc:1929] T 2d254c168b5746b59ee57a816b53ba69 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.259631 1175 log.cc:1199] T 2d254c168b5746b59ee57a816b53ba69 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/2d254c168b5746b59ee57a816b53ba69
I20260318 02:51:20.260001 1175 ts_tablet_manager.cc:1950] T 2d254c168b5746b59ee57a816b53ba69 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:20.260656 1174 tablet_bootstrap.cc:654] T 41c97f254ae94de3bb0c03db72fb7df0 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:20.261106 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 already in progress: creating tablet
W20260318 02:51:20.263489 441 catalog_manager.cc:4969] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 41a152a453fe47d194766635ab586804 because the tablet was not found. No further retry: Not found: Tablet not found: 41a152a453fe47d194766635ab586804
I20260318 02:51:20.265853 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 5955a2ce20e64b0989f26dec7e439792 with delete_type TABLET_DATA_DELETED (replaced by tablet 549b3929ea33417bbe50e749bbfe223d) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.266197 1176 tablet_replica.cc:333] T 5955a2ce20e64b0989f26dec7e439792 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:20.266450 1176 raft_consensus.cc:2243] T 5955a2ce20e64b0989f26dec7e439792 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.266516 766 tablet_service.cc:1511] Processing CreateTablet for tablet 7e4e8586673c43058ef00f2f7aef10ee (DEFAULT_TABLE table=default.Table_bbda0f6b8794401899207ea245bdbc25 [id=e8cc0e7ae9214cc6bfcb635c00ae4090]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.266661 1176 raft_consensus.cc:2272] T 5955a2ce20e64b0989f26dec7e439792 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.266667 902 tablet_service.cc:1511] Processing CreateTablet for tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d (DEFAULT_TABLE table=default.Table_aa09b8ff832f4507b7a423914cc89b1f [id=0bd115a0960941ff9d49b4566fe1c666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.267000 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e4e8586673c43058ef00f2f7aef10ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.267096 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.267354 1176 ts_tablet_manager.cc:1916] T 5955a2ce20e64b0989f26dec7e439792 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.269456 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 2d254c168b5746b59ee57a816b53ba69 (table default.Table_1d973c441e874933af10ea309f9786d2 [id=789fd6a65c0c481494430f1ba4c574f4]) successfully deleted
I20260318 02:51:20.271771 454 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 1766ce95009b4c3f9940ebcf10503c7f (table default.Table_96ebc14af9534f3e97d9d4e731264282 [id=1c0082e294dd43cdb2eb4ed335ff3c06]). Expected version 1 got 0
I20260318 02:51:20.275655 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 5955a2ce20e64b0989f26dec7e439792 with delete_type TABLET_DATA_DELETED (replaced by tablet 549b3929ea33417bbe50e749bbfe223d) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.278129 1184 ts_tablet_manager.cc:1929] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.278306 1184 log.cc:1199] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/37cccad81a6a48bb8e2b0c4cbd5dfba3
I20260318 02:51:20.275185 1176 ts_tablet_manager.cc:1929] T 5955a2ce20e64b0989f26dec7e439792 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.280062 1176 log.cc:1199] T 5955a2ce20e64b0989f26dec7e439792 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/5955a2ce20e64b0989f26dec7e439792
I20260318 02:51:20.280527 1176 ts_tablet_manager.cc:1950] T 5955a2ce20e64b0989f26dec7e439792 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:20.281670 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d (DEFAULT_TABLE table=default.Table_aa09b8ff832f4507b7a423914cc89b1f [id=0bd115a0960941ff9d49b4566fe1c666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.282094 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.282361 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 5955a2ce20e64b0989f26dec7e439792 (table default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]) successfully deleted
I20260318 02:51:20.283020 762 tablet_service.cc:1511] Processing CreateTablet for tablet 41a152a453fe47d194766635ab586804 (DEFAULT_TABLE table=default.Table_b2b84cb26868440ca83042602d382c10 [id=e0155dac40a44f07885db7ec2d76f271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.283440 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a152a453fe47d194766635ab586804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.285051 1248 mvcc.cc:204] Tried to move back new op lower bound from 7265494139656224768 to 7265494138601590784. Current Snapshot: MvccSnapshot[applied={T|T < 7265494139656224768}]
I20260318 02:51:20.285369 1257 tablet.cc:1723] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:20.287484 1258 tablet.cc:1723] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:20.288308 1184 ts_tablet_manager.cc:1950] T 37cccad81a6a48bb8e2b0c4cbd5dfba3 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:20.289130 1251 mvcc.cc:204] Tried to move back new op lower bound from 7265494139656224768 to 7265494138601590784. Current Snapshot: MvccSnapshot[applied={T|T < 7265494139656224768}]
I20260318 02:51:20.290208 766 tablet_service.cc:1511] Processing CreateTablet for tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d (DEFAULT_TABLE table=default.Table_aa09b8ff832f4507b7a423914cc89b1f [id=0bd115a0960941ff9d49b4566fe1c666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.290652 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.291306 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 37cccad81a6a48bb8e2b0c4cbd5dfba3 (table default.Table_e12531399635425b8057086bfa69d948 [id=a0142bdf340a4928b1ec18479e8bc674]) successfully deleted
W20260318 02:51:20.293504 441 catalog_manager.cc:4969] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 53e66044bfed4b53a1c0bc4dc8de52e6 because the tablet was not found. No further retry: Not found: Tablet not found: 53e66044bfed4b53a1c0bc4dc8de52e6
W20260318 02:51:20.296178 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2d254c168b5746b59ee57a816b53ba69 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d254c168b5746b59ee57a816b53ba69 already in progress: creating tablet
W20260318 02:51:20.297215 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 5955a2ce20e64b0989f26dec7e439792 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5955a2ce20e64b0989f26dec7e439792 already in progress: creating tablet
I20260318 02:51:20.300122 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 2d254c168b5746b59ee57a816b53ba69 (table default.Table_1d973c441e874933af10ea309f9786d2 [id=789fd6a65c0c481494430f1ba4c574f4]) successfully deleted
W20260318 02:51:20.300534 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 5955a2ce20e64b0989f26dec7e439792 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5955a2ce20e64b0989f26dec7e439792 already in progress: creating tablet
I20260318 02:51:20.302739 904 tablet_service.cc:1511] Processing CreateTablet for tablet 53e66044bfed4b53a1c0bc4dc8de52e6 (DEFAULT_TABLE table=default.Table_6b0fdcb080ea4a6b97f51308598362be [id=3ce1c72a2d4e42c698e85d5034d873e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.303647 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 53e66044bfed4b53a1c0bc4dc8de52e6 (DEFAULT_TABLE table=default.Table_6b0fdcb080ea4a6b97f51308598362be [id=3ce1c72a2d4e42c698e85d5034d873e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.304307 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53e66044bfed4b53a1c0bc4dc8de52e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.299875 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 7e4e8586673c43058ef00f2f7aef10ee (DEFAULT_TABLE table=default.Table_bbda0f6b8794401899207ea245bdbc25 [id=e8cc0e7ae9214cc6bfcb635c00ae4090]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.319041 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e4e8586673c43058ef00f2f7aef10ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.321187 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53e66044bfed4b53a1c0bc4dc8de52e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.329485 766 tablet_service.cc:1511] Processing CreateTablet for tablet 54bffc30199246fd93edf7486b2e3a91 (DEFAULT_TABLE table=default.Table_3078ea8f226c4adc8743e3a9371f2a97 [id=a58374eeb920473e941c9d07accd5ee5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.330017 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54bffc30199246fd93edf7486b2e3a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.328593 1173 tablet_bootstrap.cc:492] T 9593cb3d940c42918056a222313c7adb P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:20.332988 1173 ts_tablet_manager.cc:1403] T 9593cb3d940c42918056a222313c7adb P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.108s user 0.004s sys 0.000s
I20260318 02:51:20.334198 1173 raft_consensus.cc:359] T 9593cb3d940c42918056a222313c7adb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.334503 1173 raft_consensus.cc:385] T 9593cb3d940c42918056a222313c7adb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.334633 1173 raft_consensus.cc:740] T 9593cb3d940c42918056a222313c7adb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.334966 1173 consensus_queue.cc:260] T 9593cb3d940c42918056a222313c7adb P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.335528 450 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 1766ce95009b4c3f9940ebcf10503c7f (table default.Table_96ebc14af9534f3e97d9d4e731264282 [id=1c0082e294dd43cdb2eb4ed335ff3c06]). Expected version 1 got 0
I20260318 02:51:20.337361 1173 ts_tablet_manager.cc:1434] T 9593cb3d940c42918056a222313c7adb P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260318 02:51:20.337510 450 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 1766ce95009b4c3f9940ebcf10503c7f (table default.Table_96ebc14af9534f3e97d9d4e731264282 [id=1c0082e294dd43cdb2eb4ed335ff3c06]). Expected version 1 got 0
I20260318 02:51:20.337698 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_215d98fc906d466d8c0d334250547c34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:20.338363 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_215d98fc906d466d8c0d334250547c34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.338574 1173 tablet_bootstrap.cc:492] T deba6669348248d6a1f1111122e7ad32 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:20.339535 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_96ebc14af9534f3e97d9d4e731264282" } new_table_name: "default.Table_1a4739276dd74553a2497da27d9f4f83" modify_external_catalogs: true
I20260318 02:51:20.339941 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f0f6be3d63b9474b992b607498ab7508" } new_table_name: "default.Table_211fe38e2cf749b8ac8d689f2fe65025" modify_external_catalogs: true
I20260318 02:51:20.340569 1173 tablet_bootstrap.cc:654] T deba6669348248d6a1f1111122e7ad32 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.341064 762 tablet_service.cc:1511] Processing CreateTablet for tablet 53e66044bfed4b53a1c0bc4dc8de52e6 (DEFAULT_TABLE table=default.Table_6b0fdcb080ea4a6b97f51308598362be [id=3ce1c72a2d4e42c698e85d5034d873e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.341477 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53e66044bfed4b53a1c0bc4dc8de52e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.341653 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5c99a11fc34d4ab9920aed8d53bf584c" } new_table_name: "default.Table_470fd4c570c843b395575045c9ac1bf2" modify_external_catalogs: true
I20260318 02:51:20.342667 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_82b90b9eec6a4252b7022e3cf497374c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:20.343653 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82b90b9eec6a4252b7022e3cf497374c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.349627 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 5955a2ce20e64b0989f26dec7e439792 with delete_type TABLET_DATA_DELETED (replaced by tablet 549b3929ea33417bbe50e749bbfe223d) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:20.350356 443 catalog_manager.cc:4969] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 5955a2ce20e64b0989f26dec7e439792 because the tablet was not found. No further retry: Not found: Tablet not found: 5955a2ce20e64b0989f26dec7e439792
I20260318 02:51:20.353029 907 tablet_service.cc:1511] Processing CreateTablet for tablet 54bffc30199246fd93edf7486b2e3a91 (DEFAULT_TABLE table=default.Table_3078ea8f226c4adc8743e3a9371f2a97 [id=a58374eeb920473e941c9d07accd5ee5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.353379 1172 tablet_bootstrap.cc:492] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:20.353554 1172 ts_tablet_manager.cc:1403] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.248s user 0.021s sys 0.034s
I20260318 02:51:20.353811 1174 tablet_bootstrap.cc:492] T 41c97f254ae94de3bb0c03db72fb7df0 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.353984 1174 ts_tablet_manager.cc:1403] T 41c97f254ae94de3bb0c03db72fb7df0 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.095s user 0.013s sys 0.048s
I20260318 02:51:20.354406 1172 raft_consensus.cc:359] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.354630 1172 raft_consensus.cc:385] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.354746 1172 raft_consensus.cc:740] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.354889 1174 raft_consensus.cc:359] T 41c97f254ae94de3bb0c03db72fb7df0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.354779 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54bffc30199246fd93edf7486b2e3a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.355101 1174 raft_consensus.cc:385] T 41c97f254ae94de3bb0c03db72fb7df0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.355208 1174 raft_consensus.cc:740] T 41c97f254ae94de3bb0c03db72fb7df0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.355470 1174 consensus_queue.cc:260] T 41c97f254ae94de3bb0c03db72fb7df0 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.358572 1174 ts_tablet_manager.cc:1434] T 41c97f254ae94de3bb0c03db72fb7df0 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260318 02:51:20.359611 1172 consensus_queue.cc:260] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.360185 1174 tablet_bootstrap.cc:492] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.362066 1174 tablet_bootstrap.cc:654] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:20.362725 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f7415ddf48574f7b9a746049ce78d2e9 has no consensus state
I20260318 02:51:20.363029 448 master_service.cc:954] ReplaceTablet: received request to replace tablet 9593cb3d940c42918056a222313c7adb from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:20.363523 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 54bffc30199246fd93edf7486b2e3a91 (DEFAULT_TABLE table=default.Table_3078ea8f226c4adc8743e3a9371f2a97 [id=a58374eeb920473e941c9d07accd5ee5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.363718 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3078ea8f226c4adc8743e3a9371f2a97" } modify_external_catalogs: true
I20260318 02:51:20.363900 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3078ea8f226c4adc8743e3a9371f2a97" } modify_external_catalogs: true
I20260318 02:51:20.364629 457 master_service.cc:954] ReplaceTablet: received request to replace tablet b176363ce948489ab05178e5875f2ccd from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:20.365237 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bbda0f6b8794401899207ea245bdbc25" } modify_external_catalogs: true
I20260318 02:51:20.365396 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bbda0f6b8794401899207ea245bdbc25" } modify_external_catalogs: true
I20260318 02:51:20.365679 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54bffc30199246fd93edf7486b2e3a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.372009 1219 raft_consensus.cc:493] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:20.372231 1219 raft_consensus.cc:515] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.373590 1219 leader_election.cc:290] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:20.374411 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff8e4571d0a47ae984a918f17ba1d6b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:20.375064 1172 ts_tablet_manager.cc:1434] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.021s user 0.003s sys 0.000s
I20260318 02:51:20.375415 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff8e4571d0a47ae984a918f17ba1d6b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:20.375988 719 leader_election.cc:343] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:20.376202 1172 tablet_bootstrap.cc:492] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:20.377067 719 leader_election.cc:343] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:20.377202 719 leader_election.cc:304] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:20.377689 1219 raft_consensus.cc:2749] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:20.377794 1260 tablet.cc:1723] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:20.383028 1219 raft_consensus.cc:493] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:20.383240 1219 raft_consensus.cc:515] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.383877 1219 leader_election.cc:290] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:20.384863 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176363ce948489ab05178e5875f2ccd" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:20.385362 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b176363ce948489ab05178e5875f2ccd" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:20.385735 1173 tablet_bootstrap.cc:492] T deba6669348248d6a1f1111122e7ad32 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:20.385901 1173 ts_tablet_manager.cc:1403] T deba6669348248d6a1f1111122e7ad32 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.047s user 0.006s sys 0.002s
W20260318 02:51:20.386055 719 leader_election.cc:343] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:20.386303 719 leader_election.cc:343] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:20.386409 719 leader_election.cc:304] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:20.386682 1219 raft_consensus.cc:2749] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:20.386691 1173 raft_consensus.cc:359] T deba6669348248d6a1f1111122e7ad32 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:20.386806 456 master_service.cc:954] ReplaceTablet: received request to replace tablet 41a152a453fe47d194766635ab586804 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:20.386842 1173 raft_consensus.cc:385] T deba6669348248d6a1f1111122e7ad32 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.386925 1173 raft_consensus.cc:740] T deba6669348248d6a1f1111122e7ad32 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.387146 1173 consensus_queue.cc:260] T deba6669348248d6a1f1111122e7ad32 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:20.387641 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4b07774692544b1c83bc547302b203a5 consensus state has no leader
I20260318 02:51:20.387843 1174 tablet_bootstrap.cc:492] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.387982 1174 ts_tablet_manager.cc:1403] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.028s user 0.011s sys 0.006s
I20260318 02:51:20.388685 1173 ts_tablet_manager.cc:1434] T deba6669348248d6a1f1111122e7ad32 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:20.388685 1174 raft_consensus.cc:359] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.388886 1174 raft_consensus.cc:385] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.388976 1174 raft_consensus.cc:740] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.389225 1174 consensus_queue.cc:260] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.389766 1173 tablet_bootstrap.cc:492] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:20.390349 1174 ts_tablet_manager.cc:1434] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260318 02:51:20.391278 1174 tablet_bootstrap.cc:492] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.391345 1173 tablet_bootstrap.cc:654] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.393643 1173 tablet_bootstrap.cc:492] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:20.393795 1173 ts_tablet_manager.cc:1403] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260318 02:51:20.394373 1173 raft_consensus.cc:359] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.394624 1173 raft_consensus.cc:385] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.394716 1173 raft_consensus.cc:740] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.394937 1173 consensus_queue.cc:260] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.395180 1174 tablet_bootstrap.cc:654] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.395540 1173 ts_tablet_manager.cc:1434] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260318 02:51:20.395912 1173 tablet_bootstrap.cc:492] T cc99bc3332eb48f7a4980533ee71f581 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:20.397869 1173 tablet_bootstrap.cc:654] T cc99bc3332eb48f7a4980533ee71f581 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.399444 1173 tablet_bootstrap.cc:492] T cc99bc3332eb48f7a4980533ee71f581 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:20.399576 1173 ts_tablet_manager.cc:1403] T cc99bc3332eb48f7a4980533ee71f581 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:20.400151 1173 raft_consensus.cc:359] T cc99bc3332eb48f7a4980533ee71f581 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.400297 1173 raft_consensus.cc:385] T cc99bc3332eb48f7a4980533ee71f581 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.400422 1173 raft_consensus.cc:740] T cc99bc3332eb48f7a4980533ee71f581 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.400635 1173 consensus_queue.cc:260] T cc99bc3332eb48f7a4980533ee71f581 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.401506 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7302de3324f84feea6928392c6067ecb" } modify_external_catalogs: true
I20260318 02:51:20.401741 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7302de3324f84feea6928392c6067ecb" } modify_external_catalogs: true
I20260318 02:51:20.402890 1173 ts_tablet_manager.cc:1434] T cc99bc3332eb48f7a4980533ee71f581 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:20.403328 1173 tablet_bootstrap.cc:492] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:20.405256 1173 tablet_bootstrap.cc:654] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.406417 1172 tablet_bootstrap.cc:654] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.408433 1257 tablet.cc:1723] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:20.408635 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_dfa0685fbf9c48549250fd0753f24994" } new_table_name: "default.Table_b388bf244b7b43bf92f91551b05fcef1" modify_external_catalogs: true
I20260318 02:51:20.409991 1174 tablet_bootstrap.cc:492] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.410161 1174 ts_tablet_manager.cc:1403] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.003s
I20260318 02:51:20.411006 1174 raft_consensus.cc:359] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.411202 1174 raft_consensus.cc:385] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.411266 1174 raft_consensus.cc:740] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.411556 1174 consensus_queue.cc:260] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.411675 1172 tablet_bootstrap.cc:492] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:20.412048 1174 ts_tablet_manager.cc:1434] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:20.413306 1172 ts_tablet_manager.cc:1403] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.037s user 0.001s sys 0.004s
I20260318 02:51:20.413455 1258 tablet.cc:1723] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:20.413544 1173 tablet_bootstrap.cc:492] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:20.413719 1173 ts_tablet_manager.cc:1403] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.005s
I20260318 02:51:20.414166 1172 raft_consensus.cc:359] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.414364 1172 raft_consensus.cc:385] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.414450 1172 raft_consensus.cc:740] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.414446 1173 raft_consensus.cc:359] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.414610 1173 raft_consensus.cc:385] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.414690 1173 raft_consensus.cc:740] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.414968 1173 consensus_queue.cc:260] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.415217 1172 consensus_queue.cc:260] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.415443 1173 ts_tablet_manager.cc:1434] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:20.415697 1172 ts_tablet_manager.cc:1434] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:20.415758 1173 tablet_bootstrap.cc:492] T 6a3491e419434075ac4e6fa5881ec537 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:20.416239 1172 tablet_bootstrap.cc:492] T 2d254c168b5746b59ee57a816b53ba69 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:20.417181 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bbf2210842004e098c3fe633c4f2f7d0" } modify_external_catalogs: true
I20260318 02:51:20.417426 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bbf2210842004e098c3fe633c4f2f7d0" } modify_external_catalogs: true
I20260318 02:51:20.417768 1173 tablet_bootstrap.cc:654] T 6a3491e419434075ac4e6fa5881ec537 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.418026 1174 tablet_bootstrap.cc:492] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.419653 1174 tablet_bootstrap.cc:654] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.420137 1173 tablet_bootstrap.cc:492] T 6a3491e419434075ac4e6fa5881ec537 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:20.420246 1173 ts_tablet_manager.cc:1403] T 6a3491e419434075ac4e6fa5881ec537 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260318 02:51:20.421092 1173 raft_consensus.cc:359] T 6a3491e419434075ac4e6fa5881ec537 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.421279 1173 raft_consensus.cc:385] T 6a3491e419434075ac4e6fa5881ec537 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.421372 1173 raft_consensus.cc:740] T 6a3491e419434075ac4e6fa5881ec537 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.421581 1173 consensus_queue.cc:260] T 6a3491e419434075ac4e6fa5881ec537 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.422084 1173 ts_tablet_manager.cc:1434] T 6a3491e419434075ac4e6fa5881ec537 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:20.423328 1173 tablet_bootstrap.cc:492] T b176363ce948489ab05178e5875f2ccd P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:20.423506 1172 tablet_bootstrap.cc:654] T 2d254c168b5746b59ee57a816b53ba69 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.425093 1173 tablet_bootstrap.cc:654] T b176363ce948489ab05178e5875f2ccd P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.425402 1174 tablet_bootstrap.cc:492] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.425560 1174 ts_tablet_manager.cc:1403] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20260318 02:51:20.426390 1174 raft_consensus.cc:359] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.426590 1174 raft_consensus.cc:385] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.426678 1174 raft_consensus.cc:740] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.427014 1173 tablet_bootstrap.cc:492] T b176363ce948489ab05178e5875f2ccd P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:20.426918 1174 consensus_queue.cc:260] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.427150 1173 ts_tablet_manager.cc:1403] T b176363ce948489ab05178e5875f2ccd P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260318 02:51:20.427985 1174 ts_tablet_manager.cc:1434] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:20.427945 1173 raft_consensus.cc:359] T b176363ce948489ab05178e5875f2ccd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.428133 1173 raft_consensus.cc:385] T b176363ce948489ab05178e5875f2ccd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.428205 1173 raft_consensus.cc:740] T b176363ce948489ab05178e5875f2ccd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.428280 1174 tablet_bootstrap.cc:492] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.428454 1173 consensus_queue.cc:260] T b176363ce948489ab05178e5875f2ccd P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.429018 1172 tablet_bootstrap.cc:492] T 2d254c168b5746b59ee57a816b53ba69 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:20.429163 1172 ts_tablet_manager.cc:1403] T 2d254c168b5746b59ee57a816b53ba69 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260318 02:51:20.429541 1173 ts_tablet_manager.cc:1434] T b176363ce948489ab05178e5875f2ccd P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:20.429925 1172 raft_consensus.cc:359] T 2d254c168b5746b59ee57a816b53ba69 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.430114 1172 raft_consensus.cc:385] T 2d254c168b5746b59ee57a816b53ba69 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.430202 1172 raft_consensus.cc:740] T 2d254c168b5746b59ee57a816b53ba69 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.430400 1172 consensus_queue.cc:260] T 2d254c168b5746b59ee57a816b53ba69 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.430531 1173 tablet_bootstrap.cc:492] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:20.430915 1172 ts_tablet_manager.cc:1434] T 2d254c168b5746b59ee57a816b53ba69 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:20.431183 1172 tablet_bootstrap.cc:492] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:20.432334 1173 tablet_bootstrap.cc:654] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.432830 1172 tablet_bootstrap.cc:654] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.434530 1173 tablet_bootstrap.cc:492] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:20.434645 1173 ts_tablet_manager.cc:1403] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260318 02:51:20.435194 1173 raft_consensus.cc:359] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.435320 1174 tablet_bootstrap.cc:654] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.435359 1173 raft_consensus.cc:385] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.435451 1173 raft_consensus.cc:740] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.435698 1173 consensus_queue.cc:260] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.437958 1173 ts_tablet_manager.cc:1434] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:20.438671 1173 tablet_bootstrap.cc:492] T 41c97f254ae94de3bb0c03db72fb7df0 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:20.440552 1173 tablet_bootstrap.cc:654] T 41c97f254ae94de3bb0c03db72fb7df0 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.447810 1174 tablet_bootstrap.cc:492] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.448011 1174 ts_tablet_manager.cc:1403] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.006s
I20260318 02:51:20.448256 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_68f3e929e48949f1a9f426d64cb46006" } modify_external_catalogs: true
I20260318 02:51:20.448475 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_68f3e929e48949f1a9f426d64cb46006" } modify_external_catalogs: true
I20260318 02:51:20.448835 1174 raft_consensus.cc:359] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.449028 1174 raft_consensus.cc:385] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.449103 1174 raft_consensus.cc:740] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.449481 1174 consensus_queue.cc:260] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.451702 1174 ts_tablet_manager.cc:1434] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:20.452054 1174 tablet_bootstrap.cc:492] T 1ad59f4f5db8424a900b36e060745aa6 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.454510 762 tablet_service.cc:1511] Processing CreateTablet for tablet c23b646a132743cc9b4dcd85c6d4ebea (DEFAULT_TABLE table=default.Table_480631505a694fa2846e96ba417fcb1f [id=fbcfb142ee75458b9f3008dcc9c7e06d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.454974 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23b646a132743cc9b4dcd85c6d4ebea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.455276 1174 tablet_bootstrap.cc:654] T 1ad59f4f5db8424a900b36e060745aa6 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.459236 907 tablet_service.cc:1511] Processing CreateTablet for tablet c23b646a132743cc9b4dcd85c6d4ebea (DEFAULT_TABLE table=default.Table_480631505a694fa2846e96ba417fcb1f [id=fbcfb142ee75458b9f3008dcc9c7e06d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.459705 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23b646a132743cc9b4dcd85c6d4ebea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.459780 900 tablet_service.cc:1511] Processing CreateTablet for tablet 22caed5f1870469d834aecd2bc42bdda (DEFAULT_TABLE table=default.Table_55055e0c8594404ba26ad75b0c9eeced [id=72b1b06a17254473bb4ccdf27bb3d4f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.460085 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22caed5f1870469d834aecd2bc42bdda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.464748 451 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 1766ce95009b4c3f9940ebcf10503c7f (table default.Table_1a4739276dd74553a2497da27d9f4f83 [id=1c0082e294dd43cdb2eb4ed335ff3c06]). Expected version 2 got 0
I20260318 02:51:20.465022 451 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 6a3491e419434075ac4e6fa5881ec537 (table default.Table_bbf2210842004e098c3fe633c4f2f7d0 [id=06e124bab0a04572bab0c3c008b7d218]). Expected version 1 got 0
I20260318 02:51:20.465018 904 tablet_service.cc:1511] Processing CreateTablet for tablet f7415ddf48574f7b9a746049ce78d2e9 (DEFAULT_TABLE table=default.Table_ac694c873ef141579c82755592552b23 [id=a004400b026145a5be338b0b2e4b8ce3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.465374 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7415ddf48574f7b9a746049ce78d2e9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:20.465744 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1ed26420c64492a94e8920d8c753fc3 consensus state has no leader
I20260318 02:51:20.468158 1173 tablet_bootstrap.cc:492] T 41c97f254ae94de3bb0c03db72fb7df0 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:20.468324 1173 ts_tablet_manager.cc:1403] T 41c97f254ae94de3bb0c03db72fb7df0 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.030s user 0.012s sys 0.008s
I20260318 02:51:20.468997 902 tablet_service.cc:1511] Processing CreateTablet for tablet 0ea4a57dc67e407f9c93679cb2053557 (DEFAULT_TABLE table=default.Table_d4cb7a1606894513a0f1074bedc22ef9 [id=4067c18ce85f44d7993786a3e9bda883]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.469226 1173 raft_consensus.cc:359] T 41c97f254ae94de3bb0c03db72fb7df0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.469368 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea4a57dc67e407f9c93679cb2053557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.469422 1173 raft_consensus.cc:385] T 41c97f254ae94de3bb0c03db72fb7df0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.469489 1173 raft_consensus.cc:740] T 41c97f254ae94de3bb0c03db72fb7df0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.469748 1173 consensus_queue.cc:260] T 41c97f254ae94de3bb0c03db72fb7df0 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.469868 449 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 1766ce95009b4c3f9940ebcf10503c7f (table default.Table_1a4739276dd74553a2497da27d9f4f83 [id=1c0082e294dd43cdb2eb4ed335ff3c06]). Expected version 2 got 1
I20260318 02:51:20.471019 1173 ts_tablet_manager.cc:1434] T 41c97f254ae94de3bb0c03db72fb7df0 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:20.471349 1173 tablet_bootstrap.cc:492] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:20.473003 1173 tablet_bootstrap.cc:654] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:20.473052 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2304246c244407b9d4eb301ac5d7ba9 consensus state has no leader
I20260318 02:51:20.473003 903 tablet_service.cc:1511] Processing CreateTablet for tablet 9e421d3fe62b4985bfe0486a4b115b2a (DEFAULT_TABLE table=default.Table_19fe141c13934c04bd511b36fab6ab36 [id=5d7200a0ff764b1885c2c18bc7289e1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.473373 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e421d3fe62b4985bfe0486a4b115b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.473457 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2faebbd7206f45ebb8c858d1a5936cb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:20.474058 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2faebbd7206f45ebb8c858d1a5936cb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.476234 905 tablet_service.cc:1511] Processing CreateTablet for tablet 053a09fd13fa4d8e80133fd77acaa4ce (DEFAULT_TABLE table=default.Table_6da40d0a67f342ff867f3660f2a289ba [id=3a77e587db534e32b2716d153a8419cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.476660 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 053a09fd13fa4d8e80133fd77acaa4ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.479161 418 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu
/tmp/dist-test-taskvjTIu6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.104.188:41593
--webserver_interface=127.0.104.188
--webserver_port=37041
--builtin_ntp_servers=127.0.104.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.104.190:39451,127.0.104.189:45933,127.0.104.188:41593
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260318 02:51:20.491223 1038 tablet_service.cc:1511] Processing CreateTablet for tablet c23b646a132743cc9b4dcd85c6d4ebea (DEFAULT_TABLE table=default.Table_480631505a694fa2846e96ba417fcb1f [id=fbcfb142ee75458b9f3008dcc9c7e06d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.491770 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23b646a132743cc9b4dcd85c6d4ebea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.492898 766 tablet_service.cc:1511] Processing CreateTablet for tablet f7415ddf48574f7b9a746049ce78d2e9 (DEFAULT_TABLE table=default.Table_ac694c873ef141579c82755592552b23 [id=a004400b026145a5be338b0b2e4b8ce3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.493332 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7415ddf48574f7b9a746049ce78d2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.494151 764 tablet_service.cc:1511] Processing CreateTablet for tablet 0ea4a57dc67e407f9c93679cb2053557 (DEFAULT_TABLE table=default.Table_d4cb7a1606894513a0f1074bedc22ef9 [id=4067c18ce85f44d7993786a3e9bda883]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.494578 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea4a57dc67e407f9c93679cb2053557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.496129 763 tablet_service.cc:1511] Processing CreateTablet for tablet 22caed5f1870469d834aecd2bc42bdda (DEFAULT_TABLE table=default.Table_55055e0c8594404ba26ad75b0c9eeced [id=72b1b06a17254473bb4ccdf27bb3d4f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.496551 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22caed5f1870469d834aecd2bc42bdda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.499634 1040 tablet_service.cc:1511] Processing CreateTablet for tablet f7415ddf48574f7b9a746049ce78d2e9 (DEFAULT_TABLE table=default.Table_ac694c873ef141579c82755592552b23 [id=a004400b026145a5be338b0b2e4b8ce3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.500105 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7415ddf48574f7b9a746049ce78d2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.500121 761 tablet_service.cc:1511] Processing CreateTablet for tablet 9e421d3fe62b4985bfe0486a4b115b2a (DEFAULT_TABLE table=default.Table_19fe141c13934c04bd511b36fab6ab36 [id=5d7200a0ff764b1885c2c18bc7289e1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.500507 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e421d3fe62b4985bfe0486a4b115b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.521409 1219 raft_consensus.cc:493] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:20.521651 1219 raft_consensus.cc:515] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.522330 1219 leader_election.cc:290] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:20.523397 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af760ed8ff14a498e751e67550cb1ac" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:20.524066 719 leader_election.cc:343] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:20.528882 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af760ed8ff14a498e751e67550cb1ac" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:20.529604 719 leader_election.cc:343] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:20.529781 719 leader_election.cc:304] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:20.530234 1219 raft_consensus.cc:2749] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:20.531997 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 76fc930611024211a70301bcfd92884e
I20260318 02:51:20.533088 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 76fc930611024211a70301bcfd92884e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.533354 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1bf6b42fe89741b19856a55be8811420"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:20.533988 441 catalog_manager.cc:4969] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 76fc930611024211a70301bcfd92884e because the tablet was not found. No further retry: Not found: Tablet not found: 76fc930611024211a70301bcfd92884e
I20260318 02:51:20.534046 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 76fc930611024211a70301bcfd92884e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:20.534446 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1bf6b42fe89741b19856a55be8811420 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:20.534730 443 catalog_manager.cc:4969] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 76fc930611024211a70301bcfd92884e because the tablet was not found. No further retry: Not found: Tablet not found: 76fc930611024211a70301bcfd92884e
I20260318 02:51:20.534850 1173 tablet_bootstrap.cc:492] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:20.534989 1173 ts_tablet_manager.cc:1403] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.064s user 0.005s sys 0.012s
I20260318 02:51:20.535799 1173 raft_consensus.cc:359] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:20.535997 1173 raft_consensus.cc:385] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.536084 1173 raft_consensus.cc:740] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.536329 1173 consensus_queue.cc:260] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:20.537969 907 tablet_service.cc:1511] Processing CreateTablet for tablet 4dadf0fc6e134edd87788dd4ade59dc5 (DEFAULT_TABLE table=default.Table_0d969a129e064d118a5bd11a6f34b8f1 [id=c8d7ee2f33154a1fbc8d7c7f6fb7e3a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.538364 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dadf0fc6e134edd87788dd4ade59dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.541234 905 tablet_service.cc:1511] Processing CreateTablet for tablet 76fc930611024211a70301bcfd92884e (DEFAULT_TABLE table=default.Table_68f3e929e48949f1a9f426d64cb46006 [id=7fda019fe63e4e5995aeb77e4cf70dec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.541683 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76fc930611024211a70301bcfd92884e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.542713 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 9e421d3fe62b4985bfe0486a4b115b2a (DEFAULT_TABLE table=default.Table_19fe141c13934c04bd511b36fab6ab36 [id=5d7200a0ff764b1885c2c18bc7289e1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.542927 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 4dadf0fc6e134edd87788dd4ade59dc5 (DEFAULT_TABLE table=default.Table_0d969a129e064d118a5bd11a6f34b8f1 [id=c8d7ee2f33154a1fbc8d7c7f6fb7e3a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.543164 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e421d3fe62b4985bfe0486a4b115b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.543411 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dadf0fc6e134edd87788dd4ade59dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.543708 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 053a09fd13fa4d8e80133fd77acaa4ce (DEFAULT_TABLE table=default.Table_6da40d0a67f342ff867f3660f2a289ba [id=3a77e587db534e32b2716d153a8419cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.544075 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 053a09fd13fa4d8e80133fd77acaa4ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.544994 903 tablet_service.cc:1511] Processing CreateTablet for tablet 549b3929ea33417bbe50e749bbfe223d (DEFAULT_TABLE table=default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.545367 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 549b3929ea33417bbe50e749bbfe223d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.548934 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 76fc930611024211a70301bcfd92884e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.549445 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 76fc930611024211a70301bcfd92884e (DEFAULT_TABLE table=default.Table_68f3e929e48949f1a9f426d64cb46006 [id=7fda019fe63e4e5995aeb77e4cf70dec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.549726 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 549b3929ea33417bbe50e749bbfe223d (DEFAULT_TABLE table=default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.549867 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76fc930611024211a70301bcfd92884e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.550169 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 549b3929ea33417bbe50e749bbfe223d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.553884 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4719eafd2947bfacf3e1d2df1ae43e (DEFAULT_TABLE table=default.Table_e88f9eedc9d549e7bd8e8fb34e721a44 [id=33a7b2fdc7094616a94fa59f370e1728]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.554379 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4719eafd2947bfacf3e1d2df1ae43e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:20.557507 441 catalog_manager.cc:4969] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 76fc930611024211a70301bcfd92884e because the tablet was not found. No further retry: Not found: Tablet not found: 76fc930611024211a70301bcfd92884e
I20260318 02:51:20.566885 763 tablet_service.cc:1511] Processing CreateTablet for tablet 4dadf0fc6e134edd87788dd4ade59dc5 (DEFAULT_TABLE table=default.Table_0d969a129e064d118a5bd11a6f34b8f1 [id=c8d7ee2f33154a1fbc8d7c7f6fb7e3a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.569777 766 tablet_service.cc:1511] Processing CreateTablet for tablet 053a09fd13fa4d8e80133fd77acaa4ce (DEFAULT_TABLE table=default.Table_6da40d0a67f342ff867f3660f2a289ba [id=3a77e587db534e32b2716d153a8419cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.572435 761 tablet_service.cc:1511] Processing CreateTablet for tablet 76fc930611024211a70301bcfd92884e (DEFAULT_TABLE table=default.Table_68f3e929e48949f1a9f426d64cb46006 [id=7fda019fe63e4e5995aeb77e4cf70dec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.572664 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dadf0fc6e134edd87788dd4ade59dc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.575711 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 7e4e8586673c43058ef00f2f7aef10ee
I20260318 02:51:20.576500 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_39cfb7dac1634b1285361e7ac3735f7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:20.576853 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76fc930611024211a70301bcfd92884e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.577070 764 tablet_service.cc:1511] Processing CreateTablet for tablet 549b3929ea33417bbe50e749bbfe223d (DEFAULT_TABLE table=default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:20.577168 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39cfb7dac1634b1285361e7ac3735f7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.577522 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 549b3929ea33417bbe50e749bbfe223d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.579093 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e4e8586673c43058ef00f2f7aef10ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:20.579890 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 7e4e8586673c43058ef00f2f7aef10ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e4e8586673c43058ef00f2f7aef10ee already in progress: creating tablet
I20260318 02:51:20.580322 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b176363ce948489ab05178e5875f2ccd
I20260318 02:51:20.580844 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 053a09fd13fa4d8e80133fd77acaa4ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.581283 762 tablet_service.cc:1558] Processing DeleteTablet for tablet b176363ce948489ab05178e5875f2ccd with delete_type TABLET_DATA_DELETED (replaced by tablet 74233fd7ed094e7cbfc79309605db0e1) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.581579 1176 tablet_replica.cc:333] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:20.581796 1176 raft_consensus.cc:2243] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.581971 1176 raft_consensus.cc:2272] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.582999 1176 ts_tablet_manager.cc:1916] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.586728 1260 tablet.cc:1723] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:20.588353 765 tablet_service.cc:1511] Processing CreateTablet for tablet 96a854e3872c44e4863316c9fe5f2ee9 (DEFAULT_TABLE table=default.Table_d548901cf2e74047a18ea1460ce6fc34 [id=570322e5437b4a58b560833ee1f0f9bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.588829 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a854e3872c44e4863316c9fe5f2ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.588913 1173 ts_tablet_manager.cc:1434] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.054s user 0.002s sys 0.001s
I20260318 02:51:20.590394 760 tablet_service.cc:1511] Processing CreateTablet for tablet e2304246c244407b9d4eb301ac5d7ba9 (DEFAULT_TABLE table=default.Table_b388bf244b7b43bf92f91551b05fcef1 [id=20ed812002544f6f8caef448f7514f7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.590909 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2304246c244407b9d4eb301ac5d7ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.593394 762 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4719eafd2947bfacf3e1d2df1ae43e (DEFAULT_TABLE table=default.Table_e88f9eedc9d549e7bd8e8fb34e721a44 [id=33a7b2fdc7094616a94fa59f370e1728]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.594594 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4719eafd2947bfacf3e1d2df1ae43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.597846 1173 tablet_bootstrap.cc:492] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:20.599687 1173 tablet_bootstrap.cc:654] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.602437 457 catalog_manager.cc:6741] ReplaceTablet: tablet b176363ce948489ab05178e5875f2ccd deleted and replaced by tablet 74233fd7ed094e7cbfc79309605db0e1
I20260318 02:51:20.602881 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_422656b6b8b4438e9d2000352503c6b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:20.603880 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 54bffc30199246fd93edf7486b2e3a91
I20260318 02:51:20.604569 448 master_service.cc:954] ReplaceTablet: received request to replace tablet 54bffc30199246fd93edf7486b2e3a91 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:20.606057 763 tablet_service.cc:1511] Processing CreateTablet for tablet f1ed26420c64492a94e8920d8c753fc3 (DEFAULT_TABLE table=default.Table_470fd4c570c843b395575045c9ac1bf2 [id=50ab4db1dbeb4c6a90b33535047daa51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.606464 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ed26420c64492a94e8920d8c753fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.608886 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e4e8586673c43058ef00f2f7aef10ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.609048 1174 tablet_bootstrap.cc:492] T 1ad59f4f5db8424a900b36e060745aa6 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.609205 1174 ts_tablet_manager.cc:1403] T 1ad59f4f5db8424a900b36e060745aa6 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.157s user 0.011s sys 0.044s
I20260318 02:51:20.609443 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e4e8586673c43058ef00f2f7aef10ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.609907 448 master_service.cc:954] ReplaceTablet: received request to replace tablet 9593cb3d940c42918056a222313c7adb from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:20.610001 1174 raft_consensus.cc:359] T 1ad59f4f5db8424a900b36e060745aa6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.610175 1174 raft_consensus.cc:385] T 1ad59f4f5db8424a900b36e060745aa6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.610262 1174 raft_consensus.cc:740] T 1ad59f4f5db8424a900b36e060745aa6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.610564 1174 consensus_queue.cc:260] T 1ad59f4f5db8424a900b36e060745aa6 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.611150 1174 ts_tablet_manager.cc:1434] T 1ad59f4f5db8424a900b36e060745aa6 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:20.611449 1174 tablet_bootstrap.cc:492] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.611367 907 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4719eafd2947bfacf3e1d2df1ae43e (DEFAULT_TABLE table=default.Table_e88f9eedc9d549e7bd8e8fb34e721a44 [id=33a7b2fdc7094616a94fa59f370e1728]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.611680 905 tablet_service.cc:1511] Processing CreateTablet for tablet f1ed26420c64492a94e8920d8c753fc3 (DEFAULT_TABLE table=default.Table_470fd4c570c843b395575045c9ac1bf2 [id=50ab4db1dbeb4c6a90b33535047daa51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.611796 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4719eafd2947bfacf3e1d2df1ae43e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.612007 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ed26420c64492a94e8920d8c753fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.612478 1043 tablet_service.cc:1511] Processing CreateTablet for tablet e2304246c244407b9d4eb301ac5d7ba9 (DEFAULT_TABLE table=default.Table_b388bf244b7b43bf92f91551b05fcef1 [id=20ed812002544f6f8caef448f7514f7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.612506 1039 tablet_service.cc:1511] Processing CreateTablet for tablet f1ed26420c64492a94e8920d8c753fc3 (DEFAULT_TABLE table=default.Table_470fd4c570c843b395575045c9ac1bf2 [id=50ab4db1dbeb4c6a90b33535047daa51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.613021 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ed26420c64492a94e8920d8c753fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.613247 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2304246c244407b9d4eb301ac5d7ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.614465 1172 tablet_bootstrap.cc:492] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:20.614737 1172 ts_tablet_manager.cc:1403] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.184s user 0.013s sys 0.052s
I20260318 02:51:20.615698 904 tablet_service.cc:1511] Processing CreateTablet for tablet e2304246c244407b9d4eb301ac5d7ba9 (DEFAULT_TABLE table=default.Table_b388bf244b7b43bf92f91551b05fcef1 [id=20ed812002544f6f8caef448f7514f7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.615703 1172 raft_consensus.cc:359] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.615895 1172 raft_consensus.cc:385] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.615964 1172 raft_consensus.cc:740] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.616106 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2304246c244407b9d4eb301ac5d7ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.616269 1172 consensus_queue.cc:260] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:20.616986 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_422656b6b8b4438e9d2000352503c6b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.618741 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_14259137e6e74c67b7abb92cb2e953d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:20.619309 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14259137e6e74c67b7abb92cb2e953d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.620020 1172 ts_tablet_manager.cc:1434] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260318 02:51:20.620971 902 tablet_service.cc:1558] Processing DeleteTablet for tablet b176363ce948489ab05178e5875f2ccd with delete_type TABLET_DATA_DELETED (replaced by tablet 74233fd7ed094e7cbfc79309605db0e1) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.621209 1175 tablet_replica.cc:333] T b176363ce948489ab05178e5875f2ccd P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:20.621405 1175 raft_consensus.cc:2243] T b176363ce948489ab05178e5875f2ccd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.611367 903 tablet_service.cc:1511] Processing CreateTablet for tablet 96a854e3872c44e4863316c9fe5f2ee9 (DEFAULT_TABLE table=default.Table_d548901cf2e74047a18ea1460ce6fc34 [id=570322e5437b4a58b560833ee1f0f9bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.621580 1175 raft_consensus.cc:2272] T b176363ce948489ab05178e5875f2ccd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.623296 1172 tablet_bootstrap.cc:492] T deba6669348248d6a1f1111122e7ad32 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:20.624035 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a854e3872c44e4863316c9fe5f2ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.624490 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet b176363ce948489ab05178e5875f2ccd with delete_type TABLET_DATA_DELETED (replaced by tablet 74233fd7ed094e7cbfc79309605db0e1) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.625296 1172 tablet_bootstrap.cc:654] T deba6669348248d6a1f1111122e7ad32 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.625967 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 54bffc30199246fd93edf7486b2e3a91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:20.625974 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 7e4e8586673c43058ef00f2f7aef10ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e4e8586673c43058ef00f2f7aef10ee already in progress: creating tablet
W20260318 02:51:20.626271 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet b176363ce948489ab05178e5875f2ccd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b176363ce948489ab05178e5875f2ccd already in progress: creating tablet
W20260318 02:51:20.626571 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 7e4e8586673c43058ef00f2f7aef10ee because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e4e8586673c43058ef00f2f7aef10ee already in progress: creating tablet
I20260318 02:51:20.627386 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet 54bffc30199246fd93edf7486b2e3a91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.625273 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 96a854e3872c44e4863316c9fe5f2ee9 (DEFAULT_TABLE table=default.Table_d548901cf2e74047a18ea1460ce6fc34 [id=570322e5437b4a58b560833ee1f0f9bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.628271 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a854e3872c44e4863316c9fe5f2ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.629159 1174 tablet_bootstrap.cc:654] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.629278 1175 ts_tablet_manager.cc:1916] T b176363ce948489ab05178e5875f2ccd P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.631556 1228 raft_consensus.cc:493] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:20.631711 1228 raft_consensus.cc:515] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.632408 1228 leader_election.cc:290] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:20.633122 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96e77189d37484289fc83285f23e80d" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:20.633337 785 raft_consensus.cc:2468] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:20.633785 862 leader_election.cc:304] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:20.634063 1228 raft_consensus.cc:2804] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:20.634164 1228 raft_consensus.cc:493] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:20.634253 1228 raft_consensus.cc:3060] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:20.637648 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96e77189d37484289fc83285f23e80d" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:20.638393 860 leader_election.cc:343] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:20.639534 1175 ts_tablet_manager.cc:1929] T b176363ce948489ab05178e5875f2ccd P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.639686 1175 log.cc:1199] T b176363ce948489ab05178e5875f2ccd P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/b176363ce948489ab05178e5875f2ccd
I20260318 02:51:20.639861 1174 tablet_bootstrap.cc:492] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.640031 1175 ts_tablet_manager.cc:1950] T b176363ce948489ab05178e5875f2ccd P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:20.640045 1174 ts_tablet_manager.cc:1403] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.000s
I20260318 02:51:20.640437 1176 ts_tablet_manager.cc:1929] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.646101 1228 raft_consensus.cc:515] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.647197 1228 leader_election.cc:290] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:20.647332 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96e77189d37484289fc83285f23e80d" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
W20260318 02:51:20.647921 860 leader_election.cc:343] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:20.659755 1172 tablet_bootstrap.cc:492] T deba6669348248d6a1f1111122e7ad32 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:20.659945 1172 ts_tablet_manager.cc:1403] T deba6669348248d6a1f1111122e7ad32 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.037s user 0.013s sys 0.009s
I20260318 02:51:20.660104 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 1ad59f4f5db8424a900b36e060745aa6
I20260318 02:51:20.660784 1172 raft_consensus.cc:359] T deba6669348248d6a1f1111122e7ad32 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:20.661000 1172 raft_consensus.cc:385] T deba6669348248d6a1f1111122e7ad32 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.661092 1172 raft_consensus.cc:740] T deba6669348248d6a1f1111122e7ad32 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.661340 1172 consensus_queue.cc:260] T deba6669348248d6a1f1111122e7ad32 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:20.661723 454 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_1a4739276dd74553a2497da27d9f4f83 [id=1c0082e294dd43cdb2eb4ed335ff3c06] alter complete (version 2)
I20260318 02:51:20.665179 1172 ts_tablet_manager.cc:1434] T deba6669348248d6a1f1111122e7ad32 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260318 02:51:20.668334 1172 tablet_bootstrap.cc:492] T f96e77189d37484289fc83285f23e80d P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:20.670257 1172 tablet_bootstrap.cc:654] T f96e77189d37484289fc83285f23e80d P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.671401 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 6a3491e419434075ac4e6fa5881ec537
W20260318 02:51:20.677438 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 54bffc30199246fd93edf7486b2e3a91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54bffc30199246fd93edf7486b2e3a91 already in progress: creating tablet
I20260318 02:51:20.678689 1172 tablet_bootstrap.cc:492] T f96e77189d37484289fc83285f23e80d P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:20.678893 1172 ts_tablet_manager.cc:1403] T f96e77189d37484289fc83285f23e80d P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.001s
I20260318 02:51:20.679713 1172 raft_consensus.cc:359] T f96e77189d37484289fc83285f23e80d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.679912 1172 raft_consensus.cc:385] T f96e77189d37484289fc83285f23e80d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.679982 1172 raft_consensus.cc:740] T f96e77189d37484289fc83285f23e80d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.680250 1172 consensus_queue.cc:260] T f96e77189d37484289fc83285f23e80d P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.684144 1172 ts_tablet_manager.cc:1434] T f96e77189d37484289fc83285f23e80d P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260318 02:51:20.687089 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet b176363ce948489ab05178e5875f2ccd (table default.Table_e56aadd2977f4c5e816768f78d70ba61 [id=f6d13c14fec24bc8894ebd60b88fca77]) successfully deleted
I20260318 02:51:20.689497 1172 tablet_bootstrap.cc:492] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:20.685397 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9cc80dda475640989a3e3c6f37b35831"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:20.691691 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 54bffc30199246fd93edf7486b2e3a91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54bffc30199246fd93edf7486b2e3a91 already in progress: creating tablet
W20260318 02:51:20.692533 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9cc80dda475640989a3e3c6f37b35831 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.692663 1043 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ad59f4f5db8424a900b36e060745aa6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.677775 451 master_service.cc:954] ReplaceTablet: received request to replace tablet cc99bc3332eb48f7a4980533ee71f581 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:20.694468 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_edbae2d50973420e97cce96b373081db" } new_table_name: "default.Table_6649f615bb3d4590bb3ff395d88019cb" modify_external_catalogs: true
I20260318 02:51:20.687419 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1e6ea5dc81d34a03b5135f4caeef56f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:20.696096 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 22caed5f1870469d834aecd2bc42bdda (DEFAULT_TABLE table=default.Table_55055e0c8594404ba26ad75b0c9eeced [id=72b1b06a17254473bb4ccdf27bb3d4f1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:20.696203 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e6ea5dc81d34a03b5135f4caeef56f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.687773 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_aa09b8ff832f4507b7a423914cc89b1f" } new_table_name: "default.Table_6a5db8c928804fa283f723cd481e8e8d" modify_external_catalogs: true
I20260318 02:51:20.688047 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3a4bc21a576546c9be4d3e0f9bdfb32b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:20.697762 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a4bc21a576546c9be4d3e0f9bdfb32b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.698589 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22caed5f1870469d834aecd2bc42bdda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.699941 1172 tablet_bootstrap.cc:654] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.640975 1174 raft_consensus.cc:359] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:20.646885 1219 raft_consensus.cc:493] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:20.700886 1174 raft_consensus.cc:385] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.700985 1174 raft_consensus.cc:740] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.701012 1219 raft_consensus.cc:515] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.701263 1174 consensus_queue.cc:260] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:20.701699 1219 leader_election.cc:290] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:20.701879 1219 raft_consensus.cc:493] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:20.702028 1219 raft_consensus.cc:515] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.702620 1219 leader_election.cc:290] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:20.647325 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96e77189d37484289fc83285f23e80d" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:20.647480 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 54bffc30199246fd93edf7486b2e3a91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.674520 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ff8e4571d0a47ae984a918f17ba1d6b with delete_type TABLET_DATA_DELETED (replaced by tablet f1ed26420c64492a94e8920d8c753fc3) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.704449 785 raft_consensus.cc:3060] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:20.689868 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ad59f4f5db8424a900b36e060745aa6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.693240 765 tablet_service.cc:1558] Processing DeleteTablet for tablet f96e77189d37484289fc83285f23e80d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.706245 1174 ts_tablet_manager.cc:1434] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.066s user 0.005s sys 0.000s
I20260318 02:51:20.706640 1174 tablet_bootstrap.cc:492] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.708026 785 raft_consensus.cc:2468] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:20.708551 1174 tablet_bootstrap.cc:654] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.708585 862 leader_election.cc:304] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:20.709075 1228 raft_consensus.cc:2804] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:20.709205 1228 raft_consensus.cc:697] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:20.709460 1228 consensus_queue.cc:237] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.711179 1172 tablet_bootstrap.cc:492] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:20.711341 1172 ts_tablet_manager.cc:1403] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.006s
I20260318 02:51:20.712154 1172 raft_consensus.cc:359] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.712353 1172 raft_consensus.cc:385] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.712460 1172 raft_consensus.cc:740] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.712560 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 0ea4a57dc67e407f9c93679cb2053557 (DEFAULT_TABLE table=default.Table_d4cb7a1606894513a0f1074bedc22ef9 [id=4067c18ce85f44d7993786a3e9bda883]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.712736 1288 raft_consensus.cc:493] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:20.712881 1288 raft_consensus.cc:515] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.713204 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea4a57dc67e407f9c93679cb2053557. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.713590 1288 leader_election.cc:290] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:20.713907 1172 consensus_queue.cc:260] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.697961 1287 raft_consensus.cc:493] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:20.698071 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a3491e419434075ac4e6fa5881ec537 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.717150 1287 raft_consensus.cc:515] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.716921 1176 log.cc:1199] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/b176363ce948489ab05178e5875f2ccd
I20260318 02:51:20.717880 1172 ts_tablet_manager.cc:1434] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260318 02:51:20.718012 1287 leader_election.cc:290] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:20.718238 1176 ts_tablet_manager.cc:1950] T b176363ce948489ab05178e5875f2ccd P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:20.719367 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet b176363ce948489ab05178e5875f2ccd (table default.Table_e56aadd2977f4c5e816768f78d70ba61 [id=f6d13c14fec24bc8894ebd60b88fca77]) successfully deleted
W20260318 02:51:20.720281 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 54bffc30199246fd93edf7486b2e3a91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54bffc30199246fd93edf7486b2e3a91 already in progress: creating tablet
I20260318 02:51:20.720728 1176 tablet_replica.cc:333] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:20.720953 1176 raft_consensus.cc:2243] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.721050 1172 tablet_bootstrap.cc:492] T 0ef71cea07cf42dea6cf96a5341542b3 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:20.721263 1176 raft_consensus.cc:2272] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.722431 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ad59f4f5db8424a900b36e060745aa6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.722918 1172 tablet_bootstrap.cc:654] T 0ef71cea07cf42dea6cf96a5341542b3 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.723520 903 tablet_service.cc:1558] Processing DeleteTablet for tablet deba6669348248d6a1f1111122e7ad32 with delete_type TABLET_DATA_DELETED (replaced by tablet 53502a8e2d184b7ea7fa575d4836f0ea) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.723520 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 9593cb3d940c42918056a222313c7adb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.723811 1175 tablet_replica.cc:333] T deba6669348248d6a1f1111122e7ad32 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:20.723969 1175 raft_consensus.cc:2243] T deba6669348248d6a1f1111122e7ad32 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.724126 1175 raft_consensus.cc:2272] T deba6669348248d6a1f1111122e7ad32 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.724761 1176 ts_tablet_manager.cc:1916] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:20.724803 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 1ad59f4f5db8424a900b36e060745aa6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ad59f4f5db8424a900b36e060745aa6 already in progress: creating tablet
I20260318 02:51:20.724850 1175 ts_tablet_manager.cc:1916] T deba6669348248d6a1f1111122e7ad32 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.724982 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a3491e419434075ac4e6fa5881ec537 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:20.725327 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 1ad59f4f5db8424a900b36e060745aa6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ad59f4f5db8424a900b36e060745aa6 already in progress: creating tablet
I20260318 02:51:20.731568 1175 ts_tablet_manager.cc:1929] T deba6669348248d6a1f1111122e7ad32 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.731763 1175 log.cc:1199] T deba6669348248d6a1f1111122e7ad32 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/deba6669348248d6a1f1111122e7ad32
I20260318 02:51:20.732358 1176 ts_tablet_manager.cc:1929] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.732555 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a3491e419434075ac4e6fa5881ec537 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.732836 1175 ts_tablet_manager.cc:1950] T deba6669348248d6a1f1111122e7ad32 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:20.733397 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d254c168b5746b59ee57a816b53ba69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.733656 1184 tablet_replica.cc:333] T 2d254c168b5746b59ee57a816b53ba69 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:20.733863 1184 raft_consensus.cc:2243] T 2d254c168b5746b59ee57a816b53ba69 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.734056 1184 raft_consensus.cc:2272] T 2d254c168b5746b59ee57a816b53ba69 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.734539 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a81d51587eb4e5cab9fb61bf7f524a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.734794 1176 log.cc:1199] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/2ff8e4571d0a47ae984a918f17ba1d6b
I20260318 02:51:20.734987 1184 ts_tablet_manager.cc:1916] T 2d254c168b5746b59ee57a816b53ba69 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.735323 1176 ts_tablet_manager.cc:1950] T 2ff8e4571d0a47ae984a918f17ba1d6b P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:20.737087 1228 raft_consensus.cc:493] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:20.737282 1176 tablet_replica.cc:333] T 1ad59f4f5db8424a900b36e060745aa6 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:20.737268 1228 raft_consensus.cc:515] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.737474 1176 raft_consensus.cc:2243] T 1ad59f4f5db8424a900b36e060745aa6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.737439 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 2ff8e4571d0a47ae984a918f17ba1d6b (table default.Table_470fd4c570c843b395575045c9ac1bf2 [id=50ab4db1dbeb4c6a90b33535047daa51]) successfully deleted
I20260318 02:51:20.737892 1228 leader_election.cc:290] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:20.738583 1176 raft_consensus.cc:2272] T 1ad59f4f5db8424a900b36e060745aa6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.738935 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ff8e4571d0a47ae984a918f17ba1d6b" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:20.739169 1190 raft_consensus.cc:493] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:20.739324 1190 raft_consensus.cc:515] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.740027 1190 leader_election.cc:290] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:20.740307 1174 tablet_bootstrap.cc:492] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.740468 1174 ts_tablet_manager.cc:1403] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.000s
W20260318 02:51:20.740839 862 leader_election.cc:343] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2ff8e4571d0a47ae984a918f17ba1d6b
I20260318 02:51:20.740919 1176 ts_tablet_manager.cc:1916] T 1ad59f4f5db8424a900b36e060745aa6 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:20.741194 860 leader_election.cc:343] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:20.741243 1174 raft_consensus.cc:359] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.741315 860 leader_election.cc:304] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:20.741425 1174 raft_consensus.cc:385] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.741500 1184 ts_tablet_manager.cc:1929] T 2d254c168b5746b59ee57a816b53ba69 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.741514 1174 raft_consensus.cc:740] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.741601 1184 log.cc:1199] T 2d254c168b5746b59ee57a816b53ba69 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/2d254c168b5746b59ee57a816b53ba69
I20260318 02:51:20.741796 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee07c93213d44d9bb156d9ad7937facf" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:20.741772 1174 consensus_queue.cc:260] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.741989 1184 ts_tablet_manager.cc:1950] T 2d254c168b5746b59ee57a816b53ba69 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:20.742228 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee07c93213d44d9bb156d9ad7937facf" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:20.742457 927 raft_consensus.cc:2393] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9422bb7011f342b08be0b073a88c4c4d in current term 1: Already voted for candidate 6a903d876086423b8016d705b98895ad in this term.
I20260318 02:51:20.742909 1175 tablet_replica.cc:333] T 9593cb3d940c42918056a222313c7adb P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:20.743100 1175 raft_consensus.cc:2243] T 9593cb3d940c42918056a222313c7adb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.743144 999 leader_election.cc:304] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:20.743247 1175 raft_consensus.cc:2272] T 9593cb3d940c42918056a222313c7adb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.743458 1174 ts_tablet_manager.cc:1434] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:20.743536 1190 raft_consensus.cc:3060] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:20.744383 1228 raft_consensus.cc:2749] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:20.745122 1175 ts_tablet_manager.cc:1916] T 9593cb3d940c42918056a222313c7adb P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.746661 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet deba6669348248d6a1f1111122e7ad32 (table default.Table_63ea580c95a14a2f85b3ca002a8b1399 [id=0c04457e82e54a229437db0c3f90811b]) successfully deleted
W20260318 02:51:20.747128 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 6a3491e419434075ac4e6fa5881ec537 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a3491e419434075ac4e6fa5881ec537 already in progress: creating tablet
I20260318 02:51:20.748432 1174 tablet_bootstrap.cc:492] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.749927 1176 ts_tablet_manager.cc:1929] T 1ad59f4f5db8424a900b36e060745aa6 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.751482 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b07774692544b1c83bc547302b203a5" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:20.752877 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9fe7de28b0646b9b2b96fc46962df9e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:20.753088 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b07774692544b1c83bc547302b203a5" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:20.754034 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9fe7de28b0646b9b2b96fc46962df9e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:20.754460 1176 log.cc:1199] T 1ad59f4f5db8424a900b36e060745aa6 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/1ad59f4f5db8424a900b36e060745aa6
I20260318 02:51:20.754540 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f95f7591b84ebbba033ec0e0cfc8b3" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:20.755316 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f95f7591b84ebbba033ec0e0cfc8b3" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:20.755446 1176 ts_tablet_manager.cc:1950] T 1ad59f4f5db8424a900b36e060745aa6 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:20.755764 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da240bc0d5b043b89232fdf646f4f344" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:20.755964 1063 raft_consensus.cc:2468] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 0.
I20260318 02:51:20.756388 1176 tablet_replica.cc:333] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:20.756510 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 1ad59f4f5db8424a900b36e060745aa6 (table default.Table_7302de3324f84feea6928392c6067ecb [id=5104d449469a4fdc99dab10843e6c5b1]) successfully deleted
I20260318 02:51:20.756567 1176 raft_consensus.cc:2243] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.756763 1176 raft_consensus.cc:2272] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.757210 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da240bc0d5b043b89232fdf646f4f344" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:20.757315 1176 ts_tablet_manager.cc:1916] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.757436 927 raft_consensus.cc:2468] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 0.
I20260318 02:51:20.757921 1175 ts_tablet_manager.cc:1929] T 9593cb3d940c42918056a222313c7adb P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.758054 1175 log.cc:1199] T 9593cb3d940c42918056a222313c7adb P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/9593cb3d940c42918056a222313c7adb
I20260318 02:51:20.758330 1175 ts_tablet_manager.cc:1950] T 9593cb3d940c42918056a222313c7adb P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:20.750128 1174 tablet_bootstrap.cc:654] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:20.759589 719 leader_election.cc:343] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:20.759884 719 leader_election.cc:343] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:20.760116 719 leader_election.cc:343] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:20.760345 719 leader_election.cc:304] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
W20260318 02:51:20.760886 719 leader_election.cc:343] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:20.761086 719 leader_election.cc:304] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:20.761377 1287 raft_consensus.cc:2804] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:20.761489 1287 raft_consensus.cc:493] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:20.761569 1287 raft_consensus.cc:3060] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:20.764339 1287 raft_consensus.cc:515] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.765213 1287 leader_election.cc:290] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:20.765542 1287 raft_consensus.cc:2749] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:20.767868 1175 tablet_replica.cc:333] T 6a3491e419434075ac4e6fa5881ec537 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
W20260318 02:51:20.768221 719 leader_election.cc:343] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:20.768395 1175 raft_consensus.cc:2243] T 6a3491e419434075ac4e6fa5881ec537 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.768451 719 leader_election.cc:304] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:20.768946 719 leader_election.cc:343] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:20.769124 719 leader_election.cc:304] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:20.769351 1175 raft_consensus.cc:2272] T 6a3491e419434075ac4e6fa5881ec537 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.769407 1287 raft_consensus.cc:2749] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:20.769634 1287 raft_consensus.cc:2749] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:20.770718 1176 ts_tablet_manager.cc:1929] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.770839 1176 log.cc:1199] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/f96e77189d37484289fc83285f23e80d
I20260318 02:51:20.771178 1176 ts_tablet_manager.cc:1950] T f96e77189d37484289fc83285f23e80d P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:20.771390 1175 ts_tablet_manager.cc:1916] T 6a3491e419434075ac4e6fa5881ec537 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.772210 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet f96e77189d37484289fc83285f23e80d (table default.Table_81978fc781014c4e9a71dc85a7ac0daf [id=6a8a3c65c0994085a0b5ba207107d287]) successfully deleted
I20260318 02:51:20.772595 1176 tablet_replica.cc:333] T 6a3491e419434075ac4e6fa5881ec537 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:20.772907 1176 raft_consensus.cc:2243] T 6a3491e419434075ac4e6fa5881ec537 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.773147 1176 raft_consensus.cc:2272] T 6a3491e419434075ac4e6fa5881ec537 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.773705 1176 ts_tablet_manager.cc:1916] T 6a3491e419434075ac4e6fa5881ec537 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.773910 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da240bc0d5b043b89232fdf646f4f344" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:20.774135 1063 raft_consensus.cc:3060] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:20.774890 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da240bc0d5b043b89232fdf646f4f344" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:20.775135 927 raft_consensus.cc:3060] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:20.777954 927 raft_consensus.cc:2468] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 1.
I20260318 02:51:20.779659 1184 tablet_replica.cc:333] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:20.779709 719 leader_election.cc:304] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:20.779870 1184 raft_consensus.cc:2243] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.780037 1184 raft_consensus.cc:2272] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.781276 1184 ts_tablet_manager.cc:1916] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.791738 1175 ts_tablet_manager.cc:1929] T 6a3491e419434075ac4e6fa5881ec537 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.791891 1175 log.cc:1199] T 6a3491e419434075ac4e6fa5881ec537 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/6a3491e419434075ac4e6fa5881ec537
I20260318 02:51:20.792238 1175 ts_tablet_manager.cc:1950] T 6a3491e419434075ac4e6fa5881ec537 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:20.792755 1184 ts_tablet_manager.cc:1929] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.792972 1184 log.cc:1199] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/7a81d51587eb4e5cab9fb61bf7f524a1
I20260318 02:51:20.793366 1184 ts_tablet_manager.cc:1950] T 7a81d51587eb4e5cab9fb61bf7f524a1 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:20.793682 1285 raft_consensus.cc:2804] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:20.794971 1285 raft_consensus.cc:697] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Becoming Leader. State: Replica: 6a903d876086423b8016d705b98895ad, State: Running, Role: LEADER
I20260318 02:51:20.795692 1285 consensus_queue.cc:237] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.799804 1063 raft_consensus.cc:2468] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 1.
I20260318 02:51:20.801000 1190 raft_consensus.cc:2749] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:20.778435 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 9593cb3d940c42918056a222313c7adb (table default.Table_737bd9edac1b45d68b210a423b0e17ee [id=97e9a124fd8d4b279d8db98ee802ede4]) successfully deleted
I20260318 02:51:20.808925 1173 tablet_bootstrap.cc:492] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:20.809121 1173 ts_tablet_manager.cc:1403] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.211s user 0.035s sys 0.024s
I20260318 02:51:20.809461 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 2d254c168b5746b59ee57a816b53ba69 (table default.Table_1d973c441e874933af10ea309f9786d2 [id=789fd6a65c0c481494430f1ba4c574f4]) successfully deleted
I20260318 02:51:20.809916 1173 raft_consensus.cc:359] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.810120 1173 raft_consensus.cc:385] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.810195 1173 raft_consensus.cc:740] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.810381 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 7a81d51587eb4e5cab9fb61bf7f524a1 (table default.Table_541a8f0af72c48529db5904e9400919f [id=5e3dec62fd1942a5b64c954901219b4c]) successfully deleted
I20260318 02:51:20.810477 1173 consensus_queue.cc:260] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.810930 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 6a3491e419434075ac4e6fa5881ec537 (table default.Table_bbf2210842004e098c3fe633c4f2f7d0 [id=06e124bab0a04572bab0c3c008b7d218]) successfully deleted
I20260318 02:51:20.811321 1173 ts_tablet_manager.cc:1434] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:20.811666 1173 tablet_bootstrap.cc:492] T b9fe7de28b0646b9b2b96fc46962df9e P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:20.813563 1173 tablet_bootstrap.cc:654] T b9fe7de28b0646b9b2b96fc46962df9e P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.816493 1176 ts_tablet_manager.cc:1929] T 6a3491e419434075ac4e6fa5881ec537 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.816758 1176 log.cc:1199] T 6a3491e419434075ac4e6fa5881ec537 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/6a3491e419434075ac4e6fa5881ec537
I20260318 02:51:20.817209 1176 ts_tablet_manager.cc:1950] T 6a3491e419434075ac4e6fa5881ec537 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:20.818389 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 6a3491e419434075ac4e6fa5881ec537 (table default.Table_bbf2210842004e098c3fe633c4f2f7d0 [id=06e124bab0a04572bab0c3c008b7d218]) successfully deleted
I20260318 02:51:20.821810 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b388bf244b7b43bf92f91551b05fcef1" } new_table_name: "default.Table_870eb9eb87224d229502d71d64113e3a" modify_external_catalogs: true
I20260318 02:51:20.823491 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b1a09bb29fe3410295d991fbdf5cbce4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:20.823832 455 master_service.cc:954] ReplaceTablet: received request to replace tablet f96e77189d37484289fc83285f23e80d from {username='slave'} at 127.0.0.1:47158
W20260318 02:51:20.824024 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1a09bb29fe3410295d991fbdf5cbce4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.824375 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_903c945355934d5985bf71a777ad32ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:20.825088 449 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet da240bc0d5b043b89232fdf646f4f344 (table default.Table_d7429a91cdb142b99d2f341a75bc82bf [id=d7f85dc897794d14af2f182a59150e92]). Expected version 2 got 0
I20260318 02:51:20.826085 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e56aadd2977f4c5e816768f78d70ba61" } new_table_name: "default.Table_90fbf2263430453082ef161ec0025a5a" modify_external_catalogs: true
I20260318 02:51:20.827471 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9f3caaf4accf437894abd4d1e00a4a27" } new_table_name: "default.Table_4dc88020e12048858ae8533475bc1215" modify_external_catalogs: true
W20260318 02:51:20.828670 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba consensus state has no leader
I20260318 02:51:20.829000 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ac694c873ef141579c82755592552b23" } modify_external_catalogs: true
I20260318 02:51:20.829185 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ac694c873ef141579c82755592552b23" } modify_external_catalogs: true
W20260318 02:51:20.830366 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d consensus state has no leader
I20260318 02:51:20.830291 907 tablet_service.cc:1511] Processing CreateTablet for tablet d604cd634a1c470ba3896cf02d2804d4 (DEFAULT_TABLE table=default.Table_215d98fc906d466d8c0d334250547c34 [id=1165495ee0884badba5bd95f87987e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.830754 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d604cd634a1c470ba3896cf02d2804d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.831465 453 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 4b07774692544b1c83bc547302b203a5 (table default.Table_211fe38e2cf749b8ac8d689f2fe65025 [id=da7b89f9dc554a6a9e383537b40ab14e]). Expected version 1 got 0
I20260318 02:51:20.834400 763 tablet_service.cc:1511] Processing CreateTablet for tablet d604cd634a1c470ba3896cf02d2804d4 (DEFAULT_TABLE table=default.Table_215d98fc906d466d8c0d334250547c34 [id=1165495ee0884badba5bd95f87987e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.834869 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d604cd634a1c470ba3896cf02d2804d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.836980 454 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 1af760ed8ff14a498e751e67550cb1ac (table default.Table_0c5e75f8ad484c6d87b15a8f88667a0b [id=433e7aa77412424ebb38784bb073d1fb]). Expected version 4 got 0
I20260318 02:51:20.841584 454 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 1af760ed8ff14a498e751e67550cb1ac (table default.Table_0c5e75f8ad484c6d87b15a8f88667a0b [id=433e7aa77412424ebb38784bb073d1fb]). Expected version 4 got 0
I20260318 02:51:20.842110 765 tablet_service.cc:1511] Processing CreateTablet for tablet 1df8029146564e1c9dc88dd9f5fb64ae (DEFAULT_TABLE table=default.Table_8191659006de403a8de64233efbf3486 [id=c2fac99943e14848aec3bc3195a60023]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.842525 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df8029146564e1c9dc88dd9f5fb64ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.845032 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 92f95f7591b84ebbba033ec0e0cfc8b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.845067 766 tablet_service.cc:1511] Processing CreateTablet for tablet 32880a703603476786b4a34ddd40cab8 (DEFAULT_TABLE table=default.Table_82b90b9eec6a4252b7022e3cf497374c [id=f63cc6603c274afba2cb3ae1228ed566]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.845533 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32880a703603476786b4a34ddd40cab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.846026 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 4dadf0fc6e134edd87788dd4ade59dc5) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.846256 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 41c97f254ae94de3bb0c03db72fb7df0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.848982 904 tablet_service.cc:1558] Processing DeleteTablet for tablet f96e77189d37484289fc83285f23e80d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.849233 905 tablet_service.cc:1558] Processing DeleteTablet for tablet cc99bc3332eb48f7a4980533ee71f581 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.849478 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 41c97f254ae94de3bb0c03db72fb7df0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.849767 905 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ff8e4571d0a47ae984a918f17ba1d6b with delete_type TABLET_DATA_DELETED (replaced by tablet f1ed26420c64492a94e8920d8c753fc3) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.849946 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a3491e419434075ac4e6fa5881ec537 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.849992 764 tablet_service.cc:1511] Processing CreateTablet for tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba (DEFAULT_TABLE table=default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.850004 453 catalog_manager.cc:5671] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a903d876086423b8016d705b98895ad (127.0.104.129). New cstate: current_term: 1 leader_uuid: "6a903d876086423b8016d705b98895ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:20.850348 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.850457 453 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet da240bc0d5b043b89232fdf646f4f344 (table default.Table_d7429a91cdb142b99d2f341a75bc82bf [id=d7f85dc897794d14af2f182a59150e92]). Expected version 2 got 0
I20260318 02:51:20.850741 453 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 53502a8e2d184b7ea7fa575d4836f0ea (table default.Table_63ea580c95a14a2f85b3ca002a8b1399 [id=0c04457e82e54a229437db0c3f90811b]). Expected version 3 got 0
I20260318 02:51:20.852342 1175 tablet_replica.cc:333] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:20.852875 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet deba6669348248d6a1f1111122e7ad32 with delete_type TABLET_DATA_DELETED (replaced by tablet 53502a8e2d184b7ea7fa575d4836f0ea) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.853145 1184 tablet_replica.cc:333] T deba6669348248d6a1f1111122e7ad32 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:20.852397 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ef71cea07cf42dea6cf96a5341542b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.853313 1184 raft_consensus.cc:2243] T deba6669348248d6a1f1111122e7ad32 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.852871 903 tablet_service.cc:1558] Processing DeleteTablet for tablet deba6669348248d6a1f1111122e7ad32 with delete_type TABLET_DATA_DELETED (replaced by tablet 53502a8e2d184b7ea7fa575d4836f0ea) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.853505 1184 raft_consensus.cc:2272] T deba6669348248d6a1f1111122e7ad32 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.853446 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ad59f4f5db8424a900b36e060745aa6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.854296 1184 ts_tablet_manager.cc:1916] T deba6669348248d6a1f1111122e7ad32 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.854868 1175 raft_consensus.cc:2243] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:20.854532 761 tablet_service.cc:1511] Processing CreateTablet for tablet 74233fd7ed094e7cbfc79309605db0e1 (DEFAULT_TABLE table=default.Table_e56aadd2977f4c5e816768f78d70ba61 [id=f6d13c14fec24bc8894ebd60b88fca77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.854730 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 5955a2ce20e64b0989f26dec7e439792 with delete_type TABLET_DATA_DELETED (replaced by tablet 549b3929ea33417bbe50e749bbfe223d) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.857280 1175 pending_rounds.cc:70] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18: Trying to abort 1 pending ops.
I20260318 02:51:20.857494 1175 pending_rounds.cc:77] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494141788614656 op_type: NO_OP noop_request { }
I20260318 02:51:20.857620 1175 raft_consensus.cc:2889] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:20.857860 1040 tablet_service.cc:1511] Processing CreateTablet for tablet d604cd634a1c470ba3896cf02d2804d4 (DEFAULT_TABLE table=default.Table_215d98fc906d466d8c0d334250547c34 [id=1165495ee0884badba5bd95f87987e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.858330 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74233fd7ed094e7cbfc79309605db0e1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:20.858351 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_903c945355934d5985bf71a777ad32ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.858808 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d604cd634a1c470ba3896cf02d2804d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.860108 1175 raft_consensus.cc:2272] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.861400 1175 ts_tablet_manager.cc:1916] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.861426 1228 raft_consensus.cc:493] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:20.861577 1228 raft_consensus.cc:515] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:20.864001 862 leader_election.cc:343] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 5955a2ce20e64b0989f26dec7e439792
I20260318 02:51:20.864040 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 1df8029146564e1c9dc88dd9f5fb64ae (DEFAULT_TABLE table=default.Table_8191659006de403a8de64233efbf3486 [id=c2fac99943e14848aec3bc3195a60023]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.864465 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df8029146564e1c9dc88dd9f5fb64ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.865339 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5955a2ce20e64b0989f26dec7e439792" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:20.865849 1179 raft_consensus.cc:493] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:20.865995 1179 raft_consensus.cc:515] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
W20260318 02:51:20.866080 860 leader_election.cc:343] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:20.866271 860 leader_election.cc:304] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:20.866612 1179 leader_election.cc:290] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:20.866897 1179 raft_consensus.cc:2749] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:20.867304 1228 leader_election.cc:290] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:20.867522 1175 ts_tablet_manager.cc:1929] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:20.867647 1175 log.cc:1199] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/f96e77189d37484289fc83285f23e80d
I20260318 02:51:20.868101 1175 ts_tablet_manager.cc:1950] T f96e77189d37484289fc83285f23e80d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:20.868321 904 tablet_service.cc:1511] Processing CreateTablet for tablet 1df8029146564e1c9dc88dd9f5fb64ae (DEFAULT_TABLE table=default.Table_8191659006de403a8de64233efbf3486 [id=c2fac99943e14848aec3bc3195a60023]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.869082 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df8029146564e1c9dc88dd9f5fb64ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.873402 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet f96e77189d37484289fc83285f23e80d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.874032 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 32880a703603476786b4a34ddd40cab8 (DEFAULT_TABLE table=default.Table_82b90b9eec6a4252b7022e3cf497374c [id=f63cc6603c274afba2cb3ae1228ed566]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.874266 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba (DEFAULT_TABLE table=default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.874279 903 tablet_service.cc:1511] Processing CreateTablet for tablet 32880a703603476786b4a34ddd40cab8 (DEFAULT_TABLE table=default.Table_82b90b9eec6a4252b7022e3cf497374c [id=f63cc6603c274afba2cb3ae1228ed566]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.874408 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32880a703603476786b4a34ddd40cab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.874619 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.874655 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32880a703603476786b4a34ddd40cab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.876298 1175 tablet_replica.cc:333] T cc99bc3332eb48f7a4980533ee71f581 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:20.876505 1175 raft_consensus.cc:2243] T cc99bc3332eb48f7a4980533ee71f581 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.876663 1175 raft_consensus.cc:2272] T cc99bc3332eb48f7a4980533ee71f581 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.877194 900 tablet_service.cc:1511] Processing CreateTablet for tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba (DEFAULT_TABLE table=default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.877436 1175 ts_tablet_manager.cc:1916] T cc99bc3332eb48f7a4980533ee71f581 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.877599 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.882323 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 74233fd7ed094e7cbfc79309605db0e1 (DEFAULT_TABLE table=default.Table_e56aadd2977f4c5e816768f78d70ba61 [id=f6d13c14fec24bc8894ebd60b88fca77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.882928 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74233fd7ed094e7cbfc79309605db0e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.883353 902 tablet_service.cc:1511] Processing CreateTablet for tablet 74233fd7ed094e7cbfc79309605db0e1 (DEFAULT_TABLE table=default.Table_e56aadd2977f4c5e816768f78d70ba61 [id=f6d13c14fec24bc8894ebd60b88fca77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.883744 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74233fd7ed094e7cbfc79309605db0e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.884147 1175 ts_tablet_manager.cc:1929] T cc99bc3332eb48f7a4980533ee71f581 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.884276 1175 log.cc:1199] T cc99bc3332eb48f7a4980533ee71f581 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/cc99bc3332eb48f7a4980533ee71f581
I20260318 02:51:20.884624 1175 ts_tablet_manager.cc:1950] T cc99bc3332eb48f7a4980533ee71f581 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:20.889907 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_19fe141c13934c04bd511b36fab6ab36" } modify_external_catalogs: true
I20260318 02:51:20.890116 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_19fe141c13934c04bd511b36fab6ab36" } modify_external_catalogs: true
W20260318 02:51:20.891067 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2304246c244407b9d4eb301ac5d7ba9 consensus state has no leader
I20260318 02:51:20.891767 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e88f9eedc9d549e7bd8e8fb34e721a44" } modify_external_catalogs: true
I20260318 02:51:20.891904 452 master_service.cc:954] ReplaceTablet: received request to replace tablet 0ea4a57dc67e407f9c93679cb2053557 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:20.891942 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e88f9eedc9d549e7bd8e8fb34e721a44" } modify_external_catalogs: true
I20260318 02:51:20.892323 456 master_service.cc:954] ReplaceTablet: received request to replace tablet 53e66044bfed4b53a1c0bc4dc8de52e6 from {username='slave'} at 127.0.0.1:47158
W20260318 02:51:20.892983 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 74233fd7ed094e7cbfc79309605db0e1 consensus state has no leader
I20260318 02:51:20.893241 448 master_service.cc:954] ReplaceTablet: received request to replace tablet f7415ddf48574f7b9a746049ce78d2e9 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:20.894721 1175 tablet_replica.cc:333] T 41c97f254ae94de3bb0c03db72fb7df0 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:20.894915 1175 raft_consensus.cc:2243] T 41c97f254ae94de3bb0c03db72fb7df0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.895076 1175 raft_consensus.cc:2272] T 41c97f254ae94de3bb0c03db72fb7df0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.895877 1175 ts_tablet_manager.cc:1916] T 41c97f254ae94de3bb0c03db72fb7df0 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.899873 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet f96e77189d37484289fc83285f23e80d (table default.Table_81978fc781014c4e9a71dc85a7ac0daf [id=6a8a3c65c0994085a0b5ba207107d287]) successfully deleted
I20260318 02:51:20.900245 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet cc99bc3332eb48f7a4980533ee71f581 (table default.Table_cd18ea9af8074f5398e9d37d53332f19 [id=635bb52ee26d4a95865a9039f6a1a0ec]) successfully deleted
W20260318 02:51:20.900801 862 leader_election.cc:343] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 0ef71cea07cf42dea6cf96a5341542b3
I20260318 02:51:20.903208 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f7415ddf48574f7b9a746049ce78d2e9
I20260318 02:51:20.904369 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_db9a2182adab412682721c74365227db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:20.904980 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db9a2182adab412682721c74365227db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.904966 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet f7415ddf48574f7b9a746049ce78d2e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.907879 762 tablet_service.cc:1558] Processing DeleteTablet for tablet f7415ddf48574f7b9a746049ce78d2e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:20.912181 453 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 53502a8e2d184b7ea7fa575d4836f0ea (table default.Table_63ea580c95a14a2f85b3ca002a8b1399 [id=0c04457e82e54a229437db0c3f90811b], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 53502a8e2d184b7ea7fa575d4836f0ea consensus state has no leader
I20260318 02:51:20.914638 1172 tablet_bootstrap.cc:492] T 0ef71cea07cf42dea6cf96a5341542b3 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:20.914680 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 9e421d3fe62b4985bfe0486a4b115b2a
I20260318 02:51:20.915042 1172 ts_tablet_manager.cc:1403] T 0ef71cea07cf42dea6cf96a5341542b3 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.194s user 0.010s sys 0.023s
I20260318 02:51:20.918056 1172 raft_consensus.cc:359] T 0ef71cea07cf42dea6cf96a5341542b3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.919198 1172 raft_consensus.cc:385] T 0ef71cea07cf42dea6cf96a5341542b3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.919340 1172 raft_consensus.cc:740] T 0ef71cea07cf42dea6cf96a5341542b3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.919710 1172 consensus_queue.cc:260] T 0ef71cea07cf42dea6cf96a5341542b3 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:20.926179 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e421d3fe62b4985bfe0486a4b115b2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.926478 902 tablet_service.cc:1558] Processing DeleteTablet for tablet f7415ddf48574f7b9a746049ce78d2e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:20.926589 927 raft_consensus.cc:1275] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Refusing update from remote peer 6a903d876086423b8016d705b98895ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:20.927587 1287 consensus_queue.cc:1048] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:20.927896 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ef71cea07cf42dea6cf96a5341542b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.930226 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e4e8586673c43058ef00f2f7aef10ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.930496 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e421d3fe62b4985bfe0486a4b115b2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.916332 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e421d3fe62b4985bfe0486a4b115b2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.916682 1063 raft_consensus.cc:1275] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Refusing update from remote peer 6a903d876086423b8016d705b98895ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:20.931371 1172 ts_tablet_manager.cc:1434] T 0ef71cea07cf42dea6cf96a5341542b3 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260318 02:51:20.932288 1287 consensus_queue.cc:1048] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:20.932507 1174 tablet_bootstrap.cc:492] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:20.933888 1184 ts_tablet_manager.cc:1929] T deba6669348248d6a1f1111122e7ad32 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.934008 1184 log.cc:1199] T deba6669348248d6a1f1111122e7ad32 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/deba6669348248d6a1f1111122e7ad32
I20260318 02:51:20.934331 1184 ts_tablet_manager.cc:1950] T deba6669348248d6a1f1111122e7ad32 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:20.936887 1176 tablet_replica.cc:333] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:20.937139 1176 raft_consensus.cc:2243] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.937430 1176 raft_consensus.cc:2272] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.938014 1176 ts_tablet_manager.cc:1916] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.936669 1172 tablet_bootstrap.cc:492] T 2ff8e4571d0a47ae984a918f17ba1d6b P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:20.932680 1174 ts_tablet_manager.cc:1403] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.189s user 0.019s sys 0.000s
I20260318 02:51:20.942538 1174 raft_consensus.cc:359] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:20.944242 1172 tablet_bootstrap.cc:654] T 2ff8e4571d0a47ae984a918f17ba1d6b P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.944406 1174 raft_consensus.cc:385] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:20.944413 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet deba6669348248d6a1f1111122e7ad32 (table default.Table_63ea580c95a14a2f85b3ca002a8b1399 [id=0c04457e82e54a229437db0c3f90811b]) successfully deleted
I20260318 02:51:20.944598 1174 raft_consensus.cc:740] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:20.945420 1175 ts_tablet_manager.cc:1929] T 41c97f254ae94de3bb0c03db72fb7df0 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:20.945394 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8191659006de403a8de64233efbf3486" } modify_external_catalogs: true
I20260318 02:51:20.945431 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_211fe38e2cf749b8ac8d689f2fe65025" } modify_external_catalogs: true
I20260318 02:51:20.945657 1175 log.cc:1199] T 41c97f254ae94de3bb0c03db72fb7df0 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/41c97f254ae94de3bb0c03db72fb7df0
I20260318 02:51:20.945648 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8191659006de403a8de64233efbf3486" } modify_external_catalogs: true
I20260318 02:51:20.945612 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_211fe38e2cf749b8ac8d689f2fe65025" } modify_external_catalogs: true
I20260318 02:51:20.946048 1175 ts_tablet_manager.cc:1950] T 41c97f254ae94de3bb0c03db72fb7df0 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:20.946393 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3e4d4a8323da4e20a12b2b6a9f7fd54c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:20.946561 1174 consensus_queue.cc:260] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:20.947021 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e4d4a8323da4e20a12b2b6a9f7fd54c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:20.946241 1184 tablet_replica.cc:333] T f96e77189d37484289fc83285f23e80d P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:20.949609 1184 raft_consensus.cc:2243] T f96e77189d37484289fc83285f23e80d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.949896 1184 raft_consensus.cc:2272] T f96e77189d37484289fc83285f23e80d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.955265 1184 ts_tablet_manager.cc:1916] T f96e77189d37484289fc83285f23e80d P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.955479 1174 ts_tablet_manager.cc:1434] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260318 02:51:20.956252 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 41c97f254ae94de3bb0c03db72fb7df0 (table default.Table_4285d188a85b436894c35f7c097232d6 [id=431159d5b4774b2a8dd9de63bd2d1923]) successfully deleted
I20260318 02:51:20.956328 1174 tablet_bootstrap.cc:492] T 41a152a453fe47d194766635ab586804 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:20.958187 1174 tablet_bootstrap.cc:654] T 41a152a453fe47d194766635ab586804 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:20.946724 1175 tablet_replica.cc:333] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:20.958855 1175 raft_consensus.cc:2243] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:20.959117 1175 raft_consensus.cc:2272] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:20.959784 1175 ts_tablet_manager.cc:1916] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:20.966019 453 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d (table default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666]). Expected version 4 got 0
I20260318 02:51:20.969358 454 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d (table default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666]). Expected version 4 got 0
I20260318 02:51:20.972880 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 0ea4a57dc67e407f9c93679cb2053557
I20260318 02:51:20.973325 452 catalog_manager.cc:6741] ReplaceTablet: tablet 0ea4a57dc67e407f9c93679cb2053557 deleted and replaced by tablet 959faf1fbb224434b896c0f21e9715be
I20260318 02:51:20.973771 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 0e4719eafd2947bfacf3e1d2df1ae43e
I20260318 02:51:20.975782 759 tablet_service.cc:1511] Processing CreateTablet for tablet 24c66e2cc96f458fb3279827cea4ca9e (DEFAULT_TABLE table=default.Table_1bf6b42fe89741b19856a55be8811420 [id=ade423581b18488699c64d3b107d0b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.977632 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c66e2cc96f458fb3279827cea4ca9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.979152 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 8319efcfa31b45afb4dbd90cb5f13e97 (DEFAULT_TABLE table=default.Table_2faebbd7206f45ebb8c858d1a5936cb3 [id=985db776346840d0afa3544d24902aa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.979650 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8319efcfa31b45afb4dbd90cb5f13e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.980211 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ea4a57dc67e407f9c93679cb2053557 with delete_type TABLET_DATA_DELETED (replaced by tablet 959faf1fbb224434b896c0f21e9715be) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.976183 766 tablet_service.cc:1511] Processing CreateTablet for tablet b69dd1653a304f3d99346e89dacf9208 (DEFAULT_TABLE table=default.Table_422656b6b8b4438e9d2000352503c6b9 [id=57dcabdb56b84275bb202ad3decd8b15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.981607 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b69dd1653a304f3d99346e89dacf9208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.982033 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 24c66e2cc96f458fb3279827cea4ca9e (DEFAULT_TABLE table=default.Table_1bf6b42fe89741b19856a55be8811420 [id=ade423581b18488699c64d3b107d0b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.982538 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c66e2cc96f458fb3279827cea4ca9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.976410 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e4719eafd2947bfacf3e1d2df1ae43e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:20.976698 762 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff487cba236491eb22becf0dc591925 (DEFAULT_TABLE table=default.Table_3a4bc21a576546c9be4d3e0f9bdfb32b [id=d20f8f1bd66d4dceab3b7bc72608da2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.985648 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff487cba236491eb22becf0dc591925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.987807 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e4719eafd2947bfacf3e1d2df1ae43e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:20.994239 1036 tablet_service.cc:1511] Processing CreateTablet for tablet b69dd1653a304f3d99346e89dacf9208 (DEFAULT_TABLE table=default.Table_422656b6b8b4438e9d2000352503c6b9 [id=57dcabdb56b84275bb202ad3decd8b15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.994768 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b69dd1653a304f3d99346e89dacf9208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.976686 764 tablet_service.cc:1511] Processing CreateTablet for tablet 8319efcfa31b45afb4dbd90cb5f13e97 (DEFAULT_TABLE table=default.Table_2faebbd7206f45ebb8c858d1a5936cb3 [id=985db776346840d0afa3544d24902aa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:20.999181 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8319efcfa31b45afb4dbd90cb5f13e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:20.977061 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ea4a57dc67e407f9c93679cb2053557 with delete_type TABLET_DATA_DELETED (replaced by tablet 959faf1fbb224434b896c0f21e9715be) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.003086 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff487cba236491eb22becf0dc591925 (DEFAULT_TABLE table=default.Table_3a4bc21a576546c9be4d3e0f9bdfb32b [id=d20f8f1bd66d4dceab3b7bc72608da2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.003757 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff487cba236491eb22becf0dc591925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.011482 1184 ts_tablet_manager.cc:1929] T f96e77189d37484289fc83285f23e80d P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.011672 1184 log.cc:1199] T f96e77189d37484289fc83285f23e80d P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/f96e77189d37484289fc83285f23e80d
I20260318 02:51:21.012120 1184 ts_tablet_manager.cc:1950] T f96e77189d37484289fc83285f23e80d P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:21.014794 764 tablet_service.cc:1511] Processing CreateTablet for tablet 6b82751cbcbb4c39a6942b6856412fc8 (DEFAULT_TABLE table=default.Table_9cc80dda475640989a3e3c6f37b35831 [id=84a657155372475db438c6eb3119b595]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.014992 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 6b82751cbcbb4c39a6942b6856412fc8 (DEFAULT_TABLE table=default.Table_9cc80dda475640989a3e3c6f37b35831 [id=84a657155372475db438c6eb3119b595]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.015259 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b82751cbcbb4c39a6942b6856412fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.015349 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b82751cbcbb4c39a6942b6856412fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.017877 1174 tablet_bootstrap.cc:492] T 41a152a453fe47d194766635ab586804 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:21.018033 1174 ts_tablet_manager.cc:1403] T 41a152a453fe47d194766635ab586804 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.062s user 0.001s sys 0.002s
I20260318 02:51:21.018808 1174 raft_consensus.cc:359] T 41a152a453fe47d194766635ab586804 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.018980 1174 raft_consensus.cc:385] T 41a152a453fe47d194766635ab586804 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.019052 1174 raft_consensus.cc:740] T 41a152a453fe47d194766635ab586804 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.019780 900 tablet_service.cc:1511] Processing CreateTablet for tablet 24c66e2cc96f458fb3279827cea4ca9e (DEFAULT_TABLE table=default.Table_1bf6b42fe89741b19856a55be8811420 [id=ade423581b18488699c64d3b107d0b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.019896 1174 consensus_queue.cc:260] T 41a152a453fe47d194766635ab586804 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.020445 1174 ts_tablet_manager.cc:1434] T 41a152a453fe47d194766635ab586804 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:21.024051 901 tablet_service.cc:1511] Processing CreateTablet for tablet 6b82751cbcbb4c39a6942b6856412fc8 (DEFAULT_TABLE table=default.Table_9cc80dda475640989a3e3c6f37b35831 [id=84a657155372475db438c6eb3119b595]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.024220 1172 tablet_bootstrap.cc:492] T 2ff8e4571d0a47ae984a918f17ba1d6b P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:21.024188 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 4b07774692544b1c83bc547302b203a5
I20260318 02:51:21.024421 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e4719eafd2947bfacf3e1d2df1ae43e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.024498 1172 ts_tablet_manager.cc:1403] T 2ff8e4571d0a47ae984a918f17ba1d6b P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.088s user 0.004s sys 0.000s
I20260318 02:51:21.024590 907 tablet_service.cc:1511] Processing CreateTablet for tablet 8319efcfa31b45afb4dbd90cb5f13e97 (DEFAULT_TABLE table=default.Table_2faebbd7206f45ebb8c858d1a5936cb3 [id=985db776346840d0afa3544d24902aa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.025055 905 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff487cba236491eb22becf0dc591925 (DEFAULT_TABLE table=default.Table_3a4bc21a576546c9be4d3e0f9bdfb32b [id=d20f8f1bd66d4dceab3b7bc72608da2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.025372 1172 raft_consensus.cc:359] T 2ff8e4571d0a47ae984a918f17ba1d6b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.025569 1172 raft_consensus.cc:385] T 2ff8e4571d0a47ae984a918f17ba1d6b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.025669 1172 raft_consensus.cc:740] T 2ff8e4571d0a47ae984a918f17ba1d6b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.025869 1172 consensus_queue.cc:260] T 2ff8e4571d0a47ae984a918f17ba1d6b P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.026315 903 tablet_service.cc:1511] Processing CreateTablet for tablet b69dd1653a304f3d99346e89dacf9208 (DEFAULT_TABLE table=default.Table_422656b6b8b4438e9d2000352503c6b9 [id=57dcabdb56b84275bb202ad3decd8b15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.026826 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c66e2cc96f458fb3279827cea4ca9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.027405 1172 ts_tablet_manager.cc:1434] T 2ff8e4571d0a47ae984a918f17ba1d6b P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260318 02:51:21.028882 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b07774692544b1c83bc547302b203a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.029135 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 41a152a453fe47d194766635ab586804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.029263 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 1df8029146564e1c9dc88dd9f5fb64ae
I20260318 02:51:21.029446 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ea4a57dc67e407f9c93679cb2053557 with delete_type TABLET_DATA_DELETED (replaced by tablet 959faf1fbb224434b896c0f21e9715be) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.030359 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 1df8029146564e1c9dc88dd9f5fb64ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.030700 1172 tablet_bootstrap.cc:492] T 41c97f254ae94de3bb0c03db72fb7df0 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:21.031441 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8319efcfa31b45afb4dbd90cb5f13e97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.031694 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b82751cbcbb4c39a6942b6856412fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.032338 763 tablet_service.cc:1511] Processing CreateTablet for tablet 45fddf78fc834d20908696b980d394a2 (DEFAULT_TABLE table=default.Table_39cfb7dac1634b1285361e7ac3735f7b [id=895bbd90cf47462ab116ee3f37e94982]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.032764 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45fddf78fc834d20908696b980d394a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.033284 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_38aed4c9ee134e8da344410657d43034"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.033823 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38aed4c9ee134e8da344410657d43034 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.034875 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff487cba236491eb22becf0dc591925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.040550 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b69dd1653a304f3d99346e89dacf9208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.035568 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b07774692544b1c83bc547302b203a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.037199 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 1df8029146564e1c9dc88dd9f5fb64ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.043149 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 45fddf78fc834d20908696b980d394a2 (DEFAULT_TABLE table=default.Table_39cfb7dac1634b1285361e7ac3735f7b [id=895bbd90cf47462ab116ee3f37e94982]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.043303 1172 tablet_bootstrap.cc:654] T 41c97f254ae94de3bb0c03db72fb7df0 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.043608 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45fddf78fc834d20908696b980d394a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.044272 1176 ts_tablet_manager.cc:1929] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.044399 1176 log.cc:1199] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/92f95f7591b84ebbba033ec0e0cfc8b3
I20260318 02:51:21.044749 1176 ts_tablet_manager.cc:1950] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:21.045017 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 1df8029146564e1c9dc88dd9f5fb64ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.045790 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 92f95f7591b84ebbba033ec0e0cfc8b3 (table default.Table_5f19fbe9c1f94632833382d5ff0c71c8 [id=5237c0e4bebf4b26a0bb902002016ac7]) successfully deleted
I20260318 02:51:21.048046 1174 tablet_bootstrap.cc:492] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:21.049391 763 tablet_service.cc:1511] Processing CreateTablet for tablet 31d493650d07437c9f1d657bb08a98d7 (DEFAULT_TABLE table=default.Table_14259137e6e74c67b7abb92cb2e953d8 [id=58354360683d422dbdcc43826b39dbc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.049837 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d493650d07437c9f1d657bb08a98d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.052666 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_376ed96eff2f4d13a0872f0984da4828"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:21.053167 1287 raft_consensus.cc:493] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260318 02:51:21.053293 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_376ed96eff2f4d13a0872f0984da4828 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.053354 1287 raft_consensus.cc:515] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.054028 1287 leader_election.cc:290] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:21.055197 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4e8586673c43058ef00f2f7aef10ee" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:21.056591 719 leader_election.cc:343] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:21.056543 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 31d493650d07437c9f1d657bb08a98d7 (DEFAULT_TABLE table=default.Table_14259137e6e74c67b7abb92cb2e953d8 [id=58354360683d422dbdcc43826b39dbc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.057016 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d493650d07437c9f1d657bb08a98d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.057262 905 tablet_service.cc:1511] Processing CreateTablet for tablet 45fddf78fc834d20908696b980d394a2 (DEFAULT_TABLE table=default.Table_39cfb7dac1634b1285361e7ac3735f7b [id=895bbd90cf47462ab116ee3f37e94982]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.057497 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0d76788054244bdc8c7aa32525412970"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:21.057722 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45fddf78fc834d20908696b980d394a2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:21.058086 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d76788054244bdc8c7aa32525412970 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.059548 926 raft_consensus.cc:1275] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Refusing update from remote peer 6a903d876086423b8016d705b98895ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:21.060213 1288 consensus_queue.cc:1048] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:21.060627 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e4e8586673c43058ef00f2f7aef10ee" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:21.061602 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0774c189a31544eb8132eb97d4bef464"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.062150 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0774c189a31544eb8132eb97d4bef464 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.065665 453 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet ee07c93213d44d9bb156d9ad7937facf (table default.Table_4dc88020e12048858ae8533475bc1215 [id=46bae779de56403ab810fc4dcde25233]). Expected version 1 got 0
I20260318 02:51:21.066336 1063 raft_consensus.cc:1275] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Refusing update from remote peer 6a903d876086423b8016d705b98895ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:21.066891 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b1a09bb29fe3410295d991fbdf5cbce4" } new_table_name: "default.Table_347e676321aa483fa750cfa91235cbe7" modify_external_catalogs: true
I20260318 02:51:21.068190 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6da40d0a67f342ff867f3660f2a289ba" } new_table_name: "default.Table_7356aa10012142459f00e965c450d3ea" modify_external_catalogs: true
I20260318 02:51:21.069562 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3fbf83db2cc447889b1a1d67741ca227"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.070112 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fbf83db2cc447889b1a1d67741ca227 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:21.075671 719 leader_election.cc:343] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:21.075876 719 leader_election.cc:304] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:21.076488 1287 raft_consensus.cc:2749] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:21.076702 1287 consensus_queue.cc:1048] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:21.077644 1250 mvcc.cc:204] Tried to move back new op lower bound from 7265494142604906496 to 7265494139039543296. Current Snapshot: MvccSnapshot[applied={T|T < 7265494142604906496}]
I20260318 02:51:21.078071 1260 tablet.cc:1723] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:21.078605 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b07774692544b1c83bc547302b203a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.078910 901 tablet_service.cc:1511] Processing CreateTablet for tablet 31d493650d07437c9f1d657bb08a98d7 (DEFAULT_TABLE table=default.Table_14259137e6e74c67b7abb92cb2e953d8 [id=58354360683d422dbdcc43826b39dbc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.080003 449 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet ee07c93213d44d9bb156d9ad7937facf (table default.Table_4dc88020e12048858ae8533475bc1215 [id=46bae779de56403ab810fc4dcde25233]). Expected version 1 got 0
I20260318 02:51:21.080914 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d493650d07437c9f1d657bb08a98d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.081892 1173 tablet_bootstrap.cc:492] T b9fe7de28b0646b9b2b96fc46962df9e P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:21.083194 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ff8e4571d0a47ae984a918f17ba1d6b with delete_type TABLET_DATA_DELETED (replaced by tablet f1ed26420c64492a94e8920d8c753fc3) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.085632 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a61fc584a9fb41fa9d17ab0aef58582d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.086278 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a61fc584a9fb41fa9d17ab0aef58582d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.090848 1173 ts_tablet_manager.cc:1403] T b9fe7de28b0646b9b2b96fc46962df9e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.270s user 0.008s sys 0.013s
W20260318 02:51:21.091682 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e61c374078854d589219dfa4c20e4222 has no consensus state
W20260318 02:51:21.092063 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 053a09fd13fa4d8e80133fd77acaa4ce consensus state has no leader
I20260318 02:51:21.095454 1174 tablet_bootstrap.cc:654] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.096482 766 tablet_service.cc:1511] Processing CreateTablet for tablet 3b9ac6b9d4a245ec8d8aed1db976123b (DEFAULT_TABLE table=default.Table_1e6ea5dc81d34a03b5135f4caeef56f5 [id=a2ddfb27f7ea4388b92f5b5703c88fdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.097275 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b9ac6b9d4a245ec8d8aed1db976123b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.103521 1176 tablet_replica.cc:333] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:21.104884 1176 raft_consensus.cc:2243] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.105175 1176 raft_consensus.cc:2272] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.105835 1176 ts_tablet_manager.cc:1916] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:21.107054 860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.131:37025, user_credentials={real_user=slave}} blocked reactor thread for 225353us
I20260318 02:51:21.107546 1173 raft_consensus.cc:359] T b9fe7de28b0646b9b2b96fc46962df9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.107754 1173 raft_consensus.cc:385] T b9fe7de28b0646b9b2b96fc46962df9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.107858 1173 raft_consensus.cc:740] T b9fe7de28b0646b9b2b96fc46962df9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.108103 1173 consensus_queue.cc:260] T b9fe7de28b0646b9b2b96fc46962df9e P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.109016 1173 ts_tablet_manager.cc:1434] T b9fe7de28b0646b9b2b96fc46962df9e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260318 02:51:21.109313 1173 tablet_bootstrap.cc:492] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:21.109354 1172 tablet_bootstrap.cc:492] T 41c97f254ae94de3bb0c03db72fb7df0 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:21.109550 1172 ts_tablet_manager.cc:1403] T 41c97f254ae94de3bb0c03db72fb7df0 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.079s user 0.003s sys 0.000s
I20260318 02:51:21.110280 1172 raft_consensus.cc:359] T 41c97f254ae94de3bb0c03db72fb7df0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.110513 1172 raft_consensus.cc:385] T 41c97f254ae94de3bb0c03db72fb7df0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.110585 1172 raft_consensus.cc:740] T 41c97f254ae94de3bb0c03db72fb7df0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.111569 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 3b9ac6b9d4a245ec8d8aed1db976123b (DEFAULT_TABLE table=default.Table_1e6ea5dc81d34a03b5135f4caeef56f5 [id=a2ddfb27f7ea4388b92f5b5703c88fdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.111606 900 tablet_service.cc:1511] Processing CreateTablet for tablet 3b9ac6b9d4a245ec8d8aed1db976123b (DEFAULT_TABLE table=default.Table_1e6ea5dc81d34a03b5135f4caeef56f5 [id=a2ddfb27f7ea4388b92f5b5703c88fdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.111994 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b9ac6b9d4a245ec8d8aed1db976123b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.112941 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ef71cea07cf42dea6cf96a5341542b3" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:21.113227 1062 raft_consensus.cc:2468] T 0ef71cea07cf42dea6cf96a5341542b3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:21.113781 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b9ac6b9d4a245ec8d8aed1db976123b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.114009 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d4cb7a1606894513a0f1074bedc22ef9" } new_table_name: "default.Table_ebd103e5fbf4484597076b02ffd82044" modify_external_catalogs: true
I20260318 02:51:21.114907 457 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_4dc88020e12048858ae8533475bc1215 [id=46bae779de56403ab810fc4dcde25233] alter complete (version 1)
I20260318 02:51:21.115948 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7356aa10012142459f00e965c450d3ea" } new_table_name: "default.Table_440cf82cdc3a4dbeb33532b68bd865e3" modify_external_catalogs: true
I20260318 02:51:21.115906 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_470fd4c570c843b395575045c9ac1bf2" } new_table_name: "default.Table_70e2f45a75724db48820714e88bbb17d" modify_external_catalogs: true
I20260318 02:51:21.116756 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_44e0a8a98f0546b1bbebda3cbdd1fe4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.117312 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44e0a8a98f0546b1bbebda3cbdd1fe4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.115963 860 leader_election.cc:304] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:21.119849 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d548901cf2e74047a18ea1460ce6fc34" } modify_external_catalogs: true
I20260318 02:51:21.120013 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d548901cf2e74047a18ea1460ce6fc34" } modify_external_catalogs: true
I20260318 02:51:21.121639 452 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet da240bc0d5b043b89232fdf646f4f344 (table default.Table_d7429a91cdb142b99d2f341a75bc82bf [id=d7f85dc897794d14af2f182a59150e92]). Expected version 2 got 0
I20260318 02:51:21.121845 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_63ea580c95a14a2f85b3ca002a8b1399" } modify_external_catalogs: true
I20260318 02:51:21.122018 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_63ea580c95a14a2f85b3ca002a8b1399" } modify_external_catalogs: true
I20260318 02:51:21.122731 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3187e1c3102e48718763dac2a3a40dc9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.123294 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3187e1c3102e48718763dac2a3a40dc9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.125437 1260 tablet.cc:1723] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:21.126214 455 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet da240bc0d5b043b89232fdf646f4f344 (table default.Table_d7429a91cdb142b99d2f341a75bc82bf [id=d7f85dc897794d14af2f182a59150e92]). Expected version 2 got 0
I20260318 02:51:21.127367 1296 raft_consensus.cc:2804] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:21.127526 1296 raft_consensus.cc:493] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:21.127979 1296 raft_consensus.cc:3060] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:21.129374 1172 consensus_queue.cc:260] T 41c97f254ae94de3bb0c03db72fb7df0 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.130998 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet f96e77189d37484289fc83285f23e80d (table default.Table_81978fc781014c4e9a71dc85a7ac0daf [id=6a8a3c65c0994085a0b5ba207107d287]) successfully deleted
I20260318 02:51:21.131560 1172 ts_tablet_manager.cc:1434] T 41c97f254ae94de3bb0c03db72fb7df0 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
W20260318 02:51:21.132185 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f7415ddf48574f7b9a746049ce78d2e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7415ddf48574f7b9a746049ce78d2e9 already in progress: creating tablet
I20260318 02:51:21.132409 1173 tablet_bootstrap.cc:654] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.131892 1184 tablet_replica.cc:333] T 0ef71cea07cf42dea6cf96a5341542b3 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:21.132972 1184 raft_consensus.cc:2243] T 0ef71cea07cf42dea6cf96a5341542b3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.133255 1184 raft_consensus.cc:2272] T 0ef71cea07cf42dea6cf96a5341542b3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.133966 1172 tablet_bootstrap.cc:492] T 5955a2ce20e64b0989f26dec7e439792 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:21.135994 1172 tablet_bootstrap.cc:654] T 5955a2ce20e64b0989f26dec7e439792 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.138648 1175 ts_tablet_manager.cc:1929] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.138810 1175 log.cc:1199] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/2ff8e4571d0a47ae984a918f17ba1d6b
I20260318 02:51:21.139322 1175 ts_tablet_manager.cc:1950] T 2ff8e4571d0a47ae984a918f17ba1d6b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:21.140017 1175 tablet_replica.cc:333] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
W20260318 02:51:21.141700 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 959faf1fbb224434b896c0f21e9715be has no consensus state
I20260318 02:51:21.142370 1306 tablet.cc:1723] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:21.145068 1308 tablet.cc:1723] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:21.147876 1296 raft_consensus.cc:515] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.148200 1176 ts_tablet_manager.cc:1929] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.148362 1176 log.cc:1199] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/10aafa9bf1c44b95b0263d9a76b8b1b2
I20260318 02:51:21.148636 1296 leader_election.cc:290] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:21.148743 1176 ts_tablet_manager.cc:1950] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:21.149744 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 (table default.Table_0d969a129e064d118a5bd11a6f34b8f1 [id=c8d7ee2f33154a1fbc8d7c7f6fb7e3a8]) successfully deleted
I20260318 02:51:21.146900 1184 ts_tablet_manager.cc:1916] T 0ef71cea07cf42dea6cf96a5341542b3 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:21.149624 862 leader_election.cc:343] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 0ef71cea07cf42dea6cf96a5341542b3
I20260318 02:51:21.150251 1175 raft_consensus.cc:2243] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.150786 1175 raft_consensus.cc:2272] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.150799 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet da240bc0d5b043b89232fdf646f4f344 (table default.Table_d7429a91cdb142b99d2f341a75bc82bf [id=d7f85dc897794d14af2f182a59150e92]). Expected version 2 got 0
I20260318 02:51:21.150993 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet ee07c93213d44d9bb156d9ad7937facf (table default.Table_4dc88020e12048858ae8533475bc1215 [id=46bae779de56403ab810fc4dcde25233]). Expected version 1 got 0
I20260318 02:51:21.151364 1175 ts_tablet_manager.cc:1916] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.155969 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 2ff8e4571d0a47ae984a918f17ba1d6b (table default.Table_470fd4c570c843b395575045c9ac1bf2 [id=50ab4db1dbeb4c6a90b33535047daa51]) successfully deleted
I20260318 02:51:21.157373 1184 ts_tablet_manager.cc:1929] T 0ef71cea07cf42dea6cf96a5341542b3 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.157527 1184 log.cc:1199] T 0ef71cea07cf42dea6cf96a5341542b3 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/0ef71cea07cf42dea6cf96a5341542b3
W20260318 02:51:21.157677 441 catalog_manager.cc:4969] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 6a3491e419434075ac4e6fa5881ec537 because the tablet was not found. No further retry: Not found: Tablet not found: 6a3491e419434075ac4e6fa5881ec537
I20260318 02:51:21.157970 1184 ts_tablet_manager.cc:1950] T 0ef71cea07cf42dea6cf96a5341542b3 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:21.159659 1174 tablet_bootstrap.cc:492] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:21.159858 1174 ts_tablet_manager.cc:1403] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.112s user 0.004s sys 0.000s
I20260318 02:51:21.160692 1174 raft_consensus.cc:359] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.161312 1174 raft_consensus.cc:385] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260318 02:51:21.161290 860 leader_election.cc:343] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 0ef71cea07cf42dea6cf96a5341542b3
I20260318 02:51:21.161392 1174 raft_consensus.cc:740] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.161451 860 leader_election.cc:304] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:21.161063 1176 tablet_replica.cc:333] T 41c97f254ae94de3bb0c03db72fb7df0 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
W20260318 02:51:21.161629 860 raft_consensus.cc:2686] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260318 02:51:21.161741 1176 raft_consensus.cc:2243] T 41c97f254ae94de3bb0c03db72fb7df0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.161924 1176 raft_consensus.cc:2272] T 41c97f254ae94de3bb0c03db72fb7df0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.162470 1176 ts_tablet_manager.cc:1916] T 41c97f254ae94de3bb0c03db72fb7df0 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.166556 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7692f02c62f94771bc39331507161bb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.167158 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7692f02c62f94771bc39331507161bb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.168848 1174 consensus_queue.cc:260] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.170948 1174 ts_tablet_manager.cc:1434] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260318 02:51:21.172305 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 0ef71cea07cf42dea6cf96a5341542b3 (table default.Table_e635a0a24db84a149bb743edac8c1629 [id=b6fccf21c9f04af3a55c534a5f223bf1]) successfully deleted
I20260318 02:51:21.173592 1312 tablet.cc:1723] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260318 02:51:21.174297 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1ed26420c64492a94e8920d8c753fc3 consensus state has no leader
W20260318 02:51:21.174894 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 053a09fd13fa4d8e80133fd77acaa4ce consensus state has no leader
I20260318 02:51:21.175467 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 96a854e3872c44e4863316c9fe5f2ee9
I20260318 02:51:21.184056 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6b075b8bc95d4159b8269cd003c6071c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.184695 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b075b8bc95d4159b8269cd003c6071c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.185986 456 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet ee07c93213d44d9bb156d9ad7937facf (table default.Table_4dc88020e12048858ae8533475bc1215 [id=46bae779de56403ab810fc4dcde25233]). Expected version 1 got 0
I20260318 02:51:21.188949 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a854e3872c44e4863316c9fe5f2ee9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.189839 1174 tablet_bootstrap.cc:492] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:21.192291 1174 tablet_bootstrap.cc:654] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.193404 1184 tablet_replica.cc:333] T 2ff8e4571d0a47ae984a918f17ba1d6b P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:21.193463 1175 ts_tablet_manager.cc:1929] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.193599 1175 log.cc:1199] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/0ef71cea07cf42dea6cf96a5341542b3
I20260318 02:51:21.193939 1175 ts_tablet_manager.cc:1950] T 0ef71cea07cf42dea6cf96a5341542b3 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:21.194129 1184 raft_consensus.cc:2243] T 2ff8e4571d0a47ae984a918f17ba1d6b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.194383 1184 raft_consensus.cc:2272] T 2ff8e4571d0a47ae984a918f17ba1d6b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.195199 1184 ts_tablet_manager.cc:1916] T 2ff8e4571d0a47ae984a918f17ba1d6b P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.196198 1173 tablet_bootstrap.cc:492] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:21.196369 1173 ts_tablet_manager.cc:1403] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.087s user 0.001s sys 0.005s
I20260318 02:51:21.197157 1173 raft_consensus.cc:359] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.197374 1173 raft_consensus.cc:385] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.197445 1173 raft_consensus.cc:740] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.197712 1173 consensus_queue.cc:260] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.198268 1173 ts_tablet_manager.cc:1434] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:21.200917 1175 tablet_replica.cc:333] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:21.203809 1175 raft_consensus.cc:2243] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.204010 1175 raft_consensus.cc:2272] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.204155 1288 raft_consensus.cc:493] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:21.204317 1288 raft_consensus.cc:515] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.204568 1175 ts_tablet_manager.cc:1916] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.205039 1288 leader_election.cc:290] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:21.205355 1176 ts_tablet_manager.cc:1929] T 41c97f254ae94de3bb0c03db72fb7df0 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.205531 1176 log.cc:1199] T 41c97f254ae94de3bb0c03db72fb7df0 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/41c97f254ae94de3bb0c03db72fb7df0
I20260318 02:51:21.205610 1312 tablet.cc:1723] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:21.205965 1176 ts_tablet_manager.cc:1950] T 41c97f254ae94de3bb0c03db72fb7df0 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:21.207036 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 41c97f254ae94de3bb0c03db72fb7df0 (table default.Table_4285d188a85b436894c35f7c097232d6 [id=431159d5b4774b2a8dd9de63bd2d1923]) successfully deleted
I20260318 02:51:21.207093 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54bffc30199246fd93edf7486b2e3a91" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:21.207686 443 catalog_manager.cc:4969] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 1ad59f4f5db8424a900b36e060745aa6 because the tablet was not found. No further retry: Not found: Tablet not found: 1ad59f4f5db8424a900b36e060745aa6
W20260318 02:51:21.207933 719 leader_election.cc:343] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:21.208276 1173 tablet_bootstrap.cc:492] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:21.208292 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f7415ddf48574f7b9a746049ce78d2e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7415ddf48574f7b9a746049ce78d2e9 already in progress: creating tablet
I20260318 02:51:21.208472 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54bffc30199246fd93edf7486b2e3a91" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:21.208976 719 leader_election.cc:343] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:21.209095 719 leader_election.cc:304] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:21.209517 1288 raft_consensus.cc:2749] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:21.209879 1173 tablet_bootstrap.cc:654] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.210315 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a854e3872c44e4863316c9fe5f2ee9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:21.210664 442 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 053a09fd13fa4d8e80133fd77acaa4ce (table default.Table_440cf82cdc3a4dbeb33532b68bd865e3 [id=3a77e587db534e32b2716d153a8419cd], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 053a09fd13fa4d8e80133fd77acaa4ce consensus state has no leader
I20260318 02:51:21.210731 1184 ts_tablet_manager.cc:1929] T 2ff8e4571d0a47ae984a918f17ba1d6b P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.211054 1176 tablet_replica.cc:333] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:21.211273 1176 raft_consensus.cc:2243] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.211447 1176 raft_consensus.cc:2272] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.213179 1176 ts_tablet_manager.cc:1916] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.213789 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 0ef71cea07cf42dea6cf96a5341542b3 (table default.Table_e635a0a24db84a149bb743edac8c1629 [id=b6fccf21c9f04af3a55c534a5f223bf1]) successfully deleted
W20260318 02:51:21.214025 441 catalog_manager.cc:4969] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet deba6669348248d6a1f1111122e7ad32 because the tablet was not found. No further retry: Not found: Tablet not found: deba6669348248d6a1f1111122e7ad32
W20260318 02:51:21.214223 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 9e421d3fe62b4985bfe0486a4b115b2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e421d3fe62b4985bfe0486a4b115b2a already in progress: creating tablet
W20260318 02:51:21.214406 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 0ea4a57dc67e407f9c93679cb2053557 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ea4a57dc67e407f9c93679cb2053557 already in progress: creating tablet
W20260318 02:51:21.214838 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 0e4719eafd2947bfacf3e1d2df1ae43e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e4719eafd2947bfacf3e1d2df1ae43e already in progress: creating tablet
W20260318 02:51:21.215029 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 1df8029146564e1c9dc88dd9f5fb64ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1df8029146564e1c9dc88dd9f5fb64ae already in progress: creating tablet
W20260318 02:51:21.215224 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 4b07774692544b1c83bc547302b203a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b07774692544b1c83bc547302b203a5 already in progress: creating tablet
I20260318 02:51:21.215588 449 master_service.cc:954] ReplaceTablet: received request to replace tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:21.216110 453 master_service.cc:954] ReplaceTablet: received request to replace tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:21.216357 457 master_service.cc:954] ReplaceTablet: received request to replace tablet 0e4719eafd2947bfacf3e1d2df1ae43e from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:21.216426 452 master_service.cc:954] ReplaceTablet: received request to replace tablet 53502a8e2d184b7ea7fa575d4836f0ea from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:21.216995 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_db9a2182adab412682721c74365227db" } modify_external_catalogs: true
I20260318 02:51:21.217173 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_db9a2182adab412682721c74365227db" } modify_external_catalogs: true
I20260318 02:51:21.217598 1173 tablet_bootstrap.cc:492] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:21.217779 1173 ts_tablet_manager.cc:1403] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.001s
I20260318 02:51:21.217814 457 master_service.cc:954] ReplaceTablet: received request to replace tablet 0ef71cea07cf42dea6cf96a5341542b3 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:21.220186 1174 tablet_bootstrap.cc:492] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:21.220402 1174 ts_tablet_manager.cc:1403] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.003s
I20260318 02:51:21.221336 1174 raft_consensus.cc:359] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.221601 1174 raft_consensus.cc:385] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.221746 1174 raft_consensus.cc:740] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.222071 1174 consensus_queue.cc:260] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.227491 455 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_d7429a91cdb142b99d2f341a75bc82bf [id=d7f85dc897794d14af2f182a59150e92] alter complete (version 2)
I20260318 02:51:21.232571 765 tablet_service.cc:1511] Processing CreateTablet for tablet 7480b1fa026242d7bb6ddbf8df563116 (DEFAULT_TABLE table=default.Table_3e4d4a8323da4e20a12b2b6a9f7fd54c [id=71930ef490a446019e86d9159e1f67d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.232846 764 tablet_service.cc:1511] Processing CreateTablet for tablet 977b95a3442a405d90385cdb4d6dd5dd (DEFAULT_TABLE table=default.Table_38aed4c9ee134e8da344410657d43034 [id=89a90617176b4035a465731d37aa795e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.232573 763 tablet_service.cc:1511] Processing CreateTablet for tablet 323e4b1e9aee449f9402b1712b1444d9 (DEFAULT_TABLE table=default.Table_0d76788054244bdc8c7aa32525412970 [id=463a6721eb0d43d09deeb283d1cc4233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.233570 759 tablet_service.cc:1511] Processing CreateTablet for tablet 5aebb91ff6b0416fac2ef2d056ca897a (DEFAULT_TABLE table=default.Table_903c945355934d5985bf71a777ad32ab [id=e91dc919c98843a7b31ed85f73ab5774]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.233523 1173 raft_consensus.cc:359] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.233891 1173 raft_consensus.cc:385] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.234063 1173 raft_consensus.cc:740] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.234045 762 tablet_service.cc:1511] Processing CreateTablet for tablet e61c374078854d589219dfa4c20e4222 (DEFAULT_TABLE table=default.Table_347e676321aa483fa750cfa91235cbe7 [id=02ceb29568c548ffaf48bc6c5e78c929]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.234472 761 tablet_service.cc:1511] Processing CreateTablet for tablet 959faf1fbb224434b896c0f21e9715be (DEFAULT_TABLE table=default.Table_ebd103e5fbf4484597076b02ffd82044 [id=4067c18ce85f44d7993786a3e9bda883]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.234920 760 tablet_service.cc:1511] Processing CreateTablet for tablet 97655cb5968b4c819273068818d5cab8 (DEFAULT_TABLE table=default.Table_db9a2182adab412682721c74365227db [id=b6525a69ead04b8ca17dfa20eb38d663]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.237020 1173 consensus_queue.cc:260] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.237185 766 tablet_service.cc:1511] Processing CreateTablet for tablet 88eeb101a1734271973cd7d4c756b356 (DEFAULT_TABLE table=default.Table_0774c189a31544eb8132eb97d4bef464 [id=847bc952406640b1b5a4c3e55a0ee1b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.239521 1173 ts_tablet_manager.cc:1434] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20260318 02:51:21.240017 758 tablet_service.cc:1511] Processing CreateTablet for tablet 3c283efbac08468c8c20f4caba90164c (DEFAULT_TABLE table=default.Table_376ed96eff2f4d13a0872f0984da4828 [id=7ac79bf8374d4166b204274f50a1db67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.240923 1174 ts_tablet_manager.cc:1434] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260318 02:51:21.241185 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 54bffc30199246fd93edf7486b2e3a91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.241648 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 53e66044bfed4b53a1c0bc4dc8de52e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.244066 1174 tablet_bootstrap.cc:492] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:21.245721 1174 tablet_bootstrap.cc:654] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.248193 900 tablet_service.cc:1511] Processing CreateTablet for tablet 323e4b1e9aee449f9402b1712b1444d9 (DEFAULT_TABLE table=default.Table_0d76788054244bdc8c7aa32525412970 [id=463a6721eb0d43d09deeb283d1cc4233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.248628 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323e4b1e9aee449f9402b1712b1444d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.249344 1173 tablet_bootstrap.cc:492] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:21.251624 1175 ts_tablet_manager.cc:1929] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.251902 1175 log.cc:1199] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/5955a2ce20e64b0989f26dec7e439792
I20260318 02:51:21.252390 1173 tablet_bootstrap.cc:654] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.252866 1175 ts_tablet_manager.cc:1950] T 5955a2ce20e64b0989f26dec7e439792 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:21.256763 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f89bbd2163914385916f490a3e147bd8" } modify_external_catalogs: true
I20260318 02:51:21.256976 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f89bbd2163914385916f490a3e147bd8" } modify_external_catalogs: true
I20260318 02:51:21.257015 901 tablet_service.cc:1511] Processing CreateTablet for tablet 5aebb91ff6b0416fac2ef2d056ca897a (DEFAULT_TABLE table=default.Table_903c945355934d5985bf71a777ad32ab [id=e91dc919c98843a7b31ed85f73ab5774]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.257742 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aebb91ff6b0416fac2ef2d056ca897a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.258594 905 tablet_service.cc:1511] Processing CreateTablet for tablet e61c374078854d589219dfa4c20e4222 (DEFAULT_TABLE table=default.Table_347e676321aa483fa750cfa91235cbe7 [id=02ceb29568c548ffaf48bc6c5e78c929]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.259536 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e61c374078854d589219dfa4c20e4222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.264204 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_90fbf2263430453082ef161ec0025a5a" } modify_external_catalogs: true
I20260318 02:51:21.264423 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_90fbf2263430453082ef161ec0025a5a" } modify_external_catalogs: true
I20260318 02:51:21.265730 907 tablet_service.cc:1511] Processing CreateTablet for tablet 959faf1fbb224434b896c0f21e9715be (DEFAULT_TABLE table=default.Table_ebd103e5fbf4484597076b02ffd82044 [id=4067c18ce85f44d7993786a3e9bda883]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.266155 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 959faf1fbb224434b896c0f21e9715be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.268106 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7480b1fa026242d7bb6ddbf8df563116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.268749 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323e4b1e9aee449f9402b1712b1444d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.269079 903 tablet_service.cc:1511] Processing CreateTablet for tablet 7480b1fa026242d7bb6ddbf8df563116 (DEFAULT_TABLE table=default.Table_3e4d4a8323da4e20a12b2b6a9f7fd54c [id=71930ef490a446019e86d9159e1f67d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.269343 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c283efbac08468c8c20f4caba90164c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.269474 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7480b1fa026242d7bb6ddbf8df563116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.272481 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 97655cb5968b4c819273068818d5cab8
I20260318 02:51:21.274559 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 97655cb5968b4c819273068818d5cab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.275398 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 5955a2ce20e64b0989f26dec7e439792 (table default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]) successfully deleted
W20260318 02:51:21.275681 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 9e421d3fe62b4985bfe0486a4b115b2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e421d3fe62b4985bfe0486a4b115b2a already in progress: creating tablet
W20260318 02:51:21.275890 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f7415ddf48574f7b9a746049ce78d2e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7415ddf48574f7b9a746049ce78d2e9 already in progress: creating tablet
W20260318 02:51:21.276072 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 0e4719eafd2947bfacf3e1d2df1ae43e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e4719eafd2947bfacf3e1d2df1ae43e already in progress: creating tablet
W20260318 02:51:21.276234 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 0ea4a57dc67e407f9c93679cb2053557 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ea4a57dc67e407f9c93679cb2053557 already in progress: creating tablet
W20260318 02:51:21.276396 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 1df8029146564e1c9dc88dd9f5fb64ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1df8029146564e1c9dc88dd9f5fb64ae already in progress: creating tablet
W20260318 02:51:21.276575 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 4b07774692544b1c83bc547302b203a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b07774692544b1c83bc547302b203a5 already in progress: creating tablet
W20260318 02:51:21.276803 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 96a854e3872c44e4863316c9fe5f2ee9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96a854e3872c44e4863316c9fe5f2ee9 already in progress: creating tablet
I20260318 02:51:21.276880 902 tablet_service.cc:1511] Processing CreateTablet for tablet 88eeb101a1734271973cd7d4c756b356 (DEFAULT_TABLE table=default.Table_0774c189a31544eb8132eb97d4bef464 [id=847bc952406640b1b5a4c3e55a0ee1b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.277319 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88eeb101a1734271973cd7d4c756b356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.277402 1173 tablet_bootstrap.cc:492] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:21.277617 1173 ts_tablet_manager.cc:1403] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.002s
I20260318 02:51:21.277742 1184 log.cc:1199] T 2ff8e4571d0a47ae984a918f17ba1d6b P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/2ff8e4571d0a47ae984a918f17ba1d6b
I20260318 02:51:21.279040 1173 raft_consensus.cc:359] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.279345 1173 raft_consensus.cc:385] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.279487 1173 raft_consensus.cc:740] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.279837 1173 consensus_queue.cc:260] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.283700 906 tablet_service.cc:1511] Processing CreateTablet for tablet 3c283efbac08468c8c20f4caba90164c (DEFAULT_TABLE table=default.Table_376ed96eff2f4d13a0872f0984da4828 [id=7ac79bf8374d4166b204274f50a1db67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.284147 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c283efbac08468c8c20f4caba90164c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.285338 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97655cb5968b4c819273068818d5cab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.285840 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aebb91ff6b0416fac2ef2d056ca897a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.286197 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e61c374078854d589219dfa4c20e4222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.286589 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 959faf1fbb224434b896c0f21e9715be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.287025 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 977b95a3442a405d90385cdb4d6dd5dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.287850 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 53502a8e2d184b7ea7fa575d4836f0ea
I20260318 02:51:21.288767 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88eeb101a1734271973cd7d4c756b356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.288686 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 53502a8e2d184b7ea7fa575d4836f0ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.296571 1176 ts_tablet_manager.cc:1929] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.296921 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba
I20260318 02:51:21.297556 449 catalog_manager.cc:6741] ReplaceTablet: tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba deleted and replaced by tablet bd077319b3c443849de087eb61da6a77
I20260318 02:51:21.298269 904 tablet_service.cc:1511] Processing CreateTablet for tablet 97655cb5968b4c819273068818d5cab8 (DEFAULT_TABLE table=default.Table_db9a2182adab412682721c74365227db [id=b6525a69ead04b8ca17dfa20eb38d663]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.298434 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba with delete_type TABLET_DATA_DELETED (replaced by tablet bd077319b3c443849de087eb61da6a77) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.298777 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97655cb5968b4c819273068818d5cab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.299352 1176 log.cc:1199] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/7e4e8586673c43058ef00f2f7aef10ee
I20260318 02:51:21.299777 1176 ts_tablet_manager.cc:1950] T 7e4e8586673c43058ef00f2f7aef10ee P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:21.301045 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 7e4e8586673c43058ef00f2f7aef10ee (table default.Table_bbda0f6b8794401899207ea245bdbc25 [id=e8cc0e7ae9214cc6bfcb635c00ae4090]) successfully deleted
W20260318 02:51:21.301559 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 9e421d3fe62b4985bfe0486a4b115b2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e421d3fe62b4985bfe0486a4b115b2a already in progress: creating tablet
W20260318 02:51:21.301790 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 0e4719eafd2947bfacf3e1d2df1ae43e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e4719eafd2947bfacf3e1d2df1ae43e already in progress: creating tablet
I20260318 02:51:21.301874 1176 tablet_replica.cc:333] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:21.302093 1176 raft_consensus.cc:2243] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:21.302124 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 0ea4a57dc67e407f9c93679cb2053557 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ea4a57dc67e407f9c93679cb2053557 already in progress: creating tablet
I20260318 02:51:21.302276 1176 raft_consensus.cc:2272] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.304060 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b0ac5ee6e9664f0281f2f861859abca1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:21.302846 1176 ts_tablet_manager.cc:1916] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:21.304692 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0ac5ee6e9664f0281f2f861859abca1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.305286 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a854e3872c44e4863316c9fe5f2ee9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.305730 1184 ts_tablet_manager.cc:1950] T 2ff8e4571d0a47ae984a918f17ba1d6b P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:21.309154 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d469c0a03b6c480693974a3f51fc5662"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:21.309557 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 2ff8e4571d0a47ae984a918f17ba1d6b (table default.Table_70e2f45a75724db48820714e88bbb17d [id=50ab4db1dbeb4c6a90b33535047daa51]) successfully deleted
I20260318 02:51:21.309906 1172 tablet_bootstrap.cc:492] T 5955a2ce20e64b0989f26dec7e439792 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:21.310081 1172 ts_tablet_manager.cc:1403] T 5955a2ce20e64b0989f26dec7e439792 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.176s user 0.004s sys 0.000s
I20260318 02:51:21.311321 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 977b95a3442a405d90385cdb4d6dd5dd (DEFAULT_TABLE table=default.Table_38aed4c9ee134e8da344410657d43034 [id=89a90617176b4035a465731d37aa795e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.311569 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 323e4b1e9aee449f9402b1712b1444d9 (DEFAULT_TABLE table=default.Table_0d76788054244bdc8c7aa32525412970 [id=463a6721eb0d43d09deeb283d1cc4233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.312867 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 977b95a3442a405d90385cdb4d6dd5dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.317137 1174 tablet_bootstrap.cc:492] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:21.317379 1174 ts_tablet_manager.cc:1403] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.073s user 0.008s sys 0.000s
I20260318 02:51:21.318339 1174 raft_consensus.cc:359] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.318547 1174 raft_consensus.cc:385] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.318615 1174 raft_consensus.cc:740] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.318913 1174 consensus_queue.cc:260] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.319428 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323e4b1e9aee449f9402b1712b1444d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.321429 1172 raft_consensus.cc:359] T 5955a2ce20e64b0989f26dec7e439792 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:21.321678 1172 raft_consensus.cc:385] T 5955a2ce20e64b0989f26dec7e439792 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.322120 1172 raft_consensus.cc:740] T 5955a2ce20e64b0989f26dec7e439792 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.322376 1172 consensus_queue.cc:260] T 5955a2ce20e64b0989f26dec7e439792 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:21.324757 1172 ts_tablet_manager.cc:1434] T 5955a2ce20e64b0989f26dec7e439792 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260318 02:51:21.325608 1172 tablet_bootstrap.cc:492] T 6a3491e419434075ac4e6fa5881ec537 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:21.328670 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d469c0a03b6c480693974a3f51fc5662 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.328598 1037 tablet_service.cc:1511] Processing CreateTablet for tablet e61c374078854d589219dfa4c20e4222 (DEFAULT_TABLE table=default.Table_347e676321aa483fa750cfa91235cbe7 [id=02ceb29568c548ffaf48bc6c5e78c929]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.329128 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e61c374078854d589219dfa4c20e4222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.329357 1174 ts_tablet_manager.cc:1434] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260318 02:51:21.326538 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_27d90de2be7248649ebf3dde534d7091"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:21.330359 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 97655cb5968b4c819273068818d5cab8 (DEFAULT_TABLE table=default.Table_db9a2182adab412682721c74365227db [id=b6525a69ead04b8ca17dfa20eb38d663]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.330753 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97655cb5968b4c819273068818d5cab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.332747 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 88eeb101a1734271973cd7d4c756b356 (DEFAULT_TABLE table=default.Table_0774c189a31544eb8132eb97d4bef464 [id=847bc952406640b1b5a4c3e55a0ee1b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.333290 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88eeb101a1734271973cd7d4c756b356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.333343 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 3c283efbac08468c8c20f4caba90164c (DEFAULT_TABLE table=default.Table_376ed96eff2f4d13a0872f0984da4828 [id=7ac79bf8374d4166b204274f50a1db67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.333879 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 7480b1fa026242d7bb6ddbf8df563116 (DEFAULT_TABLE table=default.Table_3e4d4a8323da4e20a12b2b6a9f7fd54c [id=71930ef490a446019e86d9159e1f67d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.334270 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c283efbac08468c8c20f4caba90164c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.334196 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1a4739276dd74553a2497da27d9f4f83" } new_table_name: "default.Table_83aab17168ad4c2bae9ea1b354ef5001" modify_external_catalogs: true
I20260318 02:51:21.335621 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 53502a8e2d184b7ea7fa575d4836f0ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.335820 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet 97655cb5968b4c819273068818d5cab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.336231 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba with delete_type TABLET_DATA_DELETED (replaced by tablet bd077319b3c443849de087eb61da6a77) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.336393 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 959faf1fbb224434b896c0f21e9715be (DEFAULT_TABLE table=default.Table_ebd103e5fbf4484597076b02ffd82044 [id=4067c18ce85f44d7993786a3e9bda883]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.338377 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 959faf1fbb224434b896c0f21e9715be. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:21.342136 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 96a854e3872c44e4863316c9fe5f2ee9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96a854e3872c44e4863316c9fe5f2ee9 already in progress: creating tablet
I20260318 02:51:21.344415 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 41c97f254ae94de3bb0c03db72fb7df0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.344916 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_73bd00aac389472ba24f2baa8f23b550"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.345460 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 53502a8e2d184b7ea7fa575d4836f0ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53502a8e2d184b7ea7fa575d4836f0ea already in progress: creating tablet
W20260318 02:51:21.345569 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73bd00aac389472ba24f2baa8f23b550 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.346534 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b9fe7de28b0646b9b2b96fc46962df9e
I20260318 02:51:21.349854 763 tablet_service.cc:1558] Processing DeleteTablet for tablet b9fe7de28b0646b9b2b96fc46962df9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.348634 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_64fa6aaaa46242f3a737f4da65eb1947"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:21.351061 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 74233fd7ed094e7cbfc79309605db0e1
I20260318 02:51:21.351823 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_05696f972aa0431fa0dff6438e8e8bfd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.352607 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05696f972aa0431fa0dff6438e8e8bfd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:21.354517 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27d90de2be7248649ebf3dde534d7091 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.355307 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_38aed4c9ee134e8da344410657d43034" } new_table_name: "default.Table_096946297c3e4e4aaebde382409a6181" modify_external_catalogs: true
I20260318 02:51:21.361356 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 74233fd7ed094e7cbfc79309605db0e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:21.361682 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64fa6aaaa46242f3a737f4da65eb1947 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.364423 1174 tablet_bootstrap.cc:492] T 0ea4a57dc67e407f9c93679cb2053557 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:21.364869 441 catalog_manager.cc:4969] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 97655cb5968b4c819273068818d5cab8 because the tablet was not found. No further retry: Not found: Tablet not found: 97655cb5968b4c819273068818d5cab8
W20260318 02:51:21.365229 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba already in progress: creating tablet
I20260318 02:51:21.366050 1043 tablet_service.cc:1558] Processing DeleteTablet for tablet b9fe7de28b0646b9b2b96fc46962df9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.370389 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3a4bc21a576546c9be4d3e0f9bdfb32b" } new_table_name: "default.Table_22e1d9e9571f415597c2b5fd053f529a" modify_external_catalogs: true
I20260318 02:51:21.370620 1228 raft_consensus.cc:493] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:21.373152 1174 tablet_bootstrap.cc:654] T 0ea4a57dc67e407f9c93679cb2053557 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.373263 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 92f95f7591b84ebbba033ec0e0cfc8b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.373576 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 97655cb5968b4c819273068818d5cab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.373827 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 53502a8e2d184b7ea7fa575d4836f0ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.374089 893 tablet_service.cc:1558] Processing DeleteTablet for tablet b9fe7de28b0646b9b2b96fc46962df9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.374390 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 4dadf0fc6e134edd87788dd4ade59dc5) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.374634 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ad59f4f5db8424a900b36e060745aa6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.374858 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba with delete_type TABLET_DATA_DELETED (replaced by tablet bd077319b3c443849de087eb61da6a77) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.375099 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 74233fd7ed094e7cbfc79309605db0e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.370781 1228 raft_consensus.cc:515] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.379475 1175 tablet_replica.cc:333] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:21.380103 1228 leader_election.cc:290] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:21.380251 862 leader_election.cc:343] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 92f95f7591b84ebbba033ec0e0cfc8b3
I20260318 02:51:21.381557 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b0ac5ee6e9664f0281f2f861859abca1" } new_table_name: "default.Table_7f6deccea357456489e67b7be47c0c18" modify_external_catalogs: true
I20260318 02:51:21.381086 900 tablet_service.cc:1511] Processing CreateTablet for tablet 977b95a3442a405d90385cdb4d6dd5dd (DEFAULT_TABLE table=default.Table_38aed4c9ee134e8da344410657d43034 [id=89a90617176b4035a465731d37aa795e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.383194 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_4a675721365c4600b0a6a7712c03db81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.383785 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a675721365c4600b0a6a7712c03db81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.385361 766 tablet_service.cc:1511] Processing CreateTablet for tablet 7cfaf92570b34b2bb1f52aea06187c83 (DEFAULT_TABLE table=default.Table_44e0a8a98f0546b1bbebda3cbdd1fe4e [id=aca08645de7c4fec8ffc5dbda004973b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.385818 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cfaf92570b34b2bb1f52aea06187c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.383687 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_4d622f52dad8400883eae6801df84f37"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.386555 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d622f52dad8400883eae6801df84f37 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:21.387738 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 977b95a3442a405d90385cdb4d6dd5dd consensus state has no leader
I20260318 02:51:21.389026 764 tablet_service.cc:1511] Processing CreateTablet for tablet 677f33f9e4ad4859ab85692f7b7aad2a (DEFAULT_TABLE table=default.Table_a61fc584a9fb41fa9d17ab0aef58582d [id=a1611aa744774532bf8c16d8cc701c49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.389315 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 977b95a3442a405d90385cdb4d6dd5dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.389467 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 677f33f9e4ad4859ab85692f7b7aad2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.392958 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 7cfaf92570b34b2bb1f52aea06187c83 (DEFAULT_TABLE table=default.Table_44e0a8a98f0546b1bbebda3cbdd1fe4e [id=aca08645de7c4fec8ffc5dbda004973b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.393059 761 tablet_service.cc:1511] Processing CreateTablet for tablet af802894346443669f1cc549a1ba401b (DEFAULT_TABLE table=default.Table_3187e1c3102e48718763dac2a3a40dc9 [id=40612e2dc3b7447f8f4f753bf5474c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.393426 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af802894346443669f1cc549a1ba401b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.393941 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 677f33f9e4ad4859ab85692f7b7aad2a (DEFAULT_TABLE table=default.Table_a61fc584a9fb41fa9d17ab0aef58582d [id=a1611aa744774532bf8c16d8cc701c49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.400141 896 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9372f8871b473caa024512e936a6e5 (DEFAULT_TABLE table=default.Table_6b075b8bc95d4159b8269cd003c6071c [id=c532f0623efe4c3f8d9c90ae9c3d02c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.400405 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 5aebb91ff6b0416fac2ef2d056ca897a (DEFAULT_TABLE table=default.Table_903c945355934d5985bf71a777ad32ab [id=e91dc919c98843a7b31ed85f73ab5774]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.400781 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7480b1fa026242d7bb6ddbf8df563116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.401188 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 677f33f9e4ad4859ab85692f7b7aad2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.401446 894 tablet_service.cc:1511] Processing CreateTablet for tablet ec32c25ae14b406cb6ab4d913b575091 (DEFAULT_TABLE table=default.Table_7692f02c62f94771bc39331507161bb2 [id=60f0afdd0f9f4c5196ea491b90991241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.402155 760 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9372f8871b473caa024512e936a6e5 (DEFAULT_TABLE table=default.Table_6b075b8bc95d4159b8269cd003c6071c [id=c532f0623efe4c3f8d9c90ae9c3d02c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.402107 892 tablet_service.cc:1511] Processing CreateTablet for tablet af802894346443669f1cc549a1ba401b (DEFAULT_TABLE table=default.Table_3187e1c3102e48718763dac2a3a40dc9 [id=40612e2dc3b7447f8f4f753bf5474c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.402521 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9372f8871b473caa024512e936a6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.402849 899 tablet_service.cc:1511] Processing CreateTablet for tablet bf09f8234f36402bb9129d524637b5b5 (DEFAULT_TABLE table=default.Table_3fbf83db2cc447889b1a1d67741ca227 [id=cf74ccfff792402d87f23ac8a4988e5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.404213 1184 tablet_replica.cc:333] T 41c97f254ae94de3bb0c03db72fb7df0 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:21.404418 1184 raft_consensus.cc:2243] T 41c97f254ae94de3bb0c03db72fb7df0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.404650 1172 tablet_bootstrap.cc:654] T 6a3491e419434075ac4e6fa5881ec537 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.405021 759 tablet_service.cc:1511] Processing CreateTablet for tablet bf09f8234f36402bb9129d524637b5b5 (DEFAULT_TABLE table=default.Table_3fbf83db2cc447889b1a1d67741ca227 [id=cf74ccfff792402d87f23ac8a4988e5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.405408 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf09f8234f36402bb9129d524637b5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.407919 1044 tablet_service.cc:1511] Processing CreateTablet for tablet bf09f8234f36402bb9129d524637b5b5 (DEFAULT_TABLE table=default.Table_3fbf83db2cc447889b1a1d67741ca227 [id=cf74ccfff792402d87f23ac8a4988e5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.408365 903 tablet_service.cc:1511] Processing CreateTablet for tablet 677f33f9e4ad4859ab85692f7b7aad2a (DEFAULT_TABLE table=default.Table_a61fc584a9fb41fa9d17ab0aef58582d [id=a1611aa744774532bf8c16d8cc701c49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.410410 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 74233fd7ed094e7cbfc79309605db0e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.410614 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f95f7591b84ebbba033ec0e0cfc8b3" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:21.410967 1035 tablet_service.cc:1511] Processing CreateTablet for tablet af802894346443669f1cc549a1ba401b (DEFAULT_TABLE table=default.Table_3187e1c3102e48718763dac2a3a40dc9 [id=40612e2dc3b7447f8f4f753bf5474c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.411005 1033 tablet_service.cc:1511] Processing CreateTablet for tablet ec32c25ae14b406cb6ab4d913b575091 (DEFAULT_TABLE table=default.Table_7692f02c62f94771bc39331507161bb2 [id=60f0afdd0f9f4c5196ea491b90991241]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:21.411772 860 leader_election.cc:343] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:21.411900 860 leader_election.cc:304] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:21.412808 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9372f8871b473caa024512e936a6e5 (DEFAULT_TABLE table=default.Table_6b075b8bc95d4159b8269cd003c6071c [id=c532f0623efe4c3f8d9c90ae9c3d02c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.413450 1228 raft_consensus.cc:2749] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:21.413662 1184 raft_consensus.cc:2272] T 41c97f254ae94de3bb0c03db72fb7df0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.414460 1184 ts_tablet_manager.cc:1916] T 41c97f254ae94de3bb0c03db72fb7df0 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.414652 1314 tablet.cc:1723] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:21.415024 1176 ts_tablet_manager.cc:1929] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.416209 1308 tablet.cc:1723] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:21.416577 1043 tablet_service.cc:1558] Processing DeleteTablet for tablet 5955a2ce20e64b0989f26dec7e439792 with delete_type TABLET_DATA_DELETED (replaced by tablet 549b3929ea33417bbe50e749bbfe223d) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.416677 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cfaf92570b34b2bb1f52aea06187c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.416608 1260 tablet.cc:1723] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:21.417068 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9372f8871b473caa024512e936a6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.416489 1176 log.cc:1199] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/4b07774692544b1c83bc547302b203a5
I20260318 02:51:21.417346 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af802894346443669f1cc549a1ba401b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.420869 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec32c25ae14b406cb6ab4d913b575091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.421067 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aebb91ff6b0416fac2ef2d056ca897a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.422996 907 tablet_service.cc:1511] Processing CreateTablet for tablet 7cfaf92570b34b2bb1f52aea06187c83 (DEFAULT_TABLE table=default.Table_44e0a8a98f0546b1bbebda3cbdd1fe4e [id=aca08645de7c4fec8ffc5dbda004973b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.425937 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9372f8871b473caa024512e936a6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.426440 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af802894346443669f1cc549a1ba401b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.426934 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf09f8234f36402bb9129d524637b5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.427313 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec32c25ae14b406cb6ab4d913b575091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.428128 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 677f33f9e4ad4859ab85692f7b7aad2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.428579 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cfaf92570b34b2bb1f52aea06187c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.429006 1190 raft_consensus.cc:493] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:21.429574 1190 raft_consensus.cc:515] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.430266 1190 leader_election.cc:290] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:21.435602 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_096946297c3e4e4aaebde382409a6181" } new_table_name: "default.Table_429d1a716ae64decac39f45685e90b00" modify_external_catalogs: true
I20260318 02:51:21.439378 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2faebbd7206f45ebb8c858d1a5936cb3" } modify_external_catalogs: true
I20260318 02:51:21.439595 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf09f8234f36402bb9129d524637b5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.439589 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2faebbd7206f45ebb8c858d1a5936cb3" } modify_external_catalogs: true
I20260318 02:51:21.430783 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af760ed8ff14a498e751e67550cb1ac" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:21.434835 761 tablet_service.cc:1511] Processing CreateTablet for tablet ec32c25ae14b406cb6ab4d913b575091 (DEFAULT_TABLE table=default.Table_7692f02c62f94771bc39331507161bb2 [id=60f0afdd0f9f4c5196ea491b90991241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.443065 785 raft_consensus.cc:2468] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:21.443281 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec32c25ae14b406cb6ab4d913b575091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.444075 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_4ced5c1198ce406b85fbee4bbe6368c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:21.444135 999 leader_election.cc:304] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:21.444490 1190 raft_consensus.cc:2804] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260318 02:51:21.444752 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ced5c1198ce406b85fbee4bbe6368c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.445039 1176 ts_tablet_manager.cc:1950] T 4b07774692544b1c83bc547302b203a5 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:21.446157 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 4b07774692544b1c83bc547302b203a5 (table default.Table_211fe38e2cf749b8ac8d689f2fe65025 [id=da7b89f9dc554a6a9e383537b40ab14e]) successfully deleted
I20260318 02:51:21.448446 1176 tablet_replica.cc:333] T 41a152a453fe47d194766635ab586804 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:21.448668 1176 raft_consensus.cc:2243] T 41a152a453fe47d194766635ab586804 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.448899 1176 raft_consensus.cc:2272] T 41a152a453fe47d194766635ab586804 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.450282 455 master_service.cc:954] ReplaceTablet: received request to replace tablet 1df8029146564e1c9dc88dd9f5fb64ae from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:21.450811 455 master_service.cc:954] ReplaceTablet: received request to replace tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:21.451184 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af760ed8ff14a498e751e67550cb1ac" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:21.451412 927 raft_consensus.cc:2468] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:21.451330 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1e9e471c1715493487baf6ce6eab167a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.451889 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e9e471c1715493487baf6ce6eab167a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.444578 1190 raft_consensus.cc:493] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:21.457615 1190 raft_consensus.cc:3060] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:21.460733 1176 ts_tablet_manager.cc:1916] T 41a152a453fe47d194766635ab586804 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.465303 1288 raft_consensus.cc:493] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:21.465477 1288 raft_consensus.cc:515] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.466159 1288 leader_election.cc:290] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:21.467001 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e66044bfed4b53a1c0bc4dc8de52e6" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:21.467772 719 leader_election.cc:343] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:21.467837 1172 tablet_bootstrap.cc:492] T 6a3491e419434075ac4e6fa5881ec537 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:21.468081 1172 ts_tablet_manager.cc:1403] T 6a3491e419434075ac4e6fa5881ec537 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.142s user 0.002s sys 0.004s
I20260318 02:51:21.478106 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53e66044bfed4b53a1c0bc4dc8de52e6" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:21.488664 1184 ts_tablet_manager.cc:1929] T 41c97f254ae94de3bb0c03db72fb7df0 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.488850 1184 log.cc:1199] T 41c97f254ae94de3bb0c03db72fb7df0 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/41c97f254ae94de3bb0c03db72fb7df0
I20260318 02:51:21.488953 1175 raft_consensus.cc:2243] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.489197 1175 raft_consensus.cc:2272] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.490223 1175 ts_tablet_manager.cc:1916] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.491999 1190 raft_consensus.cc:515] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.497241 1172 raft_consensus.cc:359] T 6a3491e419434075ac4e6fa5881ec537 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.497452 1184 ts_tablet_manager.cc:1950] T 41c97f254ae94de3bb0c03db72fb7df0 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:21.497857 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af760ed8ff14a498e751e67550cb1ac" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:21.498057 927 raft_consensus.cc:3060] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:21.498602 1184 tablet_replica.cc:333] T 5955a2ce20e64b0989f26dec7e439792 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:21.498790 1184 raft_consensus.cc:2243] T 5955a2ce20e64b0989f26dec7e439792 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.498921 1184 raft_consensus.cc:2272] T 5955a2ce20e64b0989f26dec7e439792 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.499069 1190 leader_election.cc:290] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:21.499207 1172 raft_consensus.cc:385] T 6a3491e419434075ac4e6fa5881ec537 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.499266 1172 raft_consensus.cc:740] T 6a3491e419434075ac4e6fa5881ec537 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.499496 1172 consensus_queue.cc:260] T 6a3491e419434075ac4e6fa5881ec537 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.499929 1172 ts_tablet_manager.cc:1434] T 6a3491e419434075ac4e6fa5881ec537 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.032s user 0.001s sys 0.001s
I20260318 02:51:21.500257 1172 tablet_bootstrap.cc:492] T cc99bc3332eb48f7a4980533ee71f581 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:21.502192 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 41c97f254ae94de3bb0c03db72fb7df0 (table default.Table_4285d188a85b436894c35f7c097232d6 [id=431159d5b4774b2a8dd9de63bd2d1923]) successfully deleted
W20260318 02:51:21.502521 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet b9fe7de28b0646b9b2b96fc46962df9e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9fe7de28b0646b9b2b96fc46962df9e already in progress: creating tablet
W20260318 02:51:21.502786 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 74233fd7ed094e7cbfc79309605db0e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74233fd7ed094e7cbfc79309605db0e1 already in progress: creating tablet
I20260318 02:51:21.503232 1184 ts_tablet_manager.cc:1916] T 5955a2ce20e64b0989f26dec7e439792 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.508134 1172 tablet_bootstrap.cc:654] T cc99bc3332eb48f7a4980533ee71f581 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.510834 1184 ts_tablet_manager.cc:1929] T 5955a2ce20e64b0989f26dec7e439792 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.515811 927 raft_consensus.cc:2468] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:21.519273 1175 ts_tablet_manager.cc:1929] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.519505 1175 log.cc:1199] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/92f95f7591b84ebbba033ec0e0cfc8b3
I20260318 02:51:21.520062 1173 ts_tablet_manager.cc:1434] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.239s user 0.001s sys 0.001s
I20260318 02:51:21.520239 1175 ts_tablet_manager.cc:1950] T 92f95f7591b84ebbba033ec0e0cfc8b3 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:21.521015 1176 ts_tablet_manager.cc:1929] T 41a152a453fe47d194766635ab586804 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.521430 1176 log.cc:1199] T 41a152a453fe47d194766635ab586804 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/41a152a453fe47d194766635ab586804
I20260318 02:51:21.521783 1176 ts_tablet_manager.cc:1950] T 41a152a453fe47d194766635ab586804 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:21.522532 1173 tablet_bootstrap.cc:492] T 53502a8e2d184b7ea7fa575d4836f0ea P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:21.523132 719 leader_election.cc:343] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:21.523298 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 92f95f7591b84ebbba033ec0e0cfc8b3 (table default.Table_5f19fbe9c1f94632833382d5ff0c71c8 [id=5237c0e4bebf4b26a0bb902002016ac7]) successfully deleted
I20260318 02:51:21.523301 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1af760ed8ff14a498e751e67550cb1ac" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:21.523494 785 raft_consensus.cc:3060] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:21.523651 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 97655cb5968b4c819273068818d5cab8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97655cb5968b4c819273068818d5cab8 already in progress: creating tablet
W20260318 02:51:21.523881 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 53502a8e2d184b7ea7fa575d4836f0ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53502a8e2d184b7ea7fa575d4836f0ea already in progress: creating tablet
I20260318 02:51:21.524142 1175 tablet_replica.cc:333] T b9fe7de28b0646b9b2b96fc46962df9e P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:21.524353 1175 raft_consensus.cc:2243] T b9fe7de28b0646b9b2b96fc46962df9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.524513 1175 raft_consensus.cc:2272] T b9fe7de28b0646b9b2b96fc46962df9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.526134 785 raft_consensus.cc:2468] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:21.526683 719 leader_election.cc:304] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:21.527143 1175 ts_tablet_manager.cc:1916] T b9fe7de28b0646b9b2b96fc46962df9e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:21.527024 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.131:37025, user_credentials={real_user=slave}} blocked reactor thread for 48317.6us
I20260318 02:51:21.527969 1288 raft_consensus.cc:2749] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:21.528134 1176 tablet_replica.cc:333] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:21.528298 1176 raft_consensus.cc:2243] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.528481 1176 raft_consensus.cc:2272] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.526724 1173 tablet_bootstrap.cc:654] T 53502a8e2d184b7ea7fa575d4836f0ea P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:21.529284 443 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: connect: Connection refused (error 111) [suppressed 11 similar messages]
I20260318 02:51:21.529938 1174 tablet_bootstrap.cc:492] T 0ea4a57dc67e407f9c93679cb2053557 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:21.530083 1174 ts_tablet_manager.cc:1403] T 0ea4a57dc67e407f9c93679cb2053557 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.166s user 0.008s sys 0.015s
I20260318 02:51:21.516526 997 leader_election.cc:304] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:21.519709 1172 tablet_bootstrap.cc:492] T cc99bc3332eb48f7a4980533ee71f581 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:21.530750 1172 ts_tablet_manager.cc:1403] T cc99bc3332eb48f7a4980533ee71f581 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.031s user 0.010s sys 0.002s
I20260318 02:51:21.530855 1174 raft_consensus.cc:359] T 0ea4a57dc67e407f9c93679cb2053557 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.531302 1190 raft_consensus.cc:2804] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:21.531564 1174 raft_consensus.cc:385] T 0ea4a57dc67e407f9c93679cb2053557 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.531689 1174 raft_consensus.cc:740] T 0ea4a57dc67e407f9c93679cb2053557 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.531960 1174 consensus_queue.cc:260] T 0ea4a57dc67e407f9c93679cb2053557 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.532531 1176 ts_tablet_manager.cc:1916] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.532663 1174 ts_tablet_manager.cc:1434] T 0ea4a57dc67e407f9c93679cb2053557 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:21.533001 1174 tablet_bootstrap.cc:492] T 9e421d3fe62b4985bfe0486a4b115b2a P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:21.532768 1172 raft_consensus.cc:359] T cc99bc3332eb48f7a4980533ee71f581 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.533494 1172 raft_consensus.cc:385] T cc99bc3332eb48f7a4980533ee71f581 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.533915 1172 raft_consensus.cc:740] T cc99bc3332eb48f7a4980533ee71f581 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.534176 1172 consensus_queue.cc:260] T cc99bc3332eb48f7a4980533ee71f581 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.534991 1174 tablet_bootstrap.cc:654] T 9e421d3fe62b4985bfe0486a4b115b2a P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.535225 1184 log.cc:1199] T 5955a2ce20e64b0989f26dec7e439792 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/5955a2ce20e64b0989f26dec7e439792
I20260318 02:51:21.535621 1184 ts_tablet_manager.cc:1950] T 5955a2ce20e64b0989f26dec7e439792 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:21.536669 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 5955a2ce20e64b0989f26dec7e439792 (table default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]) successfully deleted
I20260318 02:51:21.545704 1176 ts_tablet_manager.cc:1929] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.545874 1176 log.cc:1199] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/54bffc30199246fd93edf7486b2e3a91
I20260318 02:51:21.546233 1176 ts_tablet_manager.cc:1950] T 54bffc30199246fd93edf7486b2e3a91 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:21.547326 1172 ts_tablet_manager.cc:1434] T cc99bc3332eb48f7a4980533ee71f581 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.016s user 0.000s sys 0.004s
I20260318 02:51:21.547690 1172 tablet_bootstrap.cc:492] T b176363ce948489ab05178e5875f2ccd P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:21.548115 1190 raft_consensus.cc:697] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:21.548755 1190 consensus_queue.cc:237] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.552506 1175 ts_tablet_manager.cc:1929] T b9fe7de28b0646b9b2b96fc46962df9e P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.552682 1175 log.cc:1199] T b9fe7de28b0646b9b2b96fc46962df9e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/b9fe7de28b0646b9b2b96fc46962df9e
I20260318 02:51:21.553062 1175 ts_tablet_manager.cc:1950] T b9fe7de28b0646b9b2b96fc46962df9e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:21.557370 1176 tablet_replica.cc:333] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
W20260318 02:51:21.560298 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ff487cba236491eb22becf0dc591925 consensus state has no leader
I20260318 02:51:21.560751 1172 tablet_bootstrap.cc:654] T b176363ce948489ab05178e5875f2ccd P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:21.561964 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a8b44b68094344f7a694ae4d985f56a6 has no consensus state
I20260318 02:51:21.562335 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_64fa6aaaa46242f3a737f4da65eb1947" } modify_external_catalogs: true
I20260318 02:51:21.562516 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_64fa6aaaa46242f3a737f4da65eb1947" } modify_external_catalogs: true
I20260318 02:51:21.563547 1175 tablet_replica.cc:333] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:21.563535 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet b9fe7de28b0646b9b2b96fc46962df9e (table default.Table_f89bbd2163914385916f490a3e147bd8 [id=3503ad3a2305498f97378035b06f06b1]) successfully deleted
I20260318 02:51:21.563802 1175 raft_consensus.cc:2243] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.564023 1175 raft_consensus.cc:2272] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.564021 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_70e2f45a75724db48820714e88bbb17d" } modify_external_catalogs: true
I20260318 02:51:21.564198 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_70e2f45a75724db48820714e88bbb17d" } modify_external_catalogs: true
I20260318 02:51:21.564817 1175 ts_tablet_manager.cc:1916] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.564906 457 master_service.cc:954] ReplaceTablet: received request to replace tablet 54bffc30199246fd93edf7486b2e3a91 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:21.564105 1173 tablet_bootstrap.cc:492] T 53502a8e2d184b7ea7fa575d4836f0ea P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:21.565128 1173 ts_tablet_manager.cc:1403] T 53502a8e2d184b7ea7fa575d4836f0ea P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.003s
I20260318 02:51:21.565430 457 master_service.cc:954] ReplaceTablet: received request to replace tablet 3ff487cba236491eb22becf0dc591925 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:21.565968 1173 raft_consensus.cc:359] T 53502a8e2d184b7ea7fa575d4836f0ea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:21.566152 1173 raft_consensus.cc:385] T 53502a8e2d184b7ea7fa575d4836f0ea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.566241 1173 raft_consensus.cc:740] T 53502a8e2d184b7ea7fa575d4836f0ea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.566314 1176 raft_consensus.cc:2243] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.566553 1176 raft_consensus.cc:2272] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.566502 1173 consensus_queue.cc:260] T 53502a8e2d184b7ea7fa575d4836f0ea P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:21.569118 1173 ts_tablet_manager.cc:1434] T 53502a8e2d184b7ea7fa575d4836f0ea P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260318 02:51:21.569487 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 977b95a3442a405d90385cdb4d6dd5dd consensus state has no leader
I20260318 02:51:21.569531 1173 tablet_bootstrap.cc:492] T 41a152a453fe47d194766635ab586804 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:21.569824 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1e6ea5dc81d34a03b5135f4caeef56f5" } modify_external_catalogs: true
I20260318 02:51:21.569995 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1e6ea5dc81d34a03b5135f4caeef56f5" } modify_external_catalogs: true
I20260318 02:51:21.570760 1172 tablet_bootstrap.cc:492] T b176363ce948489ab05178e5875f2ccd P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:21.570780 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_347e676321aa483fa750cfa91235cbe7" } modify_external_catalogs: true
I20260318 02:51:21.570932 1172 ts_tablet_manager.cc:1403] T b176363ce948489ab05178e5875f2ccd P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.004s
I20260318 02:51:21.570921 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_347e676321aa483fa750cfa91235cbe7" } modify_external_catalogs: true
I20260318 02:51:21.571521 1173 tablet_bootstrap.cc:654] T 41a152a453fe47d194766635ab586804 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.571919 1172 raft_consensus.cc:359] T b176363ce948489ab05178e5875f2ccd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.572125 1172 raft_consensus.cc:385] T b176363ce948489ab05178e5875f2ccd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.572204 1172 raft_consensus.cc:740] T b176363ce948489ab05178e5875f2ccd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.572499 1172 consensus_queue.cc:260] T b176363ce948489ab05178e5875f2ccd P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.573045 1172 ts_tablet_manager.cc:1434] T b176363ce948489ab05178e5875f2ccd P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260318 02:51:21.573130 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 62af8b953213412bb0c3bd1c68042ec9 (DEFAULT_TABLE table=default.Table_64fa6aaaa46242f3a737f4da65eb1947 [id=de39610433af488e9fc732cbb5dd7523]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.573415 1172 tablet_bootstrap.cc:492] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:21.573546 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62af8b953213412bb0c3bd1c68042ec9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:21.573421 443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.188:41593, user_credentials={real_user=slave}} blocked reactor thread for 44121.1us
I20260318 02:51:21.573855 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 41a152a453fe47d194766635ab586804 (table default.Table_b2b84cb26868440ca83042602d382c10 [id=e0155dac40a44f07885db7ec2d76f271]) successfully deleted
W20260318 02:51:21.574083 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 1df8029146564e1c9dc88dd9f5fb64ae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1df8029146564e1c9dc88dd9f5fb64ae already in progress: creating tablet
W20260318 02:51:21.574318 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 96a854e3872c44e4863316c9fe5f2ee9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96a854e3872c44e4863316c9fe5f2ee9 already in progress: creating tablet
I20260318 02:51:21.574509 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 54bffc30199246fd93edf7486b2e3a91 (table default.Table_3078ea8f226c4adc8743e3a9371f2a97 [id=a58374eeb920473e941c9d07accd5ee5]) successfully deleted
I20260318 02:51:21.575315 761 tablet_service.cc:1511] Processing CreateTablet for tablet 62af8b953213412bb0c3bd1c68042ec9 (DEFAULT_TABLE table=default.Table_64fa6aaaa46242f3a737f4da65eb1947 [id=de39610433af488e9fc732cbb5dd7523]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.575745 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62af8b953213412bb0c3bd1c68042ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.577466 903 tablet_service.cc:1511] Processing CreateTablet for tablet 62af8b953213412bb0c3bd1c68042ec9 (DEFAULT_TABLE table=default.Table_64fa6aaaa46242f3a737f4da65eb1947 [id=de39610433af488e9fc732cbb5dd7523]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.577612 892 tablet_service.cc:1511] Processing CreateTablet for tablet d4a54d0daa9f48a89b3f114367750826 (DEFAULT_TABLE table=default.Table_73bd00aac389472ba24f2baa8f23b550 [id=5a3571f0765948588578d8e5185807a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.577872 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62af8b953213412bb0c3bd1c68042ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.577838 1039 tablet_service.cc:1511] Processing CreateTablet for tablet d4a54d0daa9f48a89b3f114367750826 (DEFAULT_TABLE table=default.Table_73bd00aac389472ba24f2baa8f23b550 [id=5a3571f0765948588578d8e5185807a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.578130 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a54d0daa9f48a89b3f114367750826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.578189 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a54d0daa9f48a89b3f114367750826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.578416 907 tablet_service.cc:1511] Processing CreateTablet for tablet 00d953e1ae2f47fc8016a2f9a791141d (DEFAULT_TABLE table=default.Table_27d90de2be7248649ebf3dde534d7091 [id=b3f661ab32bc4941805f8c4018d47435]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.578753 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00d953e1ae2f47fc8016a2f9a791141d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.580883 454 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_83aab17168ad4c2bae9ea1b354ef5001 [id=1c0082e294dd43cdb2eb4ed335ff3c06] alter complete (version 3)
I20260318 02:51:21.581045 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 71c518c87bdd4a63aa1016e8de6bafdc (DEFAULT_TABLE table=default.Table_05696f972aa0431fa0dff6438e8e8bfd [id=dc28d96d1b5741de820129003145794b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.581475 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c518c87bdd4a63aa1016e8de6bafdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.584242 760 tablet_service.cc:1511] Processing CreateTablet for tablet 00d953e1ae2f47fc8016a2f9a791141d (DEFAULT_TABLE table=default.Table_27d90de2be7248649ebf3dde534d7091 [id=b3f661ab32bc4941805f8c4018d47435]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.584833 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00d953e1ae2f47fc8016a2f9a791141d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.585122 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 00d953e1ae2f47fc8016a2f9a791141d (DEFAULT_TABLE table=default.Table_27d90de2be7248649ebf3dde534d7091 [id=b3f661ab32bc4941805f8c4018d47435]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.585523 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00d953e1ae2f47fc8016a2f9a791141d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.589077 764 tablet_service.cc:1511] Processing CreateTablet for tablet d4a54d0daa9f48a89b3f114367750826 (DEFAULT_TABLE table=default.Table_73bd00aac389472ba24f2baa8f23b550 [id=5a3571f0765948588578d8e5185807a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.589516 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a54d0daa9f48a89b3f114367750826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.595835 1172 tablet_bootstrap.cc:654] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.597926 455 catalog_manager.cc:5671] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:21.598340 455 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 1af760ed8ff14a498e751e67550cb1ac (table default.Table_0c5e75f8ad484c6d87b15a8f88667a0b [id=433e7aa77412424ebb38784bb073d1fb]). Expected version 4 got 0
I20260318 02:51:21.602793 1175 ts_tablet_manager.cc:1929] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.602738 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ac3e0d779cea49a6bd0789aedae5d43c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.603334 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac3e0d779cea49a6bd0789aedae5d43c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.605777 907 tablet_service.cc:1511] Processing CreateTablet for tablet 71c518c87bdd4a63aa1016e8de6bafdc (DEFAULT_TABLE table=default.Table_05696f972aa0431fa0dff6438e8e8bfd [id=dc28d96d1b5741de820129003145794b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.606634 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c518c87bdd4a63aa1016e8de6bafdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.612763 1044 tablet_service.cc:1511] Processing CreateTablet for tablet a8b44b68094344f7a694ae4d985f56a6 (DEFAULT_TABLE table=default.Table_7f6deccea357456489e67b7be47c0c18 [id=eda94e850ac246cc878d8ef48a7f506e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.612983 892 tablet_service.cc:1511] Processing CreateTablet for tablet a8b44b68094344f7a694ae4d985f56a6 (DEFAULT_TABLE table=default.Table_7f6deccea357456489e67b7be47c0c18 [id=eda94e850ac246cc878d8ef48a7f506e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.613013 1032 tablet_service.cc:1511] Processing CreateTablet for tablet cf27c8d69f41431e9fab12e605e15b9c (DEFAULT_TABLE table=default.Table_d469c0a03b6c480693974a3f51fc5662 [id=313b847f9c15442198f034c266da8078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.613220 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b44b68094344f7a694ae4d985f56a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.613368 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b44b68094344f7a694ae4d985f56a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.613431 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf27c8d69f41431e9fab12e605e15b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.612409 903 tablet_service.cc:1511] Processing CreateTablet for tablet bd077319b3c443849de087eb61da6a77 (DEFAULT_TABLE table=default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.614861 894 tablet_service.cc:1511] Processing CreateTablet for tablet cf27c8d69f41431e9fab12e605e15b9c (DEFAULT_TABLE table=default.Table_d469c0a03b6c480693974a3f51fc5662 [id=313b847f9c15442198f034c266da8078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.616927 1228 raft_consensus.cc:493] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:21.617074 1228 raft_consensus.cc:515] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.617728 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf27c8d69f41431e9fab12e605e15b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.617798 1228 leader_election.cc:290] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:21.617795 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_19024a064c5c46bfad46c1662a67e3c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.618338 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19024a064c5c46bfad46c1662a67e3c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.619199 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ad59f4f5db8424a900b36e060745aa6" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:21.619894 860 leader_election.cc:343] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:21.620330 862 leader_election.cc:343] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 1ad59f4f5db8424a900b36e060745aa6
I20260318 02:51:21.620474 862 leader_election.cc:304] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:21.621181 1228 raft_consensus.cc:2749] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:21.621208 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_44e0a8a98f0546b1bbebda3cbdd1fe4e" } new_table_name: "default.Table_b55842f68c204d93a947d4601487112b" modify_external_catalogs: true
I20260318 02:51:21.625759 1041 tablet_service.cc:1511] Processing CreateTablet for tablet bd077319b3c443849de087eb61da6a77 (DEFAULT_TABLE table=default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.626295 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd077319b3c443849de087eb61da6a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.627394 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd077319b3c443849de087eb61da6a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.633540 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ea4a57dc67e407f9c93679cb2053557 with delete_type TABLET_DATA_DELETED (replaced by tablet 959faf1fbb224434b896c0f21e9715be) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.633648 1176 ts_tablet_manager.cc:1916] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.634502 764 tablet_service.cc:1511] Processing CreateTablet for tablet 71c518c87bdd4a63aa1016e8de6bafdc (DEFAULT_TABLE table=default.Table_05696f972aa0431fa0dff6438e8e8bfd [id=dc28d96d1b5741de820129003145794b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.634992 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c518c87bdd4a63aa1016e8de6bafdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.637264 1175 log.cc:1199] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/10aafa9bf1c44b95b0263d9a76b8b1b2
I20260318 02:51:21.638089 1175 ts_tablet_manager.cc:1950] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:21.635885 761 tablet_service.cc:1511] Processing CreateTablet for tablet bd077319b3c443849de087eb61da6a77 (DEFAULT_TABLE table=default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.638919 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd077319b3c443849de087eb61da6a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.642197 1175 tablet_replica.cc:333] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:21.642714 1175 raft_consensus.cc:2243] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.643213 1175 raft_consensus.cc:2272] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.645787 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 8319efcfa31b45afb4dbd90cb5f13e97
I20260318 02:51:21.647411 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 (table default.Table_0d969a129e064d118a5bd11a6f34b8f1 [id=c8d7ee2f33154a1fbc8d7c7f6fb7e3a8]) successfully deleted
I20260318 02:51:21.647419 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 8319efcfa31b45afb4dbd90cb5f13e97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.647744 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 8319efcfa31b45afb4dbd90cb5f13e97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.648343 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_607d1941968145a6a336b9a5bb85b43e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.648839 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 8319efcfa31b45afb4dbd90cb5f13e97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8319efcfa31b45afb4dbd90cb5f13e97 already in progress: creating tablet
I20260318 02:51:21.649128 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 53502a8e2d184b7ea7fa575d4836f0ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:21.649281 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_607d1941968145a6a336b9a5bb85b43e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.651149 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet e61c374078854d589219dfa4c20e4222
I20260318 02:51:21.651867 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_39cfb7dac1634b1285361e7ac3735f7b" } new_table_name: "default.Table_b4c6c515fa1b469bad29515911177508" modify_external_catalogs: true
I20260318 02:51:21.652370 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet e61c374078854d589219dfa4c20e4222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.652632 907 tablet_service.cc:1558] Processing DeleteTablet for tablet e61c374078854d589219dfa4c20e4222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.652905 1175 ts_tablet_manager.cc:1916] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:21.653321 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet e61c374078854d589219dfa4c20e4222 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e61c374078854d589219dfa4c20e4222 already in progress: creating tablet
I20260318 02:51:21.653504 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 3b9ac6b9d4a245ec8d8aed1db976123b
I20260318 02:51:21.654155 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_55d80bc4ac3d4e72b2c5e6a694968f83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:21.654511 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b9ac6b9d4a245ec8d8aed1db976123b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:21.654721 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55d80bc4ac3d4e72b2c5e6a694968f83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.656127 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 62af8b953213412bb0c3bd1c68042ec9
I20260318 02:51:21.656929 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c15b5791e7ca4928bfeccb13448f1cf9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:21.657104 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 62af8b953213412bb0c3bd1c68042ec9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:21.657505 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c15b5791e7ca4928bfeccb13448f1cf9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.653326 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 3ff487cba236491eb22becf0dc591925
I20260318 02:51:21.659132 457 catalog_manager.cc:6741] ReplaceTablet: tablet 3ff487cba236491eb22becf0dc591925 deleted and replaced by tablet ab158343adb14eab85c595fa5405145d
I20260318 02:51:21.659327 457 master_service.cc:954] ReplaceTablet: received request to replace tablet 677f33f9e4ad4859ab85692f7b7aad2a from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:21.659502 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ff487cba236491eb22becf0dc591925 with delete_type TABLET_DATA_DELETED (replaced by tablet ab158343adb14eab85c595fa5405145d) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.661172 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3027337e0c384f2b868ff5550be99c07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.661736 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3027337e0c384f2b868ff5550be99c07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.663134 1175 ts_tablet_manager.cc:1929] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.665465 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f1ed26420c64492a94e8920d8c753fc3
I20260318 02:51:21.666108 450 master_service.cc:954] ReplaceTablet: received request to replace tablet 97655cb5968b4c819273068818d5cab8 from {username='slave'} at 127.0.0.1:47158
W20260318 02:51:21.667066 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7cfaf92570b34b2bb1f52aea06187c83 consensus state has no leader
I20260318 02:51:21.666136 907 tablet_service.cc:1558] Processing DeleteTablet for tablet f1ed26420c64492a94e8920d8c753fc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.668507 1175 log.cc:1199] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/1ad59f4f5db8424a900b36e060745aa6
I20260318 02:51:21.668951 1175 ts_tablet_manager.cc:1950] T 1ad59f4f5db8424a900b36e060745aa6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:21.670001 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 1ad59f4f5db8424a900b36e060745aa6 (table default.Table_7302de3324f84feea6928392c6067ecb [id=5104d449469a4fdc99dab10843e6c5b1]) successfully deleted
W20260318 02:51:21.670442 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba already in progress: creating tablet
W20260318 02:51:21.670761 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 74233fd7ed094e7cbfc79309605db0e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74233fd7ed094e7cbfc79309605db0e1 already in progress: creating tablet
W20260318 02:51:21.671096 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 8319efcfa31b45afb4dbd90cb5f13e97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8319efcfa31b45afb4dbd90cb5f13e97 already in progress: creating tablet
I20260318 02:51:21.671219 1175 tablet_replica.cc:333] T 53502a8e2d184b7ea7fa575d4836f0ea P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:21.671452 1175 raft_consensus.cc:2243] T 53502a8e2d184b7ea7fa575d4836f0ea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.671684 1175 raft_consensus.cc:2272] T 53502a8e2d184b7ea7fa575d4836f0ea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.673075 455 master_service.cc:954] ReplaceTablet: received request to replace tablet af802894346443669f1cc549a1ba401b from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:21.673714 1175 ts_tablet_manager.cc:1916] T 53502a8e2d184b7ea7fa575d4836f0ea P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.636551 760 tablet_service.cc:1511] Processing CreateTablet for tablet a8b44b68094344f7a694ae4d985f56a6 (DEFAULT_TABLE table=default.Table_7f6deccea357456489e67b7be47c0c18 [id=eda94e850ac246cc878d8ef48a7f506e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.637195 759 tablet_service.cc:1511] Processing CreateTablet for tablet cf27c8d69f41431e9fab12e605e15b9c (DEFAULT_TABLE table=default.Table_d469c0a03b6c480693974a3f51fc5662 [id=313b847f9c15442198f034c266da8078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.680930 1288 raft_consensus.cc:493] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:21.681124 1288 raft_consensus.cc:515] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:21.682206 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53502a8e2d184b7ea7fa575d4836f0ea" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:21.687247 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 45fddf78fc834d20908696b980d394a2 consensus state has no leader
I20260318 02:51:21.687999 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 677f33f9e4ad4859ab85692f7b7aad2a
I20260318 02:51:21.688521 457 catalog_manager.cc:6741] ReplaceTablet: tablet 677f33f9e4ad4859ab85692f7b7aad2a deleted and replaced by tablet c5765355efaa4ef4ab3b68ea33f51536
I20260318 02:51:21.690577 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b9ac6b9d4a245ec8d8aed1db976123b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.691484 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet af802894346443669f1cc549a1ba401b
I20260318 02:51:21.692019 455 catalog_manager.cc:6741] ReplaceTablet: tablet af802894346443669f1cc549a1ba401b deleted and replaced by tablet 30205728339f4bcf8b7d94d6f373e01c
I20260318 02:51:21.688231 1175 ts_tablet_manager.cc:1929] T 53502a8e2d184b7ea7fa575d4836f0ea P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.688818 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 677f33f9e4ad4859ab85692f7b7aad2a with delete_type TABLET_DATA_DELETED (replaced by tablet c5765355efaa4ef4ab3b68ea33f51536) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.696228 758 tablet_service.cc:1558] Processing DeleteTablet for tablet e61c374078854d589219dfa4c20e4222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.696447 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 8319efcfa31b45afb4dbd90cb5f13e97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.692397 903 tablet_service.cc:1558] Processing DeleteTablet for tablet af802894346443669f1cc549a1ba401b with delete_type TABLET_DATA_DELETED (replaced by tablet 30205728339f4bcf8b7d94d6f373e01c) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.696799 1175 log.cc:1199] T 53502a8e2d184b7ea7fa575d4836f0ea P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/53502a8e2d184b7ea7fa575d4836f0ea
I20260318 02:51:21.697714 1175 ts_tablet_manager.cc:1950] T 53502a8e2d184b7ea7fa575d4836f0ea P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:21.683887 1173 tablet_bootstrap.cc:492] T 41a152a453fe47d194766635ab586804 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:21.698211 1173 ts_tablet_manager.cc:1403] T 41a152a453fe47d194766635ab586804 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.129s user 0.003s sys 0.005s
I20260318 02:51:21.698954 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 53502a8e2d184b7ea7fa575d4836f0ea (table default.Table_63ea580c95a14a2f85b3ca002a8b1399 [id=0c04457e82e54a229437db0c3f90811b]) successfully deleted
I20260318 02:51:21.699064 1173 raft_consensus.cc:359] T 41a152a453fe47d194766635ab586804 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.699186 1288 leader_election.cc:290] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:21.699273 1173 raft_consensus.cc:385] T 41a152a453fe47d194766635ab586804 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.699342 1173 raft_consensus.cc:740] T 41a152a453fe47d194766635ab586804 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.699414 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf27c8d69f41431e9fab12e605e15b9c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:21.699586 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet e61c374078854d589219dfa4c20e4222 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e61c374078854d589219dfa4c20e4222 already in progress: creating tablet
W20260318 02:51:21.699747 719 leader_election.cc:343] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: Tablet not RUNNING: STOPPED
I20260318 02:51:21.699808 1173 consensus_queue.cc:260] T 41a152a453fe47d194766635ab586804 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:21.699973 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 3b9ac6b9d4a245ec8d8aed1db976123b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b9ac6b9d4a245ec8d8aed1db976123b already in progress: creating tablet
I20260318 02:51:21.700223 1174 tablet_bootstrap.cc:492] T 9e421d3fe62b4985bfe0486a4b115b2a P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
W20260318 02:51:21.700436 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 62af8b953213412bb0c3bd1c68042ec9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62af8b953213412bb0c3bd1c68042ec9 already in progress: creating tablet
W20260318 02:51:21.701363 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 3ff487cba236491eb22becf0dc591925 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ff487cba236491eb22becf0dc591925 already in progress: creating tablet
W20260318 02:51:21.701745 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f1ed26420c64492a94e8920d8c753fc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1ed26420c64492a94e8920d8c753fc3 already in progress: creating tablet
W20260318 02:51:21.701967 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 677f33f9e4ad4859ab85692f7b7aad2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 677f33f9e4ad4859ab85692f7b7aad2a already in progress: creating tablet
W20260318 02:51:21.702461 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet af802894346443669f1cc549a1ba401b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af802894346443669f1cc549a1ba401b already in progress: creating tablet
I20260318 02:51:21.704025 903 tablet_service.cc:1511] Processing CreateTablet for tablet 0ed4350e0fde4c8690970bc69830fcb3 (DEFAULT_TABLE table=default.Table_4ced5c1198ce406b85fbee4bbe6368c0 [id=a1f776ccb9f44dba98f77ad3fec5df41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.704481 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ed4350e0fde4c8690970bc69830fcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.705946 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 62af8b953213412bb0c3bd1c68042ec9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.706125 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b9ac6b9d4a245ec8d8aed1db976123b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.708532 763 tablet_service.cc:1511] Processing CreateTablet for tablet 0ed4350e0fde4c8690970bc69830fcb3 (DEFAULT_TABLE table=default.Table_4ced5c1198ce406b85fbee4bbe6368c0 [id=a1f776ccb9f44dba98f77ad3fec5df41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.709257 757 tablet_service.cc:1511] Processing CreateTablet for tablet f447cab3445c451d8ef8746966cfcd42 (DEFAULT_TABLE table=default.Table_4d622f52dad8400883eae6801df84f37 [id=348edc09be924f24934c12fa52e9f40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.709349 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 41a152a453fe47d194766635ab586804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.709800 899 tablet_service.cc:1511] Processing CreateTablet for tablet 5db76f996b094bf99b6c6fe33f02b9f3 (DEFAULT_TABLE table=default.Table_1e9e471c1715493487baf6ce6eab167a [id=a6f1506993614ec5904423ac309abf1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.709882 1176 ts_tablet_manager.cc:1929] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.710078 907 tablet_service.cc:1511] Processing CreateTablet for tablet f447cab3445c451d8ef8746966cfcd42 (DEFAULT_TABLE table=default.Table_4d622f52dad8400883eae6801df84f37 [id=348edc09be924f24934c12fa52e9f40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.710237 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db76f996b094bf99b6c6fe33f02b9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.710389 1174 ts_tablet_manager.cc:1403] T 9e421d3fe62b4985bfe0486a4b115b2a P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.167s user 0.011s sys 0.011s
I20260318 02:51:21.710892 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b44b68094344f7a694ae4d985f56a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.711302 762 tablet_service.cc:1558] Processing DeleteTablet for tablet af802894346443669f1cc549a1ba401b with delete_type TABLET_DATA_DELETED (replaced by tablet 30205728339f4bcf8b7d94d6f373e01c) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.711416 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f447cab3445c451d8ef8746966cfcd42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.711503 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 677f33f9e4ad4859ab85692f7b7aad2a with delete_type TABLET_DATA_DELETED (replaced by tablet c5765355efaa4ef4ab3b68ea33f51536) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.711632 1174 raft_consensus.cc:359] T 9e421d3fe62b4985bfe0486a4b115b2a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.711862 1174 raft_consensus.cc:385] T 9e421d3fe62b4985bfe0486a4b115b2a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.711895 894 tablet_service.cc:1511] Processing CreateTablet for tablet b9e0c54b3f1b44e4bea7253473714e94 (DEFAULT_TABLE table=default.Table_4a675721365c4600b0a6a7712c03db81 [id=96f382936c1d4b30a3c5e3a1b55b04d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.711961 1174 raft_consensus.cc:740] T 9e421d3fe62b4985bfe0486a4b115b2a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.711920 756 tablet_service.cc:1511] Processing CreateTablet for tablet b9e0c54b3f1b44e4bea7253473714e94 (DEFAULT_TABLE table=default.Table_4a675721365c4600b0a6a7712c03db81 [id=96f382936c1d4b30a3c5e3a1b55b04d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.712219 1174 consensus_queue.cc:260] T 9e421d3fe62b4985bfe0486a4b115b2a P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.712424 758 tablet_service.cc:1558] Processing DeleteTablet for tablet f1ed26420c64492a94e8920d8c753fc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.712775 1174 ts_tablet_manager.cc:1434] T 9e421d3fe62b4985bfe0486a4b115b2a P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:21.713007 1176 log.cc:1199] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/53e66044bfed4b53a1c0bc4dc8de52e6
I20260318 02:51:21.713133 1174 tablet_bootstrap.cc:492] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:21.713423 1176 ts_tablet_manager.cc:1950] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:21.713724 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f447cab3445c451d8ef8746966cfcd42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.716368 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e0c54b3f1b44e4bea7253473714e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.712313 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ff487cba236491eb22becf0dc591925 with delete_type TABLET_DATA_DELETED (replaced by tablet ab158343adb14eab85c595fa5405145d) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.711869 755 tablet_service.cc:1511] Processing CreateTablet for tablet 5db76f996b094bf99b6c6fe33f02b9f3 (DEFAULT_TABLE table=default.Table_1e9e471c1715493487baf6ce6eab167a [id=a6f1506993614ec5904423ac309abf1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.716863 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e0c54b3f1b44e4bea7253473714e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.717964 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ed4350e0fde4c8690970bc69830fcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.722514 1174 tablet_bootstrap.cc:654] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.726197 1176 tablet_replica.cc:333] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:21.726629 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db76f996b094bf99b6c6fe33f02b9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.729723 1176 raft_consensus.cc:2243] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.729910 1176 raft_consensus.cc:2272] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.730465 1176 ts_tablet_manager.cc:1916] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:21.730937 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 41a152a453fe47d194766635ab586804 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41a152a453fe47d194766635ab586804 already in progress: creating tablet
I20260318 02:51:21.743712 1176 ts_tablet_manager.cc:1929] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.743867 1176 log.cc:1199] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/53502a8e2d184b7ea7fa575d4836f0ea
I20260318 02:51:21.745172 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 53e66044bfed4b53a1c0bc4dc8de52e6 (table default.Table_6b0fdcb080ea4a6b97f51308598362be [id=3ce1c72a2d4e42c698e85d5034d873e0]) successfully deleted
W20260318 02:51:21.745514 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 97655cb5968b4c819273068818d5cab8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97655cb5968b4c819273068818d5cab8 already in progress: creating tablet
I20260318 02:51:21.748898 1173 ts_tablet_manager.cc:1434] T 41a152a453fe47d194766635ab586804 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.051s user 0.001s sys 0.001s
I20260318 02:51:21.753062 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 41a152a453fe47d194766635ab586804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.753372 1175 tablet_replica.cc:333] T 41a152a453fe47d194766635ab586804 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:21.753580 1175 raft_consensus.cc:2243] T 41a152a453fe47d194766635ab586804 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.753748 1175 raft_consensus.cc:2272] T 41a152a453fe47d194766635ab586804 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.754612 1173 tablet_bootstrap.cc:492] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:21.756215 1175 ts_tablet_manager.cc:1916] T 41a152a453fe47d194766635ab586804 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.756973 1173 tablet_bootstrap.cc:654] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.763029 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b55842f68c204d93a947d4601487112b" } new_table_name: "default.Table_d4e725f3b7be4140bb110b7909049178" modify_external_catalogs: true
I20260318 02:51:21.763435 907 tablet_service.cc:1511] Processing CreateTablet for tablet fda9f1fe47e04688bde80ebe23494d08 (DEFAULT_TABLE table=default.Table_3027337e0c384f2b868ff5550be99c07 [id=39b15a578c754e29b3e4f28015859a73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.763895 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fda9f1fe47e04688bde80ebe23494d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.764379 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6b075b8bc95d4159b8269cd003c6071c" } new_table_name: "default.Table_06e760051f3b473f99521e4da99f8288" modify_external_catalogs: true
I20260318 02:51:21.766929 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_881262486e0f4a268678b8422cd12beb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.767443 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_881262486e0f4a268678b8422cd12beb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.769505 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e421d3fe62b4985bfe0486a4b115b2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.771153 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6fde2e0ba8774899bd68e0a0103cb35e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.771739 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6fde2e0ba8774899bd68e0a0103cb35e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.772927 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_903c945355934d5985bf71a777ad32ab" } new_table_name: "default.Table_764057148a0945d0a7a4f9e497808d92" modify_external_catalogs: true
I20260318 02:51:21.774039 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5ea72896ec3f438ca7ea9e8b599829f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:21.774487 1175 ts_tablet_manager.cc:1929] T 41a152a453fe47d194766635ab586804 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260318 02:51:21.774528 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ea72896ec3f438ca7ea9e8b599829f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.774652 1175 log.cc:1199] T 41a152a453fe47d194766635ab586804 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/41a152a453fe47d194766635ab586804
I20260318 02:51:21.774991 1175 ts_tablet_manager.cc:1950] T 41a152a453fe47d194766635ab586804 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:21.775485 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 41a152a453fe47d194766635ab586804 (table default.Table_b2b84cb26868440ca83042602d382c10 [id=e0155dac40a44f07885db7ec2d76f271]) successfully deleted
W20260318 02:51:21.777858 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6e9372f8871b473caa024512e936a6e5 consensus state has no leader
W20260318 02:51:21.778376 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7cfaf92570b34b2bb1f52aea06187c83 consensus state has no leader
I20260318 02:51:21.780342 1176 ts_tablet_manager.cc:1950] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:21.781060 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 53502a8e2d184b7ea7fa575d4836f0ea (table default.Table_63ea580c95a14a2f85b3ca002a8b1399 [id=0c04457e82e54a229437db0c3f90811b]) successfully deleted
W20260318 02:51:21.781657 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba already in progress: creating tablet
I20260318 02:51:21.783223 1176 tablet_replica.cc:333] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:21.783457 1176 raft_consensus.cc:2243] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.783654 1176 raft_consensus.cc:2272] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.784066 764 tablet_service.cc:1511] Processing CreateTablet for tablet fda9f1fe47e04688bde80ebe23494d08 (DEFAULT_TABLE table=default.Table_3027337e0c384f2b868ff5550be99c07 [id=39b15a578c754e29b3e4f28015859a73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.784544 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fda9f1fe47e04688bde80ebe23494d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.784196 1176 ts_tablet_manager.cc:1916] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.784844 453 master_service.cc:954] ReplaceTablet: received request to replace tablet 323e4b1e9aee449f9402b1712b1444d9 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:21.785614 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ff487cba236491eb22becf0dc591925 with delete_type TABLET_DATA_DELETED (replaced by tablet ab158343adb14eab85c595fa5405145d) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.786432 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53502a8e2d184b7ea7fa575d4836f0ea" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:21.786808 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 62af8b953213412bb0c3bd1c68042ec9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:21.787365 719 leader_election.cc:343] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:21.787520 719 leader_election.cc:304] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:21.787709 719 raft_consensus.cc:2686] T 53502a8e2d184b7ea7fa575d4836f0ea P 6a903d876086423b8016d705b98895ad: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260318 02:51:21.788357 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5aebb91ff6b0416fac2ef2d056ca897a consensus state has no leader
I20260318 02:51:21.789513 1173 tablet_bootstrap.cc:492] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:21.789525 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet cc99bc3332eb48f7a4980533ee71f581 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:19 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.789686 1173 ts_tablet_manager.cc:1403] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.000s
I20260318 02:51:21.789958 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a3491e419434075ac4e6fa5881ec537 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.790752 1173 raft_consensus.cc:359] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.790952 1173 raft_consensus.cc:385] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.791042 1173 raft_consensus.cc:740] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.791326 1173 consensus_queue.cc:260] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.792351 1184 tablet_replica.cc:333] T cc99bc3332eb48f7a4980533ee71f581 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:21.792560 1184 raft_consensus.cc:2243] T cc99bc3332eb48f7a4980533ee71f581 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.792766 1184 raft_consensus.cc:2272] T cc99bc3332eb48f7a4980533ee71f581 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.792948 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet b176363ce948489ab05178e5875f2ccd with delete_type TABLET_DATA_DELETED (replaced by tablet 74233fd7ed094e7cbfc79309605db0e1) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.794193 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_50e2d197579e426787bc46d7494e2f74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.794821 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50e2d197579e426787bc46d7494e2f74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.794847 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet af802894346443669f1cc549a1ba401b with delete_type TABLET_DATA_DELETED (replaced by tablet 30205728339f4bcf8b7d94d6f373e01c) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.795253 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet f1ed26420c64492a94e8920d8c753fc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.795368 451 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d (table default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666]). Expected version 4 got 0
I20260318 02:51:21.795902 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 677f33f9e4ad4859ab85692f7b7aad2a with delete_type TABLET_DATA_DELETED (replaced by tablet c5765355efaa4ef4ab3b68ea33f51536) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.796370 1033 tablet_service.cc:1511] Processing CreateTablet for tablet f447cab3445c451d8ef8746966cfcd42 (DEFAULT_TABLE table=default.Table_4d622f52dad8400883eae6801df84f37 [id=348edc09be924f24934c12fa52e9f40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.796437 1173 ts_tablet_manager.cc:1434] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260318 02:51:21.796808 1184 ts_tablet_manager.cc:1916] T cc99bc3332eb48f7a4980533ee71f581 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.796820 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 323e4b1e9aee449f9402b1712b1444d9
I20260318 02:51:21.797056 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 0ed4350e0fde4c8690970bc69830fcb3 (DEFAULT_TABLE table=default.Table_4ced5c1198ce406b85fbee4bbe6368c0 [id=a1f776ccb9f44dba98f77ad3fec5df41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.797278 453 catalog_manager.cc:6741] ReplaceTablet: tablet 323e4b1e9aee449f9402b1712b1444d9 deleted and replaced by tablet 8c20810ad3354126bf49bbeeb6edb098
I20260318 02:51:21.798079 1041 tablet_service.cc:1511] Processing CreateTablet for tablet b9e0c54b3f1b44e4bea7253473714e94 (DEFAULT_TABLE table=default.Table_4a675721365c4600b0a6a7712c03db81 [id=96f382936c1d4b30a3c5e3a1b55b04d4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:21.798867 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 3b9ac6b9d4a245ec8d8aed1db976123b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b9ac6b9d4a245ec8d8aed1db976123b already in progress: creating tablet
I20260318 02:51:21.798902 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 323e4b1e9aee449f9402b1712b1444d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 8c20810ad3354126bf49bbeeb6edb098) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:21.799134 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 3ff487cba236491eb22becf0dc591925 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ff487cba236491eb22becf0dc591925 already in progress: creating tablet
I20260318 02:51:21.799216 453 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d (table default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666]). Expected version 4 got 0
W20260318 02:51:21.799332 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 62af8b953213412bb0c3bd1c68042ec9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62af8b953213412bb0c3bd1c68042ec9 already in progress: creating tablet
W20260318 02:51:21.800014 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 323e4b1e9aee449f9402b1712b1444d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 323e4b1e9aee449f9402b1712b1444d9 already in progress: creating tablet
I20260318 02:51:21.800060 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 5db76f996b094bf99b6c6fe33f02b9f3 (DEFAULT_TABLE table=default.Table_1e9e471c1715493487baf6ce6eab167a [id=a6f1506993614ec5904423ac309abf1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.800352 1039 tablet_service.cc:1511] Processing CreateTablet for tablet fda9f1fe47e04688bde80ebe23494d08 (DEFAULT_TABLE table=default.Table_3027337e0c384f2b868ff5550be99c07 [id=39b15a578c754e29b3e4f28015859a73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.800659 1173 tablet_bootstrap.cc:492] T 4b07774692544b1c83bc547302b203a5 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:21.801169 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f447cab3445c451d8ef8746966cfcd42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.801285 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 323e4b1e9aee449f9402b1712b1444d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 8c20810ad3354126bf49bbeeb6edb098) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.802770 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 323e4b1e9aee449f9402b1712b1444d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 8c20810ad3354126bf49bbeeb6edb098) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.803399 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fda9f1fe47e04688bde80ebe23494d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.804925 760 tablet_service.cc:1511] Processing CreateTablet for tablet 2bd6ac47ba044099ad9bd211ef8d26a2 (DEFAULT_TABLE table=default.Table_55d80bc4ac3d4e72b2c5e6a694968f83 [id=541170c7c4bf49deb86cd4c15ffdd04f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.805330 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bd6ac47ba044099ad9bd211ef8d26a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.806946 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 918c542a51864e54871efc5e7f62ef61 (DEFAULT_TABLE table=default.Table_19024a064c5c46bfad46c1662a67e3c6 [id=ee10bea676fa4d1a837737c939f3306b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.807302 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918c542a51864e54871efc5e7f62ef61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.808928 761 tablet_service.cc:1511] Processing CreateTablet for tablet 918c542a51864e54871efc5e7f62ef61 (DEFAULT_TABLE table=default.Table_19024a064c5c46bfad46c1662a67e3c6 [id=ee10bea676fa4d1a837737c939f3306b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.809307 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918c542a51864e54871efc5e7f62ef61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.809463 899 tablet_service.cc:1511] Processing CreateTablet for tablet 918c542a51864e54871efc5e7f62ef61 (DEFAULT_TABLE table=default.Table_19024a064c5c46bfad46c1662a67e3c6 [id=ee10bea676fa4d1a837737c939f3306b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.809859 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918c542a51864e54871efc5e7f62ef61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.810053 756 tablet_service.cc:1511] Processing CreateTablet for tablet d6a08d8bbe3a4234b97203536db32078 (DEFAULT_TABLE table=default.Table_ac3e0d779cea49a6bd0789aedae5d43c [id=9d4604e81d4a4c8394bf285ef36e07e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.810392 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a08d8bbe3a4234b97203536db32078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.812446 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 2bd6ac47ba044099ad9bd211ef8d26a2 (DEFAULT_TABLE table=default.Table_55d80bc4ac3d4e72b2c5e6a694968f83 [id=541170c7c4bf49deb86cd4c15ffdd04f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.812844 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ed4350e0fde4c8690970bc69830fcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.813478 755 tablet_service.cc:1511] Processing CreateTablet for tablet a4f891043b7d468da3e808980690354d (DEFAULT_TABLE table=default.Table_607d1941968145a6a336b9a5bb85b43e [id=85784a23699343ee80e0adb9e5f82413]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.813876 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f891043b7d468da3e808980690354d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.813874 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bd6ac47ba044099ad9bd211ef8d26a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.814881 764 tablet_service.cc:1511] Processing CreateTablet for tablet ab158343adb14eab85c595fa5405145d (DEFAULT_TABLE table=default.Table_22e1d9e9571f415597c2b5fd053f529a [id=d20f8f1bd66d4dceab3b7bc72608da2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.815239 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab158343adb14eab85c595fa5405145d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.817081 757 tablet_service.cc:1511] Processing CreateTablet for tablet 2e16272bcf9c435a80b32ba9cba9c738 (DEFAULT_TABLE table=default.Table_c15b5791e7ca4928bfeccb13448f1cf9 [id=259a4cc85c2f4ecdbf865398fefcb0e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.817457 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e16272bcf9c435a80b32ba9cba9c738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.817554 903 tablet_service.cc:1511] Processing CreateTablet for tablet d6a08d8bbe3a4234b97203536db32078 (DEFAULT_TABLE table=default.Table_ac3e0d779cea49a6bd0789aedae5d43c [id=9d4604e81d4a4c8394bf285ef36e07e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.817956 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a08d8bbe3a4234b97203536db32078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.818246 1042 tablet_service.cc:1511] Processing CreateTablet for tablet d6a08d8bbe3a4234b97203536db32078 (DEFAULT_TABLE table=default.Table_ac3e0d779cea49a6bd0789aedae5d43c [id=9d4604e81d4a4c8394bf285ef36e07e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.818600 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a08d8bbe3a4234b97203536db32078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.821027 894 tablet_service.cc:1511] Processing CreateTablet for tablet a4f891043b7d468da3e808980690354d (DEFAULT_TABLE table=default.Table_607d1941968145a6a336b9a5bb85b43e [id=85784a23699343ee80e0adb9e5f82413]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.821027 1043 tablet_service.cc:1511] Processing CreateTablet for tablet a4f891043b7d468da3e808980690354d (DEFAULT_TABLE table=default.Table_607d1941968145a6a336b9a5bb85b43e [id=85784a23699343ee80e0adb9e5f82413]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.821408 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f891043b7d468da3e808980690354d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.821450 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f891043b7d468da3e808980690354d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.823561 763 tablet_service.cc:1511] Processing CreateTablet for tablet 30205728339f4bcf8b7d94d6f373e01c (DEFAULT_TABLE table=default.Table_3187e1c3102e48718763dac2a3a40dc9 [id=40612e2dc3b7447f8f4f753bf5474c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.824008 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30205728339f4bcf8b7d94d6f373e01c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.824764 759 tablet_service.cc:1511] Processing CreateTablet for tablet c5765355efaa4ef4ab3b68ea33f51536 (DEFAULT_TABLE table=default.Table_a61fc584a9fb41fa9d17ab0aef58582d [id=a1611aa744774532bf8c16d8cc701c49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.825003 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 2e16272bcf9c435a80b32ba9cba9c738 (DEFAULT_TABLE table=default.Table_c15b5791e7ca4928bfeccb13448f1cf9 [id=259a4cc85c2f4ecdbf865398fefcb0e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.825167 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5765355efaa4ef4ab3b68ea33f51536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.825156 892 tablet_service.cc:1511] Processing CreateTablet for tablet 2e16272bcf9c435a80b32ba9cba9c738 (DEFAULT_TABLE table=default.Table_c15b5791e7ca4928bfeccb13448f1cf9 [id=259a4cc85c2f4ecdbf865398fefcb0e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.825397 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e16272bcf9c435a80b32ba9cba9c738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.825524 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e16272bcf9c435a80b32ba9cba9c738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.833177 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e0c54b3f1b44e4bea7253473714e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.833199 904 tablet_service.cc:1511] Processing CreateTablet for tablet ab158343adb14eab85c595fa5405145d (DEFAULT_TABLE table=default.Table_22e1d9e9571f415597c2b5fd053f529a [id=d20f8f1bd66d4dceab3b7bc72608da2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.833535 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab158343adb14eab85c595fa5405145d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.836973 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db76f996b094bf99b6c6fe33f02b9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.837062 900 tablet_service.cc:1511] Processing CreateTablet for tablet 30205728339f4bcf8b7d94d6f373e01c (DEFAULT_TABLE table=default.Table_3187e1c3102e48718763dac2a3a40dc9 [id=40612e2dc3b7447f8f4f753bf5474c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.837445 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30205728339f4bcf8b7d94d6f373e01c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.840883 1174 tablet_bootstrap.cc:492] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:21.841068 1174 ts_tablet_manager.cc:1403] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.128s user 0.013s sys 0.000s
I20260318 02:51:21.841904 906 tablet_service.cc:1511] Processing CreateTablet for tablet c5765355efaa4ef4ab3b68ea33f51536 (DEFAULT_TABLE table=default.Table_a61fc584a9fb41fa9d17ab0aef58582d [id=a1611aa744774532bf8c16d8cc701c49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.841881 1174 raft_consensus.cc:359] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.842082 1174 raft_consensus.cc:385] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.842173 1174 raft_consensus.cc:740] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.842273 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5765355efaa4ef4ab3b68ea33f51536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.842391 1174 consensus_queue.cc:260] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.842893 1174 ts_tablet_manager.cc:1434] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:21.843206 1174 tablet_bootstrap.cc:492] T f7415ddf48574f7b9a746049ce78d2e9 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:21.846549 1173 tablet_bootstrap.cc:654] T 4b07774692544b1c83bc547302b203a5 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.847384 1174 tablet_bootstrap.cc:654] T f7415ddf48574f7b9a746049ce78d2e9 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.852349 1176 ts_tablet_manager.cc:1929] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.853024 1176 log.cc:1199] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/b9fe7de28b0646b9b2b96fc46962df9e
I20260318 02:51:21.853412 1176 ts_tablet_manager.cc:1950] T b9fe7de28b0646b9b2b96fc46962df9e P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:21.854537 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet b9fe7de28b0646b9b2b96fc46962df9e (table default.Table_f89bbd2163914385916f490a3e147bd8 [id=3503ad3a2305498f97378035b06f06b1]) successfully deleted
I20260318 02:51:21.855470 1174 tablet_bootstrap.cc:492] T f7415ddf48574f7b9a746049ce78d2e9 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:21.855640 1174 ts_tablet_manager.cc:1403] T f7415ddf48574f7b9a746049ce78d2e9 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.000s
I20260318 02:51:21.856026 1173 tablet_bootstrap.cc:492] T 4b07774692544b1c83bc547302b203a5 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:21.856241 1173 ts_tablet_manager.cc:1403] T 4b07774692544b1c83bc547302b203a5 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.056s user 0.004s sys 0.000s
I20260318 02:51:21.856467 1174 raft_consensus.cc:359] T f7415ddf48574f7b9a746049ce78d2e9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.856678 1174 raft_consensus.cc:385] T f7415ddf48574f7b9a746049ce78d2e9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.856779 1174 raft_consensus.cc:740] T f7415ddf48574f7b9a746049ce78d2e9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.857275 1173 raft_consensus.cc:359] T 4b07774692544b1c83bc547302b203a5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.857313 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 30205728339f4bcf8b7d94d6f373e01c (DEFAULT_TABLE table=default.Table_3187e1c3102e48718763dac2a3a40dc9 [id=40612e2dc3b7447f8f4f753bf5474c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.857389 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_82b90b9eec6a4252b7022e3cf497374c" } modify_external_catalogs: true
I20260318 02:51:21.857519 1173 raft_consensus.cc:385] T 4b07774692544b1c83bc547302b203a5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.857597 1173 raft_consensus.cc:740] T 4b07774692544b1c83bc547302b203a5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.857589 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_82b90b9eec6a4252b7022e3cf497374c" } modify_external_catalogs: true
I20260318 02:51:21.857851 1173 consensus_queue.cc:260] T 4b07774692544b1c83bc547302b203a5 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.857062 1174 consensus_queue.cc:260] T f7415ddf48574f7b9a746049ce78d2e9 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.858309 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c15b5791e7ca4928bfeccb13448f1cf9" } modify_external_catalogs: true
I20260318 02:51:21.858479 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c15b5791e7ca4928bfeccb13448f1cf9" } modify_external_catalogs: true
I20260318 02:51:21.858937 1174 ts_tablet_manager.cc:1434] T f7415ddf48574f7b9a746049ce78d2e9 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260318 02:51:21.859258 1174 tablet_bootstrap.cc:492] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:21.859480 907 tablet_service.cc:1511] Processing CreateTablet for tablet 2bd6ac47ba044099ad9bd211ef8d26a2 (DEFAULT_TABLE table=default.Table_55d80bc4ac3d4e72b2c5e6a694968f83 [id=541170c7c4bf49deb86cd4c15ffdd04f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.859933 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bd6ac47ba044099ad9bd211ef8d26a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.861521 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30205728339f4bcf8b7d94d6f373e01c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.863747 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_422656b6b8b4438e9d2000352503c6b9" } modify_external_catalogs: true
I20260318 02:51:21.863960 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_422656b6b8b4438e9d2000352503c6b9" } modify_external_catalogs: true
I20260318 02:51:21.864131 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b07774692544b1c83bc547302b203a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.865175 1173 ts_tablet_manager.cc:1434] T 4b07774692544b1c83bc547302b203a5 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260318 02:51:21.866101 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3027337e0c384f2b868ff5550be99c07" } modify_external_catalogs: true
I20260318 02:51:21.866250 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3027337e0c384f2b868ff5550be99c07" } modify_external_catalogs: true
W20260318 02:51:21.867223 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 4b07774692544b1c83bc547302b203a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b07774692544b1c83bc547302b203a5 already in progress: creating tablet
I20260318 02:51:21.869961 1173 tablet_bootstrap.cc:492] T 7e4e8586673c43058ef00f2f7aef10ee P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:21.870463 1036 tablet_service.cc:1511] Processing CreateTablet for tablet c5765355efaa4ef4ab3b68ea33f51536 (DEFAULT_TABLE table=default.Table_a61fc584a9fb41fa9d17ab0aef58582d [id=a1611aa744774532bf8c16d8cc701c49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.870559 1042 tablet_service.cc:1511] Processing CreateTablet for tablet ab158343adb14eab85c595fa5405145d (DEFAULT_TABLE table=default.Table_22e1d9e9571f415597c2b5fd053f529a [id=d20f8f1bd66d4dceab3b7bc72608da2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.870716 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d4e725f3b7be4140bb110b7909049178" } new_table_name: "default.Table_2d7043580f83421ca8d7039923dc441e" modify_external_catalogs: true
I20260318 02:51:21.870787 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b07774692544b1c83bc547302b203a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.870886 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5765355efaa4ef4ab3b68ea33f51536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.871039 1175 tablet_replica.cc:333] T 4b07774692544b1c83bc547302b203a5 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:21.871204 1175 raft_consensus.cc:2243] T 4b07774692544b1c83bc547302b203a5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.871376 1175 raft_consensus.cc:2272] T 4b07774692544b1c83bc547302b203a5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.872090 1175 ts_tablet_manager.cc:1916] T 4b07774692544b1c83bc547302b203a5 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.873238 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_376ed96eff2f4d13a0872f0984da4828" } modify_external_catalogs: true
I20260318 02:51:21.873399 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_376ed96eff2f4d13a0872f0984da4828" } modify_external_catalogs: true
I20260318 02:51:21.873871 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_74486e0a87264fb8ae22f015c8eb3fbe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.874398 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74486e0a87264fb8ae22f015c8eb3fbe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.876598 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab158343adb14eab85c595fa5405145d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.879999 1173 tablet_bootstrap.cc:654] T 7e4e8586673c43058ef00f2f7aef10ee P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.880936 1176 tablet_replica.cc:333] T 0ea4a57dc67e407f9c93679cb2053557 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:21.881141 1176 raft_consensus.cc:2243] T 0ea4a57dc67e407f9c93679cb2053557 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.881335 1176 raft_consensus.cc:2272] T 0ea4a57dc67e407f9c93679cb2053557 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.883203 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8d881dd16c5442d78313f6766ca90d4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.883781 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d881dd16c5442d78313f6766ca90d4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.884341 1175 ts_tablet_manager.cc:1929] T 4b07774692544b1c83bc547302b203a5 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.884473 1175 log.cc:1199] T 4b07774692544b1c83bc547302b203a5 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/4b07774692544b1c83bc547302b203a5
I20260318 02:51:21.884858 1175 ts_tablet_manager.cc:1950] T 4b07774692544b1c83bc547302b203a5 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:21.885931 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 4b07774692544b1c83bc547302b203a5 (table default.Table_211fe38e2cf749b8ac8d689f2fe65025 [id=da7b89f9dc554a6a9e383537b40ab14e]) successfully deleted
I20260318 02:51:21.886294 1176 ts_tablet_manager.cc:1916] T 0ea4a57dc67e407f9c93679cb2053557 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.886560 761 tablet_service.cc:1558] Processing DeleteTablet for tablet f7415ddf48574f7b9a746049ce78d2e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:21.886585 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 74233fd7ed094e7cbfc79309605db0e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74233fd7ed094e7cbfc79309605db0e1 already in progress: creating tablet
W20260318 02:51:21.887285 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7cfaf92570b34b2bb1f52aea06187c83 consensus state has no leader
I20260318 02:51:21.887811 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_113ffa1cc0ef491cbc6786967482632f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.888373 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_113ffa1cc0ef491cbc6786967482632f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.890756 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a15515bcae1f4d8db3cebc745b7ea5a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.891287 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a15515bcae1f4d8db3cebc745b7ea5a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.892298 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6d506ddf2c854df0a30d396a197e4032"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.893404 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d506ddf2c854df0a30d396a197e4032 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.895557 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_14259137e6e74c67b7abb92cb2e953d8" } new_table_name: "default.Table_aaff9d9f20e641efa8b5c156a7055b9c" modify_external_catalogs: true
I20260318 02:51:21.896431 1173 tablet_bootstrap.cc:492] T 7e4e8586673c43058ef00f2f7aef10ee P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:21.896574 1173 ts_tablet_manager.cc:1403] T 7e4e8586673c43058ef00f2f7aef10ee P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260318 02:51:21.897253 1176 ts_tablet_manager.cc:1929] T 0ea4a57dc67e407f9c93679cb2053557 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.897383 1176 log.cc:1199] T 0ea4a57dc67e407f9c93679cb2053557 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/0ea4a57dc67e407f9c93679cb2053557
I20260318 02:51:21.897423 1173 raft_consensus.cc:359] T 7e4e8586673c43058ef00f2f7aef10ee P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.897594 1173 raft_consensus.cc:385] T 7e4e8586673c43058ef00f2f7aef10ee P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.897673 1173 raft_consensus.cc:740] T 7e4e8586673c43058ef00f2f7aef10ee P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.897758 1176 ts_tablet_manager.cc:1950] T 0ea4a57dc67e407f9c93679cb2053557 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:21.898818 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 0ea4a57dc67e407f9c93679cb2053557 (table default.Table_ebd103e5fbf4484597076b02ffd82044 [id=4067c18ce85f44d7993786a3e9bda883]) successfully deleted
I20260318 02:51:21.898872 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ef8abb8805eb442b804b8b5a910029ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:21.899266 1173 consensus_queue.cc:260] T 7e4e8586673c43058ef00f2f7aef10ee P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:21.899389 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef8abb8805eb442b804b8b5a910029ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.901975 1173 ts_tablet_manager.cc:1434] T 7e4e8586673c43058ef00f2f7aef10ee P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260318 02:51:21.902467 1173 tablet_bootstrap.cc:492] T 53e66044bfed4b53a1c0bc4dc8de52e6 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:21.905138 1173 tablet_bootstrap.cc:654] T 53e66044bfed4b53a1c0bc4dc8de52e6 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:21.907966 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet e61c374078854d589219dfa4c20e4222 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e61c374078854d589219dfa4c20e4222 already in progress: creating tablet
W20260318 02:51:21.908811 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 8319efcfa31b45afb4dbd90cb5f13e97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8319efcfa31b45afb4dbd90cb5f13e97 already in progress: creating tablet
W20260318 02:51:21.909420 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 62af8b953213412bb0c3bd1c68042ec9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62af8b953213412bb0c3bd1c68042ec9 already in progress: creating tablet
W20260318 02:51:21.910037 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 3b9ac6b9d4a245ec8d8aed1db976123b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b9ac6b9d4a245ec8d8aed1db976123b already in progress: creating tablet
W20260318 02:51:21.910625 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet af802894346443669f1cc549a1ba401b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af802894346443669f1cc549a1ba401b already in progress: creating tablet
W20260318 02:51:21.911229 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 677f33f9e4ad4859ab85692f7b7aad2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 677f33f9e4ad4859ab85692f7b7aad2a already in progress: creating tablet
W20260318 02:51:21.911816 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f1ed26420c64492a94e8920d8c753fc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1ed26420c64492a94e8920d8c753fc3 already in progress: creating tablet
W20260318 02:51:21.912424 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 3ff487cba236491eb22becf0dc591925 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ff487cba236491eb22becf0dc591925 already in progress: creating tablet
I20260318 02:51:21.912808 1176 tablet_replica.cc:333] T 9e421d3fe62b4985bfe0486a4b115b2a P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:21.913087 1176 raft_consensus.cc:2243] T 9e421d3fe62b4985bfe0486a4b115b2a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.913369 1176 raft_consensus.cc:2272] T 9e421d3fe62b4985bfe0486a4b115b2a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.914208 1176 ts_tablet_manager.cc:1916] T 9e421d3fe62b4985bfe0486a4b115b2a P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.915246 1184 ts_tablet_manager.cc:1929] T cc99bc3332eb48f7a4980533ee71f581 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.915397 1184 log.cc:1199] T cc99bc3332eb48f7a4980533ee71f581 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/cc99bc3332eb48f7a4980533ee71f581
W20260318 02:51:21.915665 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 31d493650d07437c9f1d657bb08a98d7 consensus state has no leader
I20260318 02:51:21.915860 1184 ts_tablet_manager.cc:1950] T cc99bc3332eb48f7a4980533ee71f581 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:21.917923 452 master_service.cc:954] ReplaceTablet: received request to replace tablet 1af760ed8ff14a498e751e67550cb1ac from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:21.923712 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet cc99bc3332eb48f7a4980533ee71f581 (table default.Table_cd18ea9af8074f5398e9d37d53332f19 [id=635bb52ee26d4a95865a9039f6a1a0ec]) successfully deleted
I20260318 02:51:21.924348 1184 tablet_replica.cc:333] T 6a3491e419434075ac4e6fa5881ec537 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:21.924578 1184 raft_consensus.cc:2243] T 6a3491e419434075ac4e6fa5881ec537 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.924772 1184 raft_consensus.cc:2272] T 6a3491e419434075ac4e6fa5881ec537 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.924795 1176 ts_tablet_manager.cc:1929] T 9e421d3fe62b4985bfe0486a4b115b2a P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.926755 1176 log.cc:1199] T 9e421d3fe62b4985bfe0486a4b115b2a P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/9e421d3fe62b4985bfe0486a4b115b2a
I20260318 02:51:21.926981 1172 tablet_bootstrap.cc:492] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:21.927129 1172 ts_tablet_manager.cc:1403] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.354s user 0.025s sys 0.043s
I20260318 02:51:21.927337 1176 ts_tablet_manager.cc:1950] T 9e421d3fe62b4985bfe0486a4b115b2a P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:21.928027 1172 raft_consensus.cc:359] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.928218 1172 raft_consensus.cc:385] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:21.928313 1172 raft_consensus.cc:740] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:21.928553 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 9e421d3fe62b4985bfe0486a4b115b2a (table default.Table_19fe141c13934c04bd511b36fab6ab36 [id=5d7200a0ff764b1885c2c18bc7289e1b]) successfully deleted
I20260318 02:51:21.928556 1172 consensus_queue.cc:260] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:21.930147 1172 ts_tablet_manager.cc:1434] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:21.930452 1172 tablet_bootstrap.cc:492] T b9fe7de28b0646b9b2b96fc46962df9e P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:21.931427 1288 raft_consensus.cc:493] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:21.931607 1288 raft_consensus.cc:515] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.932067 1172 tablet_bootstrap.cc:654] T b9fe7de28b0646b9b2b96fc46962df9e P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.932222 1288 leader_election.cc:290] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:21.932478 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e4e8586673c43058ef00f2f7aef10ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.932889 1175 tablet_replica.cc:333] T 7e4e8586673c43058ef00f2f7aef10ee P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:21.933097 1175 raft_consensus.cc:2243] T 7e4e8586673c43058ef00f2f7aef10ee P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.933281 1175 raft_consensus.cc:2272] T 7e4e8586673c43058ef00f2f7aef10ee P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.933889 1175 ts_tablet_manager.cc:1916] T 7e4e8586673c43058ef00f2f7aef10ee P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:21.935382 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bc1c926c0f4ef2a4c9c52d991f8f0d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:21.936009 719 leader_election.cc:343] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:21.933035 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bc1c926c0f4ef2a4c9c52d991f8f0d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:21.937809 927 raft_consensus.cc:2468] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 0.
I20260318 02:51:21.938459 719 leader_election.cc:304] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:21.940163 1288 raft_consensus.cc:2804] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:21.940263 1288 raft_consensus.cc:493] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:21.940361 1288 raft_consensus.cc:3060] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:21.940866 1175 ts_tablet_manager.cc:1929] T 7e4e8586673c43058ef00f2f7aef10ee P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:21.940990 1175 log.cc:1199] T 7e4e8586673c43058ef00f2f7aef10ee P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/7e4e8586673c43058ef00f2f7aef10ee
I20260318 02:51:21.941313 1175 ts_tablet_manager.cc:1950] T 7e4e8586673c43058ef00f2f7aef10ee P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:21.942595 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 92f95f7591b84ebbba033ec0e0cfc8b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.942946 1288 raft_consensus.cc:515] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:21.943667 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 7e4e8586673c43058ef00f2f7aef10ee (table default.Table_bbda0f6b8794401899207ea245bdbc25 [id=e8cc0e7ae9214cc6bfcb635c00ae4090]) successfully deleted
I20260318 02:51:21.948093 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bc1c926c0f4ef2a4c9c52d991f8f0d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:21.949167 457 master_service.cc:954] ReplaceTablet: received request to replace tablet f447cab3445c451d8ef8746966cfcd42 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:21.949527 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41bc1c926c0f4ef2a4c9c52d991f8f0d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:21.949736 927 raft_consensus.cc:3060] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:21.951272 719 leader_election.cc:343] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:21.952322 927 raft_consensus.cc:2468] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 1.
I20260318 02:51:21.952543 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2e16272bcf9c435a80b32ba9cba9c738
I20260318 02:51:21.952838 719 leader_election.cc:304] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:21.953190 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e16272bcf9c435a80b32ba9cba9c738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.953423 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 32880a703603476786b4a34ddd40cab8
I20260318 02:51:21.953490 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e16272bcf9c435a80b32ba9cba9c738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.953682 1288 leader_election.cc:290] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:21.953738 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e16272bcf9c435a80b32ba9cba9c738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.953704 907 tablet_service.cc:1511] Processing CreateTablet for tablet e55bbc320b0e4f9595bae9816e594b82 (DEFAULT_TABLE table=default.Table_6fde2e0ba8774899bd68e0a0103cb35e [id=f64d22ad510d4dd587445837c79a53c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.953837 1288 raft_consensus.cc:2804] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:21.954075 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55bbc320b0e4f9595bae9816e594b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.954348 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 32880a703603476786b4a34ddd40cab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.954475 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 32880a703603476786b4a34ddd40cab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.954752 1288 raft_consensus.cc:697] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Becoming Leader. State: Replica: 6a903d876086423b8016d705b98895ad, State: Running, Role: LEADER
I20260318 02:51:21.954913 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 32880a703603476786b4a34ddd40cab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:21.955279 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2e16272bcf9c435a80b32ba9cba9c738 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e16272bcf9c435a80b32ba9cba9c738 already in progress: creating tablet
I20260318 02:51:21.955420 761 tablet_service.cc:1511] Processing CreateTablet for tablet e55bbc320b0e4f9595bae9816e594b82 (DEFAULT_TABLE table=default.Table_6fde2e0ba8774899bd68e0a0103cb35e [id=f64d22ad510d4dd587445837c79a53c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.955829 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55bbc320b0e4f9595bae9816e594b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.955943 1038 tablet_service.cc:1511] Processing CreateTablet for tablet e55bbc320b0e4f9595bae9816e594b82 (DEFAULT_TABLE table=default.Table_6fde2e0ba8774899bd68e0a0103cb35e [id=f64d22ad510d4dd587445837c79a53c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.956286 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55bbc320b0e4f9595bae9816e594b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.961042 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 1af760ed8ff14a498e751e67550cb1ac
I20260318 02:51:21.961650 452 catalog_manager.cc:6741] ReplaceTablet: tablet 1af760ed8ff14a498e751e67550cb1ac deleted and replaced by tablet 1516525b471540288c6cb5d61120d430
I20260318 02:51:21.962436 456 master_service.cc:954] ReplaceTablet: received request to replace tablet 31d493650d07437c9f1d657bb08a98d7 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:21.962610 760 tablet_service.cc:1511] Processing CreateTablet for tablet 0c8264f69f934d3ba2e41434ce350f3e (DEFAULT_TABLE table=default.Table_50e2d197579e426787bc46d7494e2f74 [id=83452e9434ad488c9cda6c178ec3b182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.963058 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c8264f69f934d3ba2e41434ce350f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.964658 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 0c8264f69f934d3ba2e41434ce350f3e (DEFAULT_TABLE table=default.Table_50e2d197579e426787bc46d7494e2f74 [id=83452e9434ad488c9cda6c178ec3b182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.964984 899 tablet_service.cc:1511] Processing CreateTablet for tablet 2adcc9f1ad69458c997475111bb787cf (DEFAULT_TABLE table=default.Table_881262486e0f4a268678b8422cd12beb [id=e7071ce844664614a646a3554c38ae41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.965080 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c8264f69f934d3ba2e41434ce350f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.964994 763 tablet_service.cc:1511] Processing CreateTablet for tablet 2adcc9f1ad69458c997475111bb787cf (DEFAULT_TABLE table=default.Table_881262486e0f4a268678b8422cd12beb [id=e7071ce844664614a646a3554c38ae41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.965318 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2adcc9f1ad69458c997475111bb787cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.965381 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2adcc9f1ad69458c997475111bb787cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.969031 755 tablet_service.cc:1511] Processing CreateTablet for tablet 2b6267d3f6e142579c62bbb4b14da4b0 (DEFAULT_TABLE table=default.Table_5ea72896ec3f438ca7ea9e8b599829f2 [id=a0b50d2be41f469f8e63545b054b9e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.969401 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b6267d3f6e142579c62bbb4b14da4b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.969358 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 2adcc9f1ad69458c997475111bb787cf (DEFAULT_TABLE table=default.Table_881262486e0f4a268678b8422cd12beb [id=e7071ce844664614a646a3554c38ae41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.969717 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2adcc9f1ad69458c997475111bb787cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.971828 757 tablet_service.cc:1511] Processing CreateTablet for tablet 8c20810ad3354126bf49bbeeb6edb098 (DEFAULT_TABLE table=default.Table_0d76788054244bdc8c7aa32525412970 [id=463a6721eb0d43d09deeb283d1cc4233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.972216 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c20810ad3354126bf49bbeeb6edb098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.972661 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 1af760ed8ff14a498e751e67550cb1ac with delete_type TABLET_DATA_DELETED (replaced by tablet 1516525b471540288c6cb5d61120d430) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.973268 903 tablet_service.cc:1511] Processing CreateTablet for tablet 2b6267d3f6e142579c62bbb4b14da4b0 (DEFAULT_TABLE table=default.Table_5ea72896ec3f438ca7ea9e8b599829f2 [id=a0b50d2be41f469f8e63545b054b9e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.973677 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b6267d3f6e142579c62bbb4b14da4b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.975482 900 tablet_service.cc:1511] Processing CreateTablet for tablet 8c20810ad3354126bf49bbeeb6edb098 (DEFAULT_TABLE table=default.Table_0d76788054244bdc8c7aa32525412970 [id=463a6721eb0d43d09deeb283d1cc4233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.975876 1175 tablet_replica.cc:333] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:21.976070 1175 raft_consensus.cc:2243] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:21.976239 1175 raft_consensus.cc:2272] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:21.975886 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c20810ad3354126bf49bbeeb6edb098. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:21.977110 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 32880a703603476786b4a34ddd40cab8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32880a703603476786b4a34ddd40cab8 already in progress: creating tablet
I20260318 02:51:21.980199 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 1af760ed8ff14a498e751e67550cb1ac with delete_type TABLET_DATA_DELETED (replaced by tablet 1516525b471540288c6cb5d61120d430) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.981271 907 tablet_service.cc:1511] Processing CreateTablet for tablet 0c8264f69f934d3ba2e41434ce350f3e (DEFAULT_TABLE table=default.Table_50e2d197579e426787bc46d7494e2f74 [id=83452e9434ad488c9cda6c178ec3b182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:21.981696 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c8264f69f934d3ba2e41434ce350f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.983978 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 3c283efbac08468c8c20f4caba90164c
I20260318 02:51:21.985246 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0c5e75f8ad484c6d87b15a8f88667a0b" } new_table_name: "default.Table_77c75231b25242e7aa24d2bae80c37c5" modify_external_catalogs: true
I20260318 02:51:21.989049 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c283efbac08468c8c20f4caba90164c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.989526 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b69dd1653a304f3d99346e89dacf9208
I20260318 02:51:21.989822 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9ca04fe0c2a64ef7a9bcfd309a2a00f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:21.991637 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ca04fe0c2a64ef7a9bcfd309a2a00f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.990232 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet fda9f1fe47e04688bde80ebe23494d08
I20260318 02:51:21.992961 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c283efbac08468c8c20f4caba90164c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.993607 899 tablet_service.cc:1558] Processing DeleteTablet for tablet b69dd1653a304f3d99346e89dacf9208 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:21.994393 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4d622f52dad8400883eae6801df84f37" } new_table_name: "default.Table_c7a8290fdcc149148f002a665a6c3d41" modify_external_catalogs: true
I20260318 02:51:21.995276 764 tablet_service.cc:1558] Processing DeleteTablet for tablet b69dd1653a304f3d99346e89dacf9208 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:21.995940 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_76edb5c5aa524eda83e05de00631650c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:21.996129 899 tablet_service.cc:1558] Processing DeleteTablet for tablet fda9f1fe47e04688bde80ebe23494d08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:21.996526 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76edb5c5aa524eda83e05de00631650c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.000171 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_696d62e7ef59402ca5878b9a43539cc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.000694 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_696d62e7ef59402ca5878b9a43539cc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.000658 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f447cab3445c451d8ef8746966cfcd42
I20260318 02:51:22.003996 457 catalog_manager.cc:6741] ReplaceTablet: tablet f447cab3445c451d8ef8746966cfcd42 deleted and replaced by tablet 2c5038e9e1074f46976a1a5bb4282944
I20260318 02:51:22.004132 764 tablet_service.cc:1558] Processing DeleteTablet for tablet f447cab3445c451d8ef8746966cfcd42 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c5038e9e1074f46976a1a5bb4282944) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.004583 1288 consensus_queue.cc:237] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.005106 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0774c189a31544eb8132eb97d4bef464" } new_table_name: "default.Table_6725b184c1db4933ba6f28668b0031fa" modify_external_catalogs: true
I20260318 02:51:22.011066 755 tablet_service.cc:1558] Processing DeleteTablet for tablet fda9f1fe47e04688bde80ebe23494d08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:22.011101 1280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260318 02:51:22.011505 1280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260318 02:51:22.011647 1280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260318 02:51:22.012888 899 tablet_service.cc:1558] Processing DeleteTablet for tablet f447cab3445c451d8ef8746966cfcd42 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c5038e9e1074f46976a1a5bb4282944) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.012949 1174 tablet_bootstrap.cc:654] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:21.977044 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 8c20810ad3354126bf49bbeeb6edb098 (DEFAULT_TABLE table=default.Table_0d76788054244bdc8c7aa32525412970 [id=463a6721eb0d43d09deeb283d1cc4233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.014410 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c20810ad3354126bf49bbeeb6edb098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.977325 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 2b6267d3f6e142579c62bbb4b14da4b0 (DEFAULT_TABLE table=default.Table_5ea72896ec3f438ca7ea9e8b599829f2 [id=a0b50d2be41f469f8e63545b054b9e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.017247 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b6267d3f6e142579c62bbb4b14da4b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:21.977434 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 1af760ed8ff14a498e751e67550cb1ac with delete_type TABLET_DATA_DELETED (replaced by tablet 1516525b471540288c6cb5d61120d430) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.993114 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet b69dd1653a304f3d99346e89dacf9208 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.996385 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet fda9f1fe47e04688bde80ebe23494d08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.005728 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet f447cab3445c451d8ef8746966cfcd42 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c5038e9e1074f46976a1a5bb4282944) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:21.986963 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c283efbac08468c8c20f4caba90164c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.023842 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6372798c3d47435ea80a21ca734ce78f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.024510 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6372798c3d47435ea80a21ca734ce78f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:21.976744 1175 ts_tablet_manager.cc:1916] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:22.028903 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 323e4b1e9aee449f9402b1712b1444d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 323e4b1e9aee449f9402b1712b1444d9 already in progress: creating tablet
I20260318 02:51:22.039765 457 master_service.cc:954] ReplaceTablet: received request to replace tablet 3b9ac6b9d4a245ec8d8aed1db976123b from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:21.976619 1184 ts_tablet_manager.cc:1916] T 6a3491e419434075ac4e6fa5881ec537 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:22.042539 997 consensus_peers.cc:597] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:22.042757 426 master_runner.cc:186] Error getting master registration for 127.0.104.188:41593: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: connect: Connection refused (error 111),
I20260318 02:51:22.042939 426 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260318 02:51:22.043246 443 consensus_peers.cc:597] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a -> Peer 971baf5b9e4644c990dbf4d4fc7ba900 (127.0.104.188:41593): Couldn't send request to peer 971baf5b9e4644c990dbf4d4fc7ba900. Status: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260318 02:51:22.043725 1175 ts_tablet_manager.cc:1929] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:22.043857 1175 log.cc:1199] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/1af760ed8ff14a498e751e67550cb1ac
I20260318 02:51:22.044230 1175 ts_tablet_manager.cc:1950] T 1af760ed8ff14a498e751e67550cb1ac P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:22.044844 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 1af760ed8ff14a498e751e67550cb1ac (table default.Table_0c5e75f8ad484c6d87b15a8f88667a0b [id=433e7aa77412424ebb38784bb073d1fb]) successfully deleted
W20260318 02:51:22.045563 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 3c283efbac08468c8c20f4caba90164c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c283efbac08468c8c20f4caba90164c already in progress: creating tablet
W20260318 02:51:22.046787 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet b69dd1653a304f3d99346e89dacf9208 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b69dd1653a304f3d99346e89dacf9208 already in progress: creating tablet
I20260318 02:51:22.024821 1176 tablet_replica.cc:333] T f7415ddf48574f7b9a746049ce78d2e9 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:22.047274 1176 raft_consensus.cc:2243] T f7415ddf48574f7b9a746049ce78d2e9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:22.047489 1176 raft_consensus.cc:2272] T f7415ddf48574f7b9a746049ce78d2e9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:22.047602 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet fda9f1fe47e04688bde80ebe23494d08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fda9f1fe47e04688bde80ebe23494d08 already in progress: creating tablet
W20260318 02:51:22.048190 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f447cab3445c451d8ef8746966cfcd42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f447cab3445c451d8ef8746966cfcd42 already in progress: creating tablet
I20260318 02:51:22.033082 1288 raft_consensus.cc:493] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:22.048576 1288 raft_consensus.cc:515] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.049178 1288 leader_election.cc:290] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
W20260318 02:51:22.038117 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 85284.6us
I20260318 02:51:22.043339 785 raft_consensus.cc:1275] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Refusing update from remote peer 9422bb7011f342b08be0b073a88c4c4d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:22.050153 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23b646a132743cc9b4dcd85c6d4ebea" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:22.050289 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23b646a132743cc9b4dcd85c6d4ebea" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:22.051111 1190 consensus_queue.cc:1048] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260318 02:51:22.051826 719 leader_election.cc:343] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:22.052167 719 leader_election.cc:343] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:22.052292 719 leader_election.cc:304] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:22.053028 1288 raft_consensus.cc:2749] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:22.054072 1176 ts_tablet_manager.cc:1916] T f7415ddf48574f7b9a746049ce78d2e9 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:22.065743 1176 ts_tablet_manager.cc:1929] T f7415ddf48574f7b9a746049ce78d2e9 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:22.067867 1176 log.cc:1199] T f7415ddf48574f7b9a746049ce78d2e9 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/f7415ddf48574f7b9a746049ce78d2e9
I20260318 02:51:22.068634 1176 ts_tablet_manager.cc:1950] T f7415ddf48574f7b9a746049ce78d2e9 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:22.070231 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet f7415ddf48574f7b9a746049ce78d2e9 (table default.Table_ac694c873ef141579c82755592552b23 [id=a004400b026145a5be338b0b2e4b8ce3]) successfully deleted
I20260318 02:51:22.070603 457 master_service.cc:954] ReplaceTablet: received request to replace tablet 74233fd7ed094e7cbfc79309605db0e1 from {username='slave'} at 127.0.0.1:47158
W20260318 02:51:22.075281 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2e16272bcf9c435a80b32ba9cba9c738 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e16272bcf9c435a80b32ba9cba9c738 already in progress: creating tablet
W20260318 02:51:22.076736 1280 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260318 02:51:22.076833 1280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260318 02:51:22.076900 1280 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260318 02:51:22.076951 1280 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260318 02:51:22.077875 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2c5038e9e1074f46976a1a5bb4282944 has no consensus state
W20260318 02:51:22.079538 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 32880a703603476786b4a34ddd40cab8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32880a703603476786b4a34ddd40cab8 already in progress: creating tablet
I20260318 02:51:22.080243 1176 tablet_replica.cc:333] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:22.081565 1173 tablet_bootstrap.cc:492] T 53e66044bfed4b53a1c0bc4dc8de52e6 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:22.081755 1173 ts_tablet_manager.cc:1403] T 53e66044bfed4b53a1c0bc4dc8de52e6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.179s user 0.015s sys 0.015s
I20260318 02:51:22.082913 1173 raft_consensus.cc:359] T 53e66044bfed4b53a1c0bc4dc8de52e6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.083103 1173 raft_consensus.cc:385] T 53e66044bfed4b53a1c0bc4dc8de52e6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.083163 1173 raft_consensus.cc:740] T 53e66044bfed4b53a1c0bc4dc8de52e6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.083416 1173 consensus_queue.cc:260] T 53e66044bfed4b53a1c0bc4dc8de52e6 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:22.084883 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1516525b471540288c6cb5d61120d430 has no consensus state
I20260318 02:51:22.085566 1344 raft_consensus.cc:493] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:22.085767 1344 raft_consensus.cc:515] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.086975 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caed5f1870469d834aecd2bc42bdda" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:22.087611 719 leader_election.cc:343] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:22.087610 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 53e66044bfed4b53a1c0bc4dc8de52e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.089300 1174 tablet_bootstrap.cc:492] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:22.089521 1174 ts_tablet_manager.cc:1403] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.230s user 0.002s sys 0.003s
W20260318 02:51:22.089612 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 53e66044bfed4b53a1c0bc4dc8de52e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53e66044bfed4b53a1c0bc4dc8de52e6 already in progress: creating tablet
I20260318 02:51:22.090144 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_27d90de2be7248649ebf3dde534d7091" } new_table_name: "default.Table_87b1b608a1414098af9c5136bf508ab7" modify_external_catalogs: true
I20260318 02:51:22.090416 1174 raft_consensus.cc:359] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:22.090576 1174 raft_consensus.cc:385] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.090665 1174 raft_consensus.cc:740] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.090879 1174 consensus_queue.cc:260] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:22.091688 1173 ts_tablet_manager.cc:1434] T 53e66044bfed4b53a1c0bc4dc8de52e6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260318 02:51:22.092562 1344 leader_election.cc:290] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:22.092954 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caed5f1870469d834aecd2bc42bdda" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:22.093253 1174 ts_tablet_manager.cc:1434] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
W20260318 02:51:22.093861 719 leader_election.cc:343] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:22.093999 719 leader_election.cc:304] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:22.094007 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7915e6d57ee1442c8b08ce6acc4a31b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:22.094481 1344 raft_consensus.cc:2749] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:22.093600 1174 tablet_bootstrap.cc:492] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:22.094669 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7915e6d57ee1442c8b08ce6acc4a31b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.096745 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 53e66044bfed4b53a1c0bc4dc8de52e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.097028 1175 tablet_replica.cc:333] T 53e66044bfed4b53a1c0bc4dc8de52e6 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:22.097230 1175 raft_consensus.cc:2243] T 53e66044bfed4b53a1c0bc4dc8de52e6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:22.097445 1175 raft_consensus.cc:2272] T 53e66044bfed4b53a1c0bc4dc8de52e6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:22.097934 1174 tablet_bootstrap.cc:654] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.098021 1175 ts_tablet_manager.cc:1916] T 53e66044bfed4b53a1c0bc4dc8de52e6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:22.098400 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 88eeb101a1734271973cd7d4c756b356 consensus state has no leader
I20260318 02:51:22.098927 1184 ts_tablet_manager.cc:1929] T 6a3491e419434075ac4e6fa5881ec537 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:22.099109 1184 log.cc:1199] T 6a3491e419434075ac4e6fa5881ec537 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/6a3491e419434075ac4e6fa5881ec537
I20260318 02:51:22.099494 1184 ts_tablet_manager.cc:1950] T 6a3491e419434075ac4e6fa5881ec537 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:22.103652 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 6a3491e419434075ac4e6fa5881ec537 (table default.Table_bbf2210842004e098c3fe633c4f2f7d0 [id=06e124bab0a04572bab0c3c008b7d218]) successfully deleted
I20260318 02:51:22.104511 1184 tablet_replica.cc:333] T b176363ce948489ab05178e5875f2ccd P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:22.104290 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7710260d7bd54a859b6fc9023ce450e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:22.104738 1184 raft_consensus.cc:2243] T b176363ce948489ab05178e5875f2ccd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:22.104940 1184 raft_consensus.cc:2272] T b176363ce948489ab05178e5875f2ccd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:22.105006 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7710260d7bd54a859b6fc9023ce450e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.105515 1184 ts_tablet_manager.cc:1916] T b176363ce948489ab05178e5875f2ccd P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:22.108311 451 catalog_manager.cc:5671] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a903d876086423b8016d705b98895ad (127.0.104.129). New cstate: current_term: 1 leader_uuid: "6a903d876086423b8016d705b98895ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:22.108770 451 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d (table default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666]). Expected version 4 got 0
W20260318 02:51:22.111933 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 00d953e1ae2f47fc8016a2f9a791141d consensus state has no leader
I20260318 02:51:22.113687 907 tablet_service.cc:1511] Processing CreateTablet for tablet f1ff303b23184d4b92994bde194229b4 (DEFAULT_TABLE table=default.Table_a15515bcae1f4d8db3cebc745b7ea5a9 [id=873432f002e14a4fa7065dcfe5caebd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.114110 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ff303b23184d4b92994bde194229b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.114508 760 tablet_service.cc:1511] Processing CreateTablet for tablet f1ff303b23184d4b92994bde194229b4 (DEFAULT_TABLE table=default.Table_a15515bcae1f4d8db3cebc745b7ea5a9 [id=873432f002e14a4fa7065dcfe5caebd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.114966 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ff303b23184d4b92994bde194229b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.122171 1035 tablet_service.cc:1511] Processing CreateTablet for tablet f1ff303b23184d4b92994bde194229b4 (DEFAULT_TABLE table=default.Table_a15515bcae1f4d8db3cebc745b7ea5a9 [id=873432f002e14a4fa7065dcfe5caebd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.122634 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ff303b23184d4b92994bde194229b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.124087 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6fde2e0ba8774899bd68e0a0103cb35e" } new_table_name: "default.Table_2edfe13a5f2b4267a7e522a474ac0cc0" modify_external_catalogs: true
I20260318 02:51:22.124943 760 tablet_service.cc:1511] Processing CreateTablet for tablet 916b5b77fb2f4003b78a71025319ed15 (DEFAULT_TABLE table=default.Table_6d506ddf2c854df0a30d396a197e4032 [id=57891ff71e194a8f8959294ba552fb23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.125330 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916b5b77fb2f4003b78a71025319ed15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.125571 907 tablet_service.cc:1511] Processing CreateTablet for tablet 916b5b77fb2f4003b78a71025319ed15 (DEFAULT_TABLE table=default.Table_6d506ddf2c854df0a30d396a197e4032 [id=57891ff71e194a8f8959294ba552fb23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.125550 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_80f976f24d184e2cbaf4f63b8495c8ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:22.125934 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916b5b77fb2f4003b78a71025319ed15. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:22.126065 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80f976f24d184e2cbaf4f63b8495c8ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.127431 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 916b5b77fb2f4003b78a71025319ed15 (DEFAULT_TABLE table=default.Table_6d506ddf2c854df0a30d396a197e4032 [id=57891ff71e194a8f8959294ba552fb23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.127897 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916b5b77fb2f4003b78a71025319ed15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.129504 1175 ts_tablet_manager.cc:1929] T 53e66044bfed4b53a1c0bc4dc8de52e6 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:22.129643 1175 log.cc:1199] T 53e66044bfed4b53a1c0bc4dc8de52e6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/53e66044bfed4b53a1c0bc4dc8de52e6
I20260318 02:51:22.129726 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_167a79354e7844aabe2ae725df4f536c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:22.129801 899 tablet_service.cc:1511] Processing CreateTablet for tablet af793623466249e695b262ab451d4dc9 (DEFAULT_TABLE table=default.Table_8d881dd16c5442d78313f6766ca90d4c [id=34553220f38c4ffd99cf61e1679bdb81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.130123 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af793623466249e695b262ab451d4dc9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:22.130227 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_167a79354e7844aabe2ae725df4f536c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.133862 757 tablet_service.cc:1511] Processing CreateTablet for tablet af793623466249e695b262ab451d4dc9 (DEFAULT_TABLE table=default.Table_8d881dd16c5442d78313f6766ca90d4c [id=34553220f38c4ffd99cf61e1679bdb81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.133852 1042 tablet_service.cc:1511] Processing CreateTablet for tablet af793623466249e695b262ab451d4dc9 (DEFAULT_TABLE table=default.Table_8d881dd16c5442d78313f6766ca90d4c [id=34553220f38c4ffd99cf61e1679bdb81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.134287 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af793623466249e695b262ab451d4dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.134312 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af793623466249e695b262ab451d4dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.134414 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 31d493650d07437c9f1d657bb08a98d7
I20260318 02:51:22.135658 1173 tablet_bootstrap.cc:492] T 54bffc30199246fd93edf7486b2e3a91 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:22.135784 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 31d493650d07437c9f1d657bb08a98d7 with delete_type TABLET_DATA_DELETED (replaced by tablet 105326aea9f744779ca76e0cbb2448cd) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.136837 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 31d493650d07437c9f1d657bb08a98d7 with delete_type TABLET_DATA_DELETED (replaced by tablet 105326aea9f744779ca76e0cbb2448cd) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.137639 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 31d493650d07437c9f1d657bb08a98d7 with delete_type TABLET_DATA_DELETED (replaced by tablet 105326aea9f744779ca76e0cbb2448cd) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.137796 1175 ts_tablet_manager.cc:1950] T 53e66044bfed4b53a1c0bc4dc8de52e6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:22.138438 456 catalog_manager.cc:6741] ReplaceTablet: tablet 31d493650d07437c9f1d657bb08a98d7 deleted and replaced by tablet 105326aea9f744779ca76e0cbb2448cd
I20260318 02:51:22.139366 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 53e66044bfed4b53a1c0bc4dc8de52e6 (table default.Table_6b0fdcb080ea4a6b97f51308598362be [id=3ce1c72a2d4e42c698e85d5034d873e0]) successfully deleted
I20260318 02:51:22.139809 1172 tablet_bootstrap.cc:492] T b9fe7de28b0646b9b2b96fc46962df9e P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:22.139969 1172 ts_tablet_manager.cc:1403] T b9fe7de28b0646b9b2b96fc46962df9e P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.210s user 0.016s sys 0.010s
W20260318 02:51:22.141346 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e55bbc320b0e4f9595bae9816e594b82 consensus state has no leader
I20260318 02:51:22.145186 1173 tablet_bootstrap.cc:654] T 54bffc30199246fd93edf7486b2e3a91 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.146039 757 tablet_service.cc:1511] Processing CreateTablet for tablet 95f15079d1df4314b6dd5c7afd896af5 (DEFAULT_TABLE table=default.Table_74486e0a87264fb8ae22f015c8eb3fbe [id=5d87c85c334642829cb97e4b4cc4d95f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.146548 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f15079d1df4314b6dd5c7afd896af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.148089 899 tablet_service.cc:1511] Processing CreateTablet for tablet 95f15079d1df4314b6dd5c7afd896af5 (DEFAULT_TABLE table=default.Table_74486e0a87264fb8ae22f015c8eb3fbe [id=5d87c85c334642829cb97e4b4cc4d95f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.148499 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f15079d1df4314b6dd5c7afd896af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.149046 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 95f15079d1df4314b6dd5c7afd896af5 (DEFAULT_TABLE table=default.Table_74486e0a87264fb8ae22f015c8eb3fbe [id=5d87c85c334642829cb97e4b4cc4d95f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.149416 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f15079d1df4314b6dd5c7afd896af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.154067 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_87fa1f636198436a81500e9b228f29c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.154356 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 31d493650d07437c9f1d657bb08a98d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31d493650d07437c9f1d657bb08a98d7 already in progress: creating tablet
W20260318 02:51:22.154683 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87fa1f636198436a81500e9b228f29c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.156596 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5ea72896ec3f438ca7ea9e8b599829f2" } modify_external_catalogs: true
I20260318 02:51:22.156807 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5ea72896ec3f438ca7ea9e8b599829f2" } modify_external_catalogs: true
I20260318 02:51:22.156862 903 tablet_service.cc:1511] Processing CreateTablet for tablet bc47f35f9c2c4e5085ab482285effc91 (DEFAULT_TABLE table=default.Table_ef8abb8805eb442b804b8b5a910029ff [id=1515573be85644d7a4f046947aa1537b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.157362 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc47f35f9c2c4e5085ab482285effc91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.163005 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9ca04fe0c2a64ef7a9bcfd309a2a00f5" } modify_external_catalogs: true
I20260318 02:51:22.163219 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9ca04fe0c2a64ef7a9bcfd309a2a00f5" } modify_external_catalogs: true
I20260318 02:51:22.164489 1173 tablet_bootstrap.cc:492] T 54bffc30199246fd93edf7486b2e3a91 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:22.164610 1173 ts_tablet_manager.cc:1403] T 54bffc30199246fd93edf7486b2e3a91 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20260318 02:51:22.165781 1173 raft_consensus.cc:359] T 54bffc30199246fd93edf7486b2e3a91 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.165923 1173 raft_consensus.cc:385] T 54bffc30199246fd93edf7486b2e3a91 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.165977 1173 raft_consensus.cc:740] T 54bffc30199246fd93edf7486b2e3a91 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.166181 1173 consensus_queue.cc:260] T 54bffc30199246fd93edf7486b2e3a91 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.167168 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2b6267d3f6e142579c62bbb4b14da4b0
I20260318 02:51:22.168255 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b6267d3f6e142579c62bbb4b14da4b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.168648 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b6267d3f6e142579c62bbb4b14da4b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.168802 1174 tablet_bootstrap.cc:492] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:22.168931 1174 ts_tablet_manager.cc:1403] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.075s user 0.001s sys 0.003s
I20260318 02:51:22.169638 1174 raft_consensus.cc:359] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.169855 1174 raft_consensus.cc:385] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.169946 1174 raft_consensus.cc:740] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.170194 1174 consensus_queue.cc:260] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.170481 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b6267d3f6e142579c62bbb4b14da4b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.172592 1174 ts_tablet_manager.cc:1434] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:22.172923 448 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet f7aa9f8882a34615983aeb55f40c6d76
I20260318 02:51:22.173108 1174 tablet_bootstrap.cc:492] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:22.174279 1173 ts_tablet_manager.cc:1434] T 54bffc30199246fd93edf7486b2e3a91 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260318 02:51:22.177045 926 raft_consensus.cc:1275] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Refusing update from remote peer 6a903d876086423b8016d705b98895ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:22.177872 1344 consensus_queue.cc:1048] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260318 02:51:22.178166 719 consensus_peers.cc:597] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad -> Peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Couldn't send request to peer 9422bb7011f342b08be0b073a88c4c4d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:22.178504 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6d3695295b794364b4cdc7849155a559"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.179051 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d3695295b794364b4cdc7849155a559 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:22.180969 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2b6267d3f6e142579c62bbb4b14da4b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b6267d3f6e142579c62bbb4b14da4b0 already in progress: creating tablet
I20260318 02:51:22.181262 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 54bffc30199246fd93edf7486b2e3a91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.183818 1174 tablet_bootstrap.cc:654] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.190225 1041 tablet_service.cc:1511] Processing CreateTablet for tablet bc47f35f9c2c4e5085ab482285effc91 (DEFAULT_TABLE table=default.Table_ef8abb8805eb442b804b8b5a910029ff [id=1515573be85644d7a4f046947aa1537b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.190423 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3e4d4a8323da4e20a12b2b6a9f7fd54c" } modify_external_catalogs: true
I20260318 02:51:22.190645 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3e4d4a8323da4e20a12b2b6a9f7fd54c" } modify_external_catalogs: true
I20260318 02:51:22.190735 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc47f35f9c2c4e5085ab482285effc91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.191659 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 666c2992fa4f479ab4ffd7ac0c3a9c92 (DEFAULT_TABLE table=default.Table_113ffa1cc0ef491cbc6786967482632f [id=504539970798458680abc4a9307656fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.192015 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 666c2992fa4f479ab4ffd7ac0c3a9c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.196162 1173 tablet_bootstrap.cc:492] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:22.196763 1175 tablet_replica.cc:333] T 54bffc30199246fd93edf7486b2e3a91 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:22.196992 1175 raft_consensus.cc:2243] T 54bffc30199246fd93edf7486b2e3a91 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:22.200121 1172 raft_consensus.cc:359] T b9fe7de28b0646b9b2b96fc46962df9e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:22.200601 1172 raft_consensus.cc:385] T b9fe7de28b0646b9b2b96fc46962df9e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.200788 1172 raft_consensus.cc:740] T b9fe7de28b0646b9b2b96fc46962df9e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.201148 1172 consensus_queue.cc:260] T b9fe7de28b0646b9b2b96fc46962df9e P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:22.201730 1172 ts_tablet_manager.cc:1434] T b9fe7de28b0646b9b2b96fc46962df9e P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.062s user 0.001s sys 0.001s
I20260318 02:51:22.202144 1172 tablet_bootstrap.cc:492] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:22.205535 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_74486e0a87264fb8ae22f015c8eb3fbe" } modify_external_catalogs: true
I20260318 02:51:22.206296 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_74486e0a87264fb8ae22f015c8eb3fbe" } modify_external_catalogs: true
I20260318 02:51:22.206703 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_215d98fc906d466d8c0d334250547c34" } modify_external_catalogs: true
I20260318 02:51:22.206848 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_215d98fc906d466d8c0d334250547c34" } modify_external_catalogs: true
W20260318 02:51:22.211014 444 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet e55bbc320b0e4f9595bae9816e594b82 (table default.Table_2edfe13a5f2b4267a7e522a474ac0cc0 [id=f64d22ad510d4dd587445837c79a53c9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e55bbc320b0e4f9595bae9816e594b82 consensus state has no leader
I20260318 02:51:22.211293 761 tablet_service.cc:1511] Processing CreateTablet for tablet 666c2992fa4f479ab4ffd7ac0c3a9c92 (DEFAULT_TABLE table=default.Table_113ffa1cc0ef491cbc6786967482632f [id=504539970798458680abc4a9307656fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.211597 1175 raft_consensus.cc:2272] T 54bffc30199246fd93edf7486b2e3a91 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:22.212009 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 666c2992fa4f479ab4ffd7ac0c3a9c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.213006 763 tablet_service.cc:1511] Processing CreateTablet for tablet bc47f35f9c2c4e5085ab482285effc91 (DEFAULT_TABLE table=default.Table_ef8abb8805eb442b804b8b5a910029ff [id=1515573be85644d7a4f046947aa1537b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.213403 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc47f35f9c2c4e5085ab482285effc91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.216511 1173 tablet_bootstrap.cc:654] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.219287 903 tablet_service.cc:1511] Processing CreateTablet for tablet 666c2992fa4f479ab4ffd7ac0c3a9c92 (DEFAULT_TABLE table=default.Table_113ffa1cc0ef491cbc6786967482632f [id=504539970798458680abc4a9307656fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.220185 1175 ts_tablet_manager.cc:1916] T 54bffc30199246fd93edf7486b2e3a91 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:22.223403 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 666c2992fa4f479ab4ffd7ac0c3a9c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.224629 1172 tablet_bootstrap.cc:654] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.230185 1176 raft_consensus.cc:2243] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:22.230718 1176 pending_rounds.cc:70] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad: Trying to abort 2 pending ops.
W20260318 02:51:22.230878 1349 consensus_queue.cc:1175] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6a903d876086423b8016d705b98895ad" status { last_received { term: 1 index: 2 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 2 } }
I20260318 02:51:22.230823 1176 pending_rounds.cc:77] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7265494147224178688 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "1af760ed8ff14a498e751e67550cb1ac" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 4 new_table_name: "default.Table_0c5e75f8ad484c6d87b15a8f88667a0b" dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" new_extra_config { } }
I20260318 02:51:22.231277 1176 pending_rounds.cc:77] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494145230229504 op_type: NO_OP noop_request { }
I20260318 02:51:22.231413 1176 raft_consensus.cc:2889] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:22.231547 1176 raft_consensus.cc:2272] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:22.234625 1175 ts_tablet_manager.cc:1929] T 54bffc30199246fd93edf7486b2e3a91 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:22.235337 1176 ts_tablet_manager.cc:1916] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:22.235966 1174 tablet_bootstrap.cc:492] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:22.237432 1174 ts_tablet_manager.cc:1403] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.065s user 0.002s sys 0.002s
I20260318 02:51:22.241843 1175 log.cc:1199] T 54bffc30199246fd93edf7486b2e3a91 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/54bffc30199246fd93edf7486b2e3a91
I20260318 02:51:22.241917 1176 ts_tablet_manager.cc:1929] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:22.242056 1176 log.cc:1199] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/1af760ed8ff14a498e751e67550cb1ac
I20260318 02:51:22.242457 1176 ts_tablet_manager.cc:1950] T 1af760ed8ff14a498e751e67550cb1ac P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:22.242628 1175 ts_tablet_manager.cc:1950] T 54bffc30199246fd93edf7486b2e3a91 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:22.243636 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 1af760ed8ff14a498e751e67550cb1ac (table default.Table_77c75231b25242e7aa24d2bae80c37c5 [id=433e7aa77412424ebb38784bb073d1fb]) successfully deleted
I20260318 02:51:22.243901 1172 tablet_bootstrap.cc:492] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:22.244062 1172 ts_tablet_manager.cc:1403] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.000s
W20260318 02:51:22.244485 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 3c283efbac08468c8c20f4caba90164c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c283efbac08468c8c20f4caba90164c already in progress: creating tablet
I20260318 02:51:22.244804 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 54bffc30199246fd93edf7486b2e3a91 (table default.Table_3078ea8f226c4adc8743e3a9371f2a97 [id=a58374eeb920473e941c9d07accd5ee5]) successfully deleted
I20260318 02:51:22.244925 1172 raft_consensus.cc:359] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:22.245123 1172 raft_consensus.cc:385] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260318 02:51:22.245110 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet b69dd1653a304f3d99346e89dacf9208 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b69dd1653a304f3d99346e89dacf9208 already in progress: creating tablet
I20260318 02:51:22.245216 1172 raft_consensus.cc:740] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.245458 1172 consensus_queue.cc:260] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
W20260318 02:51:22.245692 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f447cab3445c451d8ef8746966cfcd42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f447cab3445c451d8ef8746966cfcd42 already in progress: creating tablet
I20260318 02:51:22.246008 1174 raft_consensus.cc:359] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:22.246194 1174 raft_consensus.cc:385] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260318 02:51:22.246201 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet fda9f1fe47e04688bde80ebe23494d08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fda9f1fe47e04688bde80ebe23494d08 already in progress: creating tablet
I20260318 02:51:22.246292 1174 raft_consensus.cc:740] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
W20260318 02:51:22.246773 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 31d493650d07437c9f1d657bb08a98d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31d493650d07437c9f1d657bb08a98d7 already in progress: creating tablet
W20260318 02:51:22.247364 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2b6267d3f6e142579c62bbb4b14da4b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b6267d3f6e142579c62bbb4b14da4b0 already in progress: creating tablet
I20260318 02:51:22.249615 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet b9fe7de28b0646b9b2b96fc46962df9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.250999 1174 consensus_queue.cc:260] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:22.251703 1174 ts_tablet_manager.cc:1434] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260318 02:51:22.252002 1174 tablet_bootstrap.cc:492] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:22.257957 1172 ts_tablet_manager.cc:1434] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260318 02:51:22.257051 1184 ts_tablet_manager.cc:1929] T b176363ce948489ab05178e5875f2ccd P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:22.258759 1184 log.cc:1199] T b176363ce948489ab05178e5875f2ccd P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/b176363ce948489ab05178e5875f2ccd
I20260318 02:51:22.259208 1184 ts_tablet_manager.cc:1950] T b176363ce948489ab05178e5875f2ccd P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:22.260453 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet b176363ce948489ab05178e5875f2ccd (table default.Table_90fbf2263430453082ef161ec0025a5a [id=f6d13c14fec24bc8894ebd60b88fca77]) successfully deleted
I20260318 02:51:22.262238 1359 tablet.cc:1723] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260318 02:51:22.263651 1174 tablet_bootstrap.cc:654] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:22.270176 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet af802894346443669f1cc549a1ba401b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af802894346443669f1cc549a1ba401b already in progress: creating tablet
I20260318 02:51:22.270498 452 master_service.cc:954] ReplaceTablet: received request to replace tablet a4f891043b7d468da3e808980690354d from {username='slave'} at 127.0.0.1:47158
W20260318 02:51:22.270968 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f1ed26420c64492a94e8920d8c753fc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1ed26420c64492a94e8920d8c753fc3 already in progress: creating tablet
W20260318 02:51:22.271683 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 677f33f9e4ad4859ab85692f7b7aad2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 677f33f9e4ad4859ab85692f7b7aad2a already in progress: creating tablet
I20260318 02:51:22.273095 449 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d (table default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666]). Expected version 4 got 0
I20260318 02:51:22.273955 450 master_service.cc:954] ReplaceTablet: received request to replace tablet 323e4b1e9aee449f9402b1712b1444d9 from {username='slave'} at 127.0.0.1:47158
W20260318 02:51:22.274736 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 323e4b1e9aee449f9402b1712b1444d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 323e4b1e9aee449f9402b1712b1444d9 already in progress: creating tablet
I20260318 02:51:22.276763 1184 tablet_replica.cc:333] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:22.276985 1184 raft_consensus.cc:2243] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:22.277190 1184 raft_consensus.cc:2272] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:22.277359 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d6ad068d690949058bd4fdeea68e31a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.277988 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6ad068d690949058bd4fdeea68e31a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.281230 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_4a42a797802e455f938612dd56b0e3ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.281790 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a42a797802e455f938612dd56b0e3ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:22.284672 999 consensus_peers.cc:597] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d -> Peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Couldn't send request to peer 6a903d876086423b8016d705b98895ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1af760ed8ff14a498e751e67550cb1ac. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:22.285125 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_440cf82cdc3a4dbeb33532b68bd865e3" } new_table_name: "default.Table_bb21feccea674d3e8845f95753367aa8" modify_external_catalogs: true
I20260318 02:51:22.286144 457 master_service.cc:954] ReplaceTablet: received request to replace tablet f1ff303b23184d4b92994bde194229b4 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:22.289294 1184 ts_tablet_manager.cc:1916] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:22.289646 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_fc98457cd89d4e7386e8668c917c0db5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:22.289776 1172 tablet_bootstrap.cc:492] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:22.291114 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc98457cd89d4e7386e8668c917c0db5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.291759 1172 tablet_bootstrap.cc:654] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.292810 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4dc88020e12048858ae8533475bc1215" } new_table_name: "default.Table_ba651a71312242f98acb8a2229bfb548" modify_external_catalogs: true
I20260318 02:51:22.294428 1174 tablet_bootstrap.cc:492] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:22.294607 1174 ts_tablet_manager.cc:1403] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.001s
I20260318 02:51:22.295477 1280 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.104.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.104.190:39451,127.0.104.189:45933,127.0.104.188:41593
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.104.188:41593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.104.188
--webserver_port=37041
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type FASTDEBUG
built by None at 18 Mar 2026 02:43:20 UTC on bdcb31816ec0
build id 10982
ASAN enabled
I20260318 02:51:22.297816 1280 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260318 02:51:22.298923 1174 raft_consensus.cc:359] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.299173 1174 raft_consensus.cc:385] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.299258 1174 raft_consensus.cc:740] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.300127 1174 consensus_queue.cc:260] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.300444 1280 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260318 02:51:22.302992 1174 ts_tablet_manager.cc:1434] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260318 02:51:22.303378 1174 tablet_bootstrap.cc:492] T 76fc930611024211a70301bcfd92884e P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:22.304948 1363 tablet.cc:1723] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260318 02:51:22.305739 1362 tablet.cc:1723] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260318 02:51:22.307080 1173 tablet_bootstrap.cc:492] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:22.307266 1173 ts_tablet_manager.cc:1403] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.125s user 0.005s sys 0.006s
I20260318 02:51:22.309278 1173 raft_consensus.cc:359] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.309494 1173 raft_consensus.cc:385] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.309577 1173 raft_consensus.cc:740] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.309839 1173 consensus_queue.cc:260] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.310338 1173 ts_tablet_manager.cc:1434] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260318 02:51:22.314532 450 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d (table default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666]). Expected version 4 got 0
I20260318 02:51:22.314882 1184 ts_tablet_manager.cc:1929] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:22.315023 1184 log.cc:1199] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/92f95f7591b84ebbba033ec0e0cfc8b3
I20260318 02:51:22.315346 1184 ts_tablet_manager.cc:1950] T 92f95f7591b84ebbba033ec0e0cfc8b3 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:22.315307 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8d881dd16c5442d78313f6766ca90d4c" } new_table_name: "default.Table_5d2bd7442ee945c48175c6dd82738a5d" modify_external_catalogs: true
I20260318 02:51:22.316466 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 92f95f7591b84ebbba033ec0e0cfc8b3 (table default.Table_5f19fbe9c1f94632833382d5ff0c71c8 [id=5237c0e4bebf4b26a0bb902002016ac7]) successfully deleted
W20260318 02:51:22.317173 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2e16272bcf9c435a80b32ba9cba9c738 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2e16272bcf9c435a80b32ba9cba9c738 already in progress: creating tablet
W20260318 02:51:22.317454 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 32880a703603476786b4a34ddd40cab8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32880a703603476786b4a34ddd40cab8 already in progress: creating tablet
I20260318 02:51:22.317731 1172 tablet_bootstrap.cc:492] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:22.317741 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ad48442498024a38afeabaecaf4937b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:22.317898 1172 ts_tablet_manager.cc:1403] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.000s
W20260318 02:51:22.318288 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad48442498024a38afeabaecaf4937b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.318768 1172 raft_consensus.cc:359] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.318954 1172 raft_consensus.cc:385] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.319024 1172 raft_consensus.cc:740] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.319303 1172 consensus_queue.cc:260] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.320251 1172 ts_tablet_manager.cc:1434] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260318 02:51:22.320643 1173 tablet_bootstrap.cc:492] T 0ea4a57dc67e407f9c93679cb2053557 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:22.321030 1172 tablet_bootstrap.cc:492] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:22.323741 1173 tablet_bootstrap.cc:654] T 0ea4a57dc67e407f9c93679cb2053557 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.324785 1184 tablet_replica.cc:333] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:22.324985 1184 raft_consensus.cc:2243] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:22.325381 451 master_service.cc:954] ReplaceTablet: received request to replace tablet 30205728339f4bcf8b7d94d6f373e01c from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:22.325532 1184 pending_rounds.cc:70] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d: Trying to abort 1 pending ops.
W20260318 02:51:22.326004 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 053a09fd13fa4d8e80133fd77acaa4ce consensus state has no leader
I20260318 02:51:22.326539 1184 pending_rounds.cc:77] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7265494148356579328 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "1af760ed8ff14a498e751e67550cb1ac" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 5 new_table_name: "default.Table_77c75231b25242e7aa24d2bae80c37c5" dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" new_extra_config { } }
W20260318 02:51:22.327093 1184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:38664: Aborted: Op aborted
I20260318 02:51:22.327454 1184 raft_consensus.cc:2272] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:22.327795 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 4dadf0fc6e134edd87788dd4ade59dc5) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.327435 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_559e7d5c5ca844c3985182f0fa1e14f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.328783 441 catalog_manager.cc:5081] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): alter failed for tablet 1af760ed8ff14a498e751e67550cb1ac (table default.Table_77c75231b25242e7aa24d2bae80c37c5 [id=433e7aa77412424ebb38784bb073d1fb]): Aborted: Op aborted
I20260318 02:51:22.329787 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3187e1c3102e48718763dac2a3a40dc9" } new_table_name: "default.Table_7442f04ad30e435b84996fb8990e0a44" modify_external_catalogs: true
W20260318 02:51:22.328670 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_559e7d5c5ca844c3985182f0fa1e14f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.335992 1184 ts_tablet_manager.cc:1916] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:22.336982 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 1af760ed8ff14a498e751e67550cb1ac with delete_type TABLET_DATA_DELETED (replaced by tablet 1516525b471540288c6cb5d61120d430) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:22.337862 443 catalog_manager.cc:4969] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 1af760ed8ff14a498e751e67550cb1ac because the tablet was not found. No further retry: Not found: Tablet not found: 1af760ed8ff14a498e751e67550cb1ac
W20260318 02:51:22.345835 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet af793623466249e695b262ab451d4dc9 consensus state has no leader
I20260318 02:51:22.350205 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 30205728339f4bcf8b7d94d6f373e01c
I20260318 02:51:22.350696 451 catalog_manager.cc:6741] ReplaceTablet: tablet 30205728339f4bcf8b7d94d6f373e01c deleted and replaced by tablet e3999f53c1cc4cb5a1d91eed23785cc6
I20260318 02:51:22.351095 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 30205728339f4bcf8b7d94d6f373e01c with delete_type TABLET_DATA_DELETED (replaced by tablet e3999f53c1cc4cb5a1d91eed23785cc6) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:22.351853 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 30205728339f4bcf8b7d94d6f373e01c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30205728339f4bcf8b7d94d6f373e01c already in progress: creating tablet
I20260318 02:51:22.353518 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 30205728339f4bcf8b7d94d6f373e01c with delete_type TABLET_DATA_DELETED (replaced by tablet e3999f53c1cc4cb5a1d91eed23785cc6) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.353513 903 tablet_service.cc:1511] Processing CreateTablet for tablet 9d20847fa6f9461cb6137f56ea680cb6 (DEFAULT_TABLE table=default.Table_87fa1f636198436a81500e9b228f29c2 [id=ed55cf5473c34c8b95532da9cfa81fad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.353885 757 tablet_service.cc:1511] Processing CreateTablet for tablet 9d20847fa6f9461cb6137f56ea680cb6 (DEFAULT_TABLE table=default.Table_87fa1f636198436a81500e9b228f29c2 [id=ed55cf5473c34c8b95532da9cfa81fad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.353981 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d20847fa6f9461cb6137f56ea680cb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.354049 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ad59f4f5db8424a900b36e060745aa6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.354291 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d20847fa6f9461cb6137f56ea680cb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.354717 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 08307bc69291479eb8ee0d7aec124829 (DEFAULT_TABLE table=default.Table_80f976f24d184e2cbaf4f63b8495c8ab [id=2597ecaa93914543870472f2af156dc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.355077 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08307bc69291479eb8ee0d7aec124829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.356056 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 9d20847fa6f9461cb6137f56ea680cb6 (DEFAULT_TABLE table=default.Table_87fa1f636198436a81500e9b228f29c2 [id=ed55cf5473c34c8b95532da9cfa81fad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.356451 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d20847fa6f9461cb6137f56ea680cb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.360522 1172 tablet_bootstrap.cc:654] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.360651 903 tablet_service.cc:1511] Processing CreateTablet for tablet 08307bc69291479eb8ee0d7aec124829 (DEFAULT_TABLE table=default.Table_80f976f24d184e2cbaf4f63b8495c8ab [id=2597ecaa93914543870472f2af156dc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.361167 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08307bc69291479eb8ee0d7aec124829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.361568 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 30205728339f4bcf8b7d94d6f373e01c with delete_type TABLET_DATA_DELETED (replaced by tablet e3999f53c1cc4cb5a1d91eed23785cc6) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:22.362277 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 30205728339f4bcf8b7d94d6f373e01c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30205728339f4bcf8b7d94d6f373e01c already in progress: creating tablet
W20260318 02:51:22.362825 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e3999f53c1cc4cb5a1d91eed23785cc6 has no consensus state
I20260318 02:51:22.363230 1174 tablet_bootstrap.cc:654] T 76fc930611024211a70301bcfd92884e P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.363209 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b3901efd64bf4590bc9995ab5af1003a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.363832 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3901efd64bf4590bc9995ab5af1003a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.365139 907 tablet_service.cc:1511] Processing CreateTablet for tablet 93479517a1d34d2d99633018a6a57127 (DEFAULT_TABLE table=default.Table_167a79354e7844aabe2ae725df4f536c [id=095e4b55b1544007a032a984ba934743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.365518 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93479517a1d34d2d99633018a6a57127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.365454 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 93479517a1d34d2d99633018a6a57127 (DEFAULT_TABLE table=default.Table_167a79354e7844aabe2ae725df4f536c [id=095e4b55b1544007a032a984ba934743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.365795 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93479517a1d34d2d99633018a6a57127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.365919 760 tablet_service.cc:1511] Processing CreateTablet for tablet 08307bc69291479eb8ee0d7aec124829 (DEFAULT_TABLE table=default.Table_80f976f24d184e2cbaf4f63b8495c8ab [id=2597ecaa93914543870472f2af156dc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.366284 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08307bc69291479eb8ee0d7aec124829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.368005 757 tablet_service.cc:1511] Processing CreateTablet for tablet 93479517a1d34d2d99633018a6a57127 (DEFAULT_TABLE table=default.Table_167a79354e7844aabe2ae725df4f536c [id=095e4b55b1544007a032a984ba934743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.369889 899 tablet_service.cc:1511] Processing CreateTablet for tablet 0d343e53f2354a3386b19d71ef00d5a4 (DEFAULT_TABLE table=default.Table_7710260d7bd54a859b6fc9023ce450e2 [id=301be4fd1a6b44c6962f9386d1e7f91e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.370800 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d343e53f2354a3386b19d71ef00d5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.371062 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a15515bcae1f4d8db3cebc745b7ea5a9" } new_table_name: "default.Table_b32688b6575041c999f2750fd0d11b2e" modify_external_catalogs: true
I20260318 02:51:22.371220 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93479517a1d34d2d99633018a6a57127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.377280 450 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 549b3929ea33417bbe50e749bbfe223d (table default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]). Expected version 2 got 0
I20260318 02:51:22.379156 450 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet e2304246c244407b9d4eb301ac5d7ba9 (table default.Table_870eb9eb87224d229502d71d64113e3a [id=20ed812002544f6f8caef448f7514f7c]). Expected version 2 got 0
I20260318 02:51:22.379488 1184 ts_tablet_manager.cc:1929] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260318 02:51:22.379647 1184 log.cc:1199] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/1af760ed8ff14a498e751e67550cb1ac
I20260318 02:51:22.380012 1184 ts_tablet_manager.cc:1950] T 1af760ed8ff14a498e751e67550cb1ac P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:22.381696 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5e18692d41ef4f6b9ac36936944042f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.382833 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e18692d41ef4f6b9ac36936944042f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.384457 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 1af760ed8ff14a498e751e67550cb1ac (table default.Table_77c75231b25242e7aa24d2bae80c37c5 [id=433e7aa77412424ebb38784bb073d1fb]) successfully deleted
I20260318 02:51:22.385495 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 7480b1fa026242d7bb6ddbf8df563116
I20260318 02:51:22.386236 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 7480b1fa026242d7bb6ddbf8df563116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.386916 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e285c48a68a04ddca6c3da148d0f43f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.387017 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet b69dd1653a304f3d99346e89dacf9208 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b69dd1653a304f3d99346e89dacf9208 already in progress: creating tablet
W20260318 02:51:22.387382 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet fda9f1fe47e04688bde80ebe23494d08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fda9f1fe47e04688bde80ebe23494d08 already in progress: creating tablet
W20260318 02:51:22.387557 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e285c48a68a04ddca6c3da148d0f43f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.388006 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 7480b1fa026242d7bb6ddbf8df563116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:22.388139 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 7480b1fa026242d7bb6ddbf8df563116 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7480b1fa026242d7bb6ddbf8df563116 already in progress: creating tablet
I20260318 02:51:22.388130 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 7480b1fa026242d7bb6ddbf8df563116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:22.388404 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f447cab3445c451d8ef8746966cfcd42 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f447cab3445c451d8ef8746966cfcd42 already in progress: creating tablet
W20260318 02:51:22.388633 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 3c283efbac08468c8c20f4caba90164c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c283efbac08468c8c20f4caba90164c already in progress: creating tablet
W20260318 02:51:22.388818 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 7480b1fa026242d7bb6ddbf8df563116 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7480b1fa026242d7bb6ddbf8df563116 already in progress: creating tablet
W20260318 02:51:22.389112 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 31d493650d07437c9f1d657bb08a98d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31d493650d07437c9f1d657bb08a98d7 already in progress: creating tablet
I20260318 02:51:22.389365 450 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 053a09fd13fa4d8e80133fd77acaa4ce (table default.Table_bb21feccea674d3e8845f95753367aa8 [id=3a77e587db534e32b2716d153a8419cd]). Expected version 3 got 0
I20260318 02:51:22.389680 1173 tablet_bootstrap.cc:492] T 0ea4a57dc67e407f9c93679cb2053557 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:22.389845 1173 ts_tablet_manager.cc:1403] T 0ea4a57dc67e407f9c93679cb2053557 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.069s user 0.017s sys 0.009s
W20260318 02:51:22.389869 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2b6267d3f6e142579c62bbb4b14da4b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b6267d3f6e142579c62bbb4b14da4b0 already in progress: creating tablet
I20260318 02:51:22.390324 1184 tablet_replica.cc:333] T b9fe7de28b0646b9b2b96fc46962df9e P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:22.390517 1184 raft_consensus.cc:2243] T b9fe7de28b0646b9b2b96fc46962df9e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:22.390707 1184 raft_consensus.cc:2272] T b9fe7de28b0646b9b2b96fc46962df9e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:22.390710 1173 raft_consensus.cc:359] T 0ea4a57dc67e407f9c93679cb2053557 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.390894 1173 raft_consensus.cc:385] T 0ea4a57dc67e407f9c93679cb2053557 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.390996 1173 raft_consensus.cc:740] T 0ea4a57dc67e407f9c93679cb2053557 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.391259 1173 consensus_queue.cc:260] T 0ea4a57dc67e407f9c93679cb2053557 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.391950 1173 ts_tablet_manager.cc:1434] T 0ea4a57dc67e407f9c93679cb2053557 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:22.393769 763 tablet_service.cc:1511] Processing CreateTablet for tablet b51a15e4303742a999fe9a96d450c827 (DEFAULT_TABLE table=default.Table_7915e6d57ee1442c8b08ce6acc4a31b1 [id=9aa1a9e376e8459987f5ef2231598bd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.394089 1173 tablet_bootstrap.cc:492] T f7415ddf48574f7b9a746049ce78d2e9 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:22.394241 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b51a15e4303742a999fe9a96d450c827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.395768 1173 tablet_bootstrap.cc:654] T f7415ddf48574f7b9a746049ce78d2e9 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.397161 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 0d343e53f2354a3386b19d71ef00d5a4 (DEFAULT_TABLE table=default.Table_7710260d7bd54a859b6fc9023ce450e2 [id=301be4fd1a6b44c6962f9386d1e7f91e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.397722 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d343e53f2354a3386b19d71ef00d5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.401365 760 tablet_service.cc:1511] Processing CreateTablet for tablet 0d343e53f2354a3386b19d71ef00d5a4 (DEFAULT_TABLE table=default.Table_7710260d7bd54a859b6fc9023ce450e2 [id=301be4fd1a6b44c6962f9386d1e7f91e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.401816 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d343e53f2354a3386b19d71ef00d5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.404137 903 tablet_service.cc:1511] Processing CreateTablet for tablet b51a15e4303742a999fe9a96d450c827 (DEFAULT_TABLE table=default.Table_7915e6d57ee1442c8b08ce6acc4a31b1 [id=9aa1a9e376e8459987f5ef2231598bd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.404654 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b51a15e4303742a999fe9a96d450c827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.412110 1172 tablet_bootstrap.cc:492] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:22.412282 1172 ts_tablet_manager.cc:1403] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.091s user 0.005s sys 0.000s
I20260318 02:51:22.414657 1034 tablet_service.cc:1511] Processing CreateTablet for tablet b51a15e4303742a999fe9a96d450c827 (DEFAULT_TABLE table=default.Table_7915e6d57ee1442c8b08ce6acc4a31b1 [id=9aa1a9e376e8459987f5ef2231598bd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.415793 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b51a15e4303742a999fe9a96d450c827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.417052 763 tablet_service.cc:1511] Processing CreateTablet for tablet 3e38dec0d2e9417e8571e202036e7117 (DEFAULT_TABLE table=default.Table_76edb5c5aa524eda83e05de00631650c [id=c06168b4ee024f728f2f11a4cc39fc4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.417538 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e38dec0d2e9417e8571e202036e7117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.418685 903 tablet_service.cc:1511] Processing CreateTablet for tablet 3e38dec0d2e9417e8571e202036e7117 (DEFAULT_TABLE table=default.Table_76edb5c5aa524eda83e05de00631650c [id=c06168b4ee024f728f2f11a4cc39fc4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.419215 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e38dec0d2e9417e8571e202036e7117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.419319 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 3e38dec0d2e9417e8571e202036e7117 (DEFAULT_TABLE table=default.Table_76edb5c5aa524eda83e05de00631650c [id=c06168b4ee024f728f2f11a4cc39fc4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.419685 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e38dec0d2e9417e8571e202036e7117. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.423627 1357 raft_consensus.cc:493] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:22.423825 1357 raft_consensus.cc:515] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.424737 1357 leader_election.cc:290] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:22.426134 997 leader_election.cc:343] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: 1ad59f4f5db8424a900b36e060745aa6
W20260318 02:51:22.427134 999 leader_election.cc:343] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 1ad59f4f5db8424a900b36e060745aa6
I20260318 02:51:22.427258 999 leader_election.cc:304] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:22.427672 1357 raft_consensus.cc:2749] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:22.431371 899 tablet_service.cc:1511] Processing CreateTablet for tablet d1a884fde2c145518a2cb14b7780b6dd (DEFAULT_TABLE table=default.Table_6372798c3d47435ea80a21ca734ce78f [id=b5127c54241a49309f32bfa4e5f6f2cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.431572 757 tablet_service.cc:1511] Processing CreateTablet for tablet d1a884fde2c145518a2cb14b7780b6dd (DEFAULT_TABLE table=default.Table_6372798c3d47435ea80a21ca734ce78f [id=b5127c54241a49309f32bfa4e5f6f2cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.431861 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a884fde2c145518a2cb14b7780b6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.432030 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a884fde2c145518a2cb14b7780b6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.414908 1172 raft_consensus.cc:359] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:22.433894 1172 raft_consensus.cc:385] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.434010 1172 raft_consensus.cc:740] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.434629 1172 consensus_queue.cc:260] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:22.436527 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 95f15079d1df4314b6dd5c7afd896af5
I20260318 02:51:22.436698 1184 ts_tablet_manager.cc:1916] T b9fe7de28b0646b9b2b96fc46962df9e P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:22.437268 453 master_service.cc:954] ReplaceTablet: received request to replace tablet e61c374078854d589219dfa4c20e4222 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:22.437579 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 95f15079d1df4314b6dd5c7afd896af5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.437866 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_429d1a716ae64decac39f45685e90b00" } modify_external_catalogs: true
I20260318 02:51:22.438060 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_429d1a716ae64decac39f45685e90b00" } modify_external_catalogs: true
W20260318 02:51:22.438227 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 95f15079d1df4314b6dd5c7afd896af5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95f15079d1df4314b6dd5c7afd896af5 already in progress: creating tablet
I20260318 02:51:22.439689 1038 tablet_service.cc:1511] Processing CreateTablet for tablet d1a884fde2c145518a2cb14b7780b6dd (DEFAULT_TABLE table=default.Table_6372798c3d47435ea80a21ca734ce78f [id=b5127c54241a49309f32bfa4e5f6f2cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.439772 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 95f15079d1df4314b6dd5c7afd896af5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.440202 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a884fde2c145518a2cb14b7780b6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.440949 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet a4f891043b7d468da3e808980690354d
I20260318 02:51:22.441388 452 catalog_manager.cc:6741] ReplaceTablet: tablet a4f891043b7d468da3e808980690354d deleted and replaced by tablet 4fa6bf38381740a1bab1088ede6ede1c
I20260318 02:51:22.442647 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet d604cd634a1c470ba3896cf02d2804d4
I20260318 02:51:22.443833 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f1ff303b23184d4b92994bde194229b4
I20260318 02:51:22.444207 457 catalog_manager.cc:6741] ReplaceTablet: tablet f1ff303b23184d4b92994bde194229b4 deleted and replaced by tablet b5c19bc5e07949088c84cedbf944dfdb
I20260318 02:51:22.446305 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 95f15079d1df4314b6dd5c7afd896af5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.449158 899 tablet_service.cc:1511] Processing CreateTablet for tablet 2c5038e9e1074f46976a1a5bb4282944 (DEFAULT_TABLE table=default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.449769 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c5038e9e1074f46976a1a5bb4282944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.450963 761 tablet_service.cc:1511] Processing CreateTablet for tablet 2c5038e9e1074f46976a1a5bb4282944 (DEFAULT_TABLE table=default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.452366 756 tablet_service.cc:1558] Processing DeleteTablet for tablet f1ff303b23184d4b92994bde194229b4 with delete_type TABLET_DATA_DELETED (replaced by tablet b5c19bc5e07949088c84cedbf944dfdb) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.452581 766 tablet_service.cc:1511] Processing CreateTablet for tablet 1516525b471540288c6cb5d61120d430 (DEFAULT_TABLE table=default.Table_77c75231b25242e7aa24d2bae80c37c5 [id=433e7aa77412424ebb38784bb073d1fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.452793 759 tablet_service.cc:1511] Processing CreateTablet for tablet 105326aea9f744779ca76e0cbb2448cd (DEFAULT_TABLE table=default.Table_aaff9d9f20e641efa8b5c156a7055b9c [id=58354360683d422dbdcc43826b39dbc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.453472 764 tablet_service.cc:1558] Processing DeleteTablet for tablet d604cd634a1c470ba3896cf02d2804d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.453840 755 tablet_service.cc:1511] Processing CreateTablet for tablet 99e807c8ff5e457fb6c97c6d1b277eab (DEFAULT_TABLE table=default.Table_696d62e7ef59402ca5878b9a43539cc2 [id=568e88222ca648ce88ee962e91a84588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.454675 1174 tablet_bootstrap.cc:492] T 76fc930611024211a70301bcfd92884e P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:22.454896 1174 ts_tablet_manager.cc:1403] T 76fc930611024211a70301bcfd92884e P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.152s user 0.003s sys 0.003s
I20260318 02:51:22.455763 455 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666] alter complete (version 4)
I20260318 02:51:22.455775 1174 raft_consensus.cc:359] T 76fc930611024211a70301bcfd92884e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.456032 1174 raft_consensus.cc:385] T 76fc930611024211a70301bcfd92884e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.456166 1174 raft_consensus.cc:740] T 76fc930611024211a70301bcfd92884e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.456490 1174 consensus_queue.cc:260] T 76fc930611024211a70301bcfd92884e P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:22.457321 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5c19bc5e07949088c84cedbf944dfdb has no consensus state
I20260318 02:51:22.457818 1174 ts_tablet_manager.cc:1434] T 76fc930611024211a70301bcfd92884e P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:22.458732 903 tablet_service.cc:1511] Processing CreateTablet for tablet 99e807c8ff5e457fb6c97c6d1b277eab (DEFAULT_TABLE table=default.Table_696d62e7ef59402ca5878b9a43539cc2 [id=568e88222ca648ce88ee962e91a84588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.458849 907 tablet_service.cc:1558] Processing DeleteTablet for tablet a4f891043b7d468da3e808980690354d with delete_type TABLET_DATA_DELETED (replaced by tablet 4fa6bf38381740a1bab1088ede6ede1c) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.459164 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c5038e9e1074f46976a1a5bb4282944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.459188 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e807c8ff5e457fb6c97c6d1b277eab. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:22.459309 450 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 549b3929ea33417bbe50e749bbfe223d (table default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 549b3929ea33417bbe50e749bbfe223d consensus state has no leader
I20260318 02:51:22.459738 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet a4f891043b7d468da3e808980690354d with delete_type TABLET_DATA_DELETED (replaced by tablet 4fa6bf38381740a1bab1088ede6ede1c) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.460403 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 99e807c8ff5e457fb6c97c6d1b277eab (DEFAULT_TABLE table=default.Table_696d62e7ef59402ca5878b9a43539cc2 [id=568e88222ca648ce88ee962e91a84588]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.461339 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e807c8ff5e457fb6c97c6d1b277eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.464042 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5711987324e24023b68377247e832cc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.464725 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5711987324e24023b68377247e832cc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:22.464936 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 95f15079d1df4314b6dd5c7afd896af5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95f15079d1df4314b6dd5c7afd896af5 already in progress: creating tablet
W20260318 02:51:22.465304 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet a4f891043b7d468da3e808980690354d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4f891043b7d468da3e808980690354d already in progress: creating tablet
I20260318 02:51:22.466323 907 tablet_service.cc:1558] Processing DeleteTablet for tablet d604cd634a1c470ba3896cf02d2804d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:22.466471 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f1ff303b23184d4b92994bde194229b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1ff303b23184d4b92994bde194229b4 already in progress: creating tablet
I20260318 02:51:22.466485 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 2c5038e9e1074f46976a1a5bb4282944 (DEFAULT_TABLE table=default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:22.466712 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet d604cd634a1c470ba3896cf02d2804d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d604cd634a1c470ba3896cf02d2804d4 already in progress: creating tablet
I20260318 02:51:22.467099 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c5038e9e1074f46976a1a5bb4282944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.467510 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105326aea9f744779ca76e0cbb2448cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.467697 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_83aab17168ad4c2bae9ea1b354ef5001" } modify_external_catalogs: true
I20260318 02:51:22.467862 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_83aab17168ad4c2bae9ea1b354ef5001" } modify_external_catalogs: true
I20260318 02:51:22.468026 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet d604cd634a1c470ba3896cf02d2804d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.469045 907 tablet_service.cc:1558] Processing DeleteTablet for tablet f1ff303b23184d4b92994bde194229b4 with delete_type TABLET_DATA_DELETED (replaced by tablet b5c19bc5e07949088c84cedbf944dfdb) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.469080 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_14f5197a4ef6461daa2267c549d5078f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.469596 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14f5197a4ef6461daa2267c549d5078f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.473007 1362 tablet.cc:1723] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:22.473035 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99e807c8ff5e457fb6c97c6d1b277eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.473572 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1516525b471540288c6cb5d61120d430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.474465 1173 tablet_bootstrap.cc:492] T f7415ddf48574f7b9a746049ce78d2e9 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:22.474628 1173 ts_tablet_manager.cc:1403] T f7415ddf48574f7b9a746049ce78d2e9 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.081s user 0.001s sys 0.016s
I20260318 02:51:22.475489 903 tablet_service.cc:1511] Processing CreateTablet for tablet 105326aea9f744779ca76e0cbb2448cd (DEFAULT_TABLE table=default.Table_aaff9d9f20e641efa8b5c156a7055b9c [id=58354360683d422dbdcc43826b39dbc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.475924 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105326aea9f744779ca76e0cbb2448cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.476100 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 105326aea9f744779ca76e0cbb2448cd (DEFAULT_TABLE table=default.Table_aaff9d9f20e641efa8b5c156a7055b9c [id=58354360683d422dbdcc43826b39dbc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.476454 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105326aea9f744779ca76e0cbb2448cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.483971 1363 tablet.cc:1723] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:22.475489 1173 raft_consensus.cc:359] T f7415ddf48574f7b9a746049ce78d2e9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.484736 1173 raft_consensus.cc:385] T f7415ddf48574f7b9a746049ce78d2e9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.484823 1173 raft_consensus.cc:740] T f7415ddf48574f7b9a746049ce78d2e9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.485059 1173 consensus_queue.cc:260] T f7415ddf48574f7b9a746049ce78d2e9 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:22.486693 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet d604cd634a1c470ba3896cf02d2804d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d604cd634a1c470ba3896cf02d2804d4 already in progress: creating tablet
W20260318 02:51:22.486928 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f1ff303b23184d4b92994bde194229b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1ff303b23184d4b92994bde194229b4 already in progress: creating tablet
I20260318 02:51:22.488199 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ea4a57dc67e407f9c93679cb2053557 with delete_type TABLET_DATA_DELETED (replaced by tablet 959faf1fbb224434b896c0f21e9715be) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.488770 1175 tablet_replica.cc:333] T 0ea4a57dc67e407f9c93679cb2053557 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:22.489001 1175 raft_consensus.cc:2243] T 0ea4a57dc67e407f9c93679cb2053557 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:22.489166 1175 raft_consensus.cc:2272] T 0ea4a57dc67e407f9c93679cb2053557 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:22.490015 1175 ts_tablet_manager.cc:1916] T 0ea4a57dc67e407f9c93679cb2053557 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:22.500907 1175 ts_tablet_manager.cc:1929] T 0ea4a57dc67e407f9c93679cb2053557 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:22.500919 1343 raft_consensus.cc:493] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:22.501116 1343 raft_consensus.cc:515] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:22.501201 1175 log.cc:1199] T 0ea4a57dc67e407f9c93679cb2053557 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/0ea4a57dc67e407f9c93679cb2053557
W20260318 02:51:22.501423 1373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260318 02:51:22.501582 1175 ts_tablet_manager.cc:1950] T 0ea4a57dc67e407f9c93679cb2053557 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:22.501839 1343 leader_election.cc:290] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:22.503072 1174 tablet_bootstrap.cc:492] T 96a854e3872c44e4863316c9fe5f2ee9 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:22.502861 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549b3929ea33417bbe50e749bbfe223d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:22.503791 1173 ts_tablet_manager.cc:1434] T f7415ddf48574f7b9a746049ce78d2e9 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.029s user 0.000s sys 0.003s
W20260318 02:51:22.504750 719 leader_election.cc:343] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:22.504932 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 76fc930611024211a70301bcfd92884e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.505200 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet f1ff303b23184d4b92994bde194229b4 with delete_type TABLET_DATA_DELETED (replaced by tablet b5c19bc5e07949088c84cedbf944dfdb) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.505342 760 tablet_service.cc:1558] Processing DeleteTablet for tablet a4f891043b7d468da3e808980690354d with delete_type TABLET_DATA_DELETED (replaced by tablet 4fa6bf38381740a1bab1088ede6ede1c) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.505628 1176 tablet_replica.cc:333] T 76fc930611024211a70301bcfd92884e P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:22.505815 1176 raft_consensus.cc:2243] T 76fc930611024211a70301bcfd92884e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:22.506700 1176 raft_consensus.cc:2272] T 76fc930611024211a70301bcfd92884e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:22.507668 1173 tablet_bootstrap.cc:492] T 9e421d3fe62b4985bfe0486a4b115b2a P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:22.507915 1176 ts_tablet_manager.cc:1916] T 76fc930611024211a70301bcfd92884e P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:22.509744 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 1516525b471540288c6cb5d61120d430 (DEFAULT_TABLE table=default.Table_77c75231b25242e7aa24d2bae80c37c5 [id=433e7aa77412424ebb38784bb073d1fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.510674 907 tablet_service.cc:1511] Processing CreateTablet for tablet 547762347d7843e989e55e0449ad9fcb (DEFAULT_TABLE table=default.Table_6d3695295b794364b4cdc7849155a559 [id=71965e8878d84c45a022d4438ea04e0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.510651 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 547762347d7843e989e55e0449ad9fcb (DEFAULT_TABLE table=default.Table_6d3695295b794364b4cdc7849155a559 [id=71965e8878d84c45a022d4438ea04e0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.511075 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 547762347d7843e989e55e0449ad9fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.511185 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 547762347d7843e989e55e0449ad9fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.512743 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1516525b471540288c6cb5d61120d430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.512821 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549b3929ea33417bbe50e749bbfe223d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:22.513469 1357 raft_consensus.cc:493] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:22.515419 1357 raft_consensus.cc:515] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:22.516067 1357 leader_election.cc:290] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:22.516601 1176 ts_tablet_manager.cc:1929] T 76fc930611024211a70301bcfd92884e P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:22.516764 1176 log.cc:1199] T 76fc930611024211a70301bcfd92884e P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/76fc930611024211a70301bcfd92884e
W20260318 02:51:22.516994 997 leader_election.cc:343] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: 10aafa9bf1c44b95b0263d9a76b8b1b2
I20260318 02:51:22.517158 1176 ts_tablet_manager.cc:1950] T 76fc930611024211a70301bcfd92884e P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
W20260318 02:51:22.517688 719 leader_election.cc:343] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:22.517858 719 leader_election.cc:304] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:22.518229 899 tablet_service.cc:1558] Processing DeleteTablet for tablet f7415ddf48574f7b9a746049ce78d2e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.518261 1343 raft_consensus.cc:2749] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:22.518299 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 76fc930611024211a70301bcfd92884e (table default.Table_68f3e929e48949f1a9f426d64cb46006 [id=7fda019fe63e4e5995aeb77e4cf70dec]) successfully deleted
I20260318 02:51:22.518571 1175 tablet_replica.cc:333] T f7415ddf48574f7b9a746049ce78d2e9 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:22.518766 1175 raft_consensus.cc:2243] T f7415ddf48574f7b9a746049ce78d2e9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:22.518747 999 leader_election.cc:343] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 10aafa9bf1c44b95b0263d9a76b8b1b2
I20260318 02:51:22.518774 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 0ea4a57dc67e407f9c93679cb2053557 (table default.Table_ebd103e5fbf4484597076b02ffd82044 [id=4067c18ce85f44d7993786a3e9bda883]) successfully deleted
I20260318 02:51:22.518873 999 leader_election.cc:304] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:22.518963 1175 raft_consensus.cc:2272] T f7415ddf48574f7b9a746049ce78d2e9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:22.519330 1357 raft_consensus.cc:2749] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:22.519646 454 master_service.cc:954] ReplaceTablet: received request to replace tablet 97655cb5968b4c819273068818d5cab8 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:22.519742 1175 ts_tablet_manager.cc:1916] T f7415ddf48574f7b9a746049ce78d2e9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:22.522151 1174 tablet_bootstrap.cc:654] T 96a854e3872c44e4863316c9fe5f2ee9 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.523046 1172 ts_tablet_manager.cc:1434] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.111s user 0.002s sys 0.001s
I20260318 02:51:22.524060 903 tablet_service.cc:1511] Processing CreateTablet for tablet 1516525b471540288c6cb5d61120d430 (DEFAULT_TABLE table=default.Table_77c75231b25242e7aa24d2bae80c37c5 [id=433e7aa77412424ebb38784bb073d1fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.524426 1172 tablet_bootstrap.cc:492] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:22.524649 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1516525b471540288c6cb5d61120d430. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.528893 1173 tablet_bootstrap.cc:654] T 9e421d3fe62b4985bfe0486a4b115b2a P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:22.537248 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet a4f891043b7d468da3e808980690354d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4f891043b7d468da3e808980690354d already in progress: creating tablet
I20260318 02:51:22.539119 1175 ts_tablet_manager.cc:1929] T f7415ddf48574f7b9a746049ce78d2e9 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:22.539400 757 tablet_service.cc:1511] Processing CreateTablet for tablet 547762347d7843e989e55e0449ad9fcb (DEFAULT_TABLE table=default.Table_6d3695295b794364b4cdc7849155a559 [id=71965e8878d84c45a022d4438ea04e0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.540024 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 547762347d7843e989e55e0449ad9fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.541525 1175 log.cc:1199] T f7415ddf48574f7b9a746049ce78d2e9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/f7415ddf48574f7b9a746049ce78d2e9
I20260318 02:51:22.542065 1175 ts_tablet_manager.cc:1950] T f7415ddf48574f7b9a746049ce78d2e9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:22.542877 1359 tablet.cc:1723] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:22.541417 1173 tablet_bootstrap.cc:492] T 9e421d3fe62b4985bfe0486a4b115b2a P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:22.545570 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet f7415ddf48574f7b9a746049ce78d2e9 (table default.Table_ac694c873ef141579c82755592552b23 [id=a004400b026145a5be338b0b2e4b8ce3]) successfully deleted
I20260318 02:51:22.545742 1173 ts_tablet_manager.cc:1403] T 9e421d3fe62b4985bfe0486a4b115b2a P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.004s
I20260318 02:51:22.546046 1184 ts_tablet_manager.cc:1929] T b9fe7de28b0646b9b2b96fc46962df9e P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:22.546593 1173 raft_consensus.cc:359] T 9e421d3fe62b4985bfe0486a4b115b2a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.547175 1174 tablet_bootstrap.cc:492] T 96a854e3872c44e4863316c9fe5f2ee9 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:22.547472 1174 ts_tablet_manager.cc:1403] T 96a854e3872c44e4863316c9fe5f2ee9 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.069s user 0.001s sys 0.003s
I20260318 02:51:22.549226 1174 raft_consensus.cc:359] T 96a854e3872c44e4863316c9fe5f2ee9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.549539 1174 raft_consensus.cc:385] T 96a854e3872c44e4863316c9fe5f2ee9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.549662 1174 raft_consensus.cc:740] T 96a854e3872c44e4863316c9fe5f2ee9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.550058 1173 raft_consensus.cc:385] T 9e421d3fe62b4985bfe0486a4b115b2a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.549996 1174 consensus_queue.cc:260] T 96a854e3872c44e4863316c9fe5f2ee9 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.550624 1173 raft_consensus.cc:740] T 9e421d3fe62b4985bfe0486a4b115b2a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.551968 1173 consensus_queue.cc:260] T 9e421d3fe62b4985bfe0486a4b115b2a P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.552472 1280 server_base.cc:1060] running on GCE node
W20260318 02:51:22.552778 1376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260318 02:51:22.556048 1173 ts_tablet_manager.cc:1434] T 9e421d3fe62b4985bfe0486a4b115b2a P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
W20260318 02:51:22.554313 1381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260318 02:51:22.558137 1280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260318 02:51:22.558755 1173 tablet_bootstrap.cc:492] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:22.559252 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_62dcfd8adef34929a08c11dfcf174ff7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.559916 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62dcfd8adef34929a08c11dfcf174ff7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.560562 1173 tablet_bootstrap.cc:654] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.562551 1343 raft_consensus.cc:493] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:22.562721 1343 raft_consensus.cc:515] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.563390 1343 leader_election.cc:290] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:22.564921 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "053a09fd13fa4d8e80133fd77acaa4ce" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:22.565510 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 977b95a3442a405d90385cdb4d6dd5dd
W20260318 02:51:22.565623 719 leader_election.cc:343] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:22.566507 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 977b95a3442a405d90385cdb4d6dd5dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:22.567229 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 977b95a3442a405d90385cdb4d6dd5dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 977b95a3442a405d90385cdb4d6dd5dd already in progress: creating tablet
I20260318 02:51:22.567317 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 977b95a3442a405d90385cdb4d6dd5dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.570523 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b3901efd64bf4590bc9995ab5af1003a" } new_table_name: "default.Table_b81f87a10bfa4885ba1ad5ed5fdf1828" modify_external_catalogs: true
I20260318 02:51:22.570842 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9cc80dda475640989a3e3c6f37b35831" } new_table_name: "default.Table_052531beeed14df8ad6d4304d38a5b4e" modify_external_catalogs: true
I20260318 02:51:22.572183 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ce5965e4cd074e108328165edb428e18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.572798 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce5965e4cd074e108328165edb428e18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.575517 1174 ts_tablet_manager.cc:1434] T 96a854e3872c44e4863316c9fe5f2ee9 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260318 02:51:22.576433 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6b803a878dd34cc08f81c475ce92ac12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.577047 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b803a878dd34cc08f81c475ce92ac12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.577455 1174 tablet_bootstrap.cc:492] T f1ed26420c64492a94e8920d8c753fc3 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:22.577900 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0fa2447b80b545388441838507fc117c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.578397 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0fa2447b80b545388441838507fc117c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:22.578630 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 977b95a3442a405d90385cdb4d6dd5dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 977b95a3442a405d90385cdb4d6dd5dd already in progress: creating tablet
I20260318 02:51:22.578838 1184 log.cc:1199] T b9fe7de28b0646b9b2b96fc46962df9e P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/b9fe7de28b0646b9b2b96fc46962df9e
I20260318 02:51:22.579275 1184 ts_tablet_manager.cc:1950] T b9fe7de28b0646b9b2b96fc46962df9e P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:22.579623 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ad48442498024a38afeabaecaf4937b8" } new_table_name: "default.Table_f6489e5e0d7f47cb889864d493a7b77c" modify_external_catalogs: true
I20260318 02:51:22.581604 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 1766ce95009b4c3f9940ebcf10503c7f
I20260318 02:51:22.582556 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 1766ce95009b4c3f9940ebcf10503c7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.582831 1175 tablet_replica.cc:333] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:22.583029 1175 raft_consensus.cc:2243] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:22.564294 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "053a09fd13fa4d8e80133fd77acaa4ce" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:22.583433 1175 raft_consensus.cc:2272] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:22.571079 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 53502a8e2d184b7ea7fa575d4836f0ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.571274 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 977b95a3442a405d90385cdb4d6dd5dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.583873 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet b9fe7de28b0646b9b2b96fc46962df9e (table default.Table_f89bbd2163914385916f490a3e147bd8 [id=3503ad3a2305498f97378035b06f06b1]) successfully deleted
W20260318 02:51:22.583936 719 leader_election.cc:343] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:22.584046 1175 ts_tablet_manager.cc:1916] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:22.584085 719 leader_election.cc:304] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:22.552614 1172 tablet_bootstrap.cc:654] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.584408 1174 tablet_bootstrap.cc:654] T f1ed26420c64492a94e8920d8c753fc3 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.584659 1343 raft_consensus.cc:2749] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:22.584946 1184 tablet_replica.cc:333] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:22.585152 1184 raft_consensus.cc:2243] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:22.585539 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 1766ce95009b4c3f9940ebcf10503c7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.585839 1176 tablet_replica.cc:333] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:22.586078 1176 raft_consensus.cc:2243] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:22.586323 1176 raft_consensus.cc:2272] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:22.586930 1176 ts_tablet_manager.cc:1916] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:22.587016 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_aaff9d9f20e641efa8b5c156a7055b9c" } new_table_name: "default.Table_f0aa6e7d29b04dba8841fbc213c67215" modify_external_catalogs: true
I20260318 02:51:22.589870 451 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_ba651a71312242f98acb8a2229bfb548 [id=46bae779de56403ab810fc4dcde25233] alter complete (version 2)
I20260318 02:51:22.590623 454 master_service.cc:954] ReplaceTablet: received request to replace tablet 2c5038e9e1074f46976a1a5bb4282944 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:22.591116 1175 ts_tablet_manager.cc:1929] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260318 02:51:22.591378 1175 log.cc:1199] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/1766ce95009b4c3f9940ebcf10503c7f
I20260318 02:51:22.591814 1175 ts_tablet_manager.cc:1950] T 1766ce95009b4c3f9940ebcf10503c7f P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:22.592903 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 1766ce95009b4c3f9940ebcf10503c7f (table default.Table_83aab17168ad4c2bae9ea1b354ef5001 [id=1c0082e294dd43cdb2eb4ed335ff3c06]) successfully deleted
I20260318 02:51:22.593813 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e421d3fe62b4985bfe0486a4b115b2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.594172 1175 tablet_replica.cc:333] T 9e421d3fe62b4985bfe0486a4b115b2a P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:22.594405 1175 raft_consensus.cc:2243] T 9e421d3fe62b4985bfe0486a4b115b2a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:22.594631 1175 raft_consensus.cc:2272] T 9e421d3fe62b4985bfe0486a4b115b2a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:22.594890 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5c03883f4a5e4de6801f783f51440963"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:22.595142 1184 raft_consensus.cc:2272] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:22.595454 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c03883f4a5e4de6801f783f51440963 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.595484 1175 ts_tablet_manager.cc:1916] T 9e421d3fe62b4985bfe0486a4b115b2a P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:22.596040 1184 ts_tablet_manager.cc:1916] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:22.596987 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a854e3872c44e4863316c9fe5f2ee9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.597708 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7442f04ad30e435b84996fb8990e0a44" } modify_external_catalogs: true
I20260318 02:51:22.597944 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7442f04ad30e435b84996fb8990e0a44" } modify_external_catalogs: true
I20260318 02:51:22.598515 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 1766ce95009b4c3f9940ebcf10503c7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.603569 1172 tablet_bootstrap.cc:492] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:22.603840 1172 ts_tablet_manager.cc:1403] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.080s user 0.001s sys 0.008s
I20260318 02:51:22.604735 1176 ts_tablet_manager.cc:1929] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260318 02:51:22.604904 1176 log.cc:1199] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/1766ce95009b4c3f9940ebcf10503c7f
I20260318 02:51:22.604693 1172 raft_consensus.cc:359] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.605142 1172 raft_consensus.cc:385] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.605269 1172 raft_consensus.cc:740] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.605599 1172 consensus_queue.cc:260] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.607713 1172 ts_tablet_manager.cc:1434] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260318 02:51:22.608114 1172 tablet_bootstrap.cc:492] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:22.610658 1172 tablet_bootstrap.cc:654] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.616439 1175 ts_tablet_manager.cc:1929] T 9e421d3fe62b4985bfe0486a4b115b2a P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260318 02:51:22.617348 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5a829abed0444b79c48ab080d024824 has no consensus state
I20260318 02:51:22.617945 1172 tablet_bootstrap.cc:492] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:22.618638 1172 ts_tablet_manager.cc:1403] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.004s
I20260318 02:51:22.618609 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 41a152a453fe47d194766635ab586804 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.619875 1172 raft_consensus.cc:359] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.620083 1172 raft_consensus.cc:385] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.620168 1172 raft_consensus.cc:740] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.620812 1175 log.cc:1199] T 9e421d3fe62b4985bfe0486a4b115b2a P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/9e421d3fe62b4985bfe0486a4b115b2a
I20260318 02:51:22.621440 1175 ts_tablet_manager.cc:1950] T 9e421d3fe62b4985bfe0486a4b115b2a P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:22.622102 1176 ts_tablet_manager.cc:1950] T 1766ce95009b4c3f9940ebcf10503c7f P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:22.622942 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 9e421d3fe62b4985bfe0486a4b115b2a (table default.Table_19fe141c13934c04bd511b36fab6ab36 [id=5d7200a0ff764b1885c2c18bc7289e1b]) successfully deleted
I20260318 02:51:22.623235 1174 tablet_bootstrap.cc:492] T f1ed26420c64492a94e8920d8c753fc3 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:22.623449 1174 ts_tablet_manager.cc:1403] T f1ed26420c64492a94e8920d8c753fc3 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.046s user 0.001s sys 0.003s
I20260318 02:51:22.623324 1172 consensus_queue.cc:260] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.624305 1174 raft_consensus.cc:359] T f1ed26420c64492a94e8920d8c753fc3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.624540 1174 raft_consensus.cc:385] T f1ed26420c64492a94e8920d8c753fc3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.624655 1174 raft_consensus.cc:740] T f1ed26420c64492a94e8920d8c753fc3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.624949 1174 consensus_queue.cc:260] T f1ed26420c64492a94e8920d8c753fc3 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.627839 1172 ts_tablet_manager.cc:1434] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260318 02:51:22.629798 1280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260318 02:51:22.630991 1174 ts_tablet_manager.cc:1434] T f1ed26420c64492a94e8920d8c753fc3 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
I20260318 02:51:22.631641 1172 tablet_bootstrap.cc:492] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:22.634680 1172 tablet_bootstrap.cc:654] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:22.636693 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 105326aea9f744779ca76e0cbb2448cd consensus state has no leader
I20260318 02:51:22.636874 1174 tablet_bootstrap.cc:492] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:22.637537 1280 hybrid_clock.cc:648] HybridClock initialized: now 1773802282637103 us; error 418 us; skew 500 ppm
I20260318 02:51:22.638161 1280 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260318 02:51:22.638491 1343 raft_consensus.cc:493] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:22.638638 1343 raft_consensus.cc:515] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.639271 1343 leader_election.cc:290] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:22.640103 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2304246c244407b9d4eb301ac5d7ba9" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:22.640458 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2304246c244407b9d4eb301ac5d7ba9" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:22.640774 719 leader_election.cc:343] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:22.641018 719 leader_election.cc:343] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:22.641129 719 leader_election.cc:304] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:22.641958 1343 raft_consensus.cc:2749] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:22.642040 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6d3695295b794364b4cdc7849155a559" } modify_external_catalogs: true
I20260318 02:51:22.642246 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6d3695295b794364b4cdc7849155a559" } modify_external_catalogs: true
I20260318 02:51:22.642344 757 tablet_service.cc:1558] Processing DeleteTablet for tablet f1ed26420c64492a94e8920d8c753fc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.643095 1174 tablet_bootstrap.cc:654] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.646561 1184 ts_tablet_manager.cc:1929] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:22.653818 1176 tablet_replica.cc:333] T 96a854e3872c44e4863316c9fe5f2ee9 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:22.654110 1176 raft_consensus.cc:2243] T 96a854e3872c44e4863316c9fe5f2ee9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:22.654409 1176 raft_consensus.cc:2272] T 96a854e3872c44e4863316c9fe5f2ee9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:22.655206 1176 ts_tablet_manager.cc:1916] T 96a854e3872c44e4863316c9fe5f2ee9 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:22.656828 450 master_service.cc:954] ReplaceTablet: received request to replace tablet 1df8029146564e1c9dc88dd9f5fb64ae from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:22.657541 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 1766ce95009b4c3f9940ebcf10503c7f (table default.Table_83aab17168ad4c2bae9ea1b354ef5001 [id=1c0082e294dd43cdb2eb4ed335ff3c06]) successfully deleted
I20260318 02:51:22.656003 1357 raft_consensus.cc:493] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:22.660454 1357 raft_consensus.cc:515] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:22.661187 1357 leader_election.cc:290] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:22.662256 1280 webserver.cc:492] Webserver started at http://127.0.104.188:37041/ using document root <none> and password file <none>
W20260318 02:51:22.663703 999 leader_election.cc:343] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 53502a8e2d184b7ea7fa575d4836f0ea
W20260318 02:51:22.664191 997 leader_election.cc:343] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: 53502a8e2d184b7ea7fa575d4836f0ea
I20260318 02:51:22.664297 997 leader_election.cc:304] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:22.664575 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29541950221544e396ada303fbbb5002 has no consensus state
I20260318 02:51:22.665524 1357 raft_consensus.cc:2749] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:22.659706 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b07774692544b1c83bc547302b203a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.660178 1172 tablet_bootstrap.cc:492] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:22.666052 1184 log.cc:1199] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/10aafa9bf1c44b95b0263d9a76b8b1b2
I20260318 02:51:22.666097 1172 ts_tablet_manager.cc:1403] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.009s
I20260318 02:51:22.666528 1184 ts_tablet_manager.cc:1950] T 10aafa9bf1c44b95b0263d9a76b8b1b2 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:22.666988 1172 raft_consensus.cc:359] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.667258 1172 raft_consensus.cc:385] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.667387 1172 raft_consensus.cc:740] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.667526 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 10aafa9bf1c44b95b0263d9a76b8b1b2 (table default.Table_0d969a129e064d118a5bd11a6f34b8f1 [id=c8d7ee2f33154a1fbc8d7c7f6fb7e3a8]) successfully deleted
I20260318 02:51:22.667738 1172 consensus_queue.cc:260] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:22.667891 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 30205728339f4bcf8b7d94d6f373e01c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30205728339f4bcf8b7d94d6f373e01c already in progress: creating tablet
I20260318 02:51:22.667937 1184 tablet_replica.cc:333] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:22.668119 1184 raft_consensus.cc:2243] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:22.668356 1280 fs_manager.cc:362] Metadata directory not provided
I20260318 02:51:22.668578 1280 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260318 02:51:22.668627 1184 raft_consensus.cc:2272] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:22.669246 1172 ts_tablet_manager.cc:1434] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:22.669648 1172 tablet_bootstrap.cc:492] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:22.672933 1174 tablet_bootstrap.cc:492] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:22.672982 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b81f87a10bfa4885ba1ad5ed5fdf1828" } modify_external_catalogs: true
I20260318 02:51:22.673071 1172 tablet_bootstrap.cc:654] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.673167 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b81f87a10bfa4885ba1ad5ed5fdf1828" } modify_external_catalogs: true
I20260318 02:51:22.673195 1174 ts_tablet_manager.cc:1403] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.001s
I20260318 02:51:22.674065 1174 raft_consensus.cc:359] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.674381 1174 raft_consensus.cc:385] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.674501 1174 raft_consensus.cc:740] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.674855 1174 consensus_queue.cc:260] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.678808 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3c92615f79714bbdb3c88e2c373ee91e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.679461 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c92615f79714bbdb3c88e2c373ee91e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.681063 1174 ts_tablet_manager.cc:1434] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260318 02:51:22.682209 1172 tablet_bootstrap.cc:492] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:22.682382 1172 ts_tablet_manager.cc:1403] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.001s
I20260318 02:51:22.683916 1184 ts_tablet_manager.cc:1916] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:22.684329 1172 raft_consensus.cc:359] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.684518 1172 raft_consensus.cc:385] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.684620 1172 raft_consensus.cc:740] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.684904 1174 tablet_bootstrap.cc:492] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:22.686952 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_bf944c0b82364ff49225c37770b529ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:22.687110 1172 consensus_queue.cc:260] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:22.687573 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf944c0b82364ff49225c37770b529ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.686976 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f217b96e5bfe4f119051ba52273b64d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:22.689359 1172 ts_tablet_manager.cc:1434] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260318 02:51:22.689632 1172 tablet_bootstrap.cc:492] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:22.689656 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f217b96e5bfe4f119051ba52273b64d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.693756 1280 fs_manager.cc:714] Time spent opening directory manager: real 0.022s user 0.006s sys 0.000s
I20260318 02:51:22.695120 1172 tablet_bootstrap.cc:654] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.698643 457 master_service.cc:954] ReplaceTablet: received request to replace tablet af793623466249e695b262ab451d4dc9 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:22.699429 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_87fa1f636198436a81500e9b228f29c2" } new_table_name: "default.Table_d56046d9ca314b3d84d67be620445de8" modify_external_catalogs: true
I20260318 02:51:22.700125 1184 ts_tablet_manager.cc:1929] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:22.700263 1184 log.cc:1199] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/1ad59f4f5db8424a900b36e060745aa6
I20260318 02:51:22.700652 1184 ts_tablet_manager.cc:1950] T 1ad59f4f5db8424a900b36e060745aa6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
W20260318 02:51:22.701226 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6b82751cbcbb4c39a6942b6856412fc8 consensus state has no leader
I20260318 02:51:22.701422 1174 tablet_bootstrap.cc:654] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.703888 1172 tablet_bootstrap.cc:492] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:22.704903 1172 ts_tablet_manager.cc:1403] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.004s
I20260318 02:51:22.705015 1176 ts_tablet_manager.cc:1929] T 96a854e3872c44e4863316c9fe5f2ee9 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:22.706162 1172 raft_consensus.cc:359] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.706930 1343 raft_consensus.cc:493] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:22.707116 1343 raft_consensus.cc:515] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:22.707499 1172 raft_consensus.cc:385] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.707581 1172 raft_consensus.cc:740] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.707788 1343 leader_election.cc:290] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:22.708146 1172 consensus_queue.cc:260] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.708420 455 master_service.cc:954] ReplaceTablet: received request to replace tablet e61c374078854d589219dfa4c20e4222 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:22.708638 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dadf0fc6e134edd87788dd4ade59dc5" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:22.708767 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dadf0fc6e134edd87788dd4ade59dc5" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:22.709333 719 leader_election.cc:343] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:22.709568 719 leader_election.cc:343] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:22.709640 1176 log.cc:1199] T 96a854e3872c44e4863316c9fe5f2ee9 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/96a854e3872c44e4863316c9fe5f2ee9
I20260318 02:51:22.709679 719 leader_election.cc:304] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:22.710273 1172 ts_tablet_manager.cc:1434] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260318 02:51:22.711899 1343 raft_consensus.cc:2749] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:22.713506 1396 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260318 02:51:22.716626 1280 fs_manager.cc:730] Time spent opening block manager: real 0.021s user 0.003s sys 0.001s
I20260318 02:51:22.716660 1176 ts_tablet_manager.cc:1950] T 96a854e3872c44e4863316c9fe5f2ee9 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:22.718030 1173 tablet_bootstrap.cc:492] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:22.718204 1173 ts_tablet_manager.cc:1403] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.160s user 0.023s sys 0.039s
I20260318 02:51:22.716943 1280 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data,/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/wal
uuid: "971baf5b9e4644c990dbf4d4fc7ba900"
format_stamp: "Formatted at 2026-03-18 02:51:16 on dist-test-slave-km68"
I20260318 02:51:22.718933 1280 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260318 02:51:22.718994 1173 raft_consensus.cc:359] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.719175 1173 raft_consensus.cc:385] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.719238 1173 raft_consensus.cc:740] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.719470 1173 consensus_queue.cc:260] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.719980 1173 ts_tablet_manager.cc:1434] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:22.720396 1173 tablet_bootstrap.cc:492] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:22.720896 1176 tablet_replica.cc:333] T f1ed26420c64492a94e8920d8c753fc3 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:22.721107 1176 raft_consensus.cc:2243] T f1ed26420c64492a94e8920d8c753fc3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:22.721269 1176 raft_consensus.cc:2272] T f1ed26420c64492a94e8920d8c753fc3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:22.722219 1176 ts_tablet_manager.cc:1916] T f1ed26420c64492a94e8920d8c753fc3 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:22.722370 1173 tablet_bootstrap.cc:654] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.723173 1174 tablet_bootstrap.cc:492] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:22.723539 1174 ts_tablet_manager.cc:1403] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.000s
I20260318 02:51:22.724407 1174 raft_consensus.cc:359] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.724679 1174 raft_consensus.cc:385] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.724834 1174 raft_consensus.cc:740] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.725145 1174 consensus_queue.cc:260] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.729086 1174 ts_tablet_manager.cc:1434] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:22.730358 1174 tablet_bootstrap.cc:492] T 32880a703603476786b4a34ddd40cab8 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:22.734979 1034 tablet_service.cc:1511] Processing CreateTablet for tablet bfb352bce9cc4e8aa899d691954d28d2 (DEFAULT_TABLE table=default.Table_5711987324e24023b68377247e832cc2 [id=e0b93f047d414aa5bc01df1a1dcb8878]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.734980 903 tablet_service.cc:1511] Processing CreateTablet for tablet bfb352bce9cc4e8aa899d691954d28d2 (DEFAULT_TABLE table=default.Table_5711987324e24023b68377247e832cc2 [id=e0b93f047d414aa5bc01df1a1dcb8878]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.735442 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb352bce9cc4e8aa899d691954d28d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.735445 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb352bce9cc4e8aa899d691954d28d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.737440 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 421e5223d6af4da1a8e07534f942d016 (DEFAULT_TABLE table=default.Table_14f5197a4ef6461daa2267c549d5078f [id=7979bbf5d6744b6eb56acde8ec69ba5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.737854 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 421e5223d6af4da1a8e07534f942d016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.739638 899 tablet_service.cc:1511] Processing CreateTablet for tablet 421e5223d6af4da1a8e07534f942d016 (DEFAULT_TABLE table=default.Table_14f5197a4ef6461daa2267c549d5078f [id=7979bbf5d6744b6eb56acde8ec69ba5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.740062 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 421e5223d6af4da1a8e07534f942d016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.741204 1038 tablet_service.cc:1511] Processing CreateTablet for tablet f9bc73d3f85745ecb62d861b6375a987 (DEFAULT_TABLE table=default.Table_5e18692d41ef4f6b9ac36936944042f7 [id=dfd0c35772ae4d71a6679f3bdaec5068]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.741613 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9bc73d3f85745ecb62d861b6375a987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.744982 455 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 053a09fd13fa4d8e80133fd77acaa4ce (table default.Table_bb21feccea674d3e8845f95753367aa8 [id=3a77e587db534e32b2716d153a8419cd]). Expected version 3 got 0
I20260318 02:51:22.745040 907 tablet_service.cc:1511] Processing CreateTablet for tablet f9bc73d3f85745ecb62d861b6375a987 (DEFAULT_TABLE table=default.Table_5e18692d41ef4f6b9ac36936944042f7 [id=dfd0c35772ae4d71a6679f3bdaec5068]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.745406 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9bc73d3f85745ecb62d861b6375a987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.745656 1357 raft_consensus.cc:493] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:22.745815 1357 raft_consensus.cc:515] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.746505 1357 leader_election.cc:290] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:22.746920 1042 tablet_service.cc:1511] Processing CreateTablet for tablet f5a829abed0444b79c48ab080d024824 (DEFAULT_TABLE table=default.Table_b81f87a10bfa4885ba1ad5ed5fdf1828 [id=bdcf510793fa400cb6b8ddd13fd3fe0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.747292 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5a829abed0444b79c48ab080d024824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.749089 1044 tablet_service.cc:1511] Processing CreateTablet for tablet abfdba1f21e44652b2bce62cd3e6681f (DEFAULT_TABLE table=default.Table_fc98457cd89d4e7386e8668c917c0db5 [id=832c20ba6970431893816d86c1ee374b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.749238 900 tablet_service.cc:1511] Processing CreateTablet for tablet f5a829abed0444b79c48ab080d024824 (DEFAULT_TABLE table=default.Table_b81f87a10bfa4885ba1ad5ed5fdf1828 [id=bdcf510793fa400cb6b8ddd13fd3fe0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.749461 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abfdba1f21e44652b2bce62cd3e6681f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.749610 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5a829abed0444b79c48ab080d024824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.752928 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa7c1d6879c40ebb8d989ebae205e9e (DEFAULT_TABLE table=default.Table_d6ad068d690949058bd4fdeea68e31a3 [id=3557006319a041e69cf884ccd2ddd5dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.753417 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa7c1d6879c40ebb8d989ebae205e9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.755116 904 tablet_service.cc:1511] Processing CreateTablet for tablet abfdba1f21e44652b2bce62cd3e6681f (DEFAULT_TABLE table=default.Table_fc98457cd89d4e7386e8668c917c0db5 [id=832c20ba6970431893816d86c1ee374b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.755542 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abfdba1f21e44652b2bce62cd3e6681f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:22.757019 443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.188:41593, user_credentials={real_user=slave}} blocked reactor thread for 91535us
I20260318 02:51:22.757074 1040 tablet_service.cc:1511] Processing CreateTablet for tablet b5c19bc5e07949088c84cedbf944dfdb (DEFAULT_TABLE table=default.Table_b32688b6575041c999f2750fd0d11b2e [id=873432f002e14a4fa7065dcfe5caebd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.757530 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c19bc5e07949088c84cedbf944dfdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.758826 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 96a854e3872c44e4863316c9fe5f2ee9 (table default.Table_d548901cf2e74047a18ea1460ce6fc34 [id=570322e5437b4a58b560833ee1f0f9bc]) successfully deleted
I20260318 02:51:22.759063 892 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa7c1d6879c40ebb8d989ebae205e9e (DEFAULT_TABLE table=default.Table_d6ad068d690949058bd4fdeea68e31a3 [id=3557006319a041e69cf884ccd2ddd5dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.759394 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa7c1d6879c40ebb8d989ebae205e9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.760334 455 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d (table default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666]). Expected version 4 got 0
I20260318 02:51:22.760896 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 29541950221544e396ada303fbbb5002 (DEFAULT_TABLE table=default.Table_f6489e5e0d7f47cb889864d493a7b77c [id=85cf06ab49054e56859af17f79130d0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.761368 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29541950221544e396ada303fbbb5002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.762916 906 tablet_service.cc:1511] Processing CreateTablet for tablet b5c19bc5e07949088c84cedbf944dfdb (DEFAULT_TABLE table=default.Table_b32688b6575041c999f2750fd0d11b2e [id=873432f002e14a4fa7065dcfe5caebd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.763240 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c19bc5e07949088c84cedbf944dfdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.765851 455 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d (table default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666]). Expected version 4 got 0
I20260318 02:51:22.765959 894 tablet_service.cc:1511] Processing CreateTablet for tablet 29541950221544e396ada303fbbb5002 (DEFAULT_TABLE table=default.Table_f6489e5e0d7f47cb889864d493a7b77c [id=85cf06ab49054e56859af17f79130d0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.766340 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29541950221544e396ada303fbbb5002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.769070 896 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa6bf38381740a1bab1088ede6ede1c (DEFAULT_TABLE table=default.Table_607d1941968145a6a336b9a5bb85b43e [id=85784a23699343ee80e0adb9e5f82413]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.769470 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa6bf38381740a1bab1088ede6ede1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.771864 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 53e66044bfed4b53a1c0bc4dc8de52e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.772523 901 tablet_service.cc:1511] Processing CreateTablet for tablet 7883f526d06e442c81f1b66fd89d2cd0 (DEFAULT_TABLE table=default.Table_4a42a797802e455f938612dd56b0e3ea [id=32f5b93025f84549a496e5827512aed5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.772760 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa6bf38381740a1bab1088ede6ede1c (DEFAULT_TABLE table=default.Table_607d1941968145a6a336b9a5bb85b43e [id=85784a23699343ee80e0adb9e5f82413]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.772876 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7883f526d06e442c81f1b66fd89d2cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.773173 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa6bf38381740a1bab1088ede6ede1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.775399 902 tablet_service.cc:1511] Processing CreateTablet for tablet 104cd36774df4bc0adf1d449224304d5 (DEFAULT_TABLE table=default.Table_559e7d5c5ca844c3985182f0fa1e14f8 [id=8b5e3535d9e44b1a86dc59211a31deb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.775700 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104cd36774df4bc0adf1d449224304d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.777076 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 7883f526d06e442c81f1b66fd89d2cd0 (DEFAULT_TABLE table=default.Table_4a42a797802e455f938612dd56b0e3ea [id=32f5b93025f84549a496e5827512aed5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.777556 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7883f526d06e442c81f1b66fd89d2cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.777767 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 65f63eb5e114464988b3b89e3af61b61 (DEFAULT_TABLE table=default.Table_e285c48a68a04ddca6c3da148d0f43f1 [id=d7a2b53e58414b9b878a51724594ceda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.778116 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65f63eb5e114464988b3b89e3af61b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.778580 905 tablet_service.cc:1511] Processing CreateTablet for tablet e3999f53c1cc4cb5a1d91eed23785cc6 (DEFAULT_TABLE table=default.Table_7442f04ad30e435b84996fb8990e0a44 [id=40612e2dc3b7447f8f4f753bf5474c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.778956 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3999f53c1cc4cb5a1d91eed23785cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.781060 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 104cd36774df4bc0adf1d449224304d5 (DEFAULT_TABLE table=default.Table_559e7d5c5ca844c3985182f0fa1e14f8 [id=8b5e3535d9e44b1a86dc59211a31deb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.781457 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104cd36774df4bc0adf1d449224304d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.781594 893 tablet_service.cc:1511] Processing CreateTablet for tablet 65f63eb5e114464988b3b89e3af61b61 (DEFAULT_TABLE table=default.Table_e285c48a68a04ddca6c3da148d0f43f1 [id=d7a2b53e58414b9b878a51724594ceda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.782039 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65f63eb5e114464988b3b89e3af61b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.785099 1033 tablet_service.cc:1511] Processing CreateTablet for tablet e3999f53c1cc4cb5a1d91eed23785cc6 (DEFAULT_TABLE table=default.Table_7442f04ad30e435b84996fb8990e0a44 [id=40612e2dc3b7447f8f4f753bf5474c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.785570 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3999f53c1cc4cb5a1d91eed23785cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.787683 1174 tablet_bootstrap.cc:654] T 32880a703603476786b4a34ddd40cab8 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.788929 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e4e8586673c43058ef00f2f7aef10ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:22.790704 999 leader_election.cc:343] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 4b07774692544b1c83bc547302b203a5
I20260318 02:51:22.791875 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6eeca0066a9946e1b4dcfac117aad4b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.792518 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6eeca0066a9946e1b4dcfac117aad4b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.794049 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6372798c3d47435ea80a21ca734ce78f" } modify_external_catalogs: true
I20260318 02:51:22.794225 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6372798c3d47435ea80a21ca734ce78f" } modify_external_catalogs: true
I20260318 02:51:22.799616 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1c7dbfac7c8240aabb2880c2b7391d6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.800146 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9d20847fa6f9461cb6137f56ea680cb6 consensus state has no leader
W20260318 02:51:22.800230 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c7dbfac7c8240aabb2880c2b7391d6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.800550 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_eb225edbcae24cc8b21780a90930083a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.801085 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb225edbcae24cc8b21780a90930083a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.802222 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2c5038e9e1074f46976a1a5bb4282944
I20260318 02:51:22.802731 454 catalog_manager.cc:6741] ReplaceTablet: tablet 2c5038e9e1074f46976a1a5bb4282944 deleted and replaced by tablet 27fc03c90b584becb250546100af736c
I20260318 02:51:22.803089 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet af793623466249e695b262ab451d4dc9
I20260318 02:51:22.803185 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c5038e9e1074f46976a1a5bb4282944 with delete_type TABLET_DATA_DELETED (replaced by tablet 27fc03c90b584becb250546100af736c) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.803517 457 catalog_manager.cc:6741] ReplaceTablet: tablet af793623466249e695b262ab451d4dc9 deleted and replaced by tablet e57dbb1276114cd6b7d26f7167b99f25
I20260318 02:51:22.803558 1343 raft_consensus.cc:493] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:22.803705 1343 raft_consensus.cc:515] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.803850 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet e3999f53c1cc4cb5a1d91eed23785cc6
I20260318 02:51:22.804121 752 tablet_service.cc:1511] Processing CreateTablet for tablet 65f63eb5e114464988b3b89e3af61b61 (DEFAULT_TABLE table=default.Table_e285c48a68a04ddca6c3da148d0f43f1 [id=d7a2b53e58414b9b878a51724594ceda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.804405 1343 leader_election.cc:290] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:22.804520 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 547762347d7843e989e55e0449ad9fcb
I20260318 02:51:22.805073 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f5a829abed0444b79c48ab080d024824
I20260318 02:51:22.805121 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e4719eafd2947bfacf3e1d2df1ae43e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.805287 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65f63eb5e114464988b3b89e3af61b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.805409 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 1df8029146564e1c9dc88dd9f5fb64ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.805845 760 tablet_service.cc:1511] Processing CreateTablet for tablet bfb352bce9cc4e8aa899d691954d28d2 (DEFAULT_TABLE table=default.Table_5711987324e24023b68377247e832cc2 [id=e0b93f047d414aa5bc01df1a1dcb8878]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.806241 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb352bce9cc4e8aa899d691954d28d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.809028 763 tablet_service.cc:1511] Processing CreateTablet for tablet 421e5223d6af4da1a8e07534f942d016 (DEFAULT_TABLE table=default.Table_14f5197a4ef6461daa2267c549d5078f [id=7979bbf5d6744b6eb56acde8ec69ba5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.809274 754 tablet_service.cc:1511] Processing CreateTablet for tablet 104cd36774df4bc0adf1d449224304d5 (DEFAULT_TABLE table=default.Table_559e7d5c5ca844c3985182f0fa1e14f8 [id=8b5e3535d9e44b1a86dc59211a31deb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.809432 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 421e5223d6af4da1a8e07534f942d016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.809795 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 104cd36774df4bc0adf1d449224304d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.810025 759 tablet_service.cc:1511] Processing CreateTablet for tablet f9bc73d3f85745ecb62d861b6375a987 (DEFAULT_TABLE table=default.Table_5e18692d41ef4f6b9ac36936944042f7 [id=dfd0c35772ae4d71a6679f3bdaec5068]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.810377 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9bc73d3f85745ecb62d861b6375a987. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.813023 755 tablet_service.cc:1511] Processing CreateTablet for tablet f5a829abed0444b79c48ab080d024824 (DEFAULT_TABLE table=default.Table_b81f87a10bfa4885ba1ad5ed5fdf1828 [id=bdcf510793fa400cb6b8ddd13fd3fe0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.813416 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5a829abed0444b79c48ab080d024824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.815034 1173 tablet_bootstrap.cc:492] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:22.815302 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet e3999f53c1cc4cb5a1d91eed23785cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.815460 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet af793623466249e695b262ab451d4dc9 with delete_type TABLET_DATA_DELETED (replaced by tablet e57dbb1276114cd6b7d26f7167b99f25) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.815488 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 547762347d7843e989e55e0449ad9fcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.815869 1172 tablet_bootstrap.cc:492] T 54bffc30199246fd93edf7486b2e3a91 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:22.816149 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet f5a829abed0444b79c48ab080d024824 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.816905 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 1ad59f4f5db8424a900b36e060745aa6 (table default.Table_7302de3324f84feea6928392c6067ecb [id=5104d449469a4fdc99dab10843e6c5b1]) successfully deleted
I20260318 02:51:22.817059 761 tablet_service.cc:1511] Processing CreateTablet for tablet abfdba1f21e44652b2bce62cd3e6681f (DEFAULT_TABLE table=default.Table_fc98457cd89d4e7386e8668c917c0db5 [id=832c20ba6970431893816d86c1ee374b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.817447 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f6bd74ee469e431eb8367558134a24b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:22.817664 1172 tablet_bootstrap.cc:654] T 54bffc30199246fd93edf7486b2e3a91 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.817642 764 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa7c1d6879c40ebb8d989ebae205e9e (DEFAULT_TABLE table=default.Table_d6ad068d690949058bd4fdeea68e31a3 [id=3557006319a041e69cf884ccd2ddd5dc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:22.818056 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6bd74ee469e431eb8367558134a24b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.818202 756 tablet_service.cc:1511] Processing CreateTablet for tablet b5c19bc5e07949088c84cedbf944dfdb (DEFAULT_TABLE table=default.Table_b32688b6575041c999f2750fd0d11b2e [id=873432f002e14a4fa7065dcfe5caebd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.818641 758 tablet_service.cc:1511] Processing CreateTablet for tablet 29541950221544e396ada303fbbb5002 (DEFAULT_TABLE table=default.Table_f6489e5e0d7f47cb889864d493a7b77c [id=85cf06ab49054e56859af17f79130d0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.818812 1173 ts_tablet_manager.cc:1403] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.099s user 0.006s sys 0.002s
I20260318 02:51:22.819056 765 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa6bf38381740a1bab1088ede6ede1c (DEFAULT_TABLE table=default.Table_607d1941968145a6a336b9a5bb85b43e [id=85784a23699343ee80e0adb9e5f82413]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.819485 762 tablet_service.cc:1511] Processing CreateTablet for tablet 7883f526d06e442c81f1b66fd89d2cd0 (DEFAULT_TABLE table=default.Table_4a42a797802e455f938612dd56b0e3ea [id=32f5b93025f84549a496e5827512aed5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.819648 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_052531beeed14df8ad6d4304d38a5b4e" } new_table_name: "default.Table_9faefa2c0ceb4495935b65b6869b4b7a" modify_external_catalogs: true
I20260318 02:51:22.819665 1173 raft_consensus.cc:359] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.820015 753 tablet_service.cc:1511] Processing CreateTablet for tablet e3999f53c1cc4cb5a1d91eed23785cc6 (DEFAULT_TABLE table=default.Table_7442f04ad30e435b84996fb8990e0a44 [id=40612e2dc3b7447f8f4f753bf5474c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.819931 1173 raft_consensus.cc:385] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.820246 1173 raft_consensus.cc:740] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.820621 1173 consensus_queue.cc:260] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.822235 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4719eafd2947bfacf3e1d2df1ae43e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:22.823032 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 7480b1fa026242d7bb6ddbf8df563116 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7480b1fa026242d7bb6ddbf8df563116 already in progress: creating tablet
I20260318 02:51:22.823670 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4719eafd2947bfacf3e1d2df1ae43e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:22.824234 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 95f15079d1df4314b6dd5c7afd896af5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95f15079d1df4314b6dd5c7afd896af5 already in progress: creating tablet
I20260318 02:51:22.824658 1173 ts_tablet_manager.cc:1434] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260318 02:51:22.824585 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_27a5d89c22df4e6eb87b9b0a55c42604"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.825155 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27a5d89c22df4e6eb87b9b0a55c42604 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:22.825511 719 leader_election.cc:343] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:22.825891 1173 tablet_bootstrap.cc:492] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:22.826656 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet a4f891043b7d468da3e808980690354d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4f891043b7d468da3e808980690354d already in progress: creating tablet
W20260318 02:51:22.826644 719 leader_election.cc:343] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:22.826785 719 leader_election.cc:304] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:22.828387 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet d604cd634a1c470ba3896cf02d2804d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d604cd634a1c470ba3896cf02d2804d4 already in progress: creating tablet
I20260318 02:51:22.829164 1184 tablet_replica.cc:333] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:22.829391 1184 raft_consensus.cc:2243] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:22.829435 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f1ff303b23184d4b92994bde194229b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f1ff303b23184d4b92994bde194229b4 already in progress: creating tablet
I20260318 02:51:22.829560 1184 raft_consensus.cc:2272] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:22.831025 1343 raft_consensus.cc:2749] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:22.831698 457 master_service.cc:954] ReplaceTablet: received request to replace tablet 93479517a1d34d2d99633018a6a57127 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:22.834944 1173 tablet_bootstrap.cc:654] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.835459 898 tablet_service.cc:1558] Processing DeleteTablet for tablet e3999f53c1cc4cb5a1d91eed23785cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.836020 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 547762347d7843e989e55e0449ad9fcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.836316 890 tablet_service.cc:1558] Processing DeleteTablet for tablet f5a829abed0444b79c48ab080d024824 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.835637 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c5038e9e1074f46976a1a5bb4282944 with delete_type TABLET_DATA_DELETED (replaced by tablet 27fc03c90b584becb250546100af736c) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.835821 897 tablet_service.cc:1558] Processing DeleteTablet for tablet af793623466249e695b262ab451d4dc9 with delete_type TABLET_DATA_DELETED (replaced by tablet e57dbb1276114cd6b7d26f7167b99f25) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.837754 1176 ts_tablet_manager.cc:1929] T f1ed26420c64492a94e8920d8c753fc3 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:22.837911 1176 log.cc:1199] T f1ed26420c64492a94e8920d8c753fc3 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/f1ed26420c64492a94e8920d8c753fc3
I20260318 02:51:22.838243 1176 ts_tablet_manager.cc:1950] T f1ed26420c64492a94e8920d8c753fc3 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:22.838721 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa6bf38381740a1bab1088ede6ede1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.839308 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29541950221544e396ada303fbbb5002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.839865 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7883f526d06e442c81f1b66fd89d2cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.840282 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5c19bc5e07949088c84cedbf944dfdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.840682 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa7c1d6879c40ebb8d989ebae205e9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.841133 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3999f53c1cc4cb5a1d91eed23785cc6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:22.841164 441 catalog_manager.cc:4969] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet e3999f53c1cc4cb5a1d91eed23785cc6 because the tablet was not found. No further retry: Not found: Tablet not found: e3999f53c1cc4cb5a1d91eed23785cc6
I20260318 02:51:22.841600 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abfdba1f21e44652b2bce62cd3e6681f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.843262 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b2421f1e49054cd29747d7efc0bb0060"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.843837 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2421f1e49054cd29747d7efc0bb0060 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.845233 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_113ffa1cc0ef491cbc6786967482632f" } modify_external_catalogs: true
I20260318 02:51:22.845424 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_113ffa1cc0ef491cbc6786967482632f" } modify_external_catalogs: true
I20260318 02:51:22.846954 750 tablet_service.cc:1558] Processing DeleteTablet for tablet f5a829abed0444b79c48ab080d024824 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.847230 766 tablet_service.cc:1558] Processing DeleteTablet for tablet e3999f53c1cc4cb5a1d91eed23785cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.847508 751 tablet_service.cc:1558] Processing DeleteTablet for tablet af793623466249e695b262ab451d4dc9 with delete_type TABLET_DATA_DELETED (replaced by tablet e57dbb1276114cd6b7d26f7167b99f25) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.847754 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 547762347d7843e989e55e0449ad9fcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.847810 1174 tablet_bootstrap.cc:492] T 32880a703603476786b4a34ddd40cab8 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:22.847949 1174 ts_tablet_manager.cc:1403] T 32880a703603476786b4a34ddd40cab8 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.118s user 0.005s sys 0.000s
I20260318 02:51:22.849121 1174 raft_consensus.cc:359] T 32880a703603476786b4a34ddd40cab8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.849404 1174 raft_consensus.cc:385] T 32880a703603476786b4a34ddd40cab8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.849531 1174 raft_consensus.cc:740] T 32880a703603476786b4a34ddd40cab8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.849853 1174 consensus_queue.cc:260] T 32880a703603476786b4a34ddd40cab8 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.851981 1174 ts_tablet_manager.cc:1434] T 32880a703603476786b4a34ddd40cab8 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:22.852748 1174 tablet_bootstrap.cc:492] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:22.853842 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6b803a878dd34cc08f81c475ce92ac12" } new_table_name: "default.Table_cfe05462158449cca7f529d5a37270be" modify_external_catalogs: true
I20260318 02:51:22.857703 1172 tablet_bootstrap.cc:492] T 54bffc30199246fd93edf7486b2e3a91 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:22.857936 1172 ts_tablet_manager.cc:1403] T 54bffc30199246fd93edf7486b2e3a91 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.042s user 0.007s sys 0.002s
I20260318 02:51:22.858443 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet d1a884fde2c145518a2cb14b7780b6dd
I20260318 02:51:22.858965 1172 raft_consensus.cc:359] T 54bffc30199246fd93edf7486b2e3a91 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.859252 1172 raft_consensus.cc:385] T 54bffc30199246fd93edf7486b2e3a91 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.859443 1172 raft_consensus.cc:740] T 54bffc30199246fd93edf7486b2e3a91 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.860512 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet d1a884fde2c145518a2cb14b7780b6dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.860647 1172 consensus_queue.cc:260] T 54bffc30199246fd93edf7486b2e3a91 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.862087 1062 raft_consensus.cc:3060] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:22.863078 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6b82751cbcbb4c39a6942b6856412fc8 consensus state has no leader
I20260318 02:51:22.864550 1172 ts_tablet_manager.cc:1434] T 54bffc30199246fd93edf7486b2e3a91 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
W20260318 02:51:22.865449 997 leader_election.cc:343] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: 4b07774692544b1c83bc547302b203a5
I20260318 02:51:22.865612 997 leader_election.cc:304] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:22.865626 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 547762347d7843e989e55e0449ad9fcb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 547762347d7843e989e55e0449ad9fcb already in progress: creating tablet
I20260318 02:51:22.866238 897 tablet_service.cc:1558] Processing DeleteTablet for tablet d1a884fde2c145518a2cb14b7780b6dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.866765 1357 raft_consensus.cc:2749] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:22.867460 441 catalog_manager.cc:4969] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f5a829abed0444b79c48ab080d024824 because the tablet was not found. No further retry: Not found: Tablet not found: f5a829abed0444b79c48ab080d024824
W20260318 02:51:22.867743 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2c5038e9e1074f46976a1a5bb4282944 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c5038e9e1074f46976a1a5bb4282944 already in progress: creating tablet
W20260318 02:51:22.867969 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet af793623466249e695b262ab451d4dc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af793623466249e695b262ab451d4dc9 already in progress: creating tablet
W20260318 02:51:22.868178 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet d1a884fde2c145518a2cb14b7780b6dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1a884fde2c145518a2cb14b7780b6dd already in progress: creating tablet
I20260318 02:51:22.869159 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 54bffc30199246fd93edf7486b2e3a91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.869524 1172 tablet_bootstrap.cc:492] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:22.869683 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f0aa6e7d29b04dba8841fbc213c67215" } new_table_name: "default.Table_ea08fcfa1efe4bc2a486fc1423ce06ce" modify_external_catalogs: true
I20260318 02:51:22.871636 1172 tablet_bootstrap.cc:654] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.876878 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 32880a703603476786b4a34ddd40cab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.880930 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b173d9dd6cc74a9ea5044ae888a3bd14"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.881660 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b173d9dd6cc74a9ea5044ae888a3bd14 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.882072 1173 tablet_bootstrap.cc:492] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:22.882247 1173 ts_tablet_manager.cc:1403] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.056s user 0.007s sys 0.002s
I20260318 02:51:22.884912 451 master_service.cc:954] ReplaceTablet: received request to replace tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:22.885315 1173 raft_consensus.cc:359] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.885558 1173 raft_consensus.cc:385] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.885623 1173 raft_consensus.cc:740] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.885922 1173 consensus_queue.cc:260] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:22.887841 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 105326aea9f744779ca76e0cbb2448cd consensus state has no leader
I20260318 02:51:22.889196 1174 tablet_bootstrap.cc:654] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.889312 1228 raft_consensus.cc:493] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:22.889485 1228 raft_consensus.cc:515] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.890146 1228 leader_election.cc:290] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:22.890952 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76fc930611024211a70301bcfd92884e" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:22.891578 860 leader_election.cc:343] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:22.891759 862 leader_election.cc:343] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 76fc930611024211a70301bcfd92884e
I20260318 02:51:22.891891 862 leader_election.cc:304] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:22.892259 1228 raft_consensus.cc:2749] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:22.892884 1173 ts_tablet_manager.cc:1434] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
W20260318 02:51:22.893090 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dea25aaad60a4b2483a8832f995d1316 has no consensus state
I20260318 02:51:22.894738 1173 tablet_bootstrap.cc:492] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:22.896505 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet f1ed26420c64492a94e8920d8c753fc3 (table default.Table_70e2f45a75724db48820714e88bbb17d [id=50ab4db1dbeb4c6a90b33535047daa51]) successfully deleted
I20260318 02:51:22.896761 1172 tablet_bootstrap.cc:492] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:22.897032 1172 ts_tablet_manager.cc:1403] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.003s
I20260318 02:51:22.898303 1176 tablet_replica.cc:333] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:22.898506 1176 raft_consensus.cc:2243] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:22.899592 1172 raft_consensus.cc:359] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.901548 1173 tablet_bootstrap.cc:654] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.901728 1172 raft_consensus.cc:385] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.901859 1172 raft_consensus.cc:740] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:22.902830 1172 consensus_queue.cc:260] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.908565 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d
I20260318 02:51:22.909097 451 catalog_manager.cc:6741] ReplaceTablet: tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d deleted and replaced by tablet 65c50b0813b04f30896568ab2b680ba8
I20260318 02:51:22.909340 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d with delete_type TABLET_DATA_DELETED (replaced by tablet 65c50b0813b04f30896568ab2b680ba8) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.909420 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d with delete_type TABLET_DATA_DELETED (replaced by tablet 65c50b0813b04f30896568ab2b680ba8) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.909605 1172 ts_tablet_manager.cc:1434] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260318 02:51:22.909727 1175 tablet_replica.cc:333] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:22.909934 1175 raft_consensus.cc:2243] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:22.910135 1175 raft_consensus.cc:2272] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:22.910254 1172 tablet_bootstrap.cc:492] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:22.910962 1175 ts_tablet_manager.cc:1916] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:22.912690 1172 tablet_bootstrap.cc:654] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:22.915587 1033 tablet_service.cc:1511] Processing CreateTablet for tablet ce0ab476b9a54cc586a4c28e23382bfc (DEFAULT_TABLE table=default.Table_5c03883f4a5e4de6801f783f51440963 [id=94288205d88b4c6ca1f94de1b201a349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.915994 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0ab476b9a54cc586a4c28e23382bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.917977 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 2789a1195e7344c18dd226e196e2f302 (DEFAULT_TABLE table=default.Table_3c92615f79714bbdb3c88e2c373ee91e [id=3066ad66b0914b759c32fe9296ca90bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.918375 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2789a1195e7344c18dd226e196e2f302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.918913 897 tablet_service.cc:1511] Processing CreateTablet for tablet 2789a1195e7344c18dd226e196e2f302 (DEFAULT_TABLE table=default.Table_3c92615f79714bbdb3c88e2c373ee91e [id=3066ad66b0914b759c32fe9296ca90bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.919878 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_870eb9eb87224d229502d71d64113e3a" } new_table_name: "default.Table_1d1ac99a8f2941fdb5135ccc46e16c42" modify_external_catalogs: true
I20260318 02:51:22.920989 1036 tablet_service.cc:1511] Processing CreateTablet for tablet dea25aaad60a4b2483a8832f995d1316 (DEFAULT_TABLE table=default.Table_cfe05462158449cca7f529d5a37270be [id=feac1e97445140d9bfcb8eb2b9996498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.921320 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea25aaad60a4b2483a8832f995d1316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.921852 1357 raft_consensus.cc:493] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:22.921988 1357 raft_consensus.cc:515] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.922694 1357 leader_election.cc:290] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:22.925009 1034 tablet_service.cc:1511] Processing CreateTablet for tablet f04f057571584d31b1821e690ae7c75c (DEFAULT_TABLE table=default.Table_62dcfd8adef34929a08c11dfcf174ff7 [id=4a0a65332f00440f87102e8ebab708cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.925416 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04f057571584d31b1821e690ae7c75c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.925724 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2789a1195e7344c18dd226e196e2f302. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:22.926836 999 leader_election.cc:343] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 53e66044bfed4b53a1c0bc4dc8de52e6
I20260318 02:51:22.927022 1038 tablet_service.cc:1511] Processing CreateTablet for tablet f6794f8a443f41b195fb326d49f56756 (DEFAULT_TABLE table=default.Table_bf944c0b82364ff49225c37770b529ac [id=2657eb5502934a0cbd3afafab63786b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.927409 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6794f8a443f41b195fb326d49f56756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.928973 1357 raft_consensus.cc:493] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:22.929209 1357 raft_consensus.cc:515] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.930742 1357 leader_election.cc:290] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:22.930963 1176 raft_consensus.cc:2272] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:22.931562 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 3868406102b748a5b13420b24bf16485 (DEFAULT_TABLE table=default.Table_0fa2447b80b545388441838507fc117c [id=a7ad61d6d9264ec4ac482798b1ea992e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.932060 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3868406102b748a5b13420b24bf16485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.932776 905 tablet_service.cc:1511] Processing CreateTablet for tablet f04f057571584d31b1821e690ae7c75c (DEFAULT_TABLE table=default.Table_62dcfd8adef34929a08c11dfcf174ff7 [id=4a0a65332f00440f87102e8ebab708cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.933403 1044 tablet_service.cc:1511] Processing CreateTablet for tablet d0652735b8c24c23ade92913c1c7ad0f (DEFAULT_TABLE table=default.Table_ce5965e4cd074e108328165edb428e18 [id=5bc787aad96b4abd82ab3e033020ea9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.933743 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0652735b8c24c23ade92913c1c7ad0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.934645 891 tablet_service.cc:1511] Processing CreateTablet for tablet d0652735b8c24c23ade92913c1c7ad0f (DEFAULT_TABLE table=default.Table_ce5965e4cd074e108328165edb428e18 [id=5bc787aad96b4abd82ab3e033020ea9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.936195 890 tablet_service.cc:1511] Processing CreateTablet for tablet 3868406102b748a5b13420b24bf16485 (DEFAULT_TABLE table=default.Table_0fa2447b80b545388441838507fc117c [id=a7ad61d6d9264ec4ac482798b1ea992e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.939107 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a7e34d4ab9a4419793b8695abdd1c1eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.939755 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7e34d4ab9a4419793b8695abdd1c1eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.941376 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 93479517a1d34d2d99633018a6a57127
I20260318 02:51:22.941900 457 catalog_manager.cc:6741] ReplaceTablet: tablet 93479517a1d34d2d99633018a6a57127 deleted and replaced by tablet 5fec974d146f44aeb72df483fa85b287
I20260318 02:51:22.943064 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 76fc930611024211a70301bcfd92884e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.943593 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 93479517a1d34d2d99633018a6a57127 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fec974d146f44aeb72df483fa85b287) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:22.944279 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04f057571584d31b1821e690ae7c75c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.945161 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_46d782df1eb242b081563aeb0ae51278"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:22.945719 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46d782df1eb242b081563aeb0ae51278 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.946069 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3868406102b748a5b13420b24bf16485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.942689 903 tablet_service.cc:1511] Processing CreateTablet for tablet dea25aaad60a4b2483a8832f995d1316 (DEFAULT_TABLE table=default.Table_cfe05462158449cca7f529d5a37270be [id=feac1e97445140d9bfcb8eb2b9996498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.947108 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 666c2992fa4f479ab4ffd7ac0c3a9c92
W20260318 02:51:22.948529 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2304246c244407b9d4eb301ac5d7ba9 consensus state has no leader
I20260318 02:51:22.948868 1184 ts_tablet_manager.cc:1916] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:22.952806 997 leader_election.cc:343] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: 53e66044bfed4b53a1c0bc4dc8de52e6
I20260318 02:51:22.954648 997 leader_election.cc:304] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:22.955018 1357 raft_consensus.cc:2749] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:22.955659 997 leader_election.cc:343] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: 7e4e8586673c43058ef00f2f7aef10ee
I20260318 02:51:22.955708 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 666c2992fa4f479ab4ffd7ac0c3a9c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.964037 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 93479517a1d34d2d99633018a6a57127 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fec974d146f44aeb72df483fa85b287) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.965435 1359 tablet.cc:1723] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260318 02:51:22.967087 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c5038e9e1074f46976a1a5bb4282944 with delete_type TABLET_DATA_DELETED (replaced by tablet 27fc03c90b584becb250546100af736c) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:22.970050 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0652735b8c24c23ade92913c1c7ad0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.976379 1172 tablet_bootstrap.cc:492] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:22.976953 1280 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260318 02:51:22.978094 1280 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260318 02:51:22.978443 1280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260318 02:51:22.979164 1172 ts_tablet_manager.cc:1403] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.069s user 0.000s sys 0.007s
I20260318 02:51:22.980126 1172 raft_consensus.cc:359] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:22.980440 1172 raft_consensus.cc:385] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:22.978969 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet f7415ddf48574f7b9a746049ce78d2e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:22.981238 902 tablet_service.cc:1511] Processing CreateTablet for tablet b716c3a80d4a44d190de38f926098efc (DEFAULT_TABLE table=default.Table_b173d9dd6cc74a9ea5044ae888a3bd14 [id=08016e8769bf4007bdb2eba7c11fe0f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.981551 1038 tablet_service.cc:1511] Processing CreateTablet for tablet b716c3a80d4a44d190de38f926098efc (DEFAULT_TABLE table=default.Table_b173d9dd6cc74a9ea5044ae888a3bd14 [id=08016e8769bf4007bdb2eba7c11fe0f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.982352 898 tablet_service.cc:1511] Processing CreateTablet for tablet 6088f65949e24799973bd1f432b25dc7 (DEFAULT_TABLE table=default.Table_1c7dbfac7c8240aabb2880c2b7391d6b [id=826643e0cfb34a9da167995a7bc7a9ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.983167 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b716c3a80d4a44d190de38f926098efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.983543 895 tablet_service.cc:1511] Processing CreateTablet for tablet a20b9dc70b5147ff8798946eda3131ca (DEFAULT_TABLE table=default.Table_b2421f1e49054cd29747d7efc0bb0060 [id=7f9afbebeec541b9a89c049f168e87b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.990881 1033 tablet_service.cc:1511] Processing CreateTablet for tablet b230018a95a54ababfe5ecf2ca1e2e49 (DEFAULT_TABLE table=default.Table_f6bd74ee469e431eb8367558134a24b5 [id=9278db75ac0f4aa59c4af2f13a58e314]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.990936 1039 tablet_service.cc:1511] Processing CreateTablet for tablet cc1543d0e1b1431baf6d2ab6a0484ca6 (DEFAULT_TABLE table=default.Table_6eeca0066a9946e1b4dcfac117aad4b6 [id=e7c0679f0795485db510de58088251a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.991292 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b230018a95a54ababfe5ecf2ca1e2e49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.991497 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc1543d0e1b1431baf6d2ab6a0484ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.982458 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 6088f65949e24799973bd1f432b25dc7 (DEFAULT_TABLE table=default.Table_1c7dbfac7c8240aabb2880c2b7391d6b [id=826643e0cfb34a9da167995a7bc7a9ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:22.994243 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c7ff1bf8d29b485f92f33882f86219e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:22.980577 1172 raft_consensus.cc:740] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
W20260318 02:51:22.994867 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7ff1bf8d29b485f92f33882f86219e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:22.996078 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6088f65949e24799973bd1f432b25dc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.997773 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea25aaad60a4b2483a8832f995d1316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:22.999459 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6088f65949e24799973bd1f432b25dc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.003844 889 tablet_service.cc:1511] Processing CreateTablet for tablet 86f5e1cad5794c15a0b62e64d9e86417 (DEFAULT_TABLE table=default.Table_27a5d89c22df4e6eb87b9b0a55c42604 [id=d81a0140eeef4c0985a9ceea0eeafb48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.004379 888 tablet_service.cc:1511] Processing CreateTablet for tablet b230018a95a54ababfe5ecf2ca1e2e49 (DEFAULT_TABLE table=default.Table_f6bd74ee469e431eb8367558134a24b5 [id=9278db75ac0f4aa59c4af2f13a58e314]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.005704 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_05696f972aa0431fa0dff6438e8e8bfd" } new_table_name: "default.Table_346cff4fabb54f2ebef24b9eb0cf3be6" modify_external_catalogs: true
I20260318 02:51:23.007098 901 tablet_service.cc:1511] Processing CreateTablet for tablet ce0ab476b9a54cc586a4c28e23382bfc (DEFAULT_TABLE table=default.Table_5c03883f4a5e4de6801f783f51440963 [id=94288205d88b4c6ca1f94de1b201a349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.010231 904 tablet_service.cc:1511] Processing CreateTablet for tablet 27fc03c90b584becb250546100af736c (DEFAULT_TABLE table=default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.010584 899 tablet_service.cc:1511] Processing CreateTablet for tablet e57dbb1276114cd6b7d26f7167b99f25 (DEFAULT_TABLE table=default.Table_5d2bd7442ee945c48175c6dd82738a5d [id=34553220f38c4ffd99cf61e1679bdb81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.010730 900 tablet_service.cc:1511] Processing CreateTablet for tablet f6794f8a443f41b195fb326d49f56756 (DEFAULT_TABLE table=default.Table_bf944c0b82364ff49225c37770b529ac [id=2657eb5502934a0cbd3afafab63786b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.011147 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 666c2992fa4f479ab4ffd7ac0c3a9c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:23.016880 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 71c518c87bdd4a63aa1016e8de6bafdc consensus state has no leader
I20260318 02:51:23.017285 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b173d9dd6cc74a9ea5044ae888a3bd14" } modify_external_catalogs: true
I20260318 02:51:23.017302 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 86f5e1cad5794c15a0b62e64d9e86417 (DEFAULT_TABLE table=default.Table_27a5d89c22df4e6eb87b9b0a55c42604 [id=d81a0140eeef4c0985a9ceea0eeafb48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.017484 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b173d9dd6cc74a9ea5044ae888a3bd14" } modify_external_catalogs: true
I20260318 02:51:23.018304 1357 raft_consensus.cc:493] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:23.018672 1044 tablet_service.cc:1511] Processing CreateTablet for tablet e57dbb1276114cd6b7d26f7167b99f25 (DEFAULT_TABLE table=default.Table_5d2bd7442ee945c48175c6dd82738a5d [id=34553220f38c4ffd99cf61e1679bdb81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.019850 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20b9dc70b5147ff8798946eda3131ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.020932 761 tablet_service.cc:1558] Processing DeleteTablet for tablet d1a884fde2c145518a2cb14b7780b6dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.023583 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3fbf83db2cc447889b1a1d67741ca227" } modify_external_catalogs: true
I20260318 02:51:23.023819 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3fbf83db2cc447889b1a1d67741ca227" } modify_external_catalogs: true
I20260318 02:51:23.024379 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_480631505a694fa2846e96ba417fcb1f" } modify_external_catalogs: true
I20260318 02:51:23.024547 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_480631505a694fa2846e96ba417fcb1f" } modify_external_catalogs: true
I20260318 02:51:23.025547 907 tablet_service.cc:1511] Processing CreateTablet for tablet cc1543d0e1b1431baf6d2ab6a0484ca6 (DEFAULT_TABLE table=default.Table_6eeca0066a9946e1b4dcfac117aad4b6 [id=e7c0679f0795485db510de58088251a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.027449 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b230018a95a54ababfe5ecf2ca1e2e49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.018288 1034 tablet_service.cc:1511] Processing CreateTablet for tablet a20b9dc70b5147ff8798946eda3131ca (DEFAULT_TABLE table=default.Table_b2421f1e49054cd29747d7efc0bb0060 [id=7f9afbebeec541b9a89c049f168e87b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.029066 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57dbb1276114cd6b7d26f7167b99f25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.018242 1172 consensus_queue.cc:260] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.032855 757 tablet_service.cc:1511] Processing CreateTablet for tablet ce0ab476b9a54cc586a4c28e23382bfc (DEFAULT_TABLE table=default.Table_5c03883f4a5e4de6801f783f51440963 [id=94288205d88b4c6ca1f94de1b201a349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.033102 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 27fc03c90b584becb250546100af736c (DEFAULT_TABLE table=default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.033452 1357 raft_consensus.cc:515] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.033665 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d with delete_type TABLET_DATA_DELETED (replaced by tablet 65c50b0813b04f30896568ab2b680ba8) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.034183 1357 leader_election.cc:290] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:23.035382 752 tablet_service.cc:1511] Processing CreateTablet for tablet dea25aaad60a4b2483a8832f995d1316 (DEFAULT_TABLE table=default.Table_cfe05462158449cca7f529d5a37270be [id=feac1e97445140d9bfcb8eb2b9996498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.036361 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0ab476b9a54cc586a4c28e23382bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.040984 755 tablet_service.cc:1511] Processing CreateTablet for tablet f04f057571584d31b1821e690ae7c75c (DEFAULT_TABLE table=default.Table_62dcfd8adef34929a08c11dfcf174ff7 [id=4a0a65332f00440f87102e8ebab708cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.032397 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6794f8a443f41b195fb326d49f56756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.032196 896 tablet_service.cc:1511] Processing CreateTablet for tablet 65c50b0813b04f30896568ab2b680ba8 (DEFAULT_TABLE table=default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.041338 761 tablet_service.cc:1511] Processing CreateTablet for tablet 2789a1195e7344c18dd226e196e2f302 (DEFAULT_TABLE table=default.Table_3c92615f79714bbdb3c88e2c373ee91e [id=3066ad66b0914b759c32fe9296ca90bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.043347 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86f5e1cad5794c15a0b62e64d9e86417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.043687 1184 ts_tablet_manager.cc:1929] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:23.044131 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 65c50b0813b04f30896568ab2b680ba8 (DEFAULT_TABLE table=default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.045099 1184 log.cc:1199] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/53502a8e2d184b7ea7fa575d4836f0ea
I20260318 02:51:23.045934 1184 ts_tablet_manager.cc:1950] T 53502a8e2d184b7ea7fa575d4836f0ea P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:23.049268 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9a40c252bf664c028621b2e116ccc09a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:23.049932 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a40c252bf664c028621b2e116ccc09a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.053304 760 tablet_service.cc:1511] Processing CreateTablet for tablet f6794f8a443f41b195fb326d49f56756 (DEFAULT_TABLE table=default.Table_bf944c0b82364ff49225c37770b529ac [id=2657eb5502934a0cbd3afafab63786b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.053756 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86f5e1cad5794c15a0b62e64d9e86417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.059782 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea25aaad60a4b2483a8832f995d1316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.061074 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04f057571584d31b1821e690ae7c75c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.063817 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bb21feccea674d3e8845f95753367aa8" } modify_external_catalogs: true
I20260318 02:51:23.064036 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bb21feccea674d3e8845f95753367aa8" } modify_external_catalogs: true
I20260318 02:51:23.066108 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 666c2992fa4f479ab4ffd7ac0c3a9c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.067343 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1e921769921d4b0281a7699560d75010"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:23.067996 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e921769921d4b0281a7699560d75010 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.069387 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_25494285095147fa885f1aa79e2f1722"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:23.063161 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b716c3a80d4a44d190de38f926098efc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:23.069963 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25494285095147fa885f1aa79e2f1722 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.071274 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5d2bd7442ee945c48175c6dd82738a5d" } new_table_name: "default.Table_b52460621ef542dfae054fcaba6fed13" modify_external_catalogs: true
I20260318 02:51:23.072652 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c2d16f88924544cbaf4ed64b9c5bc7a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:23.073253 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2d16f88924544cbaf4ed64b9c5bc7a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.074570 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_017276a514464042a76dbff62faa6f82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:23.075132 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_017276a514464042a76dbff62faa6f82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.077481 1228 raft_consensus.cc:493] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:23.077673 1228 raft_consensus.cc:515] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.079093 1228 leader_election.cc:290] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:23.079093 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a1fc9d74bf8b4be5a48c0480aa55d189"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:23.079241 892 tablet_service.cc:1511] Processing CreateTablet for tablet 1350684961f645e089fc3fd9ba3a5b09 (DEFAULT_TABLE table=default.Table_f217b96e5bfe4f119051ba52273b64d2 [id=8c09e862552b482b83001dc99b6dee7d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:23.079635 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1fc9d74bf8b4be5a48c0480aa55d189 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.082052 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0ab476b9a54cc586a4c28e23382bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.082134 1175 ts_tablet_manager.cc:1929] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260318 02:51:23.089406 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e57dbb1276114cd6b7d26f7167b99f25 consensus state has no leader
I20260318 02:51:23.090277 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1350684961f645e089fc3fd9ba3a5b09. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:23.093271 999 leader_election.cc:343] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 7e4e8586673c43058ef00f2f7aef10ee
I20260318 02:51:23.094069 999 leader_election.cc:304] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:23.094260 759 tablet_service.cc:1511] Processing CreateTablet for tablet 3868406102b748a5b13420b24bf16485 (DEFAULT_TABLE table=default.Table_0fa2447b80b545388441838507fc117c [id=a7ad61d6d9264ec4ac482798b1ea992e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:23.094540 999 leader_election.cc:343] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 41a152a453fe47d194766635ab586804
I20260318 02:51:23.095016 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "053a09fd13fa4d8e80133fd77acaa4ce" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:23.096431 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20b9dc70b5147ff8798946eda3131ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.097249 906 tablet_service.cc:1511] Processing CreateTablet for tablet 9a5afc5611d3481e9a6d48381dc67e86 (DEFAULT_TABLE table=default.Table_eb225edbcae24cc8b21780a90930083a [id=e03eb5ce646645e393ddc268a1aabf1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.098649 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 93479517a1d34d2d99633018a6a57127 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fec974d146f44aeb72df483fa85b287) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.099141 766 tablet_service.cc:1511] Processing CreateTablet for tablet b230018a95a54ababfe5ecf2ca1e2e49 (DEFAULT_TABLE table=default.Table_f6bd74ee469e431eb8367558134a24b5 [id=9278db75ac0f4aa59c4af2f13a58e314]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.102689 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 1350684961f645e089fc3fd9ba3a5b09 (DEFAULT_TABLE table=default.Table_f217b96e5bfe4f119051ba52273b64d2 [id=8c09e862552b482b83001dc99b6dee7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.104015 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2789a1195e7344c18dd226e196e2f302. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.103006 751 tablet_service.cc:1511] Processing CreateTablet for tablet d0652735b8c24c23ade92913c1c7ad0f (DEFAULT_TABLE table=default.Table_ce5965e4cd074e108328165edb428e18 [id=5bc787aad96b4abd82ab3e033020ea9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.103830 748 tablet_service.cc:1511] Processing CreateTablet for tablet 6088f65949e24799973bd1f432b25dc7 (DEFAULT_TABLE table=default.Table_1c7dbfac7c8240aabb2880c2b7391d6b [id=826643e0cfb34a9da167995a7bc7a9ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.103857 750 tablet_service.cc:1511] Processing CreateTablet for tablet 86f5e1cad5794c15a0b62e64d9e86417 (DEFAULT_TABLE table=default.Table_27a5d89c22df4e6eb87b9b0a55c42604 [id=d81a0140eeef4c0985a9ceea0eeafb48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.105829 749 tablet_service.cc:1511] Processing CreateTablet for tablet b716c3a80d4a44d190de38f926098efc (DEFAULT_TABLE table=default.Table_b173d9dd6cc74a9ea5044ae888a3bd14 [id=08016e8769bf4007bdb2eba7c11fe0f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.106308 1176 ts_tablet_manager.cc:1916] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:23.106385 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 53502a8e2d184b7ea7fa575d4836f0ea (table default.Table_63ea580c95a14a2f85b3ca002a8b1399 [id=0c04457e82e54a229437db0c3f90811b]) successfully deleted
W20260318 02:51:23.106777 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 977b95a3442a405d90385cdb4d6dd5dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 977b95a3442a405d90385cdb4d6dd5dd already in progress: creating tablet
I20260318 02:51:23.108438 1184 tablet_replica.cc:333] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:23.108690 1175 log.cc:1199] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/41bc1c926c0f4ef2a4c9c52d991f8f0d
W20260318 02:51:23.108744 860 leader_election.cc:343] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:23.109730 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65c50b0813b04f30896568ab2b680ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.109675 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 9a5afc5611d3481e9a6d48381dc67e86 (DEFAULT_TABLE table=default.Table_eb225edbcae24cc8b21780a90930083a [id=e03eb5ce646645e393ddc268a1aabf1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.110069 1357 raft_consensus.cc:2749] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:23.110343 1184 raft_consensus.cc:2243] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:23.110077 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a5afc5611d3481e9a6d48381dc67e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.114760 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3868406102b748a5b13420b24bf16485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.115092 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86f5e1cad5794c15a0b62e64d9e86417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.115320 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6088f65949e24799973bd1f432b25dc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.115775 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b716c3a80d4a44d190de38f926098efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.115890 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27fc03c90b584becb250546100af736c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.116690 1175 ts_tablet_manager.cc:1950] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:23.117671 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1350684961f645e089fc3fd9ba3a5b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.118317 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27fc03c90b584becb250546100af736c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.121304 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "053a09fd13fa4d8e80133fd77acaa4ce" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:23.121564 785 raft_consensus.cc:2468] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
W20260318 02:51:23.117408 997 leader_election.cc:343] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: 41a152a453fe47d194766635ab586804
I20260318 02:51:23.124434 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57dbb1276114cd6b7d26f7167b99f25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.125634 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d (table default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666]) successfully deleted
I20260318 02:51:23.125891 862 leader_election.cc:304] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:23.127209 1184 raft_consensus.cc:2272] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.128439 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc1543d0e1b1431baf6d2ab6a0484ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.129521 997 leader_election.cc:304] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:23.130386 1184 ts_tablet_manager.cc:1916] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:23.131494 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0652735b8c24c23ade92913c1c7ad0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.132272 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b230018a95a54ababfe5ecf2ca1e2e49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.133868 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6794f8a443f41b195fb326d49f56756. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:23.134219 719 consensus_peers.cc:597] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:23.135478 1357 raft_consensus.cc:2749] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:23.138293 1228 raft_consensus.cc:2804] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:23.138057 747 tablet_service.cc:1511] Processing CreateTablet for tablet a20b9dc70b5147ff8798946eda3131ca (DEFAULT_TABLE table=default.Table_b2421f1e49054cd29747d7efc0bb0060 [id=7f9afbebeec541b9a89c049f168e87b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.139823 1228 raft_consensus.cc:493] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:23.139961 1228 raft_consensus.cc:3060] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.141388 1175 tablet_replica.cc:333] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:23.142316 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a5afc5611d3481e9a6d48381dc67e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.142233 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2edfe13a5f2b4267a7e522a474ac0cc0" } new_table_name: "default.Table_31d713ee51bc47c1a98874825f31a240" modify_external_catalogs: true
I20260318 02:51:23.143675 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4a42a797802e455f938612dd56b0e3ea" } new_table_name: "default.Table_bc4b73281db84d099008d5b137871ff9" modify_external_catalogs: true
I20260318 02:51:23.150310 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20b9dc70b5147ff8798946eda3131ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.150727 1173 tablet_bootstrap.cc:492] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:23.150941 1173 ts_tablet_manager.cc:1403] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.256s user 0.011s sys 0.013s
I20260318 02:51:23.156164 1175 raft_consensus.cc:2243] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:23.159133 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65c50b0813b04f30896568ab2b680ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.163831 1175 raft_consensus.cc:2272] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.164579 1175 ts_tablet_manager.cc:1916] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:23.179029 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3ca80b83e6d7423fb22529c4b0d1391f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:23.179673 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ca80b83e6d7423fb22529c4b0d1391f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.181150 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7710260d7bd54a859b6fc9023ce450e2" } modify_external_catalogs: true
I20260318 02:51:23.181331 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7710260d7bd54a859b6fc9023ce450e2" } modify_external_catalogs: true
I20260318 02:51:23.182056 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b2421f1e49054cd29747d7efc0bb0060" } new_table_name: "default.Table_ee4a90e9175d492abacfccb2acf7c108" modify_external_catalogs: true
I20260318 02:51:23.194224 1173 raft_consensus.cc:359] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:23.194495 1173 raft_consensus.cc:385] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.194581 1173 raft_consensus.cc:740] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.194875 1173 consensus_queue.cc:260] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:23.195515 758 tablet_service.cc:1511] Processing CreateTablet for tablet cc1543d0e1b1431baf6d2ab6a0484ca6 (DEFAULT_TABLE table=default.Table_6eeca0066a9946e1b4dcfac117aad4b6 [id=e7c0679f0795485db510de58088251a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.205472 756 tablet_service.cc:1511] Processing CreateTablet for tablet e57dbb1276114cd6b7d26f7167b99f25 (DEFAULT_TABLE table=default.Table_5d2bd7442ee945c48175c6dd82738a5d [id=34553220f38c4ffd99cf61e1679bdb81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.207005 1228 raft_consensus.cc:515] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.211185 1184 ts_tablet_manager.cc:1929] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
W20260318 02:51:23.216985 441 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 9d20847fa6f9461cb6137f56ea680cb6 (table default.Table_d56046d9ca314b3d84d67be620445de8 [id=ed55cf5473c34c8b95532da9cfa81fad], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9d20847fa6f9461cb6137f56ea680cb6 consensus state has no leader
I20260318 02:51:23.219977 1184 log.cc:1199] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/1766ce95009b4c3f9940ebcf10503c7f
I20260318 02:51:23.220640 1184 ts_tablet_manager.cc:1950] T 1766ce95009b4c3f9940ebcf10503c7f P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:23.222044 1184 tablet_replica.cc:333] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:23.222332 1184 raft_consensus.cc:2243] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:23.222579 1184 raft_consensus.cc:2272] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.223421 1184 ts_tablet_manager.cc:1916] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:23.226722 1228 leader_election.cc:290] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:23.228401 1228 raft_consensus.cc:493] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:23.228654 1228 raft_consensus.cc:515] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.230640 1184 ts_tablet_manager.cc:1929] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260318 02:51:23.238391 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7883f526d06e442c81f1b66fd89d2cd0 consensus state has no leader
I20260318 02:51:23.238827 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_fced45ef732a4091bc296695317df2be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:23.239384 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fced45ef732a4091bc296695317df2be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.241091 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b4f218d2fea54a31be80372e05eaa6ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:23.241624 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4f218d2fea54a31be80372e05eaa6ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.231010 1184 log.cc:1199] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/41a152a453fe47d194766635ab586804
I20260318 02:51:23.235541 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 5fec974d146f44aeb72df483fa85b287 (DEFAULT_TABLE table=default.Table_167a79354e7844aabe2ae725df4f536c [id=095e4b55b1544007a032a984ba934743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.242714 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fec974d146f44aeb72df483fa85b287. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:23.242832 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a20b9dc70b5147ff8798946eda3131ca consensus state has no leader
I20260318 02:51:23.243165 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e8949513489d44e0a36b239de4fbed56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:23.243687 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8949513489d44e0a36b239de4fbed56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:23.245748 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e55bbc320b0e4f9595bae9816e594b82 consensus state has no leader
I20260318 02:51:23.235700 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 1766ce95009b4c3f9940ebcf10503c7f (table default.Table_83aab17168ad4c2bae9ea1b354ef5001 [id=1c0082e294dd43cdb2eb4ed335ff3c06]) successfully deleted
I20260318 02:51:23.235941 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 1b439fa2481a43c78d2c486d8711175f (DEFAULT_TABLE table=default.Table_46d782df1eb242b081563aeb0ae51278 [id=2cc63f24c25a4fc396e6d026ce1ba876]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.250052 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b439fa2481a43c78d2c486d8711175f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.251068 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1d1ac99a8f2941fdb5135ccc46e16c42" } new_table_name: "default.Table_fddbe89a9a524d028fba5877d8b23387" modify_external_catalogs: true
I20260318 02:51:23.261710 1172 ts_tablet_manager.cc:1434] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.279s user 0.004s sys 0.014s
I20260318 02:51:23.267446 760 tablet_service.cc:1511] Processing CreateTablet for tablet 27fc03c90b584becb250546100af736c (DEFAULT_TABLE table=default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.268033 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "053a09fd13fa4d8e80133fd77acaa4ce" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:23.269232 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caed5f1870469d834aecd2bc42bdda" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:23.267253 1228 leader_election.cc:290] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:23.273330 1172 tablet_bootstrap.cc:492] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:23.275549 752 tablet_service.cc:1511] Processing CreateTablet for tablet 1350684961f645e089fc3fd9ba3a5b09 (DEFAULT_TABLE table=default.Table_f217b96e5bfe4f119051ba52273b64d2 [id=8c09e862552b482b83001dc99b6dee7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.271257 762 tablet_service.cc:1511] Processing CreateTablet for tablet 65c50b0813b04f30896568ab2b680ba8 (DEFAULT_TABLE table=default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.278623 757 tablet_service.cc:1511] Processing CreateTablet for tablet 083493ab9d26493a924025fbd96ab1d7 (DEFAULT_TABLE table=default.Table_a7e34d4ab9a4419793b8695abdd1c1eb [id=607d58701fef4551addddb65e64f7dcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.283438 764 tablet_service.cc:1511] Processing CreateTablet for tablet 9a5afc5611d3481e9a6d48381dc67e86 (DEFAULT_TABLE table=default.Table_eb225edbcae24cc8b21780a90930083a [id=e03eb5ce646645e393ddc268a1aabf1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.284955 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 083493ab9d26493a924025fbd96ab1d7 (DEFAULT_TABLE table=default.Table_a7e34d4ab9a4419793b8695abdd1c1eb [id=607d58701fef4551addddb65e64f7dcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.285379 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 083493ab9d26493a924025fbd96ab1d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:23.296583 860 leader_election.cc:343] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:23.297639 1228 raft_consensus.cc:493] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:23.298583 1184 ts_tablet_manager.cc:1950] T 41a152a453fe47d194766635ab586804 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:23.301862 763 tablet_service.cc:1511] Processing CreateTablet for tablet 5fec974d146f44aeb72df483fa85b287 (DEFAULT_TABLE table=default.Table_167a79354e7844aabe2ae725df4f536c [id=095e4b55b1544007a032a984ba934743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.305076 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc1543d0e1b1431baf6d2ab6a0484ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.305707 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 083493ab9d26493a924025fbd96ab1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.305944 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fec974d146f44aeb72df483fa85b287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.306682 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57dbb1276114cd6b7d26f7167b99f25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.306886 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65c50b0813b04f30896568ab2b680ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.307324 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27fc03c90b584becb250546100af736c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.307526 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a5afc5611d3481e9a6d48381dc67e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.307864 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1350684961f645e089fc3fd9ba3a5b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.308662 754 tablet_service.cc:1511] Processing CreateTablet for tablet 1b439fa2481a43c78d2c486d8711175f (DEFAULT_TABLE table=default.Table_46d782df1eb242b081563aeb0ae51278 [id=2cc63f24c25a4fc396e6d026ce1ba876]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.309095 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b439fa2481a43c78d2c486d8711175f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.309657 1184 tablet_replica.cc:333] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:23.310109 901 tablet_service.cc:1511] Processing CreateTablet for tablet 1b439fa2481a43c78d2c486d8711175f (DEFAULT_TABLE table=default.Table_46d782df1eb242b081563aeb0ae51278 [id=2cc63f24c25a4fc396e6d026ce1ba876]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.319126 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 41a152a453fe47d194766635ab586804 (table default.Table_b2b84cb26868440ca83042602d382c10 [id=e0155dac40a44f07885db7ec2d76f271]) successfully deleted
W20260318 02:51:23.322407 860 leader_election.cc:343] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:23.323272 895 tablet_service.cc:1511] Processing CreateTablet for tablet 083493ab9d26493a924025fbd96ab1d7 (DEFAULT_TABLE table=default.Table_a7e34d4ab9a4419793b8695abdd1c1eb [id=607d58701fef4551addddb65e64f7dcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.324158 1176 ts_tablet_manager.cc:1929] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:23.324383 1176 log.cc:1199] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/0e4719eafd2947bfacf3e1d2df1ae43e
I20260318 02:51:23.324851 1176 ts_tablet_manager.cc:1950] T 0e4719eafd2947bfacf3e1d2df1ae43e P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:23.327517 1184 raft_consensus.cc:2243] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:23.327762 1184 raft_consensus.cc:2272] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.327863 1228 raft_consensus.cc:515] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.328352 1184 ts_tablet_manager.cc:1916] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:23.333571 1228 leader_election.cc:290] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:23.335114 1172 tablet_bootstrap.cc:654] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.341352 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 0e4719eafd2947bfacf3e1d2df1ae43e (table default.Table_e88f9eedc9d549e7bd8e8fb34e721a44 [id=33a7b2fdc7094616a94fa59f370e1728]) successfully deleted
I20260318 02:51:23.336113 1343 raft_consensus.cc:493] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:23.342115 1343 raft_consensus.cc:515] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.342820 1343 leader_election.cc:290] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:23.343611 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df8029146564e1c9dc88dd9f5fb64ae" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:23.344204 719 leader_election.cc:343] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:23.334389 1174 tablet_bootstrap.cc:492] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:23.344787 1174 ts_tablet_manager.cc:1403] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.493s user 0.002s sys 0.013s
I20260318 02:51:23.345755 1174 raft_consensus.cc:359] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.346027 1174 raft_consensus.cc:385] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.346148 1174 raft_consensus.cc:740] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.346381 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23b646a132743cc9b4dcd85c6d4ebea" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:23.346446 1174 consensus_queue.cc:260] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.346629 1062 raft_consensus.cc:2468] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:23.348012 1174 ts_tablet_manager.cc:1434] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:23.348021 860 leader_election.cc:304] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:23.341902 1176 tablet_replica.cc:333] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:23.348541 1176 raft_consensus.cc:2243] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:23.348589 1228 raft_consensus.cc:2804] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:23.348780 1228 raft_consensus.cc:493] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:23.348825 1176 raft_consensus.cc:2272] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.348937 1228 raft_consensus.cc:3060] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.349465 1176 ts_tablet_manager.cc:1916] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:23.352407 1228 raft_consensus.cc:515] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.354202 1228 leader_election.cc:290] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:23.354681 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b439fa2481a43c78d2c486d8711175f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.354710 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 053a09fd13fa4d8e80133fd77acaa4ce
I20260318 02:51:23.356199 452 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 549b3929ea33417bbe50e749bbfe223d (table default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]). Expected version 2 got 0
I20260318 02:51:23.357429 452 master_service.cc:954] ReplaceTablet: received request to replace tablet 2bd6ac47ba044099ad9bd211ef8d26a2 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:23.364020 1175 ts_tablet_manager.cc:1929] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:23.368005 1174 tablet_bootstrap.cc:492] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:23.371780 1174 tablet_bootstrap.cc:654] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.376902 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 053a09fd13fa4d8e80133fd77acaa4ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.378094 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 053a09fd13fa4d8e80133fd77acaa4ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:23.378953 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23b646a132743cc9b4dcd85c6d4ebea" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:23.379181 1062 raft_consensus.cc:3060] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.383701 1062 raft_consensus.cc:2468] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:23.383876 1184 ts_tablet_manager.cc:1929] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:23.384012 1184 log.cc:1199] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/4b07774692544b1c83bc547302b203a5
I20260318 02:51:23.384356 1184 ts_tablet_manager.cc:1950] T 4b07774692544b1c83bc547302b203a5 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:23.388935 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 0d343e53f2354a3386b19d71ef00d5a4
I20260318 02:51:23.389238 1175 log.cc:1199] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/76fc930611024211a70301bcfd92884e
I20260318 02:51:23.389746 1175 ts_tablet_manager.cc:1950] T 76fc930611024211a70301bcfd92884e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:23.378938 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 053a09fd13fa4d8e80133fd77acaa4ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:23.384981 860 leader_election.cc:304] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:23.391264 1422 raft_consensus.cc:2804] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:23.391492 1422 raft_consensus.cc:697] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:23.391857 1422 consensus_queue.cc:237] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.392133 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3aa749750bd542738790c713a8ff0713"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:23.375312 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 083493ab9d26493a924025fbd96ab1d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.392951 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b716c3a80d4a44d190de38f926098efc
I20260318 02:51:23.393440 457 master_service.cc:954] ReplaceTablet: received request to replace tablet 6e9372f8871b473caa024512e936a6e5 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:23.394613 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet bf09f8234f36402bb9129d524637b5b5
I20260318 02:51:23.395223 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_881262486e0f4a268678b8422cd12beb" } new_table_name: "default.Table_d29ddedf032449af9ee69c8b356d5ef6" modify_external_catalogs: true
I20260318 02:51:23.378182 889 tablet_service.cc:1511] Processing CreateTablet for tablet 5fec974d146f44aeb72df483fa85b287 (DEFAULT_TABLE table=default.Table_167a79354e7844aabe2ae725df4f536c [id=095e4b55b1544007a032a984ba934743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.396317 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fec974d146f44aeb72df483fa85b287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.396904 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a73cffc7e068465bace900fc6b92c44e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:23.397440 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a73cffc7e068465bace900fc6b92c44e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.398916 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1f1814cfbad542d2819ce76c05ad9c83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:23.399437 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f1814cfbad542d2819ce76c05ad9c83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.400842 448 master_service.cc:954] ReplaceTablet: received request to replace tablet 76fc930611024211a70301bcfd92884e from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:23.385695 1173 ts_tablet_manager.cc:1434] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.235s user 0.001s sys 0.007s
I20260318 02:51:23.401312 448 master_service.cc:954] ReplaceTablet: received request to replace tablet d4a54d0daa9f48a89b3f114367750826 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:23.401504 1173 tablet_bootstrap.cc:492] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:23.402905 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet c23b646a132743cc9b4dcd85c6d4ebea
I20260318 02:51:23.403412 1173 tablet_bootstrap.cc:654] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.404927 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "053a09fd13fa4d8e80133fd77acaa4ce" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:23.405184 785 raft_consensus.cc:3060] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.408278 785 raft_consensus.cc:2468] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:23.409446 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caed5f1870469d834aecd2bc42bdda" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:23.410224 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba with delete_type TABLET_DATA_DELETED (replaced by tablet bd077319b3c443849de087eb61da6a77) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.410462 752 tablet_service.cc:1558] Processing DeleteTablet for tablet b716c3a80d4a44d190de38f926098efc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:23.410542 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3aa749750bd542738790c713a8ff0713 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.410647 757 tablet_service.cc:1558] Processing DeleteTablet for tablet bf09f8234f36402bb9129d524637b5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.410818 758 tablet_service.cc:1558] Processing DeleteTablet for tablet c23b646a132743cc9b4dcd85c6d4ebea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.410987 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d343e53f2354a3386b19d71ef00d5a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.409688 785 raft_consensus.cc:2468] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:23.416607 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d343e53f2354a3386b19d71ef00d5a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:23.417343 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d343e53f2354a3386b19d71ef00d5a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:23.418144 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23b646a132743cc9b4dcd85c6d4ebea" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:23.418406 907 tablet_service.cc:1558] Processing DeleteTablet for tablet b716c3a80d4a44d190de38f926098efc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:23.418411 785 raft_consensus.cc:2468] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:23.419106 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet b716c3a80d4a44d190de38f926098efc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:23.419342 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c23b646a132743cc9b4dcd85c6d4ebea" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:23.419595 785 raft_consensus.cc:3060] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.420091 1174 tablet_bootstrap.cc:492] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:23.420977 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet bf09f8234f36402bb9129d524637b5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:23.421634 907 tablet_service.cc:1558] Processing DeleteTablet for tablet bf09f8234f36402bb9129d524637b5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:23.422729 1172 tablet_bootstrap.cc:492] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:23.423007 1172 ts_tablet_manager.cc:1403] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.152s user 0.005s sys 0.001s
I20260318 02:51:23.423429 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df8029146564e1c9dc88dd9f5fb64ae" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:23.424266 1172 raft_consensus.cc:359] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.424635 1172 raft_consensus.cc:385] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.424759 1172 raft_consensus.cc:740] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.425072 1172 consensus_queue.cc:260] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.426834 1172 ts_tablet_manager.cc:1434] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260318 02:51:23.428102 1172 tablet_bootstrap.cc:492] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:23.429944 1172 tablet_bootstrap.cc:654] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.425380 862 leader_election.cc:304] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:23.435146 862 leader_election.cc:304] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:23.436280 1423 raft_consensus.cc:2804] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:23.436630 1421 raft_consensus.cc:2804] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:23.436798 1421 raft_consensus.cc:493] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:23.436949 1421 raft_consensus.cc:3060] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.437917 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet c23b646a132743cc9b4dcd85c6d4ebea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:23.438591 907 tablet_service.cc:1558] Processing DeleteTablet for tablet c23b646a132743cc9b4dcd85c6d4ebea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:23.438963 1174 ts_tablet_manager.cc:1403] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.071s user 0.004s sys 0.000s
I20260318 02:51:23.422803 785 raft_consensus.cc:2468] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
W20260318 02:51:23.424968 719 leader_election.cc:343] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:23.440932 719 leader_election.cc:304] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:23.441203 719 raft_consensus.cc:2686] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260318 02:51:23.442718 1423 raft_consensus.cc:697] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:23.443202 1423 consensus_queue.cc:237] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.444819 1421 raft_consensus.cc:515] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.445593 1421 leader_election.cc:290] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:23.446731 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 76fc930611024211a70301bcfd92884e (table default.Table_68f3e929e48949f1a9f426d64cb46006 [id=7fda019fe63e4e5995aeb77e4cf70dec]) successfully deleted
I20260318 02:51:23.447366 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e4719eafd2947bfacf3e1d2df1ae43e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:23.448544 1184 tablet_replica.cc:333] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:23.448769 1184 raft_consensus.cc:2243] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:23.448916 1184 raft_consensus.cc:2272] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.449620 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caed5f1870469d834aecd2bc42bdda" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:23.449854 785 raft_consensus.cc:3060] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.450078 1184 ts_tablet_manager.cc:1916] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:23.453404 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caed5f1870469d834aecd2bc42bdda" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:23.453550 1176 ts_tablet_manager.cc:1929] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:23.453815 1176 log.cc:1199] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/1df8029146564e1c9dc88dd9f5fb64ae
I20260318 02:51:23.454495 1176 ts_tablet_manager.cc:1950] T 1df8029146564e1c9dc88dd9f5fb64ae P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
W20260318 02:51:23.454120 860 leader_election.cc:343] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:23.456573 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 1df8029146564e1c9dc88dd9f5fb64ae (table default.Table_8191659006de403a8de64233efbf3486 [id=c2fac99943e14848aec3bc3195a60023]) successfully deleted
W20260318 02:51:23.456984 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 93479517a1d34d2d99633018a6a57127 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 93479517a1d34d2d99633018a6a57127 already in progress: creating tablet
I20260318 02:51:23.457597 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 4b07774692544b1c83bc547302b203a5 (table default.Table_211fe38e2cf749b8ac8d689f2fe65025 [id=da7b89f9dc554a6a9e383537b40ab14e]) successfully deleted
W20260318 02:51:23.460337 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 666c2992fa4f479ab4ffd7ac0c3a9c92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 666c2992fa4f479ab4ffd7ac0c3a9c92 already in progress: creating tablet
I20260318 02:51:23.461342 785 raft_consensus.cc:2468] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:23.461439 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c14f375645d84629b54e18e482938be5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:23.461890 862 leader_election.cc:304] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 9422bb7011f342b08be0b073a88c4c4d
W20260318 02:51:23.462066 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c14f375645d84629b54e18e482938be5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.462466 1422 raft_consensus.cc:2804] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:23.462613 1422 raft_consensus.cc:697] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:23.463510 1422 consensus_queue.cc:237] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.465437 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8d6d4b35c7754174adfe3a4d4889cdae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:23.465868 1175 tablet_replica.cc:333] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
W20260318 02:51:23.466786 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d6d4b35c7754174adfe3a4d4889cdae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.440626 1174 raft_consensus.cc:359] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.473088 1174 raft_consensus.cc:385] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.473255 1174 raft_consensus.cc:740] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.473609 1174 consensus_queue.cc:260] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.474562 1174 ts_tablet_manager.cc:1434] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.035s user 0.002s sys 0.000s
I20260318 02:51:23.474994 1174 tablet_bootstrap.cc:492] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:23.480374 1173 tablet_bootstrap.cc:492] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:23.483371 1173 ts_tablet_manager.cc:1403] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.079s user 0.002s sys 0.002s
I20260318 02:51:23.484407 1173 raft_consensus.cc:359] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:23.485087 1173 raft_consensus.cc:385] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.485234 1173 raft_consensus.cc:740] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.487950 1174 tablet_bootstrap.cc:654] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.489748 1173 consensus_queue.cc:260] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:23.490327 1173 ts_tablet_manager.cc:1434] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260318 02:51:23.491566 1175 raft_consensus.cc:2243] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:23.492599 1175 pending_rounds.cc:70] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18: Trying to abort 1 pending ops.
I20260318 02:51:23.492934 1175 pending_rounds.cc:77] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494152987328512 op_type: NO_OP noop_request { }
I20260318 02:51:23.493181 1175 raft_consensus.cc:2889] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:23.493517 1175 raft_consensus.cc:2272] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.495422 1173 tablet_bootstrap.cc:492] T f1ed26420c64492a94e8920d8c753fc3 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:23.497807 1175 ts_tablet_manager.cc:1916] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:23.500916 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f5a829abed0444b79c48ab080d024824 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5a829abed0444b79c48ab080d024824 already in progress: creating tablet
W20260318 02:51:23.505771 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet e3999f53c1cc4cb5a1d91eed23785cc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e3999f53c1cc4cb5a1d91eed23785cc6 already in progress: creating tablet
I20260318 02:51:23.505913 1172 tablet_bootstrap.cc:492] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:23.506062 1172 ts_tablet_manager.cc:1403] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.078s user 0.003s sys 0.000s
W20260318 02:51:23.506697 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet af793623466249e695b262ab451d4dc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af793623466249e695b262ab451d4dc9 already in progress: creating tablet
I20260318 02:51:23.505093 1173 tablet_bootstrap.cc:654] T f1ed26420c64492a94e8920d8c753fc3 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.506911 1172 raft_consensus.cc:359] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.507133 1172 raft_consensus.cc:385] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.507247 1172 raft_consensus.cc:740] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.507485 1172 consensus_queue.cc:260] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.508204 1172 ts_tablet_manager.cc:1434] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260318 02:51:23.508576 1172 tablet_bootstrap.cc:492] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:23.511209 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 547762347d7843e989e55e0449ad9fcb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 547762347d7843e989e55e0449ad9fcb already in progress: creating tablet
I20260318 02:51:23.513271 1176 tablet_replica.cc:333] T 32880a703603476786b4a34ddd40cab8 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:23.513454 1172 tablet_bootstrap.cc:654] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.504691 1175 ts_tablet_manager.cc:1929] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:23.518337 1175 log.cc:1199] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/053a09fd13fa4d8e80133fd77acaa4ce
I20260318 02:51:23.519112 1173 tablet_bootstrap.cc:492] T f1ed26420c64492a94e8920d8c753fc3 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:23.519320 1173 ts_tablet_manager.cc:1403] T f1ed26420c64492a94e8920d8c753fc3 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
I20260318 02:51:23.520083 1175 ts_tablet_manager.cc:1950] T 053a09fd13fa4d8e80133fd77acaa4ce P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:23.520139 1173 raft_consensus.cc:359] T f1ed26420c64492a94e8920d8c753fc3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.520325 1173 raft_consensus.cc:385] T f1ed26420c64492a94e8920d8c753fc3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.520416 1173 raft_consensus.cc:740] T f1ed26420c64492a94e8920d8c753fc3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.519956 1174 tablet_bootstrap.cc:492] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:23.520670 1173 consensus_queue.cc:260] T f1ed26420c64492a94e8920d8c753fc3 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.521116 1174 ts_tablet_manager.cc:1403] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.046s user 0.005s sys 0.000s
I20260318 02:51:23.521173 1173 ts_tablet_manager.cc:1434] T f1ed26420c64492a94e8920d8c753fc3 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:23.521616 1173 tablet_bootstrap.cc:492] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:23.522059 1174 raft_consensus.cc:359] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.522316 1176 raft_consensus.cc:2243] T 32880a703603476786b4a34ddd40cab8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:23.522423 1174 raft_consensus.cc:385] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.523402 1174 raft_consensus.cc:740] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.523759 1174 consensus_queue.cc:260] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.524470 1173 tablet_bootstrap.cc:654] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.524590 1174 ts_tablet_manager.cc:1434] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:23.524998 1174 tablet_bootstrap.cc:492] T b69dd1653a304f3d99346e89dacf9208 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:23.526790 1174 tablet_bootstrap.cc:654] T b69dd1653a304f3d99346e89dacf9208 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.527225 1172 tablet_bootstrap.cc:492] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:23.527410 1172 ts_tablet_manager.cc:1403] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.003s
I20260318 02:51:23.528288 1172 raft_consensus.cc:359] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.524446 1176 raft_consensus.cc:2272] T 32880a703603476786b4a34ddd40cab8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.528524 1172 raft_consensus.cc:385] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.528620 1172 raft_consensus.cc:740] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.528913 1172 consensus_queue.cc:260] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.529348 1176 ts_tablet_manager.cc:1916] T 32880a703603476786b4a34ddd40cab8 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:23.529573 1172 ts_tablet_manager.cc:1434] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:23.529996 1172 tablet_bootstrap.cc:492] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:23.530287 1175 tablet_replica.cc:333] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
W20260318 02:51:23.530313 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2304246c244407b9d4eb301ac5d7ba9 consensus state has no leader
I20260318 02:51:23.530637 1175 raft_consensus.cc:2243] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:23.532358 1172 tablet_bootstrap.cc:654] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.532953 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2bd6ac47ba044099ad9bd211ef8d26a2
I20260318 02:51:23.533361 1175 pending_rounds.cc:70] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18: Trying to abort 1 pending ops.
I20260318 02:51:23.533524 452 catalog_manager.cc:6741] ReplaceTablet: tablet 2bd6ac47ba044099ad9bd211ef8d26a2 deleted and replaced by tablet 7c4eca5e16f84564b31933b8227fd980
I20260318 02:51:23.533516 1175 pending_rounds.cc:77] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494152876113920 op_type: NO_OP noop_request { }
I20260318 02:51:23.533787 1175 raft_consensus.cc:2889] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:23.533962 1175 raft_consensus.cc:2272] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.534922 1175 ts_tablet_manager.cc:1916] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:23.535501 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8b0935ef185c46f8ba4fe96e60fad278"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:23.536264 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 6e9372f8871b473caa024512e936a6e5
I20260318 02:51:23.536742 457 catalog_manager.cc:6741] ReplaceTablet: tablet 6e9372f8871b473caa024512e936a6e5 deleted and replaced by tablet 20c6f1790ed34581b7507ec63ec66718
I20260318 02:51:23.537159 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0fa2447b80b545388441838507fc117c" } new_table_name: "default.Table_b1f7648e9f33494297265d436ecd65b0" modify_external_catalogs: true
W20260318 02:51:23.538803 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2adcc9f1ad69458c997475111bb787cf consensus state has no leader
I20260318 02:51:23.539268 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_bd0d5769f59b4b0d87629167dcf22094"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:23.539888 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd0d5769f59b4b0d87629167dcf22094 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.541630 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b52460621ef542dfae054fcaba6fed13" } new_table_name: "default.Table_9c0322ee5c694253958b5d9583c3708e" modify_external_catalogs: true
I20260318 02:51:23.541950 1172 tablet_bootstrap.cc:492] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:23.542106 1172 ts_tablet_manager.cc:1403] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.006s
I20260318 02:51:23.542912 1172 raft_consensus.cc:359] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.543090 1172 raft_consensus.cc:385] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.543176 1172 raft_consensus.cc:740] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.543336 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d469c0a03b6c480693974a3f51fc5662" } new_table_name: "default.Table_1d2a493334714a809ca348d380f97577" modify_external_catalogs: true
I20260318 02:51:23.543409 1172 consensus_queue.cc:260] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.543998 1174 tablet_bootstrap.cc:492] T b69dd1653a304f3d99346e89dacf9208 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:23.544152 1174 ts_tablet_manager.cc:1403] T b69dd1653a304f3d99346e89dacf9208 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.002s
I20260318 02:51:23.544206 1172 ts_tablet_manager.cc:1434] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:23.544510 1172 tablet_bootstrap.cc:492] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:23.544826 450 master_service.cc:954] ReplaceTablet: received request to replace tablet af802894346443669f1cc549a1ba401b from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:23.545073 1174 raft_consensus.cc:359] T b69dd1653a304f3d99346e89dacf9208 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.545257 1174 raft_consensus.cc:385] T b69dd1653a304f3d99346e89dacf9208 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.545709 1174 raft_consensus.cc:740] T b69dd1653a304f3d99346e89dacf9208 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.545953 1174 consensus_queue.cc:260] T b69dd1653a304f3d99346e89dacf9208 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.546550 1174 ts_tablet_manager.cc:1434] T b69dd1653a304f3d99346e89dacf9208 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260318 02:51:23.547055 1172 tablet_bootstrap.cc:654] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.550988 1175 ts_tablet_manager.cc:1929] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:23.551141 1175 log.cc:1199] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/c23b646a132743cc9b4dcd85c6d4ebea
I20260318 02:51:23.551659 1175 ts_tablet_manager.cc:1950] T c23b646a132743cc9b4dcd85c6d4ebea P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:23.555227 1176 ts_tablet_manager.cc:1929] T 32880a703603476786b4a34ddd40cab8 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:23.555513 1172 tablet_bootstrap.cc:492] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:23.555704 1172 ts_tablet_manager.cc:1403] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.003s
I20260318 02:51:23.555483 1176 log.cc:1199] T 32880a703603476786b4a34ddd40cab8 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/32880a703603476786b4a34ddd40cab8
I20260318 02:51:23.556551 1173 tablet_bootstrap.cc:492] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:23.555982 1174 tablet_bootstrap.cc:492] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:23.556803 1173 ts_tablet_manager.cc:1403] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.002s
I20260318 02:51:23.557715 1173 raft_consensus.cc:359] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.558023 1173 raft_consensus.cc:385] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.558270 1172 raft_consensus.cc:359] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.558387 1173 raft_consensus.cc:740] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.558497 1172 raft_consensus.cc:385] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.558568 1172 raft_consensus.cc:740] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.558938 1174 tablet_bootstrap.cc:654] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.558856 1173 consensus_queue.cc:260] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.559381 1173 ts_tablet_manager.cc:1434] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:23.559718 1173 tablet_bootstrap.cc:492] T 0e4719eafd2947bfacf3e1d2df1ae43e P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:23.560194 1176 ts_tablet_manager.cc:1950] T 32880a703603476786b4a34ddd40cab8 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:23.561442 1173 tablet_bootstrap.cc:654] T 0e4719eafd2947bfacf3e1d2df1ae43e P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.561973 1176 tablet_replica.cc:333] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:23.562242 1176 raft_consensus.cc:2243] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:23.562754 1176 raft_consensus.cc:2272] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.563086 1172 consensus_queue.cc:260] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.563578 1176 ts_tablet_manager.cc:1916] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:23.563903 1172 ts_tablet_manager.cc:1434] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.008s user 0.002s sys 0.002s
I20260318 02:51:23.564656 1172 tablet_bootstrap.cc:492] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:23.566367 1172 tablet_bootstrap.cc:654] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.570613 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet d4a54d0daa9f48a89b3f114367750826
I20260318 02:51:23.571061 448 catalog_manager.cc:6741] ReplaceTablet: tablet d4a54d0daa9f48a89b3f114367750826 deleted and replaced by tablet 061ebb62f4c54a2a8c24b90ec15402d3
I20260318 02:51:23.573175 1422 raft_consensus.cc:493] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:23.573346 1422 raft_consensus.cc:515] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:23.574009 1422 leader_election.cc:290] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:23.574306 1172 tablet_bootstrap.cc:492] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:23.574599 1172 ts_tablet_manager.cc:1403] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.003s
I20260318 02:51:23.575421 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dadf0fc6e134edd87788dd4ade59dc5" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:23.575700 785 raft_consensus.cc:2468] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:23.576043 1172 raft_consensus.cc:359] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.576134 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dadf0fc6e134edd87788dd4ade59dc5" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:23.576229 1172 raft_consensus.cc:385] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.576318 1172 raft_consensus.cc:740] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.576541 1172 consensus_queue.cc:260] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:23.576951 860 leader_election.cc:343] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:23.577273 1172 ts_tablet_manager.cc:1434] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:23.577370 862 leader_election.cc:304] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:23.577654 1172 tablet_bootstrap.cc:492] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:23.578039 1422 raft_consensus.cc:2804] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:23.578177 1422 raft_consensus.cc:493] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:23.578262 1422 raft_consensus.cc:3060] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.580051 1172 tablet_bootstrap.cc:654] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:23.580868 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b0935ef185c46f8ba4fe96e60fad278 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.581133 1422 raft_consensus.cc:515] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:23.582472 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dadf0fc6e134edd87788dd4ade59dc5" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:23.582702 785 raft_consensus.cc:3060] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.584676 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 2bd6ac47ba044099ad9bd211ef8d26a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 7c4eca5e16f84564b31933b8227fd980) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.585506 785 raft_consensus.cc:2468] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:23.586160 862 leader_election.cc:304] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:23.586481 1423 raft_consensus.cc:2804] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:23.586623 1423 raft_consensus.cc:697] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:23.586874 1423 consensus_queue.cc:237] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:23.587766 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e9372f8871b473caa024512e936a6e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 20c6f1790ed34581b7507ec63ec66718) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.588397 756 tablet_service.cc:1558] Processing DeleteTablet for tablet d604cd634a1c470ba3896cf02d2804d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.588995 1172 tablet_bootstrap.cc:492] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:23.589185 1172 ts_tablet_manager.cc:1403] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.002s
I20260318 02:51:23.589255 756 tablet_service.cc:1558] Processing DeleteTablet for tablet b69dd1653a304f3d99346e89dacf9208 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.589763 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 74233fd7ed094e7cbfc79309605db0e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.590021 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dadf0fc6e134edd87788dd4ade59dc5" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:23.590023 1172 raft_consensus.cc:359] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:23.590271 1172 raft_consensus.cc:385] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.590351 1172 raft_consensus.cc:740] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.590396 756 tablet_service.cc:1558] Processing DeleteTablet for tablet d4a54d0daa9f48a89b3f114367750826 with delete_type TABLET_DATA_DELETED (replaced by tablet 061ebb62f4c54a2a8c24b90ec15402d3) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:23.590595 860 leader_election.cc:343] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:23.590601 1172 consensus_queue.cc:260] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:23.591027 1422 leader_election.cc:290] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:23.591178 1172 ts_tablet_manager.cc:1434] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:23.591524 1172 tablet_bootstrap.cc:492] T 4dadf0fc6e134edd87788dd4ade59dc5 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:23.592602 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 32880a703603476786b4a34ddd40cab8 (table default.Table_82b90b9eec6a4252b7022e3cf497374c [id=f63cc6603c274afba2cb3ae1228ed566]) successfully deleted
W20260318 02:51:23.593031 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2c5038e9e1074f46976a1a5bb4282944 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c5038e9e1074f46976a1a5bb4282944 already in progress: creating tablet
I20260318 02:51:23.593242 1172 tablet_bootstrap.cc:654] T 4dadf0fc6e134edd87788dd4ade59dc5 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:23.593468 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet d1a884fde2c145518a2cb14b7780b6dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1a884fde2c145518a2cb14b7780b6dd already in progress: creating tablet
I20260318 02:51:23.597325 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 2bd6ac47ba044099ad9bd211ef8d26a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 7c4eca5e16f84564b31933b8227fd980) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:23.597453 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 2bd6ac47ba044099ad9bd211ef8d26a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 7c4eca5e16f84564b31933b8227fd980) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:23.600303 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e421d3fe62b4985bfe0486a4b115b2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:23.601048 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e9372f8871b473caa024512e936a6e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 20c6f1790ed34581b7507ec63ec66718) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:23.601526 1172 tablet_bootstrap.cc:492] T 4dadf0fc6e134edd87788dd4ade59dc5 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:23.601675 1172 ts_tablet_manager.cc:1403] T 4dadf0fc6e134edd87788dd4ade59dc5 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260318 02:51:23.601792 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e9372f8871b473caa024512e936a6e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 20c6f1790ed34581b7507ec63ec66718) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:23.602614 1172 raft_consensus.cc:359] T 4dadf0fc6e134edd87788dd4ade59dc5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:23.602818 1172 raft_consensus.cc:385] T 4dadf0fc6e134edd87788dd4ade59dc5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.603456 1172 raft_consensus.cc:740] T 4dadf0fc6e134edd87788dd4ade59dc5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.603719 1172 consensus_queue.cc:260] T 4dadf0fc6e134edd87788dd4ade59dc5 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:23.604430 1172 ts_tablet_manager.cc:1434] T 4dadf0fc6e134edd87788dd4ade59dc5 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:23.604921 1172 tablet_bootstrap.cc:492] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:23.606760 1172 tablet_bootstrap.cc:654] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.607784 1176 ts_tablet_manager.cc:1929] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:23.608827 1176 log.cc:1199] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/41bc1c926c0f4ef2a4c9c52d991f8f0d
I20260318 02:51:23.609542 1176 ts_tablet_manager.cc:1950] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:23.611469 1176 tablet_replica.cc:333] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:23.611549 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d (table default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666]) successfully deleted
W20260318 02:51:23.611969 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 666c2992fa4f479ab4ffd7ac0c3a9c92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 666c2992fa4f479ab4ffd7ac0c3a9c92 already in progress: creating tablet
W20260318 02:51:23.612406 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 93479517a1d34d2d99633018a6a57127 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 93479517a1d34d2d99633018a6a57127 already in progress: creating tablet
I20260318 02:51:23.613026 1176 raft_consensus.cc:2243] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:23.613512 1176 raft_consensus.cc:2272] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.614267 1176 ts_tablet_manager.cc:1916] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:23.614871 1172 tablet_bootstrap.cc:492] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:23.615059 1172 ts_tablet_manager.cc:1403] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.003s
I20260318 02:51:23.616003 1172 raft_consensus.cc:359] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.616202 1172 raft_consensus.cc:385] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.616297 1172 raft_consensus.cc:740] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.616611 1184 ts_tablet_manager.cc:1929] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:23.616566 1172 consensus_queue.cc:260] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.616904 1184 log.cc:1199] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/53e66044bfed4b53a1c0bc4dc8de52e6
I20260318 02:51:23.617302 1172 ts_tablet_manager.cc:1434] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:23.618033 1172 tablet_bootstrap.cc:492] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:23.619786 1184 ts_tablet_manager.cc:1950] T 53e66044bfed4b53a1c0bc4dc8de52e6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:23.621506 889 tablet_service.cc:1558] Processing DeleteTablet for tablet d4a54d0daa9f48a89b3f114367750826 with delete_type TABLET_DATA_DELETED (replaced by tablet 061ebb62f4c54a2a8c24b90ec15402d3) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:23.622474 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 053a09fd13fa4d8e80133fd77acaa4ce (table default.Table_bb21feccea674d3e8845f95753367aa8 [id=3a77e587db534e32b2716d153a8419cd]) successfully deleted
W20260318 02:51:23.622706 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 0d343e53f2354a3386b19d71ef00d5a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d343e53f2354a3386b19d71ef00d5a4 already in progress: creating tablet
W20260318 02:51:23.622900 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet b716c3a80d4a44d190de38f926098efc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b716c3a80d4a44d190de38f926098efc already in progress: creating tablet
W20260318 02:51:23.623061 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet bf09f8234f36402bb9129d524637b5b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf09f8234f36402bb9129d524637b5b5 already in progress: creating tablet
I20260318 02:51:23.623271 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet c23b646a132743cc9b4dcd85c6d4ebea (table default.Table_480631505a694fa2846e96ba417fcb1f [id=fbcfb142ee75458b9f3008dcc9c7e06d]) successfully deleted
W20260318 02:51:23.623462 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2bd6ac47ba044099ad9bd211ef8d26a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2bd6ac47ba044099ad9bd211ef8d26a2 already in progress: creating tablet
W20260318 02:51:23.623654 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 6e9372f8871b473caa024512e936a6e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e9372f8871b473caa024512e936a6e5 already in progress: creating tablet
W20260318 02:51:23.623821 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet d4a54d0daa9f48a89b3f114367750826 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4a54d0daa9f48a89b3f114367750826 already in progress: creating tablet
I20260318 02:51:23.626296 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f6489e5e0d7f47cb889864d493a7b77c" } modify_external_catalogs: true
I20260318 02:51:23.626482 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f6489e5e0d7f47cb889864d493a7b77c" } modify_external_catalogs: true
I20260318 02:51:23.627008 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2d7043580f83421ca8d7039923dc441e" } modify_external_catalogs: true
I20260318 02:51:23.627084 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_80f976f24d184e2cbaf4f63b8495c8ab" } modify_external_catalogs: true
I20260318 02:51:23.627200 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_80f976f24d184e2cbaf4f63b8495c8ab" } modify_external_catalogs: true
I20260318 02:51:23.627177 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2d7043580f83421ca8d7039923dc441e" } modify_external_catalogs: true
I20260318 02:51:23.628592 1176 ts_tablet_manager.cc:1929] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:23.630235 1176 log.cc:1199] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/053a09fd13fa4d8e80133fd77acaa4ce
I20260318 02:51:23.630626 1176 ts_tablet_manager.cc:1950] T 053a09fd13fa4d8e80133fd77acaa4ce P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:23.632144 1176 tablet_replica.cc:333] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:23.632314 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 053a09fd13fa4d8e80133fd77acaa4ce (table default.Table_bb21feccea674d3e8845f95753367aa8 [id=3a77e587db534e32b2716d153a8419cd]) successfully deleted
I20260318 02:51:23.633384 1176 raft_consensus.cc:2243] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:23.633584 1176 raft_consensus.cc:2272] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.634707 1176 ts_tablet_manager.cc:1916] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:23.637259 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3868406102b748a5b13420b24bf16485 consensus state has no leader
I20260318 02:51:23.640885 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 53e66044bfed4b53a1c0bc4dc8de52e6 (table default.Table_6b0fdcb080ea4a6b97f51308598362be [id=3ce1c72a2d4e42c698e85d5034d873e0]) successfully deleted
I20260318 02:51:23.641609 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bc4b73281db84d099008d5b137871ff9" } modify_external_catalogs: true
I20260318 02:51:23.641798 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bc4b73281db84d099008d5b137871ff9" } modify_external_catalogs: true
I20260318 02:51:23.642164 1184 tablet_replica.cc:333] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:23.642376 1184 raft_consensus.cc:2243] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:23.642567 1184 raft_consensus.cc:2272] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.643020 1184 ts_tablet_manager.cc:1916] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:23.620450 1172 tablet_bootstrap.cc:654] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.621363 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet d4a54d0daa9f48a89b3f114367750826 with delete_type TABLET_DATA_DELETED (replaced by tablet 061ebb62f4c54a2a8c24b90ec15402d3) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:23.648531 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf27c8d69f41431e9fab12e605e15b9c consensus state has no leader
W20260318 02:51:23.650112 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e57dbb1276114cd6b7d26f7167b99f25 consensus state has no leader
I20260318 02:51:23.650533 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5ffb8d228c5745e19ab88df19ce659c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:23.651136 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ffb8d228c5745e19ab88df19ce659c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.652024 454 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 549b3929ea33417bbe50e749bbfe223d (table default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]). Expected version 2 got 0
I20260318 02:51:23.652240 454 catalog_manager.cc:5671] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 reported cstate change: term changed from 0 to 1, leader changed from <none> to b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130). New cstate: current_term: 1 leader_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:23.652755 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9a44c965ec574cae8cced06f58d02bff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:23.653327 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a44c965ec574cae8cced06f58d02bff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.654717 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e062855442004fd6b375792097f6c98c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:23.655207 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e062855442004fd6b375792097f6c98c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.657075 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5e18692d41ef4f6b9ac36936944042f7" } modify_external_catalogs: true
I20260318 02:51:23.657275 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5e18692d41ef4f6b9ac36936944042f7" } modify_external_catalogs: true
I20260318 02:51:23.659080 756 tablet_service.cc:1511] Processing CreateTablet for tablet 3fccf1f2bc3547e9ba8cc5fe9419f70b (DEFAULT_TABLE table=default.Table_3ca80b83e6d7423fb22529c4b0d1391f [id=f282f0ee83114539bad2c36e8311e05e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.660017 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fccf1f2bc3547e9ba8cc5fe9419f70b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.665406 758 tablet_service.cc:1511] Processing CreateTablet for tablet 065ebc3c000a4ad3873ee031ecf9986b (DEFAULT_TABLE table=default.Table_a1fc9d74bf8b4be5a48c0480aa55d189 [id=62eb3b210f764eaaa081488904cf8aa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.665884 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 065ebc3c000a4ad3873ee031ecf9986b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.666191 752 tablet_service.cc:1511] Processing CreateTablet for tablet 3348b200e5ca4f6ebecb2c25ddbe27bf (DEFAULT_TABLE table=default.Table_1e921769921d4b0281a7699560d75010 [id=a1ea27c3f8534259bceaa1300242640a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.666589 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3348b200e5ca4f6ebecb2c25ddbe27bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.666604 1173 tablet_bootstrap.cc:492] T 0e4719eafd2947bfacf3e1d2df1ae43e P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:23.666739 1173 ts_tablet_manager.cc:1403] T 0e4719eafd2947bfacf3e1d2df1ae43e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.107s user 0.006s sys 0.026s
I20260318 02:51:23.667526 1173 raft_consensus.cc:359] T 0e4719eafd2947bfacf3e1d2df1ae43e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.667697 1173 raft_consensus.cc:385] T 0e4719eafd2947bfacf3e1d2df1ae43e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.667770 1173 raft_consensus.cc:740] T 0e4719eafd2947bfacf3e1d2df1ae43e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.667987 1173 consensus_queue.cc:260] T 0e4719eafd2947bfacf3e1d2df1ae43e P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.669034 764 tablet_service.cc:1511] Processing CreateTablet for tablet 5ffcfc0784d947419fc9b22aa636521c (DEFAULT_TABLE table=default.Table_c7ff1bf8d29b485f92f33882f86219e5 [id=d78c0f7eaa0743c784b4562452ff7c65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.669267 754 tablet_service.cc:1511] Processing CreateTablet for tablet 785f6728f94d41f3997961e3d1ebee34 (DEFAULT_TABLE table=default.Table_9a40c252bf664c028621b2e116ccc09a [id=f6fae39c375b41e096459fe397b69b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.669430 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ffcfc0784d947419fc9b22aa636521c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.669627 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 785f6728f94d41f3997961e3d1ebee34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.669935 762 tablet_service.cc:1511] Processing CreateTablet for tablet 900c6ef2dc634a788239dd5b77c4bde0 (DEFAULT_TABLE table=default.Table_c2d16f88924544cbaf4ed64b9c5bc7a6 [id=8749d9c9086f43a99348c9bfe995e6e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.670300 1173 ts_tablet_manager.cc:1434] T 0e4719eafd2947bfacf3e1d2df1ae43e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:23.670593 889 tablet_service.cc:1511] Processing CreateTablet for tablet 3fccf1f2bc3547e9ba8cc5fe9419f70b (DEFAULT_TABLE table=default.Table_3ca80b83e6d7423fb22529c4b0d1391f [id=f282f0ee83114539bad2c36e8311e05e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.671083 1173 tablet_bootstrap.cc:492] T 96a854e3872c44e4863316c9fe5f2ee9 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:23.671137 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 900c6ef2dc634a788239dd5b77c4bde0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.669047 760 tablet_service.cc:1511] Processing CreateTablet for tablet b8a46b4db30a48c99addf763f7edfb16 (DEFAULT_TABLE table=default.Table_25494285095147fa885f1aa79e2f1722 [id=6f9a87f338414f20bb3969d3c3cdfa64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.672292 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8a46b4db30a48c99addf763f7edfb16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.672978 1173 tablet_bootstrap.cc:654] T 96a854e3872c44e4863316c9fe5f2ee9 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.676779 757 tablet_service.cc:1511] Processing CreateTablet for tablet e1d804f5e9564f6d83efb77e6c18724b (DEFAULT_TABLE table=default.Table_017276a514464042a76dbff62faa6f82 [id=61b10b92b10b48a4a139b129f8797ea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.677145 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d804f5e9564f6d83efb77e6c18724b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.677456 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fccf1f2bc3547e9ba8cc5fe9419f70b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.690922 895 tablet_service.cc:1511] Processing CreateTablet for tablet 065ebc3c000a4ad3873ee031ecf9986b (DEFAULT_TABLE table=default.Table_a1fc9d74bf8b4be5a48c0480aa55d189 [id=62eb3b210f764eaaa081488904cf8aa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.691383 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 065ebc3c000a4ad3873ee031ecf9986b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.692077 1414 raft_consensus.cc:493] T 4dadf0fc6e134edd87788dd4ade59dc5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:23.692250 1414 raft_consensus.cc:515] T 4dadf0fc6e134edd87788dd4ade59dc5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:23.693511 1414 leader_election.cc:290] T 4dadf0fc6e134edd87788dd4ade59dc5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:23.693650 1414 raft_consensus.cc:493] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:23.693781 1414 raft_consensus.cc:515] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.694242 1414 leader_election.cc:290] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:23.697117 901 tablet_service.cc:1511] Processing CreateTablet for tablet e1d804f5e9564f6d83efb77e6c18724b (DEFAULT_TABLE table=default.Table_017276a514464042a76dbff62faa6f82 [id=61b10b92b10b48a4a139b129f8797ea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.697520 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d804f5e9564f6d83efb77e6c18724b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.701000 907 tablet_service.cc:1511] Processing CreateTablet for tablet 3348b200e5ca4f6ebecb2c25ddbe27bf (DEFAULT_TABLE table=default.Table_1e921769921d4b0281a7699560d75010 [id=a1ea27c3f8534259bceaa1300242640a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.701366 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3348b200e5ca4f6ebecb2c25ddbe27bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.701922 1172 tablet_bootstrap.cc:492] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:23.702075 1172 ts_tablet_manager.cc:1403] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.084s user 0.004s sys 0.009s
I20260318 02:51:23.702898 1172 raft_consensus.cc:359] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.703084 1172 raft_consensus.cc:385] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.703176 1172 raft_consensus.cc:740] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.703436 1172 consensus_queue.cc:260] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.704092 1172 ts_tablet_manager.cc:1434] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:23.705376 1172 tablet_bootstrap.cc:492] T 22caed5f1870469d834aecd2bc42bdda P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:23.705968 892 tablet_service.cc:1511] Processing CreateTablet for tablet b8a46b4db30a48c99addf763f7edfb16 (DEFAULT_TABLE table=default.Table_25494285095147fa885f1aa79e2f1722 [id=6f9a87f338414f20bb3969d3c3cdfa64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.706362 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8a46b4db30a48c99addf763f7edfb16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.707468 1172 tablet_bootstrap.cc:654] T 22caed5f1870469d834aecd2bc42bdda P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.709046 904 tablet_service.cc:1511] Processing CreateTablet for tablet 785f6728f94d41f3997961e3d1ebee34 (DEFAULT_TABLE table=default.Table_9a40c252bf664c028621b2e116ccc09a [id=f6fae39c375b41e096459fe397b69b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.709429 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 785f6728f94d41f3997961e3d1ebee34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.709789 1184 ts_tablet_manager.cc:1929] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:23.709910 1184 log.cc:1199] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/7e4e8586673c43058ef00f2f7aef10ee
I20260318 02:51:23.710325 1184 ts_tablet_manager.cc:1950] T 7e4e8586673c43058ef00f2f7aef10ee P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:23.712056 1184 tablet_replica.cc:333] T 54bffc30199246fd93edf7486b2e3a91 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:23.712306 1184 raft_consensus.cc:2243] T 54bffc30199246fd93edf7486b2e3a91 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:23.712481 1184 raft_consensus.cc:2272] T 54bffc30199246fd93edf7486b2e3a91 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.713135 906 tablet_service.cc:1511] Processing CreateTablet for tablet 5ffcfc0784d947419fc9b22aa636521c (DEFAULT_TABLE table=default.Table_c7ff1bf8d29b485f92f33882f86219e5 [id=d78c0f7eaa0743c784b4562452ff7c65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.713526 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ffcfc0784d947419fc9b22aa636521c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.715197 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dadf0fc6e134edd87788dd4ade59dc5" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:23.715903 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 7e4e8586673c43058ef00f2f7aef10ee (table default.Table_bbda0f6b8794401899207ea245bdbc25 [id=e8cc0e7ae9214cc6bfcb635c00ae4090]) successfully deleted
W20260318 02:51:23.716403 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2c5038e9e1074f46976a1a5bb4282944 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c5038e9e1074f46976a1a5bb4282944 already in progress: creating tablet
W20260318 02:51:23.716940 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet e3999f53c1cc4cb5a1d91eed23785cc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e3999f53c1cc4cb5a1d91eed23785cc6 already in progress: creating tablet
I20260318 02:51:23.717079 903 tablet_service.cc:1511] Processing CreateTablet for tablet 900c6ef2dc634a788239dd5b77c4bde0 (DEFAULT_TABLE table=default.Table_c2d16f88924544cbaf4ed64b9c5bc7a6 [id=8749d9c9086f43a99348c9bfe995e6e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.717515 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 900c6ef2dc634a788239dd5b77c4bde0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:23.717761 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet af793623466249e695b262ab451d4dc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af793623466249e695b262ab451d4dc9 already in progress: creating tablet
W20260318 02:51:23.717988 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 547762347d7843e989e55e0449ad9fcb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 547762347d7843e989e55e0449ad9fcb already in progress: creating tablet
W20260318 02:51:23.718174 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f5a829abed0444b79c48ab080d024824 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5a829abed0444b79c48ab080d024824 already in progress: creating tablet
W20260318 02:51:23.718344 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet d1a884fde2c145518a2cb14b7780b6dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1a884fde2c145518a2cb14b7780b6dd already in progress: creating tablet
I20260318 02:51:23.718851 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 3fccf1f2bc3547e9ba8cc5fe9419f70b (DEFAULT_TABLE table=default.Table_3ca80b83e6d7423fb22529c4b0d1391f [id=f282f0ee83114539bad2c36e8311e05e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.719336 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fccf1f2bc3547e9ba8cc5fe9419f70b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.722844 1467 raft_consensus.cc:493] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:23.723024 1467 raft_consensus.cc:515] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.723836 1467 leader_election.cc:290] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:23.726850 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 29541950221544e396ada303fbbb5002
I20260318 02:51:23.727533 448 master_service.cc:954] ReplaceTablet: received request to replace tablet 323e4b1e9aee449f9402b1712b1444d9 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:23.727924 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 7883f526d06e442c81f1b66fd89d2cd0
I20260318 02:51:23.728292 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 08307bc69291479eb8ee0d7aec124829
I20260318 02:51:23.729117 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 7cfaf92570b34b2bb1f52aea06187c83
I20260318 02:51:23.729153 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f9bc73d3f85745ecb62d861b6375a987
I20260318 02:51:23.730247 451 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet e2304246c244407b9d4eb301ac5d7ba9 (table default.Table_fddbe89a9a524d028fba5877d8b23387 [id=20ed812002544f6f8caef448f7514f7c]). Expected version 4 got 0
I20260318 02:51:23.740383 454 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 549b3929ea33417bbe50e749bbfe223d (table default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]). Expected version 2 got 0
I20260318 02:51:23.741032 1467 raft_consensus.cc:493] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:23.741263 1467 raft_consensus.cc:515] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.741925 1467 leader_election.cc:290] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:23.697535 1173 tablet_bootstrap.cc:492] T 96a854e3872c44e4863316c9fe5f2ee9 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:23.744352 1173 ts_tablet_manager.cc:1403] T 96a854e3872c44e4863316c9fe5f2ee9 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.073s user 0.010s sys 0.002s
I20260318 02:51:23.748729 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 7883f526d06e442c81f1b66fd89d2cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.750360 907 tablet_service.cc:1558] Processing DeleteTablet for tablet f9bc73d3f85745ecb62d861b6375a987 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:23.750697 906 tablet_service.cc:1558] Processing DeleteTablet for tablet c23b646a132743cc9b4dcd85c6d4ebea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:23.751070 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 7883f526d06e442c81f1b66fd89d2cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:23.750939 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cfaf92570b34b2bb1f52aea06187c83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:23.750828 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 08307bc69291479eb8ee0d7aec124829 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:23.751371 892 tablet_service.cc:1558] Processing DeleteTablet for tablet f1ed26420c64492a94e8920d8c753fc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:23.753355 1175 tablet_replica.cc:333] T f1ed26420c64492a94e8920d8c753fc3 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:23.753600 1175 raft_consensus.cc:2243] T f1ed26420c64492a94e8920d8c753fc3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:23.753772 1175 raft_consensus.cc:2272] T f1ed26420c64492a94e8920d8c753fc3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.751577 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 29541950221544e396ada303fbbb5002 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:23.754287 1173 raft_consensus.cc:359] T 96a854e3872c44e4863316c9fe5f2ee9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.754570 1175 ts_tablet_manager.cc:1916] T f1ed26420c64492a94e8920d8c753fc3 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:23.754601 999 leader_election.cc:343] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: f7415ddf48574f7b9a746049ce78d2e9
I20260318 02:51:23.755405 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dadf0fc6e134edd87788dd4ade59dc5" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:23.755285 451 catalog_manager.cc:5671] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 reported cstate change: term changed from 0 to 1, leader changed from <none> to b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130). New cstate: current_term: 1 leader_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:23.755671 785 raft_consensus.cc:2393] T 4dadf0fc6e134edd87788dd4ade59dc5 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9422bb7011f342b08be0b073a88c4c4d in current term 1: Already voted for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in this term.
I20260318 02:51:23.755864 451 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet e2304246c244407b9d4eb301ac5d7ba9 (table default.Table_fddbe89a9a524d028fba5877d8b23387 [id=20ed812002544f6f8caef448f7514f7c]). Expected version 4 got 0
I20260318 02:51:23.756068 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cfaf92570b34b2bb1f52aea06187c83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:23.757133 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f9bc73d3f85745ecb62d861b6375a987 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9bc73d3f85745ecb62d861b6375a987 already in progress: creating tablet
W20260318 02:51:23.757165 999 leader_election.cc:343] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 76fc930611024211a70301bcfd92884e
W20260318 02:51:23.757359 999 leader_election.cc:343] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 0e4719eafd2947bfacf3e1d2df1ae43e
W20260318 02:51:23.757427 441 catalog_manager.cc:4969] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet c23b646a132743cc9b4dcd85c6d4ebea because the tablet was not found. No further retry: Not found: Tablet not found: c23b646a132743cc9b4dcd85c6d4ebea
W20260318 02:51:23.757620 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 7cfaf92570b34b2bb1f52aea06187c83 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cfaf92570b34b2bb1f52aea06187c83 already in progress: creating tablet
W20260318 02:51:23.757790 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 08307bc69291479eb8ee0d7aec124829 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08307bc69291479eb8ee0d7aec124829 already in progress: creating tablet
W20260318 02:51:23.758096 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 7883f526d06e442c81f1b66fd89d2cd0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7883f526d06e442c81f1b66fd89d2cd0 already in progress: creating tablet
I20260318 02:51:23.759220 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 065ebc3c000a4ad3873ee031ecf9986b (DEFAULT_TABLE table=default.Table_a1fc9d74bf8b4be5a48c0480aa55d189 [id=62eb3b210f764eaaa081488904cf8aa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.759595 766 tablet_service.cc:1558] Processing DeleteTablet for tablet f9bc73d3f85745ecb62d861b6375a987 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.759680 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 065ebc3c000a4ad3873ee031ecf9986b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.760823 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 08307bc69291479eb8ee0d7aec124829 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.761240 1044 tablet_service.cc:1511] Processing CreateTablet for tablet e1d804f5e9564f6d83efb77e6c18724b (DEFAULT_TABLE table=default.Table_017276a514464042a76dbff62faa6f82 [id=61b10b92b10b48a4a139b129f8797ea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.761653 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d804f5e9564f6d83efb77e6c18724b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.762856 1175 ts_tablet_manager.cc:1929] T f1ed26420c64492a94e8920d8c753fc3 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:23.763010 1175 log.cc:1199] T f1ed26420c64492a94e8920d8c753fc3 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/f1ed26420c64492a94e8920d8c753fc3
I20260318 02:51:23.763252 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 29541950221544e396ada303fbbb5002 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.763948 1175 ts_tablet_manager.cc:1950] T f1ed26420c64492a94e8920d8c753fc3 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:23.765098 1173 raft_consensus.cc:385] T 96a854e3872c44e4863316c9fe5f2ee9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.765275 1173 raft_consensus.cc:740] T 96a854e3872c44e4863316c9fe5f2ee9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.765625 1173 consensus_queue.cc:260] T 96a854e3872c44e4863316c9fe5f2ee9 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.768784 1467 raft_consensus.cc:493] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:23.766395 1173 ts_tablet_manager.cc:1434] T 96a854e3872c44e4863316c9fe5f2ee9 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.022s user 0.000s sys 0.002s
I20260318 02:51:23.768951 1467 raft_consensus.cc:515] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.770175 1173 tablet_bootstrap.cc:492] T 32880a703603476786b4a34ddd40cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:23.773272 1467 leader_election.cc:290] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:23.774453 1174 tablet_bootstrap.cc:492] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:23.774638 1174 ts_tablet_manager.cc:1403] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.219s user 0.008s sys 0.016s
I20260318 02:51:23.774679 1176 ts_tablet_manager.cc:1929] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:23.775173 1041 tablet_service.cc:1511] Processing CreateTablet for tablet b8a46b4db30a48c99addf763f7edfb16 (DEFAULT_TABLE table=default.Table_25494285095147fa885f1aa79e2f1722 [id=6f9a87f338414f20bb3969d3c3cdfa64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.775470 1173 tablet_bootstrap.cc:654] T 32880a703603476786b4a34ddd40cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.775993 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet f1ed26420c64492a94e8920d8c753fc3 (table default.Table_70e2f45a75724db48820714e88bbb17d [id=50ab4db1dbeb4c6a90b33535047daa51]) successfully deleted
W20260318 02:51:23.776057 999 leader_election.cc:343] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 96a854e3872c44e4863316c9fe5f2ee9
W20260318 02:51:23.776326 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 29541950221544e396ada303fbbb5002 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29541950221544e396ada303fbbb5002 already in progress: creating tablet
I20260318 02:51:23.776487 1176 log.cc:1199] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/15aaa0f335ed4e828e2c0f0ffde4b6ba
I20260318 02:51:23.776510 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 900c6ef2dc634a788239dd5b77c4bde0 (DEFAULT_TABLE table=default.Table_c2d16f88924544cbaf4ed64b9c5bc7a6 [id=8749d9c9086f43a99348c9bfe995e6e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.776930 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 3348b200e5ca4f6ebecb2c25ddbe27bf (DEFAULT_TABLE table=default.Table_1e921769921d4b0281a7699560d75010 [id=a1ea27c3f8534259bceaa1300242640a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.776990 1176 ts_tablet_manager.cc:1950] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:23.777119 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 785f6728f94d41f3997961e3d1ebee34 (DEFAULT_TABLE table=default.Table_9a40c252bf664c028621b2e116ccc09a [id=f6fae39c375b41e096459fe397b69b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.778179 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba (table default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]) successfully deleted
I20260318 02:51:23.775475 1174 raft_consensus.cc:359] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.778275 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 5ffcfc0784d947419fc9b22aa636521c (DEFAULT_TABLE table=default.Table_c7ff1bf8d29b485f92f33882f86219e5 [id=d78c0f7eaa0743c784b4562452ff7c65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:23.778401 1174 raft_consensus.cc:385] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.778508 1174 raft_consensus.cc:740] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.778744 1174 consensus_queue.cc:260] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.779335 1174 ts_tablet_manager.cc:1434] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260318 02:51:23.780902 1174 tablet_bootstrap.cc:492] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:23.783409 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 29541950221544e396ada303fbbb5002 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:23.784904 1174 tablet_bootstrap.cc:654] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.786844 1176 tablet_replica.cc:333] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:23.787142 1176 raft_consensus.cc:2243] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:23.787441 1176 raft_consensus.cc:2272] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.788048 1176 ts_tablet_manager.cc:1916] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:23.788656 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet b716c3a80d4a44d190de38f926098efc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b716c3a80d4a44d190de38f926098efc already in progress: creating tablet
W20260318 02:51:23.788969 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet bf09f8234f36402bb9129d524637b5b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf09f8234f36402bb9129d524637b5b5 already in progress: creating tablet
I20260318 02:51:23.789549 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ff487cba236491eb22becf0dc591925 with delete_type TABLET_DATA_DELETED (replaced by tablet ab158343adb14eab85c595fa5405145d) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:23.788194 1174 tablet_bootstrap.cc:492] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:23.789956 1174 ts_tablet_manager.cc:1403] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.003s
I20260318 02:51:23.791008 1174 raft_consensus.cc:359] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.792280 1174 raft_consensus.cc:385] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.794909 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 7883f526d06e442c81f1b66fd89d2cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:23.798131 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet f1ed26420c64492a94e8920d8c753fc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:23.798961 1173 tablet_bootstrap.cc:492] T 32880a703603476786b4a34ddd40cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:23.799217 1173 ts_tablet_manager.cc:1403] T 32880a703603476786b4a34ddd40cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.004s
I20260318 02:51:23.799363 1490 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.104.188:41593 every 8 connection(s)
I20260318 02:51:23.799726 1280 rpc_server.cc:307] RPC server started. Bound to: 127.0.104.188:41593
I20260318 02:51:23.801786 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e4719eafd2947bfacf3e1d2df1ae43e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:23.802084 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a854e3872c44e4863316c9fe5f2ee9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:23.803470 1280 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data/info.pb
I20260318 02:51:23.803764 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3c92615f79714bbdb3c88e2c373ee91e" } new_table_name: "default.Table_230b6a19c7e444708603d97cc5d96155" modify_external_catalogs: true
I20260318 02:51:23.804044 418 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu as pid 1280
I20260318 02:51:23.807152 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7915e6d57ee1442c8b08ce6acc4a31b1" } new_table_name: "default.Table_c9fa61fd1bdb405f89a32f500da8f182" modify_external_catalogs: true
I20260318 02:51:23.810189 1175 tablet_replica.cc:333] T 0e4719eafd2947bfacf3e1d2df1ae43e P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:23.810447 1175 raft_consensus.cc:2243] T 0e4719eafd2947bfacf3e1d2df1ae43e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:23.810663 1175 raft_consensus.cc:2272] T 0e4719eafd2947bfacf3e1d2df1ae43e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.811475 1175 ts_tablet_manager.cc:1916] T 0e4719eafd2947bfacf3e1d2df1ae43e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:23.813030 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0047a213aefb4d9ca8f56c91c109b6a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:23.813675 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0047a213aefb4d9ca8f56c91c109b6a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.815565 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_35fa57e328b44e50b0d68b77bd7def72"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:23.816200 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35fa57e328b44e50b0d68b77bd7def72 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.817484 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4719eafd2947bfacf3e1d2df1ae43e" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:23.817685 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_708d1089f5f84e7999d353fda6b5985d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:23.818377 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_708d1089f5f84e7999d353fda6b5985d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.818360 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a854e3872c44e4863316c9fe5f2ee9" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:23.818593 926 raft_consensus.cc:2468] T 96a854e3872c44e4863316c9fe5f2ee9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:23.818692 1175 ts_tablet_manager.cc:1929] T 0e4719eafd2947bfacf3e1d2df1ae43e P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:23.820206 1175 log.cc:1199] T 0e4719eafd2947bfacf3e1d2df1ae43e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/0e4719eafd2947bfacf3e1d2df1ae43e
I20260318 02:51:23.821049 1175 ts_tablet_manager.cc:1950] T 0e4719eafd2947bfacf3e1d2df1ae43e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:23.821504 997 leader_election.cc:304] T 4dadf0fc6e134edd87788dd4ade59dc5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:23.825439 1467 raft_consensus.cc:3060] T 4dadf0fc6e134edd87788dd4ade59dc5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:23.827903 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b51a15e4303742a999fe9a96d450c827 consensus state has no leader
W20260318 02:51:23.828495 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2789a1195e7344c18dd226e196e2f302 consensus state has no leader
I20260318 02:51:23.830188 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_67969be821524f06922e86b98527c45b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:23.831027 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67969be821524f06922e86b98527c45b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.832391 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8a46b4db30a48c99addf763f7edfb16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.832912 1423 raft_consensus.cc:493] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:23.833065 1423 raft_consensus.cc:515] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.833781 1423 leader_election.cc:290] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:23.836542 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2304246c244407b9d4eb301ac5d7ba9" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:23.836786 1062 raft_consensus.cc:2468] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:23.836730 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f33dc646209c42f9859981dd48aed6ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:23.837426 860 leader_election.cc:304] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
W20260318 02:51:23.837605 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f33dc646209c42f9859981dd48aed6ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.838028 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 08307bc69291479eb8ee0d7aec124829 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:23.838253 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cfaf92570b34b2bb1f52aea06187c83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:23.838397 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet f9bc73d3f85745ecb62d861b6375a987 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:23.838539 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 76fc930611024211a70301bcfd92884e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:23.841998 1423 raft_consensus.cc:2804] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:23.842149 1423 raft_consensus.cc:493] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:23.842244 1423 raft_consensus.cc:3060] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.844158 456 master_service.cc:954] ReplaceTablet: received request to replace tablet b230018a95a54ababfe5ecf2ca1e2e49 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:23.844947 1422 raft_consensus.cc:493] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:23.845095 1422 raft_consensus.cc:515] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:23.845304 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 900c6ef2dc634a788239dd5b77c4bde0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.845683 1491 sys_catalog.cc:263] Verifying existing consensus state
I20260318 02:51:23.845830 1422 leader_election.cc:290] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:23.848923 1173 raft_consensus.cc:359] T 32880a703603476786b4a34ddd40cab8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.849444 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549b3929ea33417bbe50e749bbfe223d" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:23.849702 1062 raft_consensus.cc:2468] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:23.849864 1173 raft_consensus.cc:385] T 32880a703603476786b4a34ddd40cab8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.850747 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d56046d9ca314b3d84d67be620445de8" } new_table_name: "default.Table_30dc528b33264c9faed7f9f325d93738" modify_external_catalogs: true
I20260318 02:51:23.852773 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ffcfc0784d947419fc9b22aa636521c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.850150 860 leader_election.cc:304] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:23.854975 1422 raft_consensus.cc:2804] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:23.855127 1422 raft_consensus.cc:493] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:23.855202 1422 raft_consensus.cc:3060] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.857719 1491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900: Bootstrap starting.
I20260318 02:51:23.857966 1422 raft_consensus.cc:515] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:23.858629 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3348b200e5ca4f6ebecb2c25ddbe27bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.859413 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549b3929ea33417bbe50e749bbfe223d" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:23.859637 1062 raft_consensus.cc:3060] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.859691 452 master_service.cc:954] ReplaceTablet: received request to replace tablet d4a54d0daa9f48a89b3f114367750826 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:23.859958 1422 leader_election.cc:290] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:23.860159 1173 raft_consensus.cc:740] T 32880a703603476786b4a34ddd40cab8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.860474 1173 consensus_queue.cc:260] T 32880a703603476786b4a34ddd40cab8 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.863324 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 785f6728f94d41f3997961e3d1ebee34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:23.863708 1173 ts_tablet_manager.cc:1434] T 32880a703603476786b4a34ddd40cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.064s user 0.002s sys 0.000s
I20260318 02:51:23.863965 1343 raft_consensus.cc:493] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:23.865222 1174 raft_consensus.cc:740] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.869367 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_19024a064c5c46bfad46c1662a67e3c6" } new_table_name: "default.Table_1411aed3bcfc46efa721b7be6886f33f" modify_external_catalogs: true
I20260318 02:51:23.869367 1423 raft_consensus.cc:515] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.870218 1423 leader_election.cc:290] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:23.870492 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ea4a57dc67e407f9c93679cb2053557 with delete_type TABLET_DATA_DELETED (replaced by tablet 959faf1fbb224434b896c0f21e9715be) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:23.870530 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a854e3872c44e4863316c9fe5f2ee9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:23.870836 1467 raft_consensus.cc:2749] T 4dadf0fc6e134edd87788dd4ade59dc5 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:23.873706 997 leader_election.cc:343] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: f7415ddf48574f7b9a746049ce78d2e9
I20260318 02:51:23.873952 997 leader_election.cc:304] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:23.874444 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2304246c244407b9d4eb301ac5d7ba9" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:23.874568 1467 raft_consensus.cc:2749] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:23.874675 1063 raft_consensus.cc:3060] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:23.874966 997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 43881.4us
I20260318 02:51:23.878799 1173 tablet_bootstrap.cc:492] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:23.878300 1174 consensus_queue.cc:260] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.878961 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2304246c244407b9d4eb301ac5d7ba9" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:23.879341 783 raft_consensus.cc:3060] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.881151 1173 tablet_bootstrap.cc:654] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.883211 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549b3929ea33417bbe50e749bbfe223d" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:23.883387 785 raft_consensus.cc:3060] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.882901 1174 ts_tablet_manager.cc:1434] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.093s user 0.001s sys 0.002s
I20260318 02:51:23.884191 786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2304246c244407b9d4eb301ac5d7ba9" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:23.883078 1343 raft_consensus.cc:515] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.884496 1175 tablet_replica.cc:333] T 96a854e3872c44e4863316c9fe5f2ee9 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:23.884743 1175 raft_consensus.cc:2243] T 96a854e3872c44e4863316c9fe5f2ee9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:23.884927 1174 tablet_bootstrap.cc:492] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:23.885857 1175 raft_consensus.cc:2272] T 96a854e3872c44e4863316c9fe5f2ee9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.887393 783 raft_consensus.cc:2468] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:23.887893 862 leader_election.cc:304] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:23.888366 1423 raft_consensus.cc:2804] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:23.888550 1423 raft_consensus.cc:697] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:23.888957 1423 consensus_queue.cc:237] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.889468 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_98ff851e3ed0463cb3ef7f1907fa7711"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:23.891853 1175 ts_tablet_manager.cc:1916] T 96a854e3872c44e4863316c9fe5f2ee9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:23.892400 1343 leader_election.cc:290] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:23.893128 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff487cba236491eb22becf0dc591925" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:23.874444 1184 ts_tablet_manager.cc:1916] T 54bffc30199246fd93edf7486b2e3a91 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:23.882997 1062 raft_consensus.cc:2468] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:23.898432 860 leader_election.cc:304] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:23.899135 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5c03883f4a5e4de6801f783f51440963" } new_table_name: "default.Table_51fd1fd451544782b3785014979adeba" modify_external_catalogs: true
I20260318 02:51:23.886435 1063 raft_consensus.cc:2468] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:23.893803 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff487cba236491eb22becf0dc591925" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:23.900590 455 master_service.cc:954] ReplaceTablet: received request to replace tablet ec32c25ae14b406cb6ab4d913b575091 from {username='slave'} at 127.0.0.1:47158
W20260318 02:51:23.900916 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98ff851e3ed0463cb3ef7f1907fa7711 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.901041 1423 raft_consensus.cc:2804] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:23.901324 1423 raft_consensus.cc:697] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:23.901661 1423 consensus_queue.cc:237] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:23.902467 719 leader_election.cc:343] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:23.882905 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "549b3929ea33417bbe50e749bbfe223d" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:23.904611 1174 tablet_bootstrap.cc:654] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:23.904960 719 leader_election.cc:343] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:23.905118 719 leader_election.cc:304] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:23.905555 1173 tablet_bootstrap.cc:492] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:23.905761 1173 ts_tablet_manager.cc:1403] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.001s
I20260318 02:51:23.906529 1173 raft_consensus.cc:359] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.906718 1173 raft_consensus.cc:385] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.906786 1173 raft_consensus.cc:740] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.907021 1173 consensus_queue.cc:260] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.907506 1173 ts_tablet_manager.cc:1434] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:23.907810 1173 tablet_bootstrap.cc:492] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:23.907933 785 raft_consensus.cc:2468] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:23.909307 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_176fa1820ca44b3cbdfad38228b9dc7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:23.909584 1343 raft_consensus.cc:2749] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:23.909596 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 32880a703603476786b4a34ddd40cab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:23.909971 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_176fa1820ca44b3cbdfad38228b9dc7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:23.910231 1173 tablet_bootstrap.cc:654] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:23.911271 997 leader_election.cc:343] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: 76fc930611024211a70301bcfd92884e
I20260318 02:51:23.911453 997 leader_election.cc:304] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:23.914355 1491 log.cc:826] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900: Log is configured to *not* fsync() on all Append() calls
I20260318 02:51:23.915714 1467 raft_consensus.cc:2749] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:23.916352 997 leader_election.cc:343] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: Tablet not RUNNING: STOPPED
I20260318 02:51:23.913115 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 0e4719eafd2947bfacf3e1d2df1ae43e (table default.Table_e88f9eedc9d549e7bd8e8fb34e721a44 [id=33a7b2fdc7094616a94fa59f370e1728]) successfully deleted
I20260318 02:51:23.918612 1174 tablet_bootstrap.cc:492] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:23.918857 1174 ts_tablet_manager.cc:1403] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.035s user 0.007s sys 0.000s
I20260318 02:51:23.919274 997 leader_election.cc:304] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:23.919862 1467 raft_consensus.cc:2749] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:23.919939 1174 raft_consensus.cc:359] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.920220 1174 raft_consensus.cc:385] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.920349 1174 raft_consensus.cc:740] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.920363 997 leader_election.cc:304] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:23.920693 1174 consensus_queue.cc:260] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.921646 1174 ts_tablet_manager.cc:1434] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260318 02:51:23.922595 1174 tablet_bootstrap.cc:492] T 45fddf78fc834d20908696b980d394a2 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:23.928814 1467 raft_consensus.cc:2804] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:23.928952 1467 raft_consensus.cc:493] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:23.929062 1467 raft_consensus.cc:3060] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.929080 448 master_service.cc:954] ReplaceTablet: received request to replace tablet 45fddf78fc834d20908696b980d394a2 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:23.931674 1467 raft_consensus.cc:515] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.933228 1175 ts_tablet_manager.cc:1929] T 96a854e3872c44e4863316c9fe5f2ee9 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260318 02:51:23.933336 999 leader_election.cc:343] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 96a854e3872c44e4863316c9fe5f2ee9
I20260318 02:51:23.933835 1174 tablet_bootstrap.cc:654] T 45fddf78fc834d20908696b980d394a2 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.933889 1467 leader_election.cc:290] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:23.934024 1175 log.cc:1199] T 96a854e3872c44e4863316c9fe5f2ee9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/96a854e3872c44e4863316c9fe5f2ee9
I20260318 02:51:23.934507 1175 ts_tablet_manager.cc:1950] T 96a854e3872c44e4863316c9fe5f2ee9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:23.935112 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a854e3872c44e4863316c9fe5f2ee9" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:23.936482 1173 tablet_bootstrap.cc:492] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:23.936684 1173 ts_tablet_manager.cc:1403] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.005s
I20260318 02:51:23.937084 1172 tablet_bootstrap.cc:492] T 22caed5f1870469d834aecd2bc42bdda P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:23.937266 1172 ts_tablet_manager.cc:1403] T 22caed5f1870469d834aecd2bc42bdda P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.232s user 0.007s sys 0.027s
I20260318 02:51:23.937700 1175 tablet_replica.cc:333] T 32880a703603476786b4a34ddd40cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:23.937737 1173 raft_consensus.cc:359] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:23.937866 997 leader_election.cc:343] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: Tablet not RUNNING: STOPPED
I20260318 02:51:23.937954 1175 raft_consensus.cc:2243] T 32880a703603476786b4a34ddd40cab8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:23.938019 1173 raft_consensus.cc:385] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.938005 997 leader_election.cc:304] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:23.938139 1173 raft_consensus.cc:740] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.938372 1175 raft_consensus.cc:2272] T 32880a703603476786b4a34ddd40cab8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.938437 1173 consensus_queue.cc:260] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.939024 1173 ts_tablet_manager.cc:1434] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:23.939333 1175 ts_tablet_manager.cc:1916] T 32880a703603476786b4a34ddd40cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:23.939371 1173 tablet_bootstrap.cc:492] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:23.941895 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9d20847fa6f9461cb6137f56ea680cb6 consensus state has no leader
W20260318 02:51:23.942379 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 918c542a51864e54871efc5e7f62ef61 consensus state has no leader
I20260318 02:51:23.942474 1467 raft_consensus.cc:2749] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260318 02:51:23.937160 1176 ts_tablet_manager.cc:1929] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:23.943104 1176 log.cc:1199] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/c23b646a132743cc9b4dcd85c6d4ebea
I20260318 02:51:23.943979 1173 tablet_bootstrap.cc:654] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.944447 1176 ts_tablet_manager.cc:1950] T c23b646a132743cc9b4dcd85c6d4ebea P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:23.947302 1172 raft_consensus.cc:359] T 22caed5f1870469d834aecd2bc42bdda P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.947546 1172 raft_consensus.cc:385] T 22caed5f1870469d834aecd2bc42bdda P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.947644 1172 raft_consensus.cc:740] T 22caed5f1870469d834aecd2bc42bdda P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.947913 1172 consensus_queue.cc:260] T 22caed5f1870469d834aecd2bc42bdda P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.949887 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet c23b646a132743cc9b4dcd85c6d4ebea (table default.Table_480631505a694fa2846e96ba417fcb1f [id=fbcfb142ee75458b9f3008dcc9c7e06d]) successfully deleted
I20260318 02:51:23.952214 1172 ts_tablet_manager.cc:1434] T 22caed5f1870469d834aecd2bc42bdda P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
W20260318 02:51:23.952395 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 0d343e53f2354a3386b19d71ef00d5a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d343e53f2354a3386b19d71ef00d5a4 already in progress: creating tablet
I20260318 02:51:23.952677 1172 tablet_bootstrap.cc:492] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:23.953802 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2bd6ac47ba044099ad9bd211ef8d26a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2bd6ac47ba044099ad9bd211ef8d26a2 already in progress: creating tablet
I20260318 02:51:23.955886 1184 ts_tablet_manager.cc:1929] T 54bffc30199246fd93edf7486b2e3a91 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:23.956902 1343 raft_consensus.cc:493] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:23.957111 1343 raft_consensus.cc:515] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.957795 1343 leader_election.cc:290] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:23.959069 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74233fd7ed094e7cbfc79309605db0e1" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:23.959327 926 raft_consensus.cc:2468] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 0.
I20260318 02:51:23.959908 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 96a854e3872c44e4863316c9fe5f2ee9 (table default.Table_d548901cf2e74047a18ea1460ce6fc34 [id=570322e5437b4a58b560833ee1f0f9bc]) successfully deleted
I20260318 02:51:23.960304 719 leader_election.cc:304] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:23.965065 1343 raft_consensus.cc:2804] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:23.965199 1343 raft_consensus.cc:493] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:23.965299 1343 raft_consensus.cc:3060] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.967370 1175 ts_tablet_manager.cc:1929] T 32880a703603476786b4a34ddd40cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:23.967509 1175 log.cc:1199] T 32880a703603476786b4a34ddd40cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/32880a703603476786b4a34ddd40cab8
I20260318 02:51:23.967890 1175 ts_tablet_manager.cc:1950] T 32880a703603476786b4a34ddd40cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:23.968031 1343 raft_consensus.cc:515] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.969321 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74233fd7ed094e7cbfc79309605db0e1" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:23.969543 926 raft_consensus.cc:3060] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.972069 926 raft_consensus.cc:2468] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 1.
I20260318 02:51:23.972395 1174 tablet_bootstrap.cc:492] T 45fddf78fc834d20908696b980d394a2 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:23.972695 1174 ts_tablet_manager.cc:1403] T 45fddf78fc834d20908696b980d394a2 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.050s user 0.003s sys 0.004s
I20260318 02:51:23.972769 719 leader_election.cc:304] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:23.973094 1496 raft_consensus.cc:2804] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:23.973680 1174 raft_consensus.cc:359] T 45fddf78fc834d20908696b980d394a2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.973882 1174 raft_consensus.cc:385] T 45fddf78fc834d20908696b980d394a2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.973948 1174 raft_consensus.cc:740] T 45fddf78fc834d20908696b980d394a2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.974212 1174 consensus_queue.cc:260] T 45fddf78fc834d20908696b980d394a2 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.974615 1423 raft_consensus.cc:493] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:23.974753 1423 raft_consensus.cc:515] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.975525 1423 leader_election.cc:290] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:23.976119 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d604cd634a1c470ba3896cf02d2804d4" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:23.976336 785 raft_consensus.cc:2468] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:23.976838 862 leader_election.cc:304] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:23.977147 1423 raft_consensus.cc:2804] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:23.977253 1423 raft_consensus.cc:493] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:23.977336 1423 raft_consensus.cc:3060] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.980090 1423 raft_consensus.cc:515] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.980794 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_50e2d197579e426787bc46d7494e2f74" } modify_external_catalogs: true
I20260318 02:51:23.981026 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_50e2d197579e426787bc46d7494e2f74" } modify_external_catalogs: true
I20260318 02:51:23.984064 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d604cd634a1c470ba3896cf02d2804d4" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:23.984304 785 raft_consensus.cc:3060] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:23.984514 1173 tablet_bootstrap.cc:492] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:23.984730 1173 ts_tablet_manager.cc:1403] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.005s
I20260318 02:51:23.985549 1173 raft_consensus.cc:359] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.985755 1173 raft_consensus.cc:385] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:23.985812 1173 raft_consensus.cc:740] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:23.986116 1173 consensus_queue.cc:260] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.987926 1173 ts_tablet_manager.cc:1434] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260318 02:51:23.988234 1173 tablet_bootstrap.cc:492] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:23.988339 785 raft_consensus.cc:2468] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:23.989202 862 leader_election.cc:304] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:23.989476 1422 raft_consensus.cc:2804] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:23.989629 1422 raft_consensus.cc:697] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:23.989873 1422 consensus_queue.cc:237] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.990375 1343 leader_election.cc:290] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:23.990691 1423 leader_election.cc:290] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:23.993673 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 6e9372f8871b473caa024512e936a6e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e9372f8871b473caa024512e936a6e5 already in progress: creating tablet
I20260318 02:51:23.994951 1176 tablet_replica.cc:333] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:23.995254 1174 ts_tablet_manager.cc:1434] T 45fddf78fc834d20908696b980d394a2 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.022s user 0.001s sys 0.005s
I20260318 02:51:23.995505 1176 raft_consensus.cc:2243] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:23.995628 1174 tablet_bootstrap.cc:492] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:23.995877 1176 raft_consensus.cc:2272] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:23.995913 1496 raft_consensus.cc:697] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Becoming Leader. State: Replica: 6a903d876086423b8016d705b98895ad, State: Running, Role: LEADER
I20260318 02:51:23.996429 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 32880a703603476786b4a34ddd40cab8 (table default.Table_82b90b9eec6a4252b7022e3cf497374c [id=f63cc6603c274afba2cb3ae1228ed566]) successfully deleted
I20260318 02:51:23.996346 1496 consensus_queue.cc:237] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:23.998351 1173 tablet_bootstrap.cc:654] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:23.998878 1176 ts_tablet_manager.cc:1916] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:23.959704 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74233fd7ed094e7cbfc79309605db0e1" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:23.975908 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d604cd634a1c470ba3896cf02d2804d4" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:24.000329 1184 log.cc:1199] T 54bffc30199246fd93edf7486b2e3a91 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/54bffc30199246fd93edf7486b2e3a91
W20260318 02:51:24.000319 860 leader_election.cc:343] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:23.981240 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d604cd634a1c470ba3896cf02d2804d4" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:23.990478 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74233fd7ed094e7cbfc79309605db0e1" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:24.001590 1184 ts_tablet_manager.cc:1950] T 54bffc30199246fd93edf7486b2e3a91 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:24.001890 1491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=17 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260318 02:51:24.002161 860 leader_election.cc:343] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:24.002429 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 242) took 1133 ms. Trace:
I20260318 02:51:24.002630 1491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900: Bootstrap complete.
I20260318 02:51:23.999328 1174 tablet_bootstrap.cc:654] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:23.999607 719 leader_election.cc:343] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:24.004201 719 leader_election.cc:343] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:24.008857 1184 rpcz_store.cc:276] 0318 02:51:22.868955 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:22.869070 (+ 115us) service_pool.cc:225] Handling call
0318 02:51:23.711996 (+842926us) ts_tablet_manager.cc:1151] Deleting tablet 54bffc30199246fd93edf7486b2e3a91
0318 02:51:23.712001 (+ 5us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:23.942239 (+230238us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:23.955754 (+ 13515us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:24.002376 (+ 46622us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":842712}
I20260318 02:51:23.979519 1172 tablet_bootstrap.cc:654] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.009641 1184 tablet_replica.cc:333] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:24.012207 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 54bffc30199246fd93edf7486b2e3a91 (table default.Table_3078ea8f226c4adc8743e3a9371f2a97 [id=a58374eeb920473e941c9d07accd5ee5]) successfully deleted
I20260318 02:51:24.014923 1184 raft_consensus.cc:2243] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.016062 831 heartbeater.cc:344] Connected to a master server at 127.0.104.188:41593
I20260318 02:51:24.016362 1184 raft_consensus.cc:2272] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.017341 1184 ts_tablet_manager.cc:1916] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:24.019088 1172 tablet_bootstrap.cc:492] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:24.019266 1172 ts_tablet_manager.cc:1403] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.067s user 0.000s sys 0.004s
I20260318 02:51:24.020155 1172 raft_consensus.cc:359] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.020349 1172 raft_consensus.cc:385] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.021553 972 heartbeater.cc:344] Connected to a master server at 127.0.104.188:41593
W20260318 02:51:24.028450 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce0ab476b9a54cc586a4c28e23382bfc consensus state has no leader
I20260318 02:51:24.029028 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b4f791ee528d46b59428dc367b5be0a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.029703 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4f791ee528d46b59428dc367b5be0a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.033690 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_346cff4fabb54f2ebef24b9eb0cf3be6" } modify_external_catalogs: true
I20260318 02:51:24.034057 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_346cff4fabb54f2ebef24b9eb0cf3be6" } modify_external_catalogs: true
I20260318 02:51:24.035681 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8b0935ef185c46f8ba4fe96e60fad278" } modify_external_catalogs: true
I20260318 02:51:24.035880 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8b0935ef185c46f8ba4fe96e60fad278" } modify_external_catalogs: true
I20260318 02:51:24.038522 1491 raft_consensus.cc:359] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:24.041872 1491 raft_consensus.cc:740] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 971baf5b9e4644c990dbf4d4fc7ba900, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.042855 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a5974ba51eec46dfa733c7b066123d8e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:24.043277 1176 ts_tablet_manager.cc:1929] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260318 02:51:24.043517 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5974ba51eec46dfa733c7b066123d8e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.044556 1176 log.cc:1199] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/d604cd634a1c470ba3896cf02d2804d4
I20260318 02:51:24.048122 1184 ts_tablet_manager.cc:1929] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:24.044063 1491 consensus_queue.cc:260] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 2.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:24.049611 457 catalog_manager.cc:5671] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 reported cstate change: term changed from 0 to 1, leader changed from <none> to b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130). New cstate: current_term: 1 leader_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:24.050076 457 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet e2304246c244407b9d4eb301ac5d7ba9 (table default.Table_fddbe89a9a524d028fba5877d8b23387 [id=20ed812002544f6f8caef448f7514f7c]). Expected version 4 got 0
I20260318 02:51:24.051599 1176 ts_tablet_manager.cc:1950] T d604cd634a1c470ba3896cf02d2804d4 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:24.052398 1176 tablet_replica.cc:333] T b69dd1653a304f3d99346e89dacf9208 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:24.052963 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet d604cd634a1c470ba3896cf02d2804d4 (table default.Table_215d98fc906d466d8c0d334250547c34 [id=1165495ee0884badba5bd95f87987e33]) successfully deleted
I20260318 02:51:24.052699 764 tablet_service.cc:1511] Processing CreateTablet for tablet 96a6d1808417419dac0d2b2e80c5ca22 (DEFAULT_TABLE table=default.Table_8b0935ef185c46f8ba4fe96e60fad278 [id=a401bb840c9a4dddb1619805a406f8aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.054677 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a6d1808417419dac0d2b2e80c5ca22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.054701 754 tablet_service.cc:1511] Processing CreateTablet for tablet 1ef3181adc0542229897369591a30465 (DEFAULT_TABLE table=default.Table_3aa749750bd542738790c713a8ff0713 [id=c6ec8a81c28d493396980349b4ea31d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.055050 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef3181adc0542229897369591a30465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.058643 1491 sys_catalog.cc:565] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [sys.catalog]: configured and running, proceeding with master startup.
I20260318 02:51:24.062019 1176 raft_consensus.cc:2243] T b69dd1653a304f3d99346e89dacf9208 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.062561 1176 raft_consensus.cc:2272] T b69dd1653a304f3d99346e89dacf9208 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.065092 1176 ts_tablet_manager.cc:1916] T b69dd1653a304f3d99346e89dacf9208 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:24.066433 1514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:24.066802 754 tablet_service.cc:1511] Processing CreateTablet for tablet 305cc777ed0c46e497c80f15b8e6ead1 (DEFAULT_TABLE table=default.Table_1f1814cfbad542d2819ce76c05ad9c83 [id=74932ba5f5794283833a97ff4ea61734]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.066890 1514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [sys.catalog]: This master's current role is: FOLLOWER
I20260318 02:51:24.067337 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305cc777ed0c46e497c80f15b8e6ead1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.068244 1184 log.cc:1199] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/41bc1c926c0f4ef2a4c9c52d991f8f0d
I20260318 02:51:24.068961 1184 ts_tablet_manager.cc:1950] T 41bc1c926c0f4ef2a4c9c52d991f8f0d P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:24.072753 764 tablet_service.cc:1511] Processing CreateTablet for tablet 7cdd554113bf4a7092da876365a89456 (DEFAULT_TABLE table=default.Table_a73cffc7e068465bace900fc6b92c44e [id=6f9427cec2ee40699e0c736524feb90f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.073176 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cdd554113bf4a7092da876365a89456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.074231 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 243) took 1164 ms. Trace:
I20260318 02:51:24.075157 1184 rpcz_store.cc:276] 0318 02:51:22.909290 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:22.909340 (+ 50us) service_pool.cc:225] Handling call
0318 02:51:24.009530 (+1100190us) ts_tablet_manager.cc:1151] Deleting tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d
0318 02:51:24.009544 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:24.038376 (+ 28832us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:24.047967 (+ 9591us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:24.074193 (+ 26226us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1099948}
I20260318 02:51:24.076207 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 252) took 1120 ms. Trace:
I20260318 02:51:24.077805 1184 rpcz_store.cc:276] 0318 02:51:22.955491 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:22.955555 (+ 64us) service_pool.cc:225] Handling call
0318 02:51:24.076045 (+1120490us) ts_tablet_manager.cc:1151] Deleting tablet 666c2992fa4f479ab4ffd7ac0c3a9c92
0318 02:51:24.076057 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:24.076173 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1120206}
I20260318 02:51:24.078397 760 tablet_service.cc:1511] Processing CreateTablet for tablet ed697b98352c4f65931c154b1f160991 (DEFAULT_TABLE table=default.Table_e8949513489d44e0a36b239de4fbed56 [id=412636f9a1d04551b9872e99570ba8fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.080989 889 tablet_service.cc:1511] Processing CreateTablet for tablet 1ef3181adc0542229897369591a30465 (DEFAULT_TABLE table=default.Table_3aa749750bd542738790c713a8ff0713 [id=c6ec8a81c28d493396980349b4ea31d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.081457 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef3181adc0542229897369591a30465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.083725 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 96a6d1808417419dac0d2b2e80c5ca22 (DEFAULT_TABLE table=default.Table_8b0935ef185c46f8ba4fe96e60fad278 [id=a401bb840c9a4dddb1619805a406f8aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.084124 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a6d1808417419dac0d2b2e80c5ca22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.080626 892 tablet_service.cc:1511] Processing CreateTablet for tablet 96a6d1808417419dac0d2b2e80c5ca22 (DEFAULT_TABLE table=default.Table_8b0935ef185c46f8ba4fe96e60fad278 [id=a401bb840c9a4dddb1619805a406f8aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.085549 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a6d1808417419dac0d2b2e80c5ca22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.087710 1109 heartbeater.cc:344] Connected to a master server at 127.0.104.188:41593
I20260318 02:51:24.089042 901 tablet_service.cc:1511] Processing CreateTablet for tablet 305cc777ed0c46e497c80f15b8e6ead1 (DEFAULT_TABLE table=default.Table_1f1814cfbad542d2819ce76c05ad9c83 [id=74932ba5f5794283833a97ff4ea61734]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.089143 756 tablet_service.cc:1511] Processing CreateTablet for tablet ca23d4d0d3734fceb14966a4f2ad9c35 (DEFAULT_TABLE table=default.Table_fced45ef732a4091bc296695317df2be [id=61241ff920584692bba476799b6a60e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.089411 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305cc777ed0c46e497c80f15b8e6ead1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.090279 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 41bc1c926c0f4ef2a4c9c52d991f8f0d (table default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666]) successfully deleted
I20260318 02:51:24.090459 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 1ef3181adc0542229897369591a30465 (DEFAULT_TABLE table=default.Table_3aa749750bd542738790c713a8ff0713 [id=c6ec8a81c28d493396980349b4ea31d8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:24.090548 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 666c2992fa4f479ab4ffd7ac0c3a9c92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 666c2992fa4f479ab4ffd7ac0c3a9c92 already in progress: creating tablet
I20260318 02:51:24.090806 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef3181adc0542229897369591a30465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.093048 907 tablet_service.cc:1511] Processing CreateTablet for tablet 7cdd554113bf4a7092da876365a89456 (DEFAULT_TABLE table=default.Table_a73cffc7e068465bace900fc6b92c44e [id=6f9427cec2ee40699e0c736524feb90f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.093079 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 305cc777ed0c46e497c80f15b8e6ead1 (DEFAULT_TABLE table=default.Table_1f1814cfbad542d2819ce76c05ad9c83 [id=74932ba5f5794283833a97ff4ea61734]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.093416 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cdd554113bf4a7092da876365a89456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.093415 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 305cc777ed0c46e497c80f15b8e6ead1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.094192 903 tablet_service.cc:1511] Processing CreateTablet for tablet ca23d4d0d3734fceb14966a4f2ad9c35 (DEFAULT_TABLE table=default.Table_fced45ef732a4091bc296695317df2be [id=61241ff920584692bba476799b6a60e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.094642 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca23d4d0d3734fceb14966a4f2ad9c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.096197 904 tablet_service.cc:1511] Processing CreateTablet for tablet ed697b98352c4f65931c154b1f160991 (DEFAULT_TABLE table=default.Table_e8949513489d44e0a36b239de4fbed56 [id=412636f9a1d04551b9872e99570ba8fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.096380 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 7cdd554113bf4a7092da876365a89456 (DEFAULT_TABLE table=default.Table_a73cffc7e068465bace900fc6b92c44e [id=6f9427cec2ee40699e0c736524feb90f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.096518 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed697b98352c4f65931c154b1f160991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.096736 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cdd554113bf4a7092da876365a89456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.101590 1467 raft_consensus.cc:493] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:24.101759 1467 raft_consensus.cc:515] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.102516 1467 leader_election.cc:290] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:24.102934 1044 tablet_service.cc:1511] Processing CreateTablet for tablet ed697b98352c4f65931c154b1f160991 (DEFAULT_TABLE table=default.Table_e8949513489d44e0a36b239de4fbed56 [id=412636f9a1d04551b9872e99570ba8fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.103339 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed697b98352c4f65931c154b1f160991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.020447 1172 raft_consensus.cc:740] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.109943 1172 consensus_queue.cc:260] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:24.110224 999 leader_election.cc:343] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 0ea4a57dc67e407f9c93679cb2053557
I20260318 02:51:24.110539 1172 ts_tablet_manager.cc:1434] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.091s user 0.001s sys 0.001s
W20260318 02:51:24.112480 997 leader_election.cc:343] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: 0ea4a57dc67e407f9c93679cb2053557
I20260318 02:51:24.112609 997 leader_election.cc:304] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:24.113207 1467 raft_consensus.cc:2749] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:24.119377 762 tablet_service.cc:1511] Processing CreateTablet for tablet 20c6f1790ed34581b7507ec63ec66718 (DEFAULT_TABLE table=default.Table_06e760051f3b473f99521e4da99f8288 [id=c532f0623efe4c3f8d9c90ae9c3d02c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.121531 764 tablet_service.cc:1511] Processing CreateTablet for tablet 9451d57fad72413c81443623c7995d4e (DEFAULT_TABLE table=default.Table_bd0d5769f59b4b0d87629167dcf22094 [id=2d188e1de3394072a2327c0d08901bf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.129029 1174 tablet_bootstrap.cc:492] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:24.129215 1174 ts_tablet_manager.cc:1403] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.134s user 0.003s sys 0.011s
I20260318 02:51:24.130038 1174 raft_consensus.cc:359] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.130234 1174 raft_consensus.cc:385] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.130322 1174 raft_consensus.cc:740] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.130517 1174 consensus_queue.cc:260] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.131021 1174 ts_tablet_manager.cc:1434] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:24.131310 1174 tablet_bootstrap.cc:492] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:24.079689 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 251) took 1124 ms. Trace:
I20260318 02:51:24.133494 1184 rpcz_store.cc:276] 0318 02:51:22.955350 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:22.963924 (+ 8574us) service_pool.cc:225] Handling call
0318 02:51:24.079523 (+1115599us) ts_tablet_manager.cc:1151] Deleting tablet 93479517a1d34d2d99633018a6a57127
0318 02:51:24.079536 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:24.079652 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1115304}
I20260318 02:51:24.136485 1184 tablet_replica.cc:333] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:24.137521 1184 raft_consensus.cc:2243] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.133141 1174 tablet_bootstrap.cc:654] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.134872 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed697b98352c4f65931c154b1f160991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.141523 1172 tablet_bootstrap.cc:492] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:24.142786 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c6f1790ed34581b7507ec63ec66718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.145009 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca23d4d0d3734fceb14966a4f2ad9c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.145118 754 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4eca5e16f84564b31933b8227fd980 (DEFAULT_TABLE table=default.Table_55d80bc4ac3d4e72b2c5e6a694968f83 [id=541170c7c4bf49deb86cd4c15ffdd04f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.145473 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4eca5e16f84564b31933b8227fd980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.149667 903 tablet_service.cc:1511] Processing CreateTablet for tablet 9451d57fad72413c81443623c7995d4e (DEFAULT_TABLE table=default.Table_bd0d5769f59b4b0d87629167dcf22094 [id=2d188e1de3394072a2327c0d08901bf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.149726 1044 tablet_service.cc:1511] Processing CreateTablet for tablet ca23d4d0d3734fceb14966a4f2ad9c35 (DEFAULT_TABLE table=default.Table_fced45ef732a4091bc296695317df2be [id=61241ff920584692bba476799b6a60e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.150137 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9451d57fad72413c81443623c7995d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.150147 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca23d4d0d3734fceb14966a4f2ad9c35. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:24.150905 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 93479517a1d34d2d99633018a6a57127 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 93479517a1d34d2d99633018a6a57127 already in progress: creating tablet
I20260318 02:51:24.151489 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4eca5e16f84564b31933b8227fd980 (DEFAULT_TABLE table=default.Table_55d80bc4ac3d4e72b2c5e6a694968f83 [id=541170c7c4bf49deb86cd4c15ffdd04f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.151865 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4eca5e16f84564b31933b8227fd980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.153177 1467 raft_consensus.cc:493] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:24.153313 1467 raft_consensus.cc:515] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.153990 1467 leader_election.cc:290] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:24.155081 752 tablet_service.cc:1511] Processing CreateTablet for tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a (DEFAULT_TABLE table=default.Table_8d6d4b35c7754174adfe3a4d4889cdae [id=9dc5f3bbe7a34ffab1bd5105bac98325]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.155479 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:24.155936 999 leader_election.cc:343] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 9e421d3fe62b4985bfe0486a4b115b2a
I20260318 02:51:24.156340 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 9451d57fad72413c81443623c7995d4e (DEFAULT_TABLE table=default.Table_bd0d5769f59b4b0d87629167dcf22094 [id=2d188e1de3394072a2327c0d08901bf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.156690 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9451d57fad72413c81443623c7995d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.156879 892 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4eca5e16f84564b31933b8227fd980 (DEFAULT_TABLE table=default.Table_55d80bc4ac3d4e72b2c5e6a694968f83 [id=541170c7c4bf49deb86cd4c15ffdd04f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.157568 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4eca5e16f84564b31933b8227fd980. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:24.157853 997 leader_election.cc:343] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: 9e421d3fe62b4985bfe0486a4b115b2a
I20260318 02:51:24.157984 997 leader_election.cc:304] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:24.158375 1467 raft_consensus.cc:2749] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:24.159471 763 tablet_service.cc:1511] Processing CreateTablet for tablet 3d7b339a29ef456997d74a7a95d4c03a (DEFAULT_TABLE table=default.Table_b4f218d2fea54a31be80372e05eaa6ae [id=545ec19ee7a34ceb8e7adb93b6eaecf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.159837 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d7b339a29ef456997d74a7a95d4c03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.180464 1496 raft_consensus.cc:493] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:24.180689 1496 raft_consensus.cc:515] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.181479 1496 leader_election.cc:290] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:24.182148 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9ac6b9d4a245ec8d8aed1db976123b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:24.182392 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9ac6b9d4a245ec8d8aed1db976123b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:24.183091 719 leader_election.cc:343] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:24.183561 719 leader_election.cc:343] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:24.183672 719 leader_election.cc:304] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:24.184056 1496 raft_consensus.cc:2749] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:24.191009 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9451d57fad72413c81443623c7995d4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.196215 1496 raft_consensus.cc:493] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:24.196430 1496 raft_consensus.cc:515] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.197239 1496 leader_election.cc:290] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:24.198175 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8319efcfa31b45afb4dbd90cb5f13e97" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:24.198402 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8319efcfa31b45afb4dbd90cb5f13e97" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:24.138788 1184 raft_consensus.cc:2272] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:24.199225 719 leader_election.cc:343] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:24.199487 719 leader_election.cc:343] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:24.199617 719 leader_election.cc:304] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:24.200145 1496 raft_consensus.cc:2749] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:24.201915 1184 ts_tablet_manager.cc:1916] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:24.204197 892 tablet_service.cc:1511] Processing CreateTablet for tablet 20c6f1790ed34581b7507ec63ec66718 (DEFAULT_TABLE table=default.Table_06e760051f3b473f99521e4da99f8288 [id=c532f0623efe4c3f8d9c90ae9c3d02c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.203028 1172 tablet_bootstrap.cc:654] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.204736 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c6f1790ed34581b7507ec63ec66718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.209178 903 tablet_service.cc:1511] Processing CreateTablet for tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a (DEFAULT_TABLE table=default.Table_8d6d4b35c7754174adfe3a4d4889cdae [id=9dc5f3bbe7a34ffab1bd5105bac98325]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.209434 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 20c6f1790ed34581b7507ec63ec66718 (DEFAULT_TABLE table=default.Table_06e760051f3b473f99521e4da99f8288 [id=c532f0623efe4c3f8d9c90ae9c3d02c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.209702 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.209864 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c6f1790ed34581b7507ec63ec66718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.211889 1467 raft_consensus.cc:493] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:24.212050 1467 raft_consensus.cc:515] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.212780 1467 leader_election.cc:290] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:24.213946 999 leader_election.cc:343] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 053a09fd13fa4d8e80133fd77acaa4ce
W20260318 02:51:24.215354 997 leader_election.cc:343] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: 053a09fd13fa4d8e80133fd77acaa4ce
I20260318 02:51:24.215503 997 leader_election.cc:304] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:24.216332 1467 raft_consensus.cc:2749] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:24.217237 1176 ts_tablet_manager.cc:1929] T b69dd1653a304f3d99346e89dacf9208 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:24.217366 1176 log.cc:1199] T b69dd1653a304f3d99346e89dacf9208 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/b69dd1653a304f3d99346e89dacf9208
I20260318 02:51:24.217736 1176 ts_tablet_manager.cc:1950] T b69dd1653a304f3d99346e89dacf9208 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:24.217818 901 tablet_service.cc:1511] Processing CreateTablet for tablet 3d7b339a29ef456997d74a7a95d4c03a (DEFAULT_TABLE table=default.Table_b4f218d2fea54a31be80372e05eaa6ae [id=545ec19ee7a34ceb8e7adb93b6eaecf8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:24.218034 441 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 9d20847fa6f9461cb6137f56ea680cb6 (table default.Table_30dc528b33264c9faed7f9f325d93738 [id=ed55cf5473c34c8b95532da9cfa81fad], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9d20847fa6f9461cb6137f56ea680cb6 consensus state has no leader
I20260318 02:51:24.218233 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d7b339a29ef456997d74a7a95d4c03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.218735 1176 tablet_replica.cc:333] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:24.218951 1176 raft_consensus.cc:2243] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:24.218997 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet b69dd1653a304f3d99346e89dacf9208 (table default.Table_422656b6b8b4438e9d2000352503c6b9 [id=57dcabdb56b84275bb202ad3decd8b15]) successfully deleted
I20260318 02:51:24.219192 1176 pending_rounds.cc:70] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad: Trying to abort 1 pending ops.
I20260318 02:51:24.219272 1176 pending_rounds.cc:77] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494155255029760 op_type: NO_OP noop_request { }
I20260318 02:51:24.219398 1176 raft_consensus.cc:2889] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:24.219516 1176 raft_consensus.cc:2272] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.220000 1044 tablet_service.cc:1511] Processing CreateTablet for tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a (DEFAULT_TABLE table=default.Table_8d6d4b35c7754174adfe3a4d4889cdae [id=9dc5f3bbe7a34ffab1bd5105bac98325]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.220366 1176 ts_tablet_manager.cc:1916] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:24.221360 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 0c8264f69f934d3ba2e41434ce350f3e
I20260318 02:51:24.223143 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e062855442004fd6b375792097f6c98c" } modify_external_catalogs: true
I20260318 02:51:24.223346 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e062855442004fd6b375792097f6c98c" } modify_external_catalogs: true
I20260318 02:51:24.224025 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a86b913c502e4655aae9d11230109dc1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.224622 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a86b913c502e4655aae9d11230109dc1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.225567 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c8264f69f934d3ba2e41434ce350f3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:24.225891 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 96a6d1808417419dac0d2b2e80c5ca22
I20260318 02:51:24.225939 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet 1df8029146564e1c9dc88dd9f5fb64ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.226101 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.226583 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d7429a91cdb142b99d2f341a75bc82bf" } modify_external_catalogs: true
I20260318 02:51:24.226727 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d7429a91cdb142b99d2f341a75bc82bf" } modify_external_catalogs: true
I20260318 02:51:24.227123 1176 ts_tablet_manager.cc:1929] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:24.227375 1176 log.cc:1199] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/74233fd7ed094e7cbfc79309605db0e1
I20260318 02:51:24.227873 1176 ts_tablet_manager.cc:1950] T 74233fd7ed094e7cbfc79309605db0e1 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:24.227905 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b230018a95a54ababfe5ecf2ca1e2e49
I20260318 02:51:24.228332 456 catalog_manager.cc:6741] ReplaceTablet: tablet b230018a95a54ababfe5ecf2ca1e2e49 deleted and replaced by tablet 813702e53eee4a54a7d693fd6e03bbbb
I20260318 02:51:24.228513 456 master_service.cc:954] ReplaceTablet: received request to replace tablet 959faf1fbb224434b896c0f21e9715be from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:24.229632 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 45fddf78fc834d20908696b980d394a2
I20260318 02:51:24.230023 448 catalog_manager.cc:6741] ReplaceTablet: tablet 45fddf78fc834d20908696b980d394a2 deleted and replaced by tablet d2fb9c8f339444bc8d7c6479e7d87f44
I20260318 02:51:24.230293 1176 tablet_replica.cc:333] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:24.230311 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_77c75231b25242e7aa24d2bae80c37c5" } new_table_name: "default.Table_4e770bc308894d9094b88315d9093ba5" modify_external_catalogs: true
I20260318 02:51:24.230574 1176 raft_consensus.cc:2243] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.230753 1176 raft_consensus.cc:2272] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.230808 1174 tablet_bootstrap.cc:492] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:24.230971 1174 ts_tablet_manager.cc:1403] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.100s user 0.003s sys 0.000s
I20260318 02:51:24.231623 1176 ts_tablet_manager.cc:1916] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:24.231655 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ef8abb8805eb442b804b8b5a910029ff" } new_table_name: "default.Table_617760cf0940425fa9ae7a909ca840a5" modify_external_catalogs: true
I20260318 02:51:24.231819 1174 raft_consensus.cc:359] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.232007 1174 raft_consensus.cc:385] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.232077 1174 raft_consensus.cc:740] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.232357 1174 consensus_queue.cc:260] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.233107 1174 ts_tablet_manager.cc:1434] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260318 02:51:24.234400 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 74233fd7ed094e7cbfc79309605db0e1 (table default.Table_90fbf2263430453082ef161ec0025a5a [id=f6d13c14fec24bc8894ebd60b88fca77]) successfully deleted
W20260318 02:51:24.234704 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet d4a54d0daa9f48a89b3f114367750826 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4a54d0daa9f48a89b3f114367750826 already in progress: creating tablet
I20260318 02:51:24.235049 1174 tablet_bootstrap.cc:492] T 31d493650d07437c9f1d657bb08a98d7 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:24.235139 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 7883f526d06e442c81f1b66fd89d2cd0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7883f526d06e442c81f1b66fd89d2cd0 already in progress: creating tablet
W20260318 02:51:24.235337 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 7cfaf92570b34b2bb1f52aea06187c83 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cfaf92570b34b2bb1f52aea06187c83 already in progress: creating tablet
W20260318 02:51:24.235518 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f9bc73d3f85745ecb62d861b6375a987 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9bc73d3f85745ecb62d861b6375a987 already in progress: creating tablet
W20260318 02:51:24.235697 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 08307bc69291479eb8ee0d7aec124829 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08307bc69291479eb8ee0d7aec124829 already in progress: creating tablet
W20260318 02:51:24.235867 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 29541950221544e396ada303fbbb5002 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29541950221544e396ada303fbbb5002 already in progress: creating tablet
I20260318 02:51:24.236403 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a6d1808417419dac0d2b2e80c5ca22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:24.236732 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 45fddf78fc834d20908696b980d394a2 with delete_type TABLET_DATA_DELETED (replaced by tablet d2fb9c8f339444bc8d7c6479e7d87f44) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:24.237056 762 tablet_service.cc:1558] Processing DeleteTablet for tablet b230018a95a54ababfe5ecf2ca1e2e49 with delete_type TABLET_DATA_DELETED (replaced by tablet 813702e53eee4a54a7d693fd6e03bbbb) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:24.239693 1176 ts_tablet_manager.cc:1929] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:24.239938 1176 log.cc:1199] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/3ff487cba236491eb22becf0dc591925
I20260318 02:51:24.240370 1176 ts_tablet_manager.cc:1950] T 3ff487cba236491eb22becf0dc591925 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:24.241621 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 3ff487cba236491eb22becf0dc591925 (table default.Table_22e1d9e9571f415597c2b5fd053f529a [id=d20f8f1bd66d4dceab3b7bc72608da2a]) successfully deleted
W20260318 02:51:24.242491 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 0c8264f69f934d3ba2e41434ce350f3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c8264f69f934d3ba2e41434ce350f3e already in progress: creating tablet
I20260318 02:51:24.243198 1176 tablet_replica.cc:333] T 45fddf78fc834d20908696b980d394a2 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:24.243485 1176 raft_consensus.cc:2243] T 45fddf78fc834d20908696b980d394a2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.243744 1176 raft_consensus.cc:2272] T 45fddf78fc834d20908696b980d394a2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.244503 1176 ts_tablet_manager.cc:1916] T 45fddf78fc834d20908696b980d394a2 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:24.245934 451 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 6b82751cbcbb4c39a6942b6856412fc8 (table default.Table_9faefa2c0ceb4495935b65b6869b4b7a [id=84a657155372475db438c6eb3119b595]). Expected version 2 got 0
I20260318 02:51:24.246577 1174 tablet_bootstrap.cc:654] T 31d493650d07437c9f1d657bb08a98d7 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.247314 1467 raft_consensus.cc:493] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:24.247534 1467 raft_consensus.cc:515] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.248543 1467 leader_election.cc:290] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:24.249796 999 leader_election.cc:343] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: f1ed26420c64492a94e8920d8c753fc3
I20260318 02:51:24.250900 1184 ts_tablet_manager.cc:1929] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:24.253481 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9573754c7e3b4c0b8200f0cc47b2182d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.251783 997 leader_election.cc:343] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: f1ed26420c64492a94e8920d8c753fc3
I20260318 02:51:24.254667 997 leader_election.cc:304] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:24.255113 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 74233fd7ed094e7cbfc79309605db0e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:24.255362 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b9ac6b9d4a245ec8d8aed1db976123b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:24.254345 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 96a6d1808417419dac0d2b2e80c5ca22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96a6d1808417419dac0d2b2e80c5ca22 already in progress: creating tablet
I20260318 02:51:24.255606 1467 raft_consensus.cc:2749] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:24.255888 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 8319efcfa31b45afb4dbd90cb5f13e97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:24.256098 1184 log.cc:1199] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/f7415ddf48574f7b9a746049ce78d2e9
W20260318 02:51:24.256327 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9573754c7e3b4c0b8200f0cc47b2182d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.256537 1184 ts_tablet_manager.cc:1950] T f7415ddf48574f7b9a746049ce78d2e9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:24.257393 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 253) took 1278 ms. Trace:
I20260318 02:51:24.257496 1184 rpcz_store.cc:276] 0318 02:51:22.978821 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:22.978871 (+ 50us) service_pool.cc:225] Handling call
0318 02:51:24.136011 (+1157140us) ts_tablet_manager.cc:1151] Deleting tablet f7415ddf48574f7b9a746049ce78d2e9
0318 02:51:24.136129 (+ 118us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:24.207331 (+ 71202us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:24.250780 (+ 43449us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:24.257340 (+ 6560us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1155087}
I20260318 02:51:24.258351 1184 tablet_replica.cc:333] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:24.258605 1184 raft_consensus.cc:2243] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.258863 1184 raft_consensus.cc:2272] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.259526 764 tablet_service.cc:1511] Processing CreateTablet for tablet 42a6983dce4e476cae97b3ecb1133077 (DEFAULT_TABLE table=default.Table_c14f375645d84629b54e18e482938be5 [id=a2001813279f4449abf9bceaa75bcf76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.260084 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42a6983dce4e476cae97b3ecb1133077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.263111 1184 ts_tablet_manager.cc:1916] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:24.266985 1176 ts_tablet_manager.cc:1929] T 45fddf78fc834d20908696b980d394a2 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:24.267138 1176 log.cc:1199] T 45fddf78fc834d20908696b980d394a2 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/45fddf78fc834d20908696b980d394a2
I20260318 02:51:24.267513 1176 ts_tablet_manager.cc:1950] T 45fddf78fc834d20908696b980d394a2 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:24.267971 1173 tablet_bootstrap.cc:492] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:24.268137 1173 ts_tablet_manager.cc:1403] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.280s user 0.038s sys 0.105s
I20260318 02:51:24.268819 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 45fddf78fc834d20908696b980d394a2 (table default.Table_b4c6c515fa1b469bad29515911177508 [id=895bbd90cf47462ab116ee3f37e94982]) successfully deleted
I20260318 02:51:24.268991 1173 raft_consensus.cc:359] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.269186 1173 raft_consensus.cc:385] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.269282 1173 raft_consensus.cc:740] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.269572 1173 consensus_queue.cc:260] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.270257 760 tablet_service.cc:1511] Processing CreateTablet for tablet 061ebb62f4c54a2a8c24b90ec15402d3 (DEFAULT_TABLE table=default.Table_73bd00aac389472ba24f2baa8f23b550 [id=5a3571f0765948588578d8e5185807a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.270430 1176 tablet_replica.cc:333] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:24.270645 1176 raft_consensus.cc:2243] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.270727 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061ebb62f4c54a2a8c24b90ec15402d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.270812 1176 raft_consensus.cc:2272] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.271106 1173 ts_tablet_manager.cc:1434] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:24.271351 1173 tablet_bootstrap.cc:492] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:24.272951 1173 tablet_bootstrap.cc:654] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.273453 1176 ts_tablet_manager.cc:1916] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:24.277951 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet b230018a95a54ababfe5ecf2ca1e2e49 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b230018a95a54ababfe5ecf2ca1e2e49 already in progress: creating tablet
W20260318 02:51:24.278267 443 catalog_manager.cc:4969] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 74233fd7ed094e7cbfc79309605db0e1 because the tablet was not found. No further retry: Not found: Tablet not found: 74233fd7ed094e7cbfc79309605db0e1
I20260318 02:51:24.281939 1173 tablet_bootstrap.cc:492] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:24.282123 1173 ts_tablet_manager.cc:1403] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20260318 02:51:24.282634 1176 ts_tablet_manager.cc:1929] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:24.282804 1184 ts_tablet_manager.cc:1929] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:24.282835 1176 log.cc:1199] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/3b9ac6b9d4a245ec8d8aed1db976123b
I20260318 02:51:24.282938 1173 raft_consensus.cc:359] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.283181 1176 ts_tablet_manager.cc:1950] T 3b9ac6b9d4a245ec8d8aed1db976123b P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:24.283141 1173 raft_consensus.cc:385] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.283255 1173 raft_consensus.cc:740] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.283535 1173 consensus_queue.cc:260] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.284942 972 heartbeater.cc:344] Connected to a master server at 127.0.104.188:41593
I20260318 02:51:24.285377 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 3b9ac6b9d4a245ec8d8aed1db976123b (table default.Table_1e6ea5dc81d34a03b5135f4caeef56f5 [id=a2ddfb27f7ea4388b92f5b5703c88fdd]) successfully deleted
I20260318 02:51:24.285840 1176 tablet_replica.cc:333] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:24.286204 1176 raft_consensus.cc:2243] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.287386 1173 ts_tablet_manager.cc:1434] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260318 02:51:24.286844 1467 raft_consensus.cc:493] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:24.287583 1467 raft_consensus.cc:515] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.286674 1176 raft_consensus.cc:2272] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.288379 1467 leader_election.cc:290] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:24.288394 441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.189:45933, user_credentials={real_user=slave}} blocked reactor thread for 69270.8us
I20260318 02:51:24.289016 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df8029146564e1c9dc88dd9f5fb64ae" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:24.289203 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c8264f69f934d3ba2e41434ce350f3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.289247 926 raft_consensus.cc:2468] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:24.289721 1173 tablet_bootstrap.cc:492] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:24.289701 997 leader_election.cc:304] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:24.291168 1467 raft_consensus.cc:2804] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:24.291342 1467 raft_consensus.cc:493] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:24.291432 1467 raft_consensus.cc:3060] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:24.291574 1176 ts_tablet_manager.cc:1916] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:24.294328 1467 raft_consensus.cc:515] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.295938 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet b230018a95a54ababfe5ecf2ca1e2e49 with delete_type TABLET_DATA_DELETED (replaced by tablet 813702e53eee4a54a7d693fd6e03bbbb) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:24.296190 999 leader_election.cc:343] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 1df8029146564e1c9dc88dd9f5fb64ae
I20260318 02:51:24.296888 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet 45fddf78fc834d20908696b980d394a2 with delete_type TABLET_DATA_DELETED (replaced by tablet d2fb9c8f339444bc8d7c6479e7d87f44) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.297227 1467 leader_election.cc:290] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:24.297549 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a6d1808417419dac0d2b2e80c5ca22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.297775 1172 tablet_bootstrap.cc:492] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:24.297958 1172 ts_tablet_manager.cc:1403] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.156s user 0.002s sys 0.002s
I20260318 02:51:24.297966 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c8264f69f934d3ba2e41434ce350f3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.298300 1184 log.cc:1199] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/053a09fd13fa4d8e80133fd77acaa4ce
I20260318 02:51:24.298447 1176 ts_tablet_manager.cc:1929] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260318 02:51:24.298493 999 leader_election.cc:343] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 1df8029146564e1c9dc88dd9f5fb64ae
I20260318 02:51:24.298584 1176 log.cc:1199] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/8319efcfa31b45afb4dbd90cb5f13e97
I20260318 02:51:24.298758 1184 ts_tablet_manager.cc:1950] T 053a09fd13fa4d8e80133fd77acaa4ce P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:24.298913 1176 ts_tablet_manager.cc:1950] T 8319efcfa31b45afb4dbd90cb5f13e97 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:24.298856 1172 raft_consensus.cc:359] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.299085 1172 raft_consensus.cc:385] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.299168 1172 raft_consensus.cc:740] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.299401 1172 consensus_queue.cc:260] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.299952 1172 ts_tablet_manager.cc:1434] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:24.299919 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 8319efcfa31b45afb4dbd90cb5f13e97 (table default.Table_2faebbd7206f45ebb8c858d1a5936cb3 [id=985db776346840d0afa3544d24902aa7]) successfully deleted
I20260318 02:51:24.300444 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a6d1808417419dac0d2b2e80c5ca22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.301102 892 tablet_service.cc:1558] Processing DeleteTablet for tablet b230018a95a54ababfe5ecf2ca1e2e49 with delete_type TABLET_DATA_DELETED (replaced by tablet 813702e53eee4a54a7d693fd6e03bbbb) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.301496 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 45fddf78fc834d20908696b980d394a2 with delete_type TABLET_DATA_DELETED (replaced by tablet d2fb9c8f339444bc8d7c6479e7d87f44) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.301642 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df8029146564e1c9dc88dd9f5fb64ae" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:24.301854 926 raft_consensus.cc:3060] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:24.302460 903 tablet_service.cc:1511] Processing CreateTablet for tablet 42a6983dce4e476cae97b3ecb1133077 (DEFAULT_TABLE table=default.Table_c14f375645d84629b54e18e482938be5 [id=a2001813279f4449abf9bceaa75bcf76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.302588 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 3d7b339a29ef456997d74a7a95d4c03a (DEFAULT_TABLE table=default.Table_b4f218d2fea54a31be80372e05eaa6ae [id=545ec19ee7a34ceb8e7adb93b6eaecf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.302917 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42a6983dce4e476cae97b3ecb1133077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.304801 926 raft_consensus.cc:2468] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:24.306572 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d7b339a29ef456997d74a7a95d4c03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.308979 1173 tablet_bootstrap.cc:654] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.309613 997 leader_election.cc:304] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:24.310297 1467 raft_consensus.cc:2804] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:24.310837 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 42a6983dce4e476cae97b3ecb1133077 (DEFAULT_TABLE table=default.Table_c14f375645d84629b54e18e482938be5 [id=a2001813279f4449abf9bceaa75bcf76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.311311 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42a6983dce4e476cae97b3ecb1133077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.311216 903 tablet_service.cc:1511] Processing CreateTablet for tablet 061ebb62f4c54a2a8c24b90ec15402d3 (DEFAULT_TABLE table=default.Table_73bd00aac389472ba24f2baa8f23b550 [id=5a3571f0765948588578d8e5185807a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.311688 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061ebb62f4c54a2a8c24b90ec15402d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.317633 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 061ebb62f4c54a2a8c24b90ec15402d3 (DEFAULT_TABLE table=default.Table_73bd00aac389472ba24f2baa8f23b550 [id=5a3571f0765948588578d8e5185807a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.318061 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061ebb62f4c54a2a8c24b90ec15402d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.322598 1184 tablet_replica.cc:333] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:24.322973 1184 raft_consensus.cc:2243] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.323173 1184 raft_consensus.cc:2272] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.327824 1184 ts_tablet_manager.cc:1916] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:24.329011 1174 tablet_bootstrap.cc:492] T 31d493650d07437c9f1d657bb08a98d7 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:24.329182 1174 ts_tablet_manager.cc:1403] T 31d493650d07437c9f1d657bb08a98d7 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.095s user 0.006s sys 0.007s
I20260318 02:51:24.330159 1467 raft_consensus.cc:697] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:24.330185 1174 raft_consensus.cc:359] T 31d493650d07437c9f1d657bb08a98d7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.330392 1174 raft_consensus.cc:385] T 31d493650d07437c9f1d657bb08a98d7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.330498 1174 raft_consensus.cc:740] T 31d493650d07437c9f1d657bb08a98d7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.330716 1467 consensus_queue.cc:237] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.330951 1174 consensus_queue.cc:260] T 31d493650d07437c9f1d657bb08a98d7 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.331779 1174 ts_tablet_manager.cc:1434] T 31d493650d07437c9f1d657bb08a98d7 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260318 02:51:24.332206 1174 tablet_bootstrap.cc:492] T 323e4b1e9aee449f9402b1712b1444d9 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:24.334029 1174 tablet_bootstrap.cc:654] T 323e4b1e9aee449f9402b1712b1444d9 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.336283 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet f7415ddf48574f7b9a746049ce78d2e9 (table default.Table_ac694c873ef141579c82755592552b23 [id=a004400b026145a5be338b0b2e4b8ce3]) successfully deleted
I20260318 02:51:24.336352 831 heartbeater.cc:344] Connected to a master server at 127.0.104.188:41593
I20260318 02:51:24.336540 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 053a09fd13fa4d8e80133fd77acaa4ce (table default.Table_bb21feccea674d3e8845f95753367aa8 [id=3a77e587db534e32b2716d153a8419cd]) successfully deleted
W20260318 02:51:24.336794 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 0d343e53f2354a3386b19d71ef00d5a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d343e53f2354a3386b19d71ef00d5a4 already in progress: creating tablet
W20260318 02:51:24.337162 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet b716c3a80d4a44d190de38f926098efc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b716c3a80d4a44d190de38f926098efc already in progress: creating tablet
W20260318 02:51:24.337909 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet bf09f8234f36402bb9129d524637b5b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf09f8234f36402bb9129d524637b5b5 already in progress: creating tablet
W20260318 02:51:24.338465 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 0c8264f69f934d3ba2e41434ce350f3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c8264f69f934d3ba2e41434ce350f3e already in progress: creating tablet
W20260318 02:51:24.338860 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 96a6d1808417419dac0d2b2e80c5ca22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96a6d1808417419dac0d2b2e80c5ca22 already in progress: creating tablet
W20260318 02:51:24.339120 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet b230018a95a54ababfe5ecf2ca1e2e49 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b230018a95a54ababfe5ecf2ca1e2e49 already in progress: creating tablet
W20260318 02:51:24.339318 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 45fddf78fc834d20908696b980d394a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45fddf78fc834d20908696b980d394a2 already in progress: creating tablet
I20260318 02:51:24.341558 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet ec32c25ae14b406cb6ab4d913b575091
I20260318 02:51:24.342088 455 catalog_manager.cc:6741] ReplaceTablet: tablet ec32c25ae14b406cb6ab4d913b575091 deleted and replaced by tablet a0a6f4b34ff14714892ed9e9b3604dc9
I20260318 02:51:24.342511 764 tablet_service.cc:1558] Processing DeleteTablet for tablet ec32c25ae14b406cb6ab4d913b575091 with delete_type TABLET_DATA_DELETED (replaced by tablet a0a6f4b34ff14714892ed9e9b3604dc9) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:24.343137 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet ec32c25ae14b406cb6ab4d913b575091 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec32c25ae14b406cb6ab4d913b575091 already in progress: creating tablet
I20260318 02:51:24.343372 1530 raft_consensus.cc:493] T 22caed5f1870469d834aecd2bc42bdda P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:24.343544 1530 raft_consensus.cc:515] T 22caed5f1870469d834aecd2bc42bdda P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.343956 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f6b8b4d3b2c646ceb47e4a306bd93fe9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:24.344455 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7b0bea6538a9448aa9cb4132f0970647"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.344600 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6b8b4d3b2c646ceb47e4a306bd93fe9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.344846 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caed5f1870469d834aecd2bc42bdda" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
W20260318 02:51:24.344964 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b0bea6538a9448aa9cb4132f0970647 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.345083 785 raft_consensus.cc:2393] T 22caed5f1870469d834aecd2bc42bdda P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9422bb7011f342b08be0b073a88c4c4d in current term 1: Already voted for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in this term.
I20260318 02:51:24.346124 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 71c518c87bdd4a63aa1016e8de6bafdc
I20260318 02:51:24.346660 454 master_service.cc:954] ReplaceTablet: received request to replace tablet 74233fd7ed094e7cbfc79309605db0e1 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:24.347150 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22caed5f1870469d834aecd2bc42bdda" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:24.347158 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7671b3be1e0c4259a325679c394aae2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.347659 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7671b3be1e0c4259a325679c394aae2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.347998 997 leader_election.cc:304] T 22caed5f1870469d834aecd2bc42bdda P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:24.348747 449 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet a1780277d5b54e1c909bad5b22eb1e5d
I20260318 02:51:24.348815 1530 leader_election.cc:290] T 22caed5f1870469d834aecd2bc42bdda P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:24.349010 1530 raft_consensus.cc:3060] T 22caed5f1870469d834aecd2bc42bdda P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:24.349094 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c8066725c1a94b1f9e3a030be08a461d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.349597 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8066725c1a94b1f9e3a030be08a461d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.350008 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 31d493650d07437c9f1d657bb08a98d7 with delete_type TABLET_DATA_DELETED (replaced by tablet 105326aea9f744779ca76e0cbb2448cd) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:24.350415 1172 tablet_bootstrap.cc:492] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:24.350589 1176 tablet_replica.cc:333] T 31d493650d07437c9f1d657bb08a98d7 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:24.350782 1176 raft_consensus.cc:2243] T 31d493650d07437c9f1d657bb08a98d7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.350950 1176 raft_consensus.cc:2272] T 31d493650d07437c9f1d657bb08a98d7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.350942 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_14f5197a4ef6461daa2267c549d5078f" } new_table_name: "default.Table_8dfcbdb7d773436fb70053d0d4a1d9e8" modify_external_catalogs: true
I20260318 02:51:24.352969 1176 ts_tablet_manager.cc:1916] T 31d493650d07437c9f1d657bb08a98d7 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:24.354337 1530 raft_consensus.cc:2749] T 22caed5f1870469d834aecd2bc42bdda P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:24.358080 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 71c518c87bdd4a63aa1016e8de6bafdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:24.361167 1176 ts_tablet_manager.cc:1929] T 31d493650d07437c9f1d657bb08a98d7 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:24.361454 1176 log.cc:1199] T 31d493650d07437c9f1d657bb08a98d7 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/31d493650d07437c9f1d657bb08a98d7
I20260318 02:51:24.361965 1176 ts_tablet_manager.cc:1950] T 31d493650d07437c9f1d657bb08a98d7 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:24.362625 1173 tablet_bootstrap.cc:492] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:24.362634 1184 ts_tablet_manager.cc:1929] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:24.362799 1173 ts_tablet_manager.cc:1403] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.074s user 0.016s sys 0.008s
I20260318 02:51:24.363265 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 31d493650d07437c9f1d657bb08a98d7 (table default.Table_ea08fcfa1efe4bc2a486fc1423ce06ce [id=58354360683d422dbdcc43826b39dbc8]) successfully deleted
I20260318 02:51:24.363656 1173 raft_consensus.cc:359] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.363864 1173 raft_consensus.cc:385] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.363956 1173 raft_consensus.cc:740] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.364187 1173 consensus_queue.cc:260] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:24.364804 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 71c518c87bdd4a63aa1016e8de6bafdc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71c518c87bdd4a63aa1016e8de6bafdc already in progress: creating tablet
I20260318 02:51:24.368499 1184 log.cc:1199] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/c23b646a132743cc9b4dcd85c6d4ebea
I20260318 02:51:24.369029 1184 ts_tablet_manager.cc:1950] T c23b646a132743cc9b4dcd85c6d4ebea P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:24.371172 1172 tablet_bootstrap.cc:654] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.371855 1184 tablet_replica.cc:333] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:24.373167 1174 tablet_bootstrap.cc:492] T 323e4b1e9aee449f9402b1712b1444d9 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:24.373406 1174 ts_tablet_manager.cc:1403] T 323e4b1e9aee449f9402b1712b1444d9 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.000s
I20260318 02:51:24.374205 1174 raft_consensus.cc:359] T 323e4b1e9aee449f9402b1712b1444d9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.374579 1173 ts_tablet_manager.cc:1434] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260318 02:51:24.374855 892 tablet_service.cc:1558] Processing DeleteTablet for tablet ec32c25ae14b406cb6ab4d913b575091 with delete_type TABLET_DATA_DELETED (replaced by tablet a0a6f4b34ff14714892ed9e9b3604dc9) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.376437 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 71c518c87bdd4a63aa1016e8de6bafdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.376957 1184 raft_consensus.cc:2243] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.377285 1184 raft_consensus.cc:2272] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.378651 1174 raft_consensus.cc:385] T 323e4b1e9aee449f9402b1712b1444d9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.378815 1174 raft_consensus.cc:740] T 323e4b1e9aee449f9402b1712b1444d9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.378862 1184 ts_tablet_manager.cc:1916] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:24.379101 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet ec32c25ae14b406cb6ab4d913b575091 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec32c25ae14b406cb6ab4d913b575091 already in progress: creating tablet
W20260318 02:51:24.379391 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 71c518c87bdd4a63aa1016e8de6bafdc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71c518c87bdd4a63aa1016e8de6bafdc already in progress: creating tablet
I20260318 02:51:24.379484 1173 tablet_bootstrap.cc:492] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:24.381201 1174 consensus_queue.cc:260] T 323e4b1e9aee449f9402b1712b1444d9 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.382045 1174 ts_tablet_manager.cc:1434] T 323e4b1e9aee449f9402b1712b1444d9 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260318 02:51:24.382458 1174 tablet_bootstrap.cc:492] T e61c374078854d589219dfa4c20e4222 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:24.382954 1172 tablet_bootstrap.cc:492] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:24.383414 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet da240bc0d5b043b89232fdf646f4f344
I20260318 02:51:24.383112 1172 ts_tablet_manager.cc:1403] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.002s
I20260318 02:51:24.385317 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 959faf1fbb224434b896c0f21e9715be
I20260318 02:51:24.385507 1172 raft_consensus.cc:359] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.385679 1172 raft_consensus.cc:385] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.385733 456 catalog_manager.cc:6741] ReplaceTablet: tablet 959faf1fbb224434b896c0f21e9715be deleted and replaced by tablet c7c4257a54d3487aa520531a64fc721c
I20260318 02:51:24.385762 1172 raft_consensus.cc:740] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.385993 1172 consensus_queue.cc:260] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:24.386844 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1516525b471540288c6cb5d61120d430 consensus state has no leader
I20260318 02:51:24.388154 903 tablet_service.cc:1558] Processing DeleteTablet for tablet da240bc0d5b043b89232fdf646f4f344 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.388455 1175 tablet_replica.cc:333] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:24.388523 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_708d1089f5f84e7999d353fda6b5985d" } new_table_name: "default.Table_51d490345e9f497ca6b3076edf95c90f" modify_external_catalogs: true
I20260318 02:51:24.388677 1175 raft_consensus.cc:2243] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.388934 1175 raft_consensus.cc:2272] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.389540 1175 ts_tablet_manager.cc:1916] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:24.389935 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc47f35f9c2c4e5085ab482285effc91 consensus state has no leader
I20260318 02:51:24.390314 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_394ace014c534ba89ca6accaf1363761"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.390847 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_394ace014c534ba89ca6accaf1363761 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.392517 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f33dc646209c42f9859981dd48aed6ed" } new_table_name: "default.Table_e4e8936ba8634b8e8ac79e1c70e97845" modify_external_catalogs: true
I20260318 02:51:24.393867 1174 tablet_bootstrap.cc:654] T e61c374078854d589219dfa4c20e4222 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.395408 764 tablet_service.cc:1558] Processing DeleteTablet for tablet da240bc0d5b043b89232fdf646f4f344 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:24.395659 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 959faf1fbb224434b896c0f21e9715be with delete_type TABLET_DATA_DELETED (replaced by tablet c7c4257a54d3487aa520531a64fc721c) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:24.395815 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 323e4b1e9aee449f9402b1712b1444d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 8c20810ad3354126bf49bbeeb6edb098) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:24.396116 1176 tablet_replica.cc:333] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:24.396345 1176 raft_consensus.cc:2243] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:24.396782 1176 raft_consensus.cc:2272] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.397413 1176 ts_tablet_manager.cc:1916] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:24.400506 1175 ts_tablet_manager.cc:1929] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:24.400699 1173 tablet_bootstrap.cc:654] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.400842 1175 log.cc:1199] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/da240bc0d5b043b89232fdf646f4f344
I20260318 02:51:24.401377 1175 ts_tablet_manager.cc:1950] T da240bc0d5b043b89232fdf646f4f344 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:24.405404 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet da240bc0d5b043b89232fdf646f4f344 (table default.Table_d7429a91cdb142b99d2f341a75bc82bf [id=d7f85dc897794d14af2f182a59150e92]) successfully deleted
I20260318 02:51:24.406162 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 959faf1fbb224434b896c0f21e9715be with delete_type TABLET_DATA_DELETED (replaced by tablet c7c4257a54d3487aa520531a64fc721c) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.409271 1184 ts_tablet_manager.cc:1929] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260318 02:51:24.411168 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 421e5223d6af4da1a8e07534f942d016 consensus state has no leader
W20260318 02:51:24.411437 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 959faf1fbb224434b896c0f21e9715be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 959faf1fbb224434b896c0f21e9715be already in progress: creating tablet
I20260318 02:51:24.415086 1176 ts_tablet_manager.cc:1929] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260318 02:51:24.418524 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba3e7e9a85c94d7380b96a9373c1f503 has no consensus state
I20260318 02:51:24.418810 1176 log.cc:1199] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/da240bc0d5b043b89232fdf646f4f344
I20260318 02:51:24.419349 1176 ts_tablet_manager.cc:1950] T da240bc0d5b043b89232fdf646f4f344 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
W20260318 02:51:24.419361 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b383fd49049c4c1daba3f1ed60899f3e has no consensus state
I20260318 02:51:24.420521 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet da240bc0d5b043b89232fdf646f4f344 (table default.Table_d7429a91cdb142b99d2f341a75bc82bf [id=d7f85dc897794d14af2f182a59150e92]) successfully deleted
I20260318 02:51:24.421172 1184 log.cc:1199] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/0e4719eafd2947bfacf3e1d2df1ae43e
I20260318 02:51:24.421614 1184 ts_tablet_manager.cc:1950] T 0e4719eafd2947bfacf3e1d2df1ae43e P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
W20260318 02:51:24.422269 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 959faf1fbb224434b896c0f21e9715be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 959faf1fbb224434b896c0f21e9715be already in progress: creating tablet
I20260318 02:51:24.423820 1184 tablet_replica.cc:333] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:24.423870 1174 tablet_bootstrap.cc:492] T e61c374078854d589219dfa4c20e4222 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:24.424083 1176 tablet_replica.cc:333] T 323e4b1e9aee449f9402b1712b1444d9 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:24.424647 1174 ts_tablet_manager.cc:1403] T e61c374078854d589219dfa4c20e4222 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.042s user 0.008s sys 0.002s
I20260318 02:51:24.426489 1422 consensus_queue.cc:1048] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:24.429728 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_28a12ac7769744d1ba2c07c2b335e41e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.430398 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28a12ac7769744d1ba2c07c2b335e41e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.435307 452 catalog_manager.cc:5671] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 reported cstate change: term changed from 0 to 1, leader changed from <none> to b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130). New cstate: current_term: 1 leader_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:24.435774 452 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 549b3929ea33417bbe50e749bbfe223d (table default.Table_6d1c07d8eced44aa8431a666a70ae5ea [id=f62386b6ad9441eeafff054f00ee0423]). Expected version 2 got 0
I20260318 02:51:24.439581 760 tablet_service.cc:1511] Processing CreateTablet for tablet 3dda9bd9befd427fac9dfde6f299a6ab (DEFAULT_TABLE table=default.Table_a5974ba51eec46dfa733c7b066123d8e [id=be8bd5c24eda495abd4c05a866a2c194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.440747 903 tablet_service.cc:1511] Processing CreateTablet for tablet 3dda9bd9befd427fac9dfde6f299a6ab (DEFAULT_TABLE table=default.Table_a5974ba51eec46dfa733c7b066123d8e [id=be8bd5c24eda495abd4c05a866a2c194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.440832 754 tablet_service.cc:1511] Processing CreateTablet for tablet 7c0d87304c41481299f1e2ddfdfcfdec (DEFAULT_TABLE table=default.Table_b4f791ee528d46b59428dc367b5be0a8 [id=e3979c7eefe84cd7bb1dd36fa9351b7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.441213 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dda9bd9befd427fac9dfde6f299a6ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.443429 764 tablet_service.cc:1511] Processing CreateTablet for tablet 2a7ddc0807d742cea258f889390e2142 (DEFAULT_TABLE table=default.Table_176fa1820ca44b3cbdfad38228b9dc7b [id=ff1dddd3bf73410c816e618a9931c7cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.445757 892 tablet_service.cc:1511] Processing CreateTablet for tablet 7c0d87304c41481299f1e2ddfdfcfdec (DEFAULT_TABLE table=default.Table_b4f791ee528d46b59428dc367b5be0a8 [id=e3979c7eefe84cd7bb1dd36fa9351b7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.446236 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0d87304c41481299f1e2ddfdfcfdec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.447038 756 tablet_service.cc:1511] Processing CreateTablet for tablet 503386365f6a49f6b84c64b59b764c10 (DEFAULT_TABLE table=default.Table_9a44c965ec574cae8cced06f58d02bff [id=f3b5bd76bc0945119db3449ce8ce5998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.450783 762 tablet_service.cc:1511] Processing CreateTablet for tablet bf344c2361b7412c87a7c7f9a72a15b6 (DEFAULT_TABLE table=default.Table_67969be821524f06922e86b98527c45b [id=d22d61a1d07149c3bf62dd9412aaa9c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.450716 1174 raft_consensus.cc:359] T e61c374078854d589219dfa4c20e4222 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.450978 1174 raft_consensus.cc:385] T e61c374078854d589219dfa4c20e4222 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.451082 1174 raft_consensus.cc:740] T e61c374078854d589219dfa4c20e4222 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.451184 763 tablet_service.cc:1511] Processing CreateTablet for tablet e916c5419e3c457f98a47c6a1c6cdd56 (DEFAULT_TABLE table=default.Table_5ffb8d228c5745e19ab88df19ce659c2 [id=b22ba2f393644e99b2b74ff6236325c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.451380 1174 consensus_queue.cc:260] T e61c374078854d589219dfa4c20e4222 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.450736 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dda9bd9befd427fac9dfde6f299a6ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.451840 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0d87304c41481299f1e2ddfdfcfdec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.451974 1174 ts_tablet_manager.cc:1434] T e61c374078854d589219dfa4c20e4222 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.027s user 0.000s sys 0.002s
I20260318 02:51:24.452317 1174 tablet_bootstrap.cc:492] T 959faf1fbb224434b896c0f21e9715be P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:24.453070 752 tablet_service.cc:1511] Processing CreateTablet for tablet 0b39433a5a7f42c39139db0da77ae75f (DEFAULT_TABLE table=default.Table_0047a213aefb4d9ca8f56c91c109b6a6 [id=ef1334ee44b343c8be2b1ef5913bf26b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.453485 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b39433a5a7f42c39139db0da77ae75f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.453866 901 tablet_service.cc:1511] Processing CreateTablet for tablet 2a7ddc0807d742cea258f889390e2142 (DEFAULT_TABLE table=default.Table_176fa1820ca44b3cbdfad38228b9dc7b [id=ff1dddd3bf73410c816e618a9931c7cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.454246 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a7ddc0807d742cea258f889390e2142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.455421 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf344c2361b7412c87a7c7f9a72a15b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.457250 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 503386365f6a49f6b84c64b59b764c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.459724 904 tablet_service.cc:1511] Processing CreateTablet for tablet bf344c2361b7412c87a7c7f9a72a15b6 (DEFAULT_TABLE table=default.Table_67969be821524f06922e86b98527c45b [id=d22d61a1d07149c3bf62dd9412aaa9c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.460142 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf344c2361b7412c87a7c7f9a72a15b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.460304 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e916c5419e3c457f98a47c6a1c6cdd56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.462363 1174 tablet_bootstrap.cc:654] T 959faf1fbb224434b896c0f21e9715be P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.462446 754 tablet_service.cc:1511] Processing CreateTablet for tablet 813702e53eee4a54a7d693fd6e03bbbb (DEFAULT_TABLE table=default.Table_f6bd74ee469e431eb8367558134a24b5 [id=9278db75ac0f4aa59c4af2f13a58e314]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.463008 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813702e53eee4a54a7d693fd6e03bbbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.468395 889 tablet_service.cc:1511] Processing CreateTablet for tablet 503386365f6a49f6b84c64b59b764c10 (DEFAULT_TABLE table=default.Table_9a44c965ec574cae8cced06f58d02bff [id=f3b5bd76bc0945119db3449ce8ce5998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.468895 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 503386365f6a49f6b84c64b59b764c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.468979 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a7ddc0807d742cea258f889390e2142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.474239 766 tablet_service.cc:1511] Processing CreateTablet for tablet 56335a4a2c294f67a22206e6a59e29a8 (DEFAULT_TABLE table=default.Table_98ff851e3ed0463cb3ef7f1907fa7711 [id=3da3ae03107e44518a289e073abc0998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.474656 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56335a4a2c294f67a22206e6a59e29a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.475157 907 tablet_service.cc:1511] Processing CreateTablet for tablet e916c5419e3c457f98a47c6a1c6cdd56 (DEFAULT_TABLE table=default.Table_5ffb8d228c5745e19ab88df19ce659c2 [id=b22ba2f393644e99b2b74ff6236325c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.475564 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e916c5419e3c457f98a47c6a1c6cdd56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.475538 763 tablet_service.cc:1511] Processing CreateTablet for tablet d1a67e637d934c0f99c00d04fb26df0d (DEFAULT_TABLE table=default.Table_35fa57e328b44e50b0d68b77bd7def72 [id=5d7bac7ca89d4b11ab8a882731f9b858]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.475922 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a67e637d934c0f99c00d04fb26df0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.476881 758 tablet_service.cc:1558] Processing DeleteTablet for tablet e61c374078854d589219dfa4c20e4222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:24.480383 758 tablet_service.cc:1511] Processing CreateTablet for tablet d2fb9c8f339444bc8d7c6479e7d87f44 (DEFAULT_TABLE table=default.Table_b4c6c515fa1b469bad29515911177508 [id=895bbd90cf47462ab116ee3f37e94982]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.481014 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2fb9c8f339444bc8d7c6479e7d87f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.483207 906 tablet_service.cc:1511] Processing CreateTablet for tablet 0b39433a5a7f42c39139db0da77ae75f (DEFAULT_TABLE table=default.Table_0047a213aefb4d9ca8f56c91c109b6a6 [id=ef1334ee44b343c8be2b1ef5913bf26b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.483650 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b39433a5a7f42c39139db0da77ae75f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.486513 759 tablet_service.cc:1511] Processing CreateTablet for tablet b383fd49049c4c1daba3f1ed60899f3e (DEFAULT_TABLE table=default.Table_e4e8936ba8634b8e8ac79e1c70e97845 [id=fc9e568fb3884c3ca8575e591393560e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.486927 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b383fd49049c4c1daba3f1ed60899f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.490211 1173 tablet_bootstrap.cc:492] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:24.490438 1173 ts_tablet_manager.cc:1403] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.111s user 0.016s sys 0.001s
I20260318 02:51:24.491282 1173 raft_consensus.cc:359] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.491523 1173 raft_consensus.cc:385] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.491595 1173 raft_consensus.cc:740] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.491756 1228 consensus_queue.cc:1048] T 22caed5f1870469d834aecd2bc42bdda P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:24.491824 1173 consensus_queue.cc:260] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.492483 1173 ts_tablet_manager.cc:1434] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:24.494968 1422 raft_consensus.cc:493] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:24.495152 1422 raft_consensus.cc:515] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.495792 1422 leader_election.cc:290] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:24.495952 1422 raft_consensus.cc:493] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:24.496088 1422 raft_consensus.cc:515] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.496613 1422 leader_election.cc:290] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:24.503782 895 tablet_service.cc:1511] Processing CreateTablet for tablet 813702e53eee4a54a7d693fd6e03bbbb (DEFAULT_TABLE table=default.Table_f6bd74ee469e431eb8367558134a24b5 [id=9278db75ac0f4aa59c4af2f13a58e314]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.504416 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813702e53eee4a54a7d693fd6e03bbbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.511572 891 tablet_service.cc:1511] Processing CreateTablet for tablet ba3e7e9a85c94d7380b96a9373c1f503 (DEFAULT_TABLE table=default.Table_51d490345e9f497ca6b3076edf95c90f [id=fbbe8921ed4344c18e2276270fcaf24f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.512099 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba3e7e9a85c94d7380b96a9373c1f503. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:24.513782 862 leader_election.cc:343] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 3ff487cba236491eb22becf0dc591925
W20260318 02:51:24.514568 862 leader_election.cc:343] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 8319efcfa31b45afb4dbd90cb5f13e97
I20260318 02:51:24.516251 1228 consensus_queue.cc:1048] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:24.517872 1176 raft_consensus.cc:2243] T 323e4b1e9aee449f9402b1712b1444d9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.520349 902 tablet_service.cc:1511] Processing CreateTablet for tablet 56335a4a2c294f67a22206e6a59e29a8 (DEFAULT_TABLE table=default.Table_98ff851e3ed0463cb3ef7f1907fa7711 [id=3da3ae03107e44518a289e073abc0998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.520876 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56335a4a2c294f67a22206e6a59e29a8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:24.411664 997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 63722.5us
I20260318 02:51:24.522255 1176 raft_consensus.cc:2272] T 323e4b1e9aee449f9402b1712b1444d9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.522845 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet ec32c25ae14b406cb6ab4d913b575091 with delete_type TABLET_DATA_DELETED (replaced by tablet a0a6f4b34ff14714892ed9e9b3604dc9) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.523073 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba with delete_type TABLET_DATA_DELETED (replaced by tablet bd077319b3c443849de087eb61da6a77) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.523130 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet da240bc0d5b043b89232fdf646f4f344 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.523303 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 71c518c87bdd4a63aa1016e8de6bafdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.523801 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 7c0d87304c41481299f1e2ddfdfcfdec (DEFAULT_TABLE table=default.Table_b4f791ee528d46b59428dc367b5be0a8 [id=e3979c7eefe84cd7bb1dd36fa9351b7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.523943 1032 tablet_service.cc:1511] Processing CreateTablet for tablet bf344c2361b7412c87a7c7f9a72a15b6 (DEFAULT_TABLE table=default.Table_67969be821524f06922e86b98527c45b [id=d22d61a1d07149c3bf62dd9412aaa9c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.524231 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c0d87304c41481299f1e2ddfdfcfdec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.524376 1041 tablet_service.cc:1511] Processing CreateTablet for tablet e916c5419e3c457f98a47c6a1c6cdd56 (DEFAULT_TABLE table=default.Table_5ffb8d228c5745e19ab88df19ce659c2 [id=b22ba2f393644e99b2b74ff6236325c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.409319 1172 ts_tablet_manager.cc:1434] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.025s user 0.002s sys 0.000s
I20260318 02:51:24.524756 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e916c5419e3c457f98a47c6a1c6cdd56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.524900 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 503386365f6a49f6b84c64b59b764c10 (DEFAULT_TABLE table=default.Table_9a44c965ec574cae8cced06f58d02bff [id=f3b5bd76bc0945119db3449ce8ce5998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.525065 1172 tablet_bootstrap.cc:492] T 32880a703603476786b4a34ddd40cab8 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:24.523312 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet 959faf1fbb224434b896c0f21e9715be with delete_type TABLET_DATA_DELETED (replaced by tablet c7c4257a54d3487aa520531a64fc721c) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.497259 1109 heartbeater.cc:344] Connected to a master server at 127.0.104.188:41593
I20260318 02:51:24.528777 896 tablet_service.cc:1511] Processing CreateTablet for tablet d1a67e637d934c0f99c00d04fb26df0d (DEFAULT_TABLE table=default.Table_35fa57e328b44e50b0d68b77bd7def72 [id=5d7bac7ca89d4b11ab8a882731f9b858]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.529237 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a67e637d934c0f99c00d04fb26df0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.530047 752 tablet_service.cc:1511] Processing CreateTablet for tablet ba3e7e9a85c94d7380b96a9373c1f503 (DEFAULT_TABLE table=default.Table_51d490345e9f497ca6b3076edf95c90f [id=fbbe8921ed4344c18e2276270fcaf24f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.531329 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba3e7e9a85c94d7380b96a9373c1f503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.502643 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff487cba236491eb22becf0dc591925" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:24.502907 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8319efcfa31b45afb4dbd90cb5f13e97" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:24.538077 860 leader_election.cc:343] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:24.538126 900 tablet_service.cc:1511] Processing CreateTablet for tablet d2fb9c8f339444bc8d7c6479e7d87f44 (DEFAULT_TABLE table=default.Table_b4c6c515fa1b469bad29515911177508 [id=895bbd90cf47462ab116ee3f37e94982]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.538267 860 leader_election.cc:304] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:24.538558 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2fb9c8f339444bc8d7c6479e7d87f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.538491 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 2a7ddc0807d742cea258f889390e2142 (DEFAULT_TABLE table=default.Table_176fa1820ca44b3cbdfad38228b9dc7b [id=ff1dddd3bf73410c816e618a9931c7cf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:24.538733 860 leader_election.cc:343] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:24.538852 860 leader_election.cc:304] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:24.540182 1038 tablet_service.cc:1511] Processing CreateTablet for tablet d1a67e637d934c0f99c00d04fb26df0d (DEFAULT_TABLE table=default.Table_35fa57e328b44e50b0d68b77bd7def72 [id=5d7bac7ca89d4b11ab8a882731f9b858]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.540192 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 56335a4a2c294f67a22206e6a59e29a8 (DEFAULT_TABLE table=default.Table_98ff851e3ed0463cb3ef7f1907fa7711 [id=3da3ae03107e44518a289e073abc0998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.541523 1228 raft_consensus.cc:2749] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:24.541757 1228 raft_consensus.cc:2749] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:24.542629 1174 tablet_bootstrap.cc:492] T 959faf1fbb224434b896c0f21e9715be P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:24.543967 1174 ts_tablet_manager.cc:1403] T 959faf1fbb224434b896c0f21e9715be P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.091s user 0.006s sys 0.007s
I20260318 02:51:24.545605 905 tablet_service.cc:1511] Processing CreateTablet for tablet b383fd49049c4c1daba3f1ed60899f3e (DEFAULT_TABLE table=default.Table_e4e8936ba8634b8e8ac79e1c70e97845 [id=fc9e568fb3884c3ca8575e591393560e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.546200 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b383fd49049c4c1daba3f1ed60899f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.548403 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 0b39433a5a7f42c39139db0da77ae75f (DEFAULT_TABLE table=default.Table_0047a213aefb4d9ca8f56c91c109b6a6 [id=ef1334ee44b343c8be2b1ef5913bf26b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.549793 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 503386365f6a49f6b84c64b59b764c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.552193 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 3dda9bd9befd427fac9dfde6f299a6ab (DEFAULT_TABLE table=default.Table_a5974ba51eec46dfa733c7b066123d8e [id=be8bd5c24eda495abd4c05a866a2c194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.552212 1039 tablet_service.cc:1511] Processing CreateTablet for tablet ba3e7e9a85c94d7380b96a9373c1f503 (DEFAULT_TABLE table=default.Table_51d490345e9f497ca6b3076edf95c90f [id=fbbe8921ed4344c18e2276270fcaf24f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.552237 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 813702e53eee4a54a7d693fd6e03bbbb (DEFAULT_TABLE table=default.Table_f6bd74ee469e431eb8367558134a24b5 [id=9278db75ac0f4aa59c4af2f13a58e314]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.552198 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a67e637d934c0f99c00d04fb26df0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.553794 1173 tablet_bootstrap.cc:492] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:24.554062 1174 raft_consensus.cc:359] T 959faf1fbb224434b896c0f21e9715be P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:24.554275 1174 raft_consensus.cc:385] T 959faf1fbb224434b896c0f21e9715be P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.554338 1174 raft_consensus.cc:740] T 959faf1fbb224434b896c0f21e9715be P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.555495 1173 tablet_bootstrap.cc:654] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.556514 1036 tablet_service.cc:1511] Processing CreateTablet for tablet d2fb9c8f339444bc8d7c6479e7d87f44 (DEFAULT_TABLE table=default.Table_b4c6c515fa1b469bad29515911177508 [id=895bbd90cf47462ab116ee3f37e94982]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.558037 1172 tablet_bootstrap.cc:654] T 32880a703603476786b4a34ddd40cab8 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.559121 1174 consensus_queue.cc:260] T 959faf1fbb224434b896c0f21e9715be P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:24.560792 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6725b184c1db4933ba6f28668b0031fa" } modify_external_catalogs: true
I20260318 02:51:24.561079 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6725b184c1db4933ba6f28668b0031fa" } modify_external_catalogs: true
I20260318 02:51:24.561291 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_09099cfaa5e34f5fb01556055c6d72f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.561978 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09099cfaa5e34f5fb01556055c6d72f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.562642 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8dfcbdb7d773436fb70053d0d4a1d9e8" } modify_external_catalogs: true
I20260318 02:51:24.562841 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8dfcbdb7d773436fb70053d0d4a1d9e8" } modify_external_catalogs: true
I20260318 02:51:24.563429 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8cbba3ff6714425fa1c800098813892d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.563975 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8cbba3ff6714425fa1c800098813892d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.563575 1174 ts_tablet_manager.cc:1434] T 959faf1fbb224434b896c0f21e9715be P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20260318 02:51:24.564261 1176 ts_tablet_manager.cc:1916] T 323e4b1e9aee449f9402b1712b1444d9 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:24.566184 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf344c2361b7412c87a7c7f9a72a15b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.567020 1043 tablet_service.cc:1511] Processing CreateTablet for tablet b383fd49049c4c1daba3f1ed60899f3e (DEFAULT_TABLE table=default.Table_e4e8936ba8634b8e8ac79e1c70e97845 [id=fc9e568fb3884c3ca8575e591393560e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.567035 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813702e53eee4a54a7d693fd6e03bbbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.566792 1184 raft_consensus.cc:2243] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.569582 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2fb9c8f339444bc8d7c6479e7d87f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.570506 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b383fd49049c4c1daba3f1ed60899f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.570555 1184 raft_consensus.cc:2272] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.572168 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet c23b646a132743cc9b4dcd85c6d4ebea (table default.Table_480631505a694fa2846e96ba417fcb1f [id=fbcfb142ee75458b9f3008dcc9c7e06d]) successfully deleted
I20260318 02:51:24.572402 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 0e4719eafd2947bfacf3e1d2df1ae43e (table default.Table_e88f9eedc9d549e7bd8e8fb34e721a44 [id=33a7b2fdc7094616a94fa59f370e1728]) successfully deleted
W20260318 02:51:24.572582 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2bd6ac47ba044099ad9bd211ef8d26a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2bd6ac47ba044099ad9bd211ef8d26a2 already in progress: creating tablet
W20260318 02:51:24.572818 441 catalog_manager.cc:5075] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): alter failed for tablet 1af760ed8ff14a498e751e67550cb1ac (table default.Table_4e770bc308894d9094b88315d9093ba5 [id=433e7aa77412424ebb38784bb073d1fb]),no further retry: Not found: Tablet not found: 1af760ed8ff14a498e751e67550cb1ac
I20260318 02:51:24.588060 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_87b1b608a1414098af9c5136bf508ab7" } modify_external_catalogs: true
I20260318 02:51:24.588310 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_87b1b608a1414098af9c5136bf508ab7" } modify_external_catalogs: true
I20260318 02:51:24.588943 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a1fc9d74bf8b4be5a48c0480aa55d189" } modify_external_catalogs: true
I20260318 02:51:24.589118 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a1fc9d74bf8b4be5a48c0480aa55d189" } modify_external_catalogs: true
I20260318 02:51:24.589701 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b572b82f174a48ad969343a2df8b9bfe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.590263 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b572b82f174a48ad969343a2df8b9bfe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.564610 1174 tablet_bootstrap.cc:492] T 7480b1fa026242d7bb6ddbf8df563116 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:24.597620 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 88eeb101a1734271973cd7d4c756b356
I20260318 02:51:24.598492 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 88eeb101a1734271973cd7d4c756b356 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:24.600270 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 88eeb101a1734271973cd7d4c756b356 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88eeb101a1734271973cd7d4c756b356 already in progress: creating tablet
I20260318 02:51:24.601058 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 88eeb101a1734271973cd7d4c756b356 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.603035 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba3e7e9a85c94d7380b96a9373c1f503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.605275 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 74233fd7ed094e7cbfc79309605db0e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.605564 1184 ts_tablet_manager.cc:1916] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:24.605578 903 tablet_service.cc:1558] Processing DeleteTablet for tablet d604cd634a1c470ba3896cf02d2804d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.605798 905 tablet_service.cc:1558] Processing DeleteTablet for tablet 8319efcfa31b45afb4dbd90cb5f13e97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.606021 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba with delete_type TABLET_DATA_DELETED (replaced by tablet bd077319b3c443849de087eb61da6a77) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.606247 1175 tablet_replica.cc:333] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:24.606433 1175 raft_consensus.cc:2243] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.606617 1175 raft_consensus.cc:2272] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.607189 1175 ts_tablet_manager.cc:1916] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:24.615782 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b39433a5a7f42c39139db0da77ae75f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.616588 1175 ts_tablet_manager.cc:1929] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:24.616905 1175 log.cc:1199] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/74233fd7ed094e7cbfc79309605db0e1
I20260318 02:51:24.617642 1175 ts_tablet_manager.cc:1950] T 74233fd7ed094e7cbfc79309605db0e1 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:24.618294 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a5974ba51eec46dfa733c7b066123d8e" } modify_external_catalogs: true
I20260318 02:51:24.618579 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a5974ba51eec46dfa733c7b066123d8e" } modify_external_catalogs: true
I20260318 02:51:24.618844 1175 tablet_replica.cc:333] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:24.619244 1175 raft_consensus.cc:2243] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:24.619174 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 959faf1fbb224434b896c0f21e9715be with delete_type TABLET_DATA_DELETED (replaced by tablet c7c4257a54d3487aa520531a64fc721c) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:24.619663 1175 pending_rounds.cc:70] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18: Trying to abort 1 pending ops.
I20260318 02:51:24.619758 1175 pending_rounds.cc:77] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494155224944640 op_type: NO_OP noop_request { }
I20260318 02:51:24.619915 1175 raft_consensus.cc:2889] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:24.620033 1175 raft_consensus.cc:2272] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.621259 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 1df8029146564e1c9dc88dd9f5fb64ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:20 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.620971 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 74233fd7ed094e7cbfc79309605db0e1 (table default.Table_90fbf2263430453082ef161ec0025a5a [id=f6d13c14fec24bc8894ebd60b88fca77]) successfully deleted
I20260318 02:51:24.622112 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1f1814cfbad542d2819ce76c05ad9c83" } new_table_name: "default.Table_dbd509def99c4f02a35097ecbd42c1f1" modify_external_catalogs: true
I20260318 02:51:24.623991 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_28ea1894a58c438785ae9e4b8b414447"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.624576 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28ea1894a58c438785ae9e4b8b414447 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.626719 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dda9bd9befd427fac9dfde6f299a6ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.629712 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 88eeb101a1734271973cd7d4c756b356 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:24.630961 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6d1c07d8eced44aa8431a666a70ae5ea" } new_table_name: "default.Table_46fb019cb5d14d49b14ad13be0a6bd41" modify_external_catalogs: true
I20260318 02:51:24.633869 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_33930f6668f341159c318db9160c142a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.634116 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 305cc777ed0c46e497c80f15b8e6ead1 consensus state has no leader
W20260318 02:51:24.634472 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33930f6668f341159c318db9160c142a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.635166 1173 tablet_bootstrap.cc:492] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:24.634537 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f664e51423be4580b3ebf91d14e66886"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:24.635313 1173 ts_tablet_manager.cc:1403] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.082s user 0.006s sys 0.000s
W20260318 02:51:24.635670 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f664e51423be4580b3ebf91d14e66886 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.636633 1173 raft_consensus.cc:359] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.636868 1173 raft_consensus.cc:385] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.636955 1173 raft_consensus.cc:740] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.637200 1173 consensus_queue.cc:260] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.637753 1173 ts_tablet_manager.cc:1434] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260318 02:51:24.639189 1173 tablet_bootstrap.cc:492] T b69dd1653a304f3d99346e89dacf9208 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:24.641294 1173 tablet_bootstrap.cc:654] T b69dd1653a304f3d99346e89dacf9208 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.645498 1175 ts_tablet_manager.cc:1916] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:24.646905 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56335a4a2c294f67a22206e6a59e29a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.647531 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b32688b6575041c999f2750fd0d11b2e" } new_table_name: "default.Table_686a5c4a87d84876a520a57efd809f99" modify_external_catalogs: true
I20260318 02:51:24.649381 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2fb448f2651542d980b9c8f124ca5530"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.649996 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2fb448f2651542d980b9c8f124ca5530 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.656502 1534 raft_consensus.cc:493] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:24.656863 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_607fac50cf4a4239bff8616d7176493d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.657444 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_607fac50cf4a4239bff8616d7176493d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.657946 1174 tablet_bootstrap.cc:654] T 7480b1fa026242d7bb6ddbf8df563116 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.658852 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_fced45ef732a4091bc296695317df2be" } new_table_name: "default.Table_4bc7b15f91fb4bea8bb33ba125c8ae5a" modify_external_catalogs: true
I20260318 02:51:24.656736 1534 raft_consensus.cc:515] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.659482 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f4faa0e71fbe408f9bc811fe2a9c62e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:24.661293 1422 raft_consensus.cc:493] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:24.661489 1422 raft_consensus.cc:515] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:24.661953 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4faa0e71fbe408f9bc811fe2a9c62e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.662269 1422 leader_election.cc:290] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:24.665356 759 tablet_service.cc:1511] Processing CreateTablet for tablet 2882569524e74a308e9fabf533a8a87c (DEFAULT_TABLE table=default.Table_28a12ac7769744d1ba2c07c2b335e41e [id=a2aa1e87cbae4de99a4d6ba96b5ec04d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.665834 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2882569524e74a308e9fabf533a8a87c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:24.666138 862 leader_election.cc:343] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 15aaa0f335ed4e828e2c0f0ffde4b6ba
I20260318 02:51:24.667946 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a7ddc0807d742cea258f889390e2142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.675808 1175 ts_tablet_manager.cc:1929] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:24.680998 1496 raft_consensus.cc:493] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:24.681190 1496 raft_consensus.cc:515] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.681829 1496 leader_election.cc:290] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:24.684046 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c66e2cc96f458fb3279827cea4ca9e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:24.684962 452 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 6b82751cbcbb4c39a6942b6856412fc8 (table default.Table_9faefa2c0ceb4495935b65b6869b4b7a [id=84a657155372475db438c6eb3119b595]). Expected version 2 got 0
I20260318 02:51:24.685307 752 tablet_service.cc:1511] Processing CreateTablet for tablet 41646d513e834600a209761392ac7fb1 (DEFAULT_TABLE table=default.Table_394ace014c534ba89ca6accaf1363761 [id=717896f5560d483e94054f017eaa9a6f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:24.686400 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5c19bc5e07949088c84cedbf944dfdb consensus state has no leader
I20260318 02:51:24.687806 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ce5965e4cd074e108328165edb428e18" } new_table_name: "default.Table_20867faf86da4889b7995990926923a7" modify_external_catalogs: true
I20260318 02:51:24.684072 1534 leader_election.cc:290] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:24.691748 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 2882569524e74a308e9fabf533a8a87c (DEFAULT_TABLE table=default.Table_28a12ac7769744d1ba2c07c2b335e41e [id=a2aa1e87cbae4de99a4d6ba96b5ec04d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.692528 1063 raft_consensus.cc:1275] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Refusing update from remote peer b25f4f05e0c94c8db825d5afa0b8bf18: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:24.692745 766 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0af3aecf4f485ebc54e1955eca8c92 (DEFAULT_TABLE table=default.Table_7671b3be1e0c4259a325679c394aae2c [id=688586df74e84dc0a4fc5dc50ef48f32]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:24.692935 999 leader_election.cc:343] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 74233fd7ed094e7cbfc79309605db0e1
I20260318 02:51:24.693279 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0af3aecf4f485ebc54e1955eca8c92. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:24.693936 719 leader_election.cc:343] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:24.694928 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41646d513e834600a209761392ac7fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.695963 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aaa0f335ed4e828e2c0f0ffde4b6ba" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:24.698311 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2882569524e74a308e9fabf533a8a87c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:24.698518 997 leader_election.cc:343] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: 74233fd7ed094e7cbfc79309605db0e1
I20260318 02:51:24.698541 784 raft_consensus.cc:1275] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Refusing update from remote peer b25f4f05e0c94c8db825d5afa0b8bf18: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:24.699050 997 leader_election.cc:304] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:24.700548 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0af3aecf4f485ebc54e1955eca8c92 (DEFAULT_TABLE table=default.Table_7671b3be1e0c4259a325679c394aae2c [id=688586df74e84dc0a4fc5dc50ef48f32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.700788 1064 raft_consensus.cc:2468] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:24.701014 759 tablet_service.cc:1511] Processing CreateTablet for tablet 6f8b5120633e4e0d8964f17d6d5f316d (DEFAULT_TABLE table=default.Table_f6b8b4d3b2c646ceb47e4a306bd93fe9 [id=779018c836a14c518c02a844331ce251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.701508 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8b5120633e4e0d8964f17d6d5f316d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.702581 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c8ea19bed9e54eaf91af95c365e46851"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.703251 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8ea19bed9e54eaf91af95c365e46851 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.704279 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 00d953e1ae2f47fc8016a2f9a791141d
I20260318 02:51:24.705631 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 00d953e1ae2f47fc8016a2f9a791141d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:24.708388 758 tablet_service.cc:1511] Processing CreateTablet for tablet a9c60ef260d049bea4ce729316a0d09f (DEFAULT_TABLE table=default.Table_7b0bea6538a9448aa9cb4132f0970647 [id=fb45f238426142faa79cbe89242c7418]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.708818 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9c60ef260d049bea4ce729316a0d09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.720469 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 3dda9bd9befd427fac9dfde6f299a6ab
I20260318 02:51:24.720932 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 065ebc3c000a4ad3873ee031ecf9986b
I20260318 02:51:24.721634 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 3dda9bd9befd427fac9dfde6f299a6ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:24.721963 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d0652735b8c24c23ade92913c1c7ad0f consensus state has no leader
I20260318 02:51:24.722183 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 421e5223d6af4da1a8e07534f942d016
I20260318 02:51:24.722458 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 065ebc3c000a4ad3873ee031ecf9986b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:24.723002 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 421e5223d6af4da1a8e07534f942d016 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:24.725868 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca23d4d0d3734fceb14966a4f2ad9c35 consensus state has no leader
I20260318 02:51:24.729094 752 tablet_service.cc:1511] Processing CreateTablet for tablet c7c4257a54d3487aa520531a64fc721c (DEFAULT_TABLE table=default.Table_ebd103e5fbf4484597076b02ffd82044 [id=4067c18ce85f44d7993786a3e9bda883]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.731526 766 tablet_service.cc:1511] Processing CreateTablet for tablet a0a6f4b34ff14714892ed9e9b3604dc9 (DEFAULT_TABLE table=default.Table_7692f02c62f94771bc39331507161bb2 [id=60f0afdd0f9f4c5196ea491b90991241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.732198 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c4257a54d3487aa520531a64fc721c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.733037 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a6f4b34ff14714892ed9e9b3604dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.735338 1534 raft_consensus.cc:2749] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:24.738133 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0af3aecf4f485ebc54e1955eca8c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.739387 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 00d953e1ae2f47fc8016a2f9a791141d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.738163 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 41646d513e834600a209761392ac7fb1 (DEFAULT_TABLE table=default.Table_394ace014c534ba89ca6accaf1363761 [id=717896f5560d483e94054f017eaa9a6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.739405 1172 tablet_bootstrap.cc:492] T 32880a703603476786b4a34ddd40cab8 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:24.678854 896 tablet_service.cc:1511] Processing CreateTablet for tablet 2882569524e74a308e9fabf533a8a87c (DEFAULT_TABLE table=default.Table_28a12ac7769744d1ba2c07c2b335e41e [id=a2aa1e87cbae4de99a4d6ba96b5ec04d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.683228 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c66e2cc96f458fb3279827cea4ca9e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:24.747153 926 raft_consensus.cc:2468] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 0.
I20260318 02:51:24.747315 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2882569524e74a308e9fabf533a8a87c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.688274 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ff487cba236491eb22becf0dc591925 with delete_type TABLET_DATA_DELETED (replaced by tablet ab158343adb14eab85c595fa5405145d) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.689204 905 tablet_service.cc:1511] Processing CreateTablet for tablet 41646d513e834600a209761392ac7fb1 (DEFAULT_TABLE table=default.Table_394ace014c534ba89ca6accaf1363761 [id=717896f5560d483e94054f017eaa9a6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.747742 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41646d513e834600a209761392ac7fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.693222 1228 consensus_queue.cc:1048] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:24.701282 860 leader_election.cc:304] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:24.701632 892 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0af3aecf4f485ebc54e1955eca8c92 (DEFAULT_TABLE table=default.Table_7671b3be1e0c4259a325679c394aae2c [id=688586df74e84dc0a4fc5dc50ef48f32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.707106 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 00d953e1ae2f47fc8016a2f9a791141d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.749697 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 6f8b5120633e4e0d8964f17d6d5f316d (DEFAULT_TABLE table=default.Table_f6b8b4d3b2c646ceb47e4a306bd93fe9 [id=779018c836a14c518c02a844331ce251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.717903 895 tablet_service.cc:1511] Processing CreateTablet for tablet 6f8b5120633e4e0d8964f17d6d5f316d (DEFAULT_TABLE table=default.Table_f6b8b4d3b2c646ceb47e4a306bd93fe9 [id=779018c836a14c518c02a844331ce251]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.750113 1172 ts_tablet_manager.cc:1403] T 32880a703603476786b4a34ddd40cab8 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.216s user 0.020s sys 0.005s
I20260318 02:51:24.750185 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 065ebc3c000a4ad3873ee031ecf9986b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.724273 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 3dda9bd9befd427fac9dfde6f299a6ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.724679 906 tablet_service.cc:1558] Processing DeleteTablet for tablet 065ebc3c000a4ad3873ee031ecf9986b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.725363 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 421e5223d6af4da1a8e07534f942d016 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.729825 901 tablet_service.cc:1511] Processing CreateTablet for tablet a9c60ef260d049bea4ce729316a0d09f (DEFAULT_TABLE table=default.Table_7b0bea6538a9448aa9cb4132f0970647 [id=fb45f238426142faa79cbe89242c7418]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.730397 907 tablet_service.cc:1511] Processing CreateTablet for tablet c7c4257a54d3487aa520531a64fc721c (DEFAULT_TABLE table=default.Table_ebd103e5fbf4484597076b02ffd82044 [id=4067c18ce85f44d7993786a3e9bda883]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.731668 889 tablet_service.cc:1511] Processing CreateTablet for tablet 5b49b066f27b43829c8f922649744303 (DEFAULT_TABLE table=default.Table_a86b913c502e4655aae9d11230109dc1 [id=6f4e96b5a043423b95bfdf37a2411644]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.751266 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41646d513e834600a209761392ac7fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.751920 1172 raft_consensus.cc:359] T 32880a703603476786b4a34ddd40cab8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.752004 1228 consensus_queue.cc:1048] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260318 02:51:24.732836 898 tablet_service.cc:1511] Processing CreateTablet for tablet a0a6f4b34ff14714892ed9e9b3604dc9 (DEFAULT_TABLE table=default.Table_7692f02c62f94771bc39331507161bb2 [id=60f0afdd0f9f4c5196ea491b90991241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.740108 888 tablet_service.cc:1511] Processing CreateTablet for tablet 254b8722e7ff4ccabc6d16f04daf85aa (DEFAULT_TABLE table=default.Table_c8066725c1a94b1f9e3a030be08a461d [id=d9f99876511c4cf294e3edbbfae441c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.743121 897 tablet_service.cc:1511] Processing CreateTablet for tablet a6f42462ed9c49c797f5115b3ca6c423 (DEFAULT_TABLE table=default.Table_9573754c7e3b4c0b8200f0cc47b2182d [id=01cdfd48166b4ea79e00c77b1deb5eca]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:24.752630 860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.131:37025, user_credentials={real_user=slave}} blocked reactor thread for 51232.1us
I20260318 02:51:24.753906 1175 log.cc:1199] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/d604cd634a1c470ba3896cf02d2804d4
I20260318 02:51:24.754017 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8b5120633e4e0d8964f17d6d5f316d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.754652 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 3dda9bd9befd427fac9dfde6f299a6ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.756289 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f8b5120633e4e0d8964f17d6d5f316d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.756295 1172 raft_consensus.cc:385] T 32880a703603476786b4a34ddd40cab8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.756448 1172 raft_consensus.cc:740] T 32880a703603476786b4a34ddd40cab8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.756402 758 tablet_service.cc:1511] Processing CreateTablet for tablet 254b8722e7ff4ccabc6d16f04daf85aa (DEFAULT_TABLE table=default.Table_c8066725c1a94b1f9e3a030be08a461d [id=d9f99876511c4cf294e3edbbfae441c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.756769 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b49b066f27b43829c8f922649744303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.756856 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254b8722e7ff4ccabc6d16f04daf85aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.758033 762 tablet_service.cc:1511] Processing CreateTablet for tablet a6f42462ed9c49c797f5115b3ca6c423 (DEFAULT_TABLE table=default.Table_9573754c7e3b4c0b8200f0cc47b2182d [id=01cdfd48166b4ea79e00c77b1deb5eca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.758190 1172 consensus_queue.cc:260] T 32880a703603476786b4a34ddd40cab8 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.758373 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f42462ed9c49c797f5115b3ca6c423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.758728 1172 ts_tablet_manager.cc:1434] T 32880a703603476786b4a34ddd40cab8 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260318 02:51:24.761445 759 tablet_service.cc:1511] Processing CreateTablet for tablet 5b49b066f27b43829c8f922649744303 (DEFAULT_TABLE table=default.Table_a86b913c502e4655aae9d11230109dc1 [id=6f4e96b5a043423b95bfdf37a2411644]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.761883 1172 tablet_bootstrap.cc:492] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:24.763501 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 421e5223d6af4da1a8e07534f942d016 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.763936 1037 tablet_service.cc:1511] Processing CreateTablet for tablet a9c60ef260d049bea4ce729316a0d09f (DEFAULT_TABLE table=default.Table_7b0bea6538a9448aa9cb4132f0970647 [id=fb45f238426142faa79cbe89242c7418]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.764130 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 5b49b066f27b43829c8f922649744303 (DEFAULT_TABLE table=default.Table_a86b913c502e4655aae9d11230109dc1 [id=6f4e96b5a043423b95bfdf37a2411644]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.764817 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9c60ef260d049bea4ce729316a0d09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.767977 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b49b066f27b43829c8f922649744303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.768106 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f42462ed9c49c797f5115b3ca6c423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.768409 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0af3aecf4f485ebc54e1955eca8c92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.768641 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254b8722e7ff4ccabc6d16f04daf85aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.769707 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c4257a54d3487aa520531a64fc721c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.771492 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9c60ef260d049bea4ce729316a0d09f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.772303 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a6f4b34ff14714892ed9e9b3604dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.773599 1041 tablet_service.cc:1511] Processing CreateTablet for tablet c7c4257a54d3487aa520531a64fc721c (DEFAULT_TABLE table=default.Table_ebd103e5fbf4484597076b02ffd82044 [id=4067c18ce85f44d7993786a3e9bda883]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.783607 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b49b066f27b43829c8f922649744303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.786309 1035 tablet_service.cc:1511] Processing CreateTablet for tablet a0a6f4b34ff14714892ed9e9b3604dc9 (DEFAULT_TABLE table=default.Table_7692f02c62f94771bc39331507161bb2 [id=60f0afdd0f9f4c5196ea491b90991241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.788196 1043 tablet_service.cc:1558] Processing DeleteTablet for tablet 74233fd7ed094e7cbfc79309605db0e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.797263 1174 tablet_bootstrap.cc:492] T 7480b1fa026242d7bb6ddbf8df563116 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:24.798017 1174 ts_tablet_manager.cc:1403] T 7480b1fa026242d7bb6ddbf8df563116 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.233s user 0.005s sys 0.000s
I20260318 02:51:24.798275 1175 ts_tablet_manager.cc:1950] T d604cd634a1c470ba3896cf02d2804d4 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:24.801759 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9573754c7e3b4c0b8200f0cc47b2182d" } modify_external_catalogs: true
I20260318 02:51:24.802006 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9573754c7e3b4c0b8200f0cc47b2182d" } modify_external_catalogs: true
I20260318 02:51:24.802199 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b27c31a9cf2c4e53b57bff83bb0ff243"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:24.802258 1033 tablet_service.cc:1511] Processing CreateTablet for tablet a6f42462ed9c49c797f5115b3ca6c423 (DEFAULT_TABLE table=default.Table_9573754c7e3b4c0b8200f0cc47b2182d [id=01cdfd48166b4ea79e00c77b1deb5eca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:24.802523 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7c4257a54d3487aa520531a64fc721c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.789288 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 254b8722e7ff4ccabc6d16f04daf85aa (DEFAULT_TABLE table=default.Table_c8066725c1a94b1f9e3a030be08a461d [id=d9f99876511c4cf294e3edbbfae441c0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:24.802870 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b27c31a9cf2c4e53b57bff83bb0ff243 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.802906 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254b8722e7ff4ccabc6d16f04daf85aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.806762 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet d604cd634a1c470ba3896cf02d2804d4 (table default.Table_215d98fc906d466d8c0d334250547c34 [id=1165495ee0884badba5bd95f87987e33]) successfully deleted
I20260318 02:51:24.807417 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6f42462ed9c49c797f5115b3ca6c423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.810022 1175 tablet_replica.cc:333] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:24.810158 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 32880a703603476786b4a34ddd40cab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.810704 1175 raft_consensus.cc:2243] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.811044 1175 raft_consensus.cc:2272] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.811659 1175 ts_tablet_manager.cc:1916] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:24.812227 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a6f4b34ff14714892ed9e9b3604dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:24.812538 1172 tablet_bootstrap.cc:654] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.822671 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f4978db62ff94982b1fbb4afc8e96b29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.823431 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4978db62ff94982b1fbb4afc8e96b29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.833146 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5d3901a8928a4e858feab8b7c1fc5545"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.834069 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d3901a8928a4e858feab8b7c1fc5545 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.838132 457 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 549b3929ea33417bbe50e749bbfe223d (table default.Table_46fb019cb5d14d49b14ad13be0a6bd41 [id=f62386b6ad9441eeafff054f00ee0423]). Expected version 3 got 0
I20260318 02:51:24.838910 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_35fa57e328b44e50b0d68b77bd7def72" } new_table_name: "default.Table_608fb034b49c4aadb49a3dd915aee472" modify_external_catalogs: true
W20260318 02:51:24.820437 860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.131:37025, user_credentials={real_user=slave}} blocked reactor thread for 67415us
W20260318 02:51:24.831614 862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.129:46711, user_credentials={real_user=slave}} blocked reactor thread for 125639us
I20260318 02:51:24.840948 719 leader_election.cc:304] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:24.849200 1496 raft_consensus.cc:2804] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:24.849334 1496 raft_consensus.cc:493] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:24.849433 1496 raft_consensus.cc:3060] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:24.852423 1496 raft_consensus.cc:515] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.853101 1174 raft_consensus.cc:359] T 7480b1fa026242d7bb6ddbf8df563116 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.853320 1174 raft_consensus.cc:385] T 7480b1fa026242d7bb6ddbf8df563116 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.853425 1174 raft_consensus.cc:740] T 7480b1fa026242d7bb6ddbf8df563116 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.853389 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_39aee165029f47559776d7610e509b6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.854951 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39aee165029f47559776d7610e509b6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.855830 1496 leader_election.cc:290] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:24.856509 1172 tablet_bootstrap.cc:492] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:24.856792 1172 ts_tablet_manager.cc:1403] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.098s user 0.001s sys 0.009s
I20260318 02:51:24.858124 1172 raft_consensus.cc:359] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.858438 1172 raft_consensus.cc:385] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.858587 1172 raft_consensus.cc:740] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.859041 1172 consensus_queue.cc:260] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:24.859556 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1a67e637d934c0f99c00d04fb26df0d consensus state has no leader
I20260318 02:51:24.859764 1174 consensus_queue.cc:260] T 7480b1fa026242d7bb6ddbf8df563116 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.845640 1555 raft_consensus.cc:2804] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:24.860363 1174 ts_tablet_manager.cc:1434] T 7480b1fa026242d7bb6ddbf8df563116 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.062s user 0.001s sys 0.001s
I20260318 02:51:24.860751 1174 tablet_bootstrap.cc:492] T 97655cb5968b4c819273068818d5cab8 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:24.863143 1174 tablet_bootstrap.cc:654] T 97655cb5968b4c819273068818d5cab8 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.865741 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_686a5c4a87d84876a520a57efd809f99" } new_table_name: "default.Table_74fe2c7ed9f840afac5531b16e1cf834" modify_external_catalogs: true
I20260318 02:51:24.865816 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b6cc0e95556348868fc31e5d4ae173cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.866442 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6cc0e95556348868fc31e5d4ae173cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.869777 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_837986fdf0204eea89656e0edb23e67c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.870380 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_837986fdf0204eea89656e0edb23e67c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.871477 1174 tablet_bootstrap.cc:492] T 97655cb5968b4c819273068818d5cab8 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:24.871784 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet d604cd634a1c470ba3896cf02d2804d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.872278 1174 ts_tablet_manager.cc:1403] T 97655cb5968b4c819273068818d5cab8 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260318 02:51:24.873184 1172 ts_tablet_manager.cc:1434] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.016s user 0.000s sys 0.002s
W20260318 02:51:24.875612 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5c19bc5e07949088c84cedbf944dfdb consensus state has no leader
I20260318 02:51:24.881947 1534 raft_consensus.cc:493] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:24.882133 1534 raft_consensus.cc:515] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.882817 1534 leader_election.cc:290] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:24.888826 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_617760cf0940425fa9ae7a909ca840a5" } new_table_name: "default.Table_497d117a371b43f3a21e5c39793ab2c0" modify_external_catalogs: true
I20260318 02:51:24.891325 1184 ts_tablet_manager.cc:1929] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:24.891600 1184 log.cc:1199] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/9e421d3fe62b4985bfe0486a4b115b2a
I20260318 02:51:24.893198 1184 ts_tablet_manager.cc:1950] T 9e421d3fe62b4985bfe0486a4b115b2a P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
W20260318 02:51:24.893283 999 leader_election.cc:343] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: d604cd634a1c470ba3896cf02d2804d4
I20260318 02:51:24.887805 1173 tablet_bootstrap.cc:492] T b69dd1653a304f3d99346e89dacf9208 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
W20260318 02:51:24.894645 997 leader_election.cc:343] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: d604cd634a1c470ba3896cf02d2804d4
I20260318 02:51:24.894773 1173 ts_tablet_manager.cc:1403] T b69dd1653a304f3d99346e89dacf9208 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.256s user 0.011s sys 0.000s
I20260318 02:51:24.894870 997 leader_election.cc:304] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:24.895166 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 275) took 1295 ms. Trace:
I20260318 02:51:24.895258 1184 rpcz_store.cc:276] 0318 02:51:23.600128 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:23.600198 (+ 70us) service_pool.cc:225] Handling call
0318 02:51:24.423751 (+823553us) ts_tablet_manager.cc:1151] Deleting tablet 9e421d3fe62b4985bfe0486a4b115b2a
0318 02:51:24.423761 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:24.815908 (+392147us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:24.891211 (+ 75303us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:24.895105 (+ 3894us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":823294}
I20260318 02:51:24.895442 1534 raft_consensus.cc:2749] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:24.895695 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 276) took 1294 ms. Trace:
I20260318 02:51:24.895784 1173 raft_consensus.cc:359] T b69dd1653a304f3d99346e89dacf9208 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.895779 1184 rpcz_store.cc:276] 0318 02:51:23.600893 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:23.600941 (+ 48us) service_pool.cc:225] Handling call
0318 02:51:24.895534 (+1294593us) ts_tablet_manager.cc:1151] Deleting tablet 6e9372f8871b473caa024512e936a6e5
0318 02:51:24.895543 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:24.895640 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1294373}
I20260318 02:51:24.896013 1173 raft_consensus.cc:385] T b69dd1653a304f3d99346e89dacf9208 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.896122 1173 raft_consensus.cc:740] T b69dd1653a304f3d99346e89dacf9208 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.896234 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 277) took 1275 ms. Trace:
I20260318 02:51:24.896320 1184 rpcz_store.cc:276] 0318 02:51:23.621222 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:23.621284 (+ 62us) service_pool.cc:225] Handling call
0318 02:51:24.896076 (+1274792us) ts_tablet_manager.cc:1151] Deleting tablet d4a54d0daa9f48a89b3f114367750826
0318 02:51:24.896085 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:24.896181 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1251251}
I20260318 02:51:24.896360 1173 consensus_queue.cc:260] T b69dd1653a304f3d99346e89dacf9208 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.896657 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 286) took 1114 ms. Trace:
I20260318 02:51:24.896760 1184 rpcz_store.cc:276] 0318 02:51:23.782632 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:23.782716 (+ 84us) service_pool.cc:225] Handling call
0318 02:51:24.896519 (+1113803us) ts_tablet_manager.cc:1151] Deleting tablet 29541950221544e396ada303fbbb5002
0318 02:51:24.896528 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:24.896604 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1112964}
I20260318 02:51:24.896983 1173 ts_tablet_manager.cc:1434] T b69dd1653a304f3d99346e89dacf9208 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:24.897354 1173 tablet_bootstrap.cc:492] T 45fddf78fc834d20908696b980d394a2 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:24.899169 1173 tablet_bootstrap.cc:654] T 45fddf78fc834d20908696b980d394a2 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.902370 1555 raft_consensus.cc:493] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:24.903012 1555 raft_consensus.cc:3060] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:24.846956 1422 consensus_queue.cc:1048] T 4dadf0fc6e134edd87788dd4ade59dc5 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.047s
I20260318 02:51:24.897107 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 287) took 1108 ms. Trace:
I20260318 02:51:24.905926 1184 rpcz_store.cc:276] 0318 02:51:23.788765 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:23.790788 (+ 2023us) service_pool.cc:225] Handling call
0318 02:51:24.896938 (+1106150us) ts_tablet_manager.cc:1151] Deleting tablet 7883f526d06e442c81f1b66fd89d2cd0
0318 02:51:24.896946 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:24.897060 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1099549}
I20260318 02:51:24.905741 1174 raft_consensus.cc:359] T 97655cb5968b4c819273068818d5cab8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.909154 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1424aa1a08ae4f3584a9f415cd41b6e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.909809 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1424aa1a08ae4f3584a9f415cd41b6e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.912802 1174 raft_consensus.cc:385] T 97655cb5968b4c819273068818d5cab8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.912474 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 9e421d3fe62b4985bfe0486a4b115b2a (table default.Table_19fe141c13934c04bd511b36fab6ab36 [id=5d7200a0ff764b1885c2c18bc7289e1b]) successfully deleted
I20260318 02:51:24.913421 1184 tablet_replica.cc:333] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:24.913671 1174 raft_consensus.cc:740] T 97655cb5968b4c819273068818d5cab8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
W20260318 02:51:24.914288 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 6e9372f8871b473caa024512e936a6e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e9372f8871b473caa024512e936a6e5 already in progress: creating tablet
I20260318 02:51:24.915951 1184 raft_consensus.cc:2243] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:24.915870 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet d4a54d0daa9f48a89b3f114367750826 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4a54d0daa9f48a89b3f114367750826 already in progress: creating tablet
I20260318 02:51:24.916276 1174 consensus_queue.cc:260] T 97655cb5968b4c819273068818d5cab8 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.916648 1184 raft_consensus.cc:2272] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.918138 1184 ts_tablet_manager.cc:1916] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:24.917878 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 29541950221544e396ada303fbbb5002 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29541950221544e396ada303fbbb5002 already in progress: creating tablet
I20260318 02:51:24.918730 1174 ts_tablet_manager.cc:1434] T 97655cb5968b4c819273068818d5cab8 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260318 02:51:24.919135 1174 tablet_bootstrap.cc:492] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:24.924630 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 7883f526d06e442c81f1b66fd89d2cd0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7883f526d06e442c81f1b66fd89d2cd0 already in progress: creating tablet
I20260318 02:51:24.926590 1552 consensus_queue.cc:1048] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:24.926856 1172 tablet_bootstrap.cc:492] T b69dd1653a304f3d99346e89dacf9208 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:24.927467 892 tablet_service.cc:1558] Processing DeleteTablet for tablet b69dd1653a304f3d99346e89dacf9208 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:24.928835 1176 ts_tablet_manager.cc:1929] T 323e4b1e9aee449f9402b1712b1444d9 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260318 02:51:24.929493 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc47f35f9c2c4e5085ab482285effc91 consensus state has no leader
I20260318 02:51:24.930186 1176 log.cc:1199] T 323e4b1e9aee449f9402b1712b1444d9 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/323e4b1e9aee449f9402b1712b1444d9
I20260318 02:51:24.930729 1174 tablet_bootstrap.cc:654] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.930941 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c23e7504b2474f1686592467b684da52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.931591 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c23e7504b2474f1686592467b684da52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.931963 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_31d713ee51bc47c1a98874825f31a240" } modify_external_catalogs: true
I20260318 02:51:24.932497 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c14f375645d84629b54e18e482938be5" } modify_external_catalogs: true
I20260318 02:51:24.932699 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c14f375645d84629b54e18e482938be5" } modify_external_catalogs: true
I20260318 02:51:24.932523 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_31d713ee51bc47c1a98874825f31a240" } modify_external_catalogs: true
I20260318 02:51:24.934792 1564 tablet.cc:1723] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:24.934867 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ebd103e5fbf4484597076b02ffd82044" } modify_external_catalogs: true
I20260318 02:51:24.934595 1176 ts_tablet_manager.cc:1950] T 323e4b1e9aee449f9402b1712b1444d9 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:24.935019 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ebd103e5fbf4484597076b02ffd82044" } modify_external_catalogs: true
I20260318 02:51:24.936280 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_46fb019cb5d14d49b14ad13be0a6bd41" } modify_external_catalogs: true
I20260318 02:51:24.936463 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_46fb019cb5d14d49b14ad13be0a6bd41" } modify_external_catalogs: true
I20260318 02:51:24.937816 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d29ddedf032449af9ee69c8b356d5ef6" } new_table_name: "default.Table_8fdbd48eef374965b592274f14ea8ee1" modify_external_catalogs: true
I20260318 02:51:24.938107 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 323e4b1e9aee449f9402b1712b1444d9 (table default.Table_0d76788054244bdc8c7aa32525412970 [id=463a6721eb0d43d09deeb283d1cc4233]) successfully deleted
I20260318 02:51:24.939393 1172 tablet_bootstrap.cc:654] T b69dd1653a304f3d99346e89dacf9208 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.939450 1176 tablet_replica.cc:333] T e61c374078854d589219dfa4c20e4222 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:24.940259 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e81f3622048c415e977ce897e4edcacf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.940847 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e81f3622048c415e977ce897e4edcacf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.947193 1176 raft_consensus.cc:2243] T e61c374078854d589219dfa4c20e4222 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.948230 1566 tablet.cc:1723] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:24.948945 1176 raft_consensus.cc:2272] T e61c374078854d589219dfa4c20e4222 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.950210 1184 ts_tablet_manager.cc:1929] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:24.951252 1184 log.cc:1199] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/f1ed26420c64492a94e8920d8c753fc3
I20260318 02:51:24.952721 1184 ts_tablet_manager.cc:1950] T f1ed26420c64492a94e8920d8c753fc3 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:24.952993 1176 ts_tablet_manager.cc:1916] T e61c374078854d589219dfa4c20e4222 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:24.953594 1174 tablet_bootstrap.cc:492] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:24.953799 1174 ts_tablet_manager.cc:1403] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.000s
I20260318 02:51:24.954346 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_74fe2c7ed9f840afac5531b16e1cf834" } new_table_name: "default.Table_440979f48f6a443285065bb1dd666d0a" modify_external_catalogs: true
I20260318 02:51:24.954735 1174 raft_consensus.cc:359] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.955011 1174 raft_consensus.cc:385] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.956816 1174 raft_consensus.cc:740] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.957239 1174 consensus_queue.cc:260] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.960230 1174 ts_tablet_manager.cc:1434] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260318 02:51:24.961339 1174 tablet_bootstrap.cc:492] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:24.962560 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2adcc9f1ad69458c997475111bb787cf consensus state has no leader
I20260318 02:51:24.962927 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6fe999cf7db144f0ba846e7bb973d709"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:24.963521 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6fe999cf7db144f0ba846e7bb973d709 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:24.965562 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 549b3929ea33417bbe50e749bbfe223d
I20260318 02:51:24.966364 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 549b3929ea33417bbe50e749bbfe223d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:24.967012 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 549b3929ea33417bbe50e749bbfe223d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.967036 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 291) took 1170 ms. Trace:
I20260318 02:51:24.968282 1174 tablet_bootstrap.cc:654] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.968381 1184 rpcz_store.cc:276] 0318 02:51:23.797465 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:23.797846 (+ 381us) service_pool.cc:225] Handling call
0318 02:51:24.913316 (+1115470us) ts_tablet_manager.cc:1151] Deleting tablet f1ed26420c64492a94e8920d8c753fc3
0318 02:51:24.913326 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:24.922459 (+ 9133us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:24.950067 (+ 27608us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:24.966998 (+ 16931us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1115012}
I20260318 02:51:24.969599 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c66e2cc96f458fb3279827cea4ca9e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:24.970218 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet f1ed26420c64492a94e8920d8c753fc3 (table default.Table_70e2f45a75724db48820714e88bbb17d [id=50ab4db1dbeb4c6a90b33535047daa51]) successfully deleted
I20260318 02:51:24.970881 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 288) took 1179 ms. Trace:
I20260318 02:51:24.971098 1184 rpcz_store.cc:276] 0318 02:51:23.791794 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:23.792067 (+ 273us) service_pool.cc:225] Handling call
0318 02:51:24.970639 (+1178572us) ts_tablet_manager.cc:1151] Deleting tablet 08307bc69291479eb8ee0d7aec124829
0318 02:51:24.970672 (+ 33us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:24.970827 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1132470}
W20260318 02:51:24.971829 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 08307bc69291479eb8ee0d7aec124829 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08307bc69291479eb8ee0d7aec124829 already in progress: creating tablet
I20260318 02:51:24.972486 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 289) took 1179 ms. Trace:
W20260318 02:51:24.970769 719 leader_election.cc:343] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:24.972694 1184 rpcz_store.cc:276] 0318 02:51:23.793610 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:23.793704 (+ 94us) service_pool.cc:225] Handling call
0318 02:51:24.972250 (+1178546us) ts_tablet_manager.cc:1151] Deleting tablet 7cfaf92570b34b2bb1f52aea06187c83
0318 02:51:24.972283 (+ 33us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:24.972428 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1133898}
W20260318 02:51:24.973459 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 7cfaf92570b34b2bb1f52aea06187c83 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cfaf92570b34b2bb1f52aea06187c83 already in progress: creating tablet
I20260318 02:51:24.974190 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 290) took 1179 ms. Trace:
I20260318 02:51:24.974429 1184 rpcz_store.cc:276] 0318 02:51:23.795274 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:23.795612 (+ 338us) service_pool.cc:225] Handling call
0318 02:51:24.973915 (+1178303us) ts_tablet_manager.cc:1151] Deleting tablet f9bc73d3f85745ecb62d861b6375a987
0318 02:51:24.973927 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:24.974123 (+ 196us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1135398}
I20260318 02:51:24.974828 1172 tablet_bootstrap.cc:492] T b69dd1653a304f3d99346e89dacf9208 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:24.975000 1172 ts_tablet_manager.cc:1403] T b69dd1653a304f3d99346e89dacf9208 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.094s user 0.002s sys 0.003s
W20260318 02:51:24.975492 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f9bc73d3f85745ecb62d861b6375a987 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9bc73d3f85745ecb62d861b6375a987 already in progress: creating tablet
I20260318 02:51:24.976109 1184 tablet_replica.cc:333] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:24.976089 1172 raft_consensus.cc:359] T b69dd1653a304f3d99346e89dacf9208 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.976313 1172 raft_consensus.cc:385] T b69dd1653a304f3d99346e89dacf9208 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.976418 1172 raft_consensus.cc:740] T b69dd1653a304f3d99346e89dacf9208 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.977242 1172 consensus_queue.cc:260] T b69dd1653a304f3d99346e89dacf9208 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.977828 1172 ts_tablet_manager.cc:1434] T b69dd1653a304f3d99346e89dacf9208 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:24.976591 1184 raft_consensus.cc:2243] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.978085 1184 raft_consensus.cc:2272] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.978690 1184 ts_tablet_manager.cc:1916] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:24.981483 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5c19bc5e07949088c84cedbf944dfdb consensus state has no leader
I20260318 02:51:24.983891 1172 tablet_bootstrap.cc:492] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:24.986193 1172 tablet_bootstrap.cc:654] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:24.989195 1176 ts_tablet_manager.cc:1929] T e61c374078854d589219dfa4c20e4222 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:24.989428 1176 log.cc:1199] T e61c374078854d589219dfa4c20e4222 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/e61c374078854d589219dfa4c20e4222
I20260318 02:51:24.989843 1176 ts_tablet_manager.cc:1950] T e61c374078854d589219dfa4c20e4222 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:24.992981 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c66e2cc96f458fb3279827cea4ca9e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:24.993227 926 raft_consensus.cc:3060] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:24.993081 1176 tablet_replica.cc:333] T 959faf1fbb224434b896c0f21e9715be P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:24.994405 1176 raft_consensus.cc:2243] T 959faf1fbb224434b896c0f21e9715be P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:24.994575 1176 raft_consensus.cc:2272] T 959faf1fbb224434b896c0f21e9715be P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:24.994184 1174 tablet_bootstrap.cc:492] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:24.994851 1174 ts_tablet_manager.cc:1403] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.002s
I20260318 02:51:24.995618 1174 raft_consensus.cc:359] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.995810 1174 raft_consensus.cc:385] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:24.995877 1174 raft_consensus.cc:740] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:24.996117 1174 consensus_queue.cc:260] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.996274 926 raft_consensus.cc:2468] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 1.
I20260318 02:51:24.996665 1174 ts_tablet_manager.cc:1434] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:24.996807 719 leader_election.cc:304] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:24.997112 1174 tablet_bootstrap.cc:492] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:24.997081 1555 raft_consensus.cc:515] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.997299 1561 raft_consensus.cc:2804] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:24.997426 1561 raft_consensus.cc:697] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Becoming Leader. State: Replica: 6a903d876086423b8016d705b98895ad, State: Running, Role: LEADER
I20260318 02:51:24.997707 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet e61c374078854d589219dfa4c20e4222 (table default.Table_347e676321aa483fa750cfa91235cbe7 [id=02ceb29568c548ffaf48bc6c5e78c929]) successfully deleted
I20260318 02:51:24.997917 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet b69dd1653a304f3d99346e89dacf9208 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:24.997707 1561 consensus_queue.cc:237] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:24.999826 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15aaa0f335ed4e828e2c0f0ffde4b6ba" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:25.000018 1064 raft_consensus.cc:3060] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:25.000604 1184 ts_tablet_manager.cc:1929] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.002839 1555 leader_election.cc:290] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:25.003150 1176 ts_tablet_manager.cc:1916] T 959faf1fbb224434b896c0f21e9715be P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:25.004535 862 leader_election.cc:343] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 15aaa0f335ed4e828e2c0f0ffde4b6ba
I20260318 02:51:25.003057 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 549b3929ea33417bbe50e749bbfe223d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.005791 1174 tablet_bootstrap.cc:654] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.008967 1184 log.cc:1199] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/76fc930611024211a70301bcfd92884e
I20260318 02:51:25.009593 1184 ts_tablet_manager.cc:1950] T 76fc930611024211a70301bcfd92884e P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:25.012861 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_281e478e833f4d13a05ddcf65d026047"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.013514 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_281e478e833f4d13a05ddcf65d026047 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.003561 1064 raft_consensus.cc:2468] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:25.013778 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 292) took 1214 ms. Trace:
I20260318 02:51:25.013873 1184 rpcz_store.cc:276] 0318 02:51:23.799408 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:23.799709 (+ 301us) service_pool.cc:225] Handling call
0318 02:51:24.975974 (+1176265us) ts_tablet_manager.cc:1151] Deleting tablet 76fc930611024211a70301bcfd92884e
0318 02:51:24.975984 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:24.982101 (+ 6117us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:25.000465 (+ 18364us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:25.013717 (+ 13252us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1137323}
I20260318 02:51:25.014268 1184 tablet_replica.cc:333] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:25.014365 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 76fc930611024211a70301bcfd92884e (table default.Table_68f3e929e48949f1a9f426d64cb46006 [id=7fda019fe63e4e5995aeb77e4cf70dec]) successfully deleted
I20260318 02:51:25.014453 1184 raft_consensus.cc:2243] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.014636 1184 raft_consensus.cc:2272] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.015197 1184 ts_tablet_manager.cc:1916] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.015995 860 leader_election.cc:304] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:25.016964 1559 raft_consensus.cc:2804] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:25.017154 1559 raft_consensus.cc:697] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:25.017509 1559 consensus_queue.cc:237] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.021771 1175 ts_tablet_manager.cc:1929] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.022326 1175 log.cc:1199] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/8319efcfa31b45afb4dbd90cb5f13e97
I20260318 02:51:25.023983 1175 ts_tablet_manager.cc:1950] T 8319efcfa31b45afb4dbd90cb5f13e97 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:25.025499 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 8319efcfa31b45afb4dbd90cb5f13e97 (table default.Table_2faebbd7206f45ebb8c858d1a5936cb3 [id=985db776346840d0afa3544d24902aa7]) successfully deleted
I20260318 02:51:25.026472 1175 tablet_replica.cc:333] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:25.029136 1176 ts_tablet_manager.cc:1929] T 959faf1fbb224434b896c0f21e9715be P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.029315 1176 log.cc:1199] T 959faf1fbb224434b896c0f21e9715be P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/959faf1fbb224434b896c0f21e9715be
I20260318 02:51:25.029639 1176 ts_tablet_manager.cc:1950] T 959faf1fbb224434b896c0f21e9715be P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:25.032766 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 959faf1fbb224434b896c0f21e9715be (table default.Table_ebd103e5fbf4484597076b02ffd82044 [id=4067c18ce85f44d7993786a3e9bda883]) successfully deleted
W20260318 02:51:25.038177 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 88eeb101a1734271973cd7d4c756b356 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88eeb101a1734271973cd7d4c756b356 already in progress: creating tablet
I20260318 02:51:25.039202 1174 tablet_bootstrap.cc:492] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:25.039284 1173 tablet_bootstrap.cc:492] T 45fddf78fc834d20908696b980d394a2 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:25.039453 1174 ts_tablet_manager.cc:1403] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.042s user 0.007s sys 0.001s
W20260318 02:51:25.040321 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 00d953e1ae2f47fc8016a2f9a791141d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00d953e1ae2f47fc8016a2f9a791141d already in progress: creating tablet
I20260318 02:51:25.040880 1173 ts_tablet_manager.cc:1403] T 45fddf78fc834d20908696b980d394a2 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.144s user 0.013s sys 0.017s
I20260318 02:51:25.041385 1174 raft_consensus.cc:359] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:25.042696 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 3dda9bd9befd427fac9dfde6f299a6ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3dda9bd9befd427fac9dfde6f299a6ab already in progress: creating tablet
I20260318 02:51:25.042682 1173 raft_consensus.cc:359] T 45fddf78fc834d20908696b980d394a2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.042876 1173 raft_consensus.cc:385] T 45fddf78fc834d20908696b980d394a2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260318 02:51:25.043628 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 065ebc3c000a4ad3873ee031ecf9986b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 065ebc3c000a4ad3873ee031ecf9986b already in progress: creating tablet
W20260318 02:51:25.044575 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 421e5223d6af4da1a8e07534f942d016 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 421e5223d6af4da1a8e07534f942d016 already in progress: creating tablet
I20260318 02:51:25.045022 1174 raft_consensus.cc:385] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.045522 1174 raft_consensus.cc:740] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.045352 1176 tablet_replica.cc:333] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:25.046284 1174 consensus_queue.cc:260] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.047816 1174 ts_tablet_manager.cc:1434] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260318 02:51:25.048128 452 master_service.cc:954] ReplaceTablet: received request to replace tablet d604cd634a1c470ba3896cf02d2804d4 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:25.048666 1174 tablet_bootstrap.cc:492] T 977b95a3442a405d90385cdb4d6dd5dd P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:25.049002 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_944b58673e2348228ec36d8ba31e25b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:25.049855 1173 raft_consensus.cc:740] T 45fddf78fc834d20908696b980d394a2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.050149 1173 consensus_queue.cc:260] T 45fddf78fc834d20908696b980d394a2 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:25.050846 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_944b58673e2348228ec36d8ba31e25b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.051538 1184 ts_tablet_manager.cc:1929] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.052383 1175 raft_consensus.cc:2243] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:25.053360 1175 pending_rounds.cc:70] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18: Trying to abort 1 pending ops.
I20260318 02:51:25.053444 1175 pending_rounds.cc:77] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494159434780672 op_type: NO_OP noop_request { }
I20260318 02:51:25.053568 1175 raft_consensus.cc:2889] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:25.053669 1175 raft_consensus.cc:2272] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.053951 1174 tablet_bootstrap.cc:654] T 977b95a3442a405d90385cdb4d6dd5dd P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.054857 1184 log.cc:1199] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/96a854e3872c44e4863316c9fe5f2ee9
I20260318 02:51:25.055331 1173 ts_tablet_manager.cc:1434] T 45fddf78fc834d20908696b980d394a2 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260318 02:51:25.055691 1173 tablet_bootstrap.cc:492] T 31d493650d07437c9f1d657bb08a98d7 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:25.056279 1184 ts_tablet_manager.cc:1950] T 96a854e3872c44e4863316c9fe5f2ee9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:25.057729 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 294) took 1247 ms. Trace:
I20260318 02:51:25.058635 1173 tablet_bootstrap.cc:654] T 31d493650d07437c9f1d657bb08a98d7 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.059407 1184 rpcz_store.cc:276] 0318 02:51:23.812131 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:23.816775 (+ 4644us) service_pool.cc:225] Handling call
0318 02:51:25.014183 (+1197408us) ts_tablet_manager.cc:1151] Deleting tablet 96a854e3872c44e4863316c9fe5f2ee9
0318 02:51:25.014194 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:25.034522 (+ 20328us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:25.051381 (+ 16859us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:25.057685 (+ 6304us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1143447}
W20260318 02:51:25.059028 1577 consensus_queue.cc:1175] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260318 02:51:25.060724 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 96a854e3872c44e4863316c9fe5f2ee9 (table default.Table_d548901cf2e74047a18ea1460ce6fc34 [id=570322e5437b4a58b560833ee1f0f9bc]) successfully deleted
I20260318 02:51:25.060873 1175 ts_tablet_manager.cc:1916] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.061156 1184 tablet_replica.cc:333] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:25.061362 1184 raft_consensus.cc:2243] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.062628 1174 tablet_bootstrap.cc:492] T 977b95a3442a405d90385cdb4d6dd5dd P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:25.063123 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5ffb8d228c5745e19ab88df19ce659c2" } new_table_name: "default.Table_1ca30903a9ca4d31b9ad481adc6e3016" modify_external_catalogs: true
I20260318 02:51:25.063239 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 45fddf78fc834d20908696b980d394a2 with delete_type TABLET_DATA_DELETED (replaced by tablet d2fb9c8f339444bc8d7c6479e7d87f44) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.063372 1184 raft_consensus.cc:2272] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.064122 1174 ts_tablet_manager.cc:1403] T 977b95a3442a405d90385cdb4d6dd5dd P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.004s
I20260318 02:51:25.065600 1184 ts_tablet_manager.cc:1916] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.066582 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b112fd9168ad494183800cd6263a6347"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.067277 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b112fd9168ad494183800cd6263a6347 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.068686 1174 raft_consensus.cc:359] T 977b95a3442a405d90385cdb4d6dd5dd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.069485 1174 raft_consensus.cc:385] T 977b95a3442a405d90385cdb4d6dd5dd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.069722 1174 raft_consensus.cc:740] T 977b95a3442a405d90385cdb4d6dd5dd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.070190 1174 consensus_queue.cc:260] T 977b95a3442a405d90385cdb4d6dd5dd P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.071221 1174 ts_tablet_manager.cc:1434] T 977b95a3442a405d90385cdb4d6dd5dd P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260318 02:51:25.072077 1174 tablet_bootstrap.cc:492] T af802894346443669f1cc549a1ba401b P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:25.076222 1174 tablet_bootstrap.cc:654] T af802894346443669f1cc549a1ba401b P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.085341 1559 consensus_queue.cc:1048] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:25.087092 1174 tablet_bootstrap.cc:492] T af802894346443669f1cc549a1ba401b P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:25.087795 1184 ts_tablet_manager.cc:1929] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.088160 1174 ts_tablet_manager.cc:1403] T af802894346443669f1cc549a1ba401b P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.004s
I20260318 02:51:25.089268 1174 raft_consensus.cc:359] T af802894346443669f1cc549a1ba401b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.089635 1184 log.cc:1199] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/0ea4a57dc67e407f9c93679cb2053557
I20260318 02:51:25.091199 1184 ts_tablet_manager.cc:1950] T 0ea4a57dc67e407f9c93679cb2053557 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:25.093426 1174 raft_consensus.cc:385] T af802894346443669f1cc549a1ba401b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.093935 1174 raft_consensus.cc:740] T af802894346443669f1cc549a1ba401b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.094498 1174 consensus_queue.cc:260] T af802894346443669f1cc549a1ba401b P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.094834 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 293) took 1294 ms. Trace:
I20260318 02:51:25.095180 1184 rpcz_store.cc:276] 0318 02:51:23.802237 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:23.802327 (+ 90us) service_pool.cc:225] Handling call
0318 02:51:25.061072 (+1258745us) ts_tablet_manager.cc:1151] Deleting tablet 0ea4a57dc67e407f9c93679cb2053557
0318 02:51:25.061084 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:25.078030 (+ 16946us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:25.087657 (+ 9627us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:25.094776 (+ 7119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1190300}
I20260318 02:51:25.096168 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 0ea4a57dc67e407f9c93679cb2053557 (table default.Table_ebd103e5fbf4484597076b02ffd82044 [id=4067c18ce85f44d7993786a3e9bda883]) successfully deleted
I20260318 02:51:25.096421 1566 tablet.cc:1723] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260318 02:51:25.096768 1174 ts_tablet_manager.cc:1434] T af802894346443669f1cc549a1ba401b P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260318 02:51:25.097357 1184 tablet_replica.cc:333] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:25.097795 1184 raft_consensus.cc:2243] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:25.098354 1184 pending_rounds.cc:70] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d: Trying to abort 1 pending ops.
I20260318 02:51:25.098694 1174 tablet_bootstrap.cc:492] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:25.098907 1184 pending_rounds.cc:77] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494156622082048 op_type: NO_OP noop_request { }
I20260318 02:51:25.101054 1184 raft_consensus.cc:2889] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:25.101373 1184 raft_consensus.cc:2272] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.102330 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9e6e77bf748f460894d85c701ccfad5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:25.103144 1184 ts_tablet_manager.cc:1916] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:25.103374 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e6e77bf748f460894d85c701ccfad5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.103699 1109 heartbeater.cc:344] Connected to a master server at 127.0.104.188:41593
I20260318 02:51:25.105363 1174 tablet_bootstrap.cc:654] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.108763 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_997fb2399fa943e9b940ce4e2b1f31ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.109345 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_997fb2399fa943e9b940ce4e2b1f31ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.111101 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a7e34d4ab9a4419793b8695abdd1c1eb" } new_table_name: "default.Table_0bc143d5f9bf42be85f911249422e04d" modify_external_catalogs: true
I20260318 02:51:25.114759 1174 tablet_bootstrap.cc:492] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:25.117013 1173 tablet_bootstrap.cc:492] T 31d493650d07437c9f1d657bb08a98d7 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:25.117213 1173 ts_tablet_manager.cc:1403] T 31d493650d07437c9f1d657bb08a98d7 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.011s
I20260318 02:51:25.117797 1174 ts_tablet_manager.cc:1403] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.002s
I20260318 02:51:25.118079 1173 raft_consensus.cc:359] T 31d493650d07437c9f1d657bb08a98d7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.118284 1173 raft_consensus.cc:385] T 31d493650d07437c9f1d657bb08a98d7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.118374 1173 raft_consensus.cc:740] T 31d493650d07437c9f1d657bb08a98d7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.119174 1174 raft_consensus.cc:359] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:25.120235 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e916c5419e3c457f98a47c6a1c6cdd56 consensus state has no leader
I20260318 02:51:25.120272 1174 raft_consensus.cc:385] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.120358 1174 raft_consensus.cc:740] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.118618 1173 consensus_queue.cc:260] T 31d493650d07437c9f1d657bb08a98d7 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.121170 1174 consensus_queue.cc:260] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.121435 452 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet e2304246c244407b9d4eb301ac5d7ba9 (table default.Table_fddbe89a9a524d028fba5877d8b23387 [id=20ed812002544f6f8caef448f7514f7c]). Expected version 4 got 0
I20260318 02:51:25.121731 1173 ts_tablet_manager.cc:1434] T 31d493650d07437c9f1d657bb08a98d7 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:25.122211 1173 tablet_bootstrap.cc:492] T 3b9ac6b9d4a245ec8d8aed1db976123b P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:25.123344 452 master_service.cc:954] ReplaceTablet: received request to replace tablet 65c50b0813b04f30896568ab2b680ba8 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:25.123543 1184 ts_tablet_manager.cc:1929] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:25.124770 1174 ts_tablet_manager.cc:1434] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260318 02:51:25.125206 1173 tablet_bootstrap.cc:654] T 3b9ac6b9d4a245ec8d8aed1db976123b P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.125600 1174 tablet_bootstrap.cc:492] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:25.127691 1174 tablet_bootstrap.cc:654] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.128244 1184 log.cc:1199] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/1df8029146564e1c9dc88dd9f5fb64ae
I20260318 02:51:25.128657 1184 ts_tablet_manager.cc:1950] T 1df8029146564e1c9dc88dd9f5fb64ae P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:25.128978 1173 tablet_bootstrap.cc:492] T 3b9ac6b9d4a245ec8d8aed1db976123b P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:25.129123 1173 ts_tablet_manager.cc:1403] T 3b9ac6b9d4a245ec8d8aed1db976123b P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260318 02:51:25.129731 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 1df8029146564e1c9dc88dd9f5fb64ae (table default.Table_8191659006de403a8de64233efbf3486 [id=c2fac99943e14848aec3bc3195a60023]) successfully deleted
I20260318 02:51:25.129994 1173 raft_consensus.cc:359] T 3b9ac6b9d4a245ec8d8aed1db976123b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.130210 1173 raft_consensus.cc:385] T 3b9ac6b9d4a245ec8d8aed1db976123b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.130326 1173 raft_consensus.cc:740] T 3b9ac6b9d4a245ec8d8aed1db976123b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.130609 1173 consensus_queue.cc:260] T 3b9ac6b9d4a245ec8d8aed1db976123b P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.131138 1173 ts_tablet_manager.cc:1434] T 3b9ac6b9d4a245ec8d8aed1db976123b P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260318 02:51:25.131430 1173 tablet_bootstrap.cc:492] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:25.133128 1173 tablet_bootstrap.cc:654] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:25.133150 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet b230018a95a54ababfe5ecf2ca1e2e49 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b230018a95a54ababfe5ecf2ca1e2e49 already in progress: creating tablet
W20260318 02:51:25.134083 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 45fddf78fc834d20908696b980d394a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45fddf78fc834d20908696b980d394a2 already in progress: creating tablet
W20260318 02:51:25.134622 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 96a6d1808417419dac0d2b2e80c5ca22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96a6d1808417419dac0d2b2e80c5ca22 already in progress: creating tablet
W20260318 02:51:25.135515 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 0c8264f69f934d3ba2e41434ce350f3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c8264f69f934d3ba2e41434ce350f3e already in progress: creating tablet
W20260318 02:51:25.136420 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet ec32c25ae14b406cb6ab4d913b575091 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec32c25ae14b406cb6ab4d913b575091 already in progress: creating tablet
I20260318 02:51:25.136617 1184 tablet_replica.cc:333] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:25.136835 1184 raft_consensus.cc:2243] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.138057 1184 raft_consensus.cc:2272] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.138826 1174 tablet_bootstrap.cc:492] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:25.138979 1174 ts_tablet_manager.cc:1403] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.001s
I20260318 02:51:25.139622 1175 ts_tablet_manager.cc:1929] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:25.139844 1175 log.cc:1199] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/15aaa0f335ed4e828e2c0f0ffde4b6ba
I20260318 02:51:25.139760 1174 raft_consensus.cc:359] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.139927 1174 raft_consensus.cc:385] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.140352 1175 ts_tablet_manager.cc:1950] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:25.140726 1184 ts_tablet_manager.cc:1916] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.140980 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba (table default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]) successfully deleted
I20260318 02:51:25.141402 1175 tablet_replica.cc:333] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:25.141607 1175 raft_consensus.cc:2243] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.141800 1175 raft_consensus.cc:2272] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.142439 1175 ts_tablet_manager.cc:1916] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.143747 1174 raft_consensus.cc:740] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.144026 1174 consensus_queue.cc:260] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.146692 1561 raft_consensus.cc:493] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:25.146867 1561 raft_consensus.cc:515] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.147540 1561 leader_election.cc:290] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:25.147850 1176 raft_consensus.cc:2243] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.149344 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88eeb101a1734271973cd7d4c756b356" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:25.150795 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88eeb101a1734271973cd7d4c756b356" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:25.154224 1184 ts_tablet_manager.cc:1929] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.158566 1184 log.cc:1199] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/15aaa0f335ed4e828e2c0f0ffde4b6ba
I20260318 02:51:25.159207 1184 ts_tablet_manager.cc:1950] T 15aaa0f335ed4e828e2c0f0ffde4b6ba P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:25.161129 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 15aaa0f335ed4e828e2c0f0ffde4b6ba (table default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]) successfully deleted
I20260318 02:51:25.162449 1184 tablet_replica.cc:333] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:25.162950 1184 raft_consensus.cc:2243] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.163208 1566 tablet.cc:1718] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d: Skipping requested alter to schema version 3, tablet already version 3
I20260318 02:51:25.163491 1184 raft_consensus.cc:2272] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.164032 1184 ts_tablet_manager.cc:1916] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.167055 1564 tablet.cc:1723] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260318 02:51:25.178021 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 31d493650d07437c9f1d657bb08a98d7 with delete_type TABLET_DATA_DELETED (replaced by tablet 105326aea9f744779ca76e0cbb2448cd) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.180040 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_22e1d9e9571f415597c2b5fd053f529a" } new_table_name: "default.Table_b76c4b353fbe45c8a866d4cd2c4e264c" modify_external_catalogs: true
I20260318 02:51:25.180265 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7726804d85124e99b24f46fd5169aed5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.180833 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7726804d85124e99b24f46fd5169aed5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.181766 1184 ts_tablet_manager.cc:1929] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:25.181907 1184 log.cc:1199] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/da240bc0d5b043b89232fdf646f4f344
I20260318 02:51:25.182336 1184 ts_tablet_manager.cc:1950] T da240bc0d5b043b89232fdf646f4f344 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
W20260318 02:51:25.185667 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 083493ab9d26493a924025fbd96ab1d7 consensus state has no leader
I20260318 02:51:25.186105 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c662869530134cb08ab6cc52957d07d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.186721 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c662869530134cb08ab6cc52957d07d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.186729 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_374dfe5a11944231bc786a2cb0c66a84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:25.188566 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet da240bc0d5b043b89232fdf646f4f344 (table default.Table_d7429a91cdb142b99d2f341a75bc82bf [id=d7f85dc897794d14af2f182a59150e92]) successfully deleted
W20260318 02:51:25.189483 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 71c518c87bdd4a63aa1016e8de6bafdc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71c518c87bdd4a63aa1016e8de6bafdc already in progress: creating tablet
W20260318 02:51:25.190456 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 959faf1fbb224434b896c0f21e9715be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 959faf1fbb224434b896c0f21e9715be already in progress: creating tablet
W20260318 02:51:25.190990 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 88eeb101a1734271973cd7d4c756b356 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88eeb101a1734271973cd7d4c756b356 already in progress: creating tablet
W20260318 02:51:25.191776 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 00d953e1ae2f47fc8016a2f9a791141d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00d953e1ae2f47fc8016a2f9a791141d already in progress: creating tablet
W20260318 02:51:25.192615 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 065ebc3c000a4ad3873ee031ecf9986b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 065ebc3c000a4ad3873ee031ecf9986b already in progress: creating tablet
W20260318 02:51:25.192588 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_374dfe5a11944231bc786a2cb0c66a84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:25.193567 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 3dda9bd9befd427fac9dfde6f299a6ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3dda9bd9befd427fac9dfde6f299a6ab already in progress: creating tablet
W20260318 02:51:25.194520 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 421e5223d6af4da1a8e07534f942d016 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 421e5223d6af4da1a8e07534f942d016 already in progress: creating tablet
I20260318 02:51:25.195154 1184 tablet_replica.cc:333] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:25.195604 1184 raft_consensus.cc:2243] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.196868 1184 raft_consensus.cc:2272] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.197781 1184 ts_tablet_manager.cc:1916] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:25.204246 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab158343adb14eab85c595fa5405145d consensus state has no leader
I20260318 02:51:25.204013 1175 ts_tablet_manager.cc:1929] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.204660 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0d76788054244bdc8c7aa32525412970" } new_table_name: "default.Table_4775eaa0e7e84642aa0a8f8b2885610e" modify_external_catalogs: true
I20260318 02:51:25.205065 1175 log.cc:1199] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/1df8029146564e1c9dc88dd9f5fb64ae
I20260318 02:51:25.209465 1175 ts_tablet_manager.cc:1950] T 1df8029146564e1c9dc88dd9f5fb64ae P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:25.211458 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_cfd83086efd94aeeac453573d0c9350b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.212080 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfd83086efd94aeeac453573d0c9350b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.212234 1184 ts_tablet_manager.cc:1929] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.212361 1184 log.cc:1199] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/74233fd7ed094e7cbfc79309605db0e1
I20260318 02:51:25.212693 1184 ts_tablet_manager.cc:1950] T 74233fd7ed094e7cbfc79309605db0e1 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:25.213809 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 74233fd7ed094e7cbfc79309605db0e1 (table default.Table_90fbf2263430453082ef161ec0025a5a [id=f6d13c14fec24bc8894ebd60b88fca77]) successfully deleted
I20260318 02:51:25.216040 1184 tablet_replica.cc:333] T 32880a703603476786b4a34ddd40cab8 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:25.216260 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 1df8029146564e1c9dc88dd9f5fb64ae (table default.Table_8191659006de403a8de64233efbf3486 [id=c2fac99943e14848aec3bc3195a60023]) successfully deleted
I20260318 02:51:25.216557 1184 raft_consensus.cc:2243] T 32880a703603476786b4a34ddd40cab8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.216761 1184 raft_consensus.cc:2272] T 32880a703603476786b4a34ddd40cab8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.217211 1175 tablet_replica.cc:333] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:25.218075 1173 tablet_bootstrap.cc:492] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:25.218109 1184 ts_tablet_manager.cc:1916] T 32880a703603476786b4a34ddd40cab8 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.218364 1173 ts_tablet_manager.cc:1403] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.087s user 0.039s sys 0.038s
W20260318 02:51:25.219249 442 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet ce0ab476b9a54cc586a4c28e23382bfc (table default.Table_51fd1fd451544782b3785014979adeba [id=94288205d88b4c6ca1f94de1b201a349], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ce0ab476b9a54cc586a4c28e23382bfc consensus state has no leader
I20260318 02:51:25.220172 1176 pending_rounds.cc:70] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad: Trying to abort 2 pending ops.
I20260318 02:51:25.220098 1173 raft_consensus.cc:359] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.220275 1176 pending_rounds.cc:77] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7265494157984661504 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "549b3929ea33417bbe50e749bbfe223d" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 3 new_table_name: "default.Table_46fb019cb5d14d49b14ad13be0a6bd41" dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" new_extra_config { } }
I20260318 02:51:25.220645 1173 raft_consensus.cc:385] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.220683 1174 ts_tablet_manager.cc:1434] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.081s user 0.001s sys 0.001s
I20260318 02:51:25.221017 1174 tablet_bootstrap.cc:492] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:25.220969 719 leader_election.cc:343] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.220856 1173 raft_consensus.cc:740] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.221436 1173 consensus_queue.cc:260] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.217496 1175 raft_consensus.cc:2243] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.222065 1175 raft_consensus.cc:2272] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.222350 1173 ts_tablet_manager.cc:1434] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:25.222748 1561 raft_consensus.cc:493] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:25.223083 1561 raft_consensus.cc:515] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.223188 1175 ts_tablet_manager.cc:1916] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.223229 1173 tablet_bootstrap.cc:492] T 7480b1fa026242d7bb6ddbf8df563116 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:25.223784 1561 leader_election.cc:290] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:25.224164 1174 tablet_bootstrap.cc:654] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:25.224182 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 71206.5us
W20260318 02:51:25.224936 719 leader_election.cc:343] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.225071 719 leader_election.cc:304] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:25.225139 1176 pending_rounds.cc:77] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494154866233344 op_type: NO_OP noop_request { }
I20260318 02:51:25.225250 1176 raft_consensus.cc:2889] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:25.225363 1176 raft_consensus.cc:2272] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.225819 1173 tablet_bootstrap.cc:654] T 7480b1fa026242d7bb6ddbf8df563116 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.226101 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf09f8234f36402bb9129d524637b5b5" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:25.226569 1560 raft_consensus.cc:493] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:25.226703 1560 raft_consensus.cc:515] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.227495 1560 leader_election.cc:290] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:25.227656 1560 raft_consensus.cc:2749] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:25.229419 719 leader_election.cc:343] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.230015 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b82751cbcbb4c39a6942b6856412fc8" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:25.230232 926 raft_consensus.cc:2468] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 0.
I20260318 02:51:25.230195 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b82751cbcbb4c39a6942b6856412fc8" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:25.232496 719 leader_election.cc:343] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.233912 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf09f8234f36402bb9129d524637b5b5" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:25.232697 719 leader_election.cc:304] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:25.233982 1587 tablet.cc:1723] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20260318 02:51:25.235317 719 leader_election.cc:343] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.235478 719 leader_election.cc:304] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:25.236004 1561 raft_consensus.cc:2804] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:25.236119 1561 raft_consensus.cc:493] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:25.236191 1561 raft_consensus.cc:3060] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:25.239964 1496 raft_consensus.cc:2749] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:25.240181 1496 raft_consensus.cc:493] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:25.240298 1496 raft_consensus.cc:515] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.240937 1496 leader_election.cc:290] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:25.242247 1175 ts_tablet_manager.cc:1929] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.242493 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfaf92570b34b2bb1f52aea06187c83" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:25.242681 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfaf92570b34b2bb1f52aea06187c83" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:25.242831 1175 log.cc:1199] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/3ff487cba236491eb22becf0dc591925
W20260318 02:51:25.243994 719 leader_election.cc:343] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.244040 1175 ts_tablet_manager.cc:1950] T 3ff487cba236491eb22becf0dc591925 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
W20260318 02:51:25.244607 719 leader_election.cc:343] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.244817 719 leader_election.cc:304] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:25.245549 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 3ff487cba236491eb22becf0dc591925 (table default.Table_b76c4b353fbe45c8a866d4cd2c4e264c [id=d20f8f1bd66d4dceab3b7bc72608da2a]) successfully deleted
I20260318 02:51:25.247921 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1d2a493334714a809ca348d380f97577" } modify_external_catalogs: true
I20260318 02:51:25.248139 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1d2a493334714a809ca348d380f97577" } modify_external_catalogs: true
I20260318 02:51:25.248418 1175 tablet_replica.cc:333] T b69dd1653a304f3d99346e89dacf9208 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:25.249140 1175 raft_consensus.cc:2243] T b69dd1653a304f3d99346e89dacf9208 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.249804 1175 raft_consensus.cc:2272] T b69dd1653a304f3d99346e89dacf9208 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.249899 1496 raft_consensus.cc:2749] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:25.250252 456 master_service.cc:954] ReplaceTablet: received request to replace tablet 2789a1195e7344c18dd226e196e2f302 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:25.251718 1175 ts_tablet_manager.cc:1916] T b69dd1653a304f3d99346e89dacf9208 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:25.253518 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c20810ad3354126bf49bbeeb6edb098 consensus state has no leader
I20260318 02:51:25.253957 1173 tablet_bootstrap.cc:492] T 7480b1fa026242d7bb6ddbf8df563116 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:25.254099 1173 ts_tablet_manager.cc:1403] T 7480b1fa026242d7bb6ddbf8df563116 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.031s user 0.010s sys 0.001s
W20260318 02:51:25.250797 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 00d953e1ae2f47fc8016a2f9a791141d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00d953e1ae2f47fc8016a2f9a791141d already in progress: creating tablet
W20260318 02:51:25.255200 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 3dda9bd9befd427fac9dfde6f299a6ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3dda9bd9befd427fac9dfde6f299a6ab already in progress: creating tablet
I20260318 02:51:25.255220 1173 raft_consensus.cc:359] T 7480b1fa026242d7bb6ddbf8df563116 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.255398 1173 raft_consensus.cc:385] T 7480b1fa026242d7bb6ddbf8df563116 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260318 02:51:25.255438 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 065ebc3c000a4ad3873ee031ecf9986b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 065ebc3c000a4ad3873ee031ecf9986b already in progress: creating tablet
I20260318 02:51:25.255481 1173 raft_consensus.cc:740] T 7480b1fa026242d7bb6ddbf8df563116 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
W20260318 02:51:25.255640 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 421e5223d6af4da1a8e07534f942d016 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 421e5223d6af4da1a8e07534f942d016 already in progress: creating tablet
I20260318 02:51:25.255714 1173 consensus_queue.cc:260] T 7480b1fa026242d7bb6ddbf8df563116 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.256237 1173 ts_tablet_manager.cc:1434] T 7480b1fa026242d7bb6ddbf8df563116 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:25.256512 1173 tablet_bootstrap.cc:492] T 88eeb101a1734271973cd7d4c756b356 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:25.257958 451 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 5aebb91ff6b0416fac2ef2d056ca897a (table default.Table_764057148a0945d0a7a4f9e497808d92 [id=e91dc919c98843a7b31ed85f73ab5774]). Expected version 1 got 0
I20260318 02:51:25.259753 451 catalog_manager.cc:5671] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a903d876086423b8016d705b98895ad (127.0.104.129). New cstate: current_term: 1 leader_uuid: "6a903d876086423b8016d705b98895ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:25.259351 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3ca80b83e6d7423fb22529c4b0d1391f" } new_table_name: "default.Table_3406e803538541a5b564a3ae03dfedd6" modify_external_catalogs: true
I20260318 02:51:25.262177 1184 ts_tablet_manager.cc:1929] T 32880a703603476786b4a34ddd40cab8 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.262334 1184 log.cc:1199] T 32880a703603476786b4a34ddd40cab8 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/32880a703603476786b4a34ddd40cab8
I20260318 02:51:25.262686 1184 ts_tablet_manager.cc:1950] T 32880a703603476786b4a34ddd40cab8 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:25.263716 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 32880a703603476786b4a34ddd40cab8 (table default.Table_82b90b9eec6a4252b7022e3cf497374c [id=f63cc6603c274afba2cb3ae1228ed566]) successfully deleted
I20260318 02:51:25.258529 1173 tablet_bootstrap.cc:654] T 88eeb101a1734271973cd7d4c756b356 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.264986 1561 raft_consensus.cc:515] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.265786 1561 leader_election.cc:290] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:25.267562 1175 ts_tablet_manager.cc:1929] T b69dd1653a304f3d99346e89dacf9208 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.267884 1175 log.cc:1199] T b69dd1653a304f3d99346e89dacf9208 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/b69dd1653a304f3d99346e89dacf9208
I20260318 02:51:25.268487 1175 ts_tablet_manager.cc:1950] T b69dd1653a304f3d99346e89dacf9208 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:25.268982 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 42a6983dce4e476cae97b3ecb1133077
I20260318 02:51:25.269227 1175 tablet_replica.cc:333] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:25.269337 1184 tablet_replica.cc:333] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:25.269527 1184 raft_consensus.cc:2243] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.269541 1175 raft_consensus.cc:2243] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:25.269650 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 65c50b0813b04f30896568ab2b680ba8
I20260318 02:51:25.269675 448 master_service.cc:954] ReplaceTablet: received request to replace tablet 5db76f996b094bf99b6c6fe33f02b9f3 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:25.269708 1184 raft_consensus.cc:2272] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.270002 1175 raft_consensus.cc:2272] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.270164 452 catalog_manager.cc:6741] ReplaceTablet: tablet 65c50b0813b04f30896568ab2b680ba8 deleted and replaced by tablet 20a492fdea6c44ba8439614b0dcc2ba6
I20260318 02:51:25.270603 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b6e28e78c8ce47bc8a4b3a78f29d43ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.271230 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6e28e78c8ce47bc8a4b3a78f29d43ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.272372 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 42a6983dce4e476cae97b3ecb1133077 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.272655 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 65c50b0813b04f30896568ab2b680ba8 with delete_type TABLET_DATA_DELETED (replaced by tablet 20a492fdea6c44ba8439614b0dcc2ba6) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.273856 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b82751cbcbb4c39a6942b6856412fc8" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:25.274217 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b82751cbcbb4c39a6942b6856412fc8" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:25.274435 926 raft_consensus.cc:3060] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:25.274423 719 leader_election.cc:343] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.275266 450 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_fddbe89a9a524d028fba5877d8b23387 [id=20ed812002544f6f8caef448f7514f7c] alter complete (version 4)
I20260318 02:51:25.276093 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1fb3a44bfb2f4aac917af6b4684d7668"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.277097 1572 log.cc:927] Time spent T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad: Append to log took a long time: real 0.130s user 0.000s sys 0.000s
I20260318 02:51:25.279083 926 raft_consensus.cc:2468] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 1.
I20260318 02:51:25.280333 719 leader_election.cc:304] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 9422bb7011f342b08be0b073a88c4c4d
W20260318 02:51:25.276688 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1fb3a44bfb2f4aac917af6b4684d7668 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.282552 766 tablet_service.cc:1511] Processing CreateTablet for tablet c0c33cfa1c194a65bfc64d0e1e9434ff (DEFAULT_TABLE table=default.Table_c8ea19bed9e54eaf91af95c365e46851 [id=551f7031c6b84904836a915c07704492]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.283042 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c33cfa1c194a65bfc64d0e1e9434ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.286129 1564 tablet.cc:1718] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18: Skipping requested alter to schema version 3, tablet already version 3
I20260318 02:51:25.289268 1175 ts_tablet_manager.cc:1916] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.289780 1561 raft_consensus.cc:2804] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:25.290028 1561 raft_consensus.cc:697] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Becoming Leader. State: Replica: 6a903d876086423b8016d705b98895ad, State: Running, Role: LEADER
I20260318 02:51:25.290216 1172 tablet_bootstrap.cc:492] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:25.290382 1172 ts_tablet_manager.cc:1403] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.307s user 0.020s sys 0.067s
I20260318 02:51:25.290326 1561 consensus_queue.cc:237] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.291229 1172 raft_consensus.cc:359] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.291400 1172 raft_consensus.cc:385] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260318 02:51:25.277632 1572 consensus_queue.cc:1175] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6a903d876086423b8016d705b98895ad" status { last_received { term: 1 index: 2 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 2 } }
I20260318 02:51:25.291478 1172 raft_consensus.cc:740] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.291702 1172 consensus_queue.cc:260] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.292236 1172 ts_tablet_manager.cc:1434] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:25.294123 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 42a6983dce4e476cae97b3ecb1133077 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.294806 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 42a6983dce4e476cae97b3ecb1133077 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.295179 1172 tablet_bootstrap.cc:492] T 24c66e2cc96f458fb3279827cea4ca9e P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:25.295198 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 65c50b0813b04f30896568ab2b680ba8 with delete_type TABLET_DATA_DELETED (replaced by tablet 20a492fdea6c44ba8439614b0dcc2ba6) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.296943 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 65c50b0813b04f30896568ab2b680ba8 with delete_type TABLET_DATA_DELETED (replaced by tablet 20a492fdea6c44ba8439614b0dcc2ba6) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.297132 1172 tablet_bootstrap.cc:654] T 24c66e2cc96f458fb3279827cea4ca9e P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.299599 1176 ts_tablet_manager.cc:1916] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.296389 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet b69dd1653a304f3d99346e89dacf9208 (table default.Table_422656b6b8b4438e9d2000352503c6b9 [id=57dcabdb56b84275bb202ad3decd8b15]) successfully deleted
I20260318 02:51:25.302181 1175 ts_tablet_manager.cc:1929] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260318 02:51:25.302392 1175 log.cc:1199] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/549b3929ea33417bbe50e749bbfe223d
I20260318 02:51:25.302851 1175 ts_tablet_manager.cc:1950] T 549b3929ea33417bbe50e749bbfe223d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:25.303488 1175 tablet_replica.cc:333] T 45fddf78fc834d20908696b980d394a2 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:25.303493 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 549b3929ea33417bbe50e749bbfe223d (table default.Table_46fb019cb5d14d49b14ad13be0a6bd41 [id=f62386b6ad9441eeafff054f00ee0423]) successfully deleted
I20260318 02:51:25.303706 1175 raft_consensus.cc:2243] T 45fddf78fc834d20908696b980d394a2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.303917 1175 raft_consensus.cc:2272] T 45fddf78fc834d20908696b980d394a2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.304746 1175 ts_tablet_manager.cc:1916] T 45fddf78fc834d20908696b980d394a2 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.305265 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet a6f42462ed9c49c797f5115b3ca6c423
I20260318 02:51:25.307412 455 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 6b82751cbcbb4c39a6942b6856412fc8 (table default.Table_9faefa2c0ceb4495935b65b6869b4b7a [id=84a657155372475db438c6eb3119b595]). Expected version 2 got 0
I20260318 02:51:25.308096 455 master_service.cc:954] ReplaceTablet: received request to replace tablet 2789a1195e7344c18dd226e196e2f302 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:25.310945 455 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 6b82751cbcbb4c39a6942b6856412fc8 (table default.Table_9faefa2c0ceb4495935b65b6869b4b7a [id=84a657155372475db438c6eb3119b595]). Expected version 2 got 0
I20260318 02:51:25.311168 1176 ts_tablet_manager.cc:1929] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:25.311313 1176 log.cc:1199] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/549b3929ea33417bbe50e749bbfe223d
I20260318 02:51:25.311784 1176 ts_tablet_manager.cc:1950] T 549b3929ea33417bbe50e749bbfe223d P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:25.311980 1175 ts_tablet_manager.cc:1929] T 45fddf78fc834d20908696b980d394a2 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.312655 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 549b3929ea33417bbe50e749bbfe223d (table default.Table_46fb019cb5d14d49b14ad13be0a6bd41 [id=f62386b6ad9441eeafff054f00ee0423]) successfully deleted
I20260318 02:51:25.305979 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2789a1195e7344c18dd226e196e2f302
I20260318 02:51:25.313380 456 catalog_manager.cc:6741] ReplaceTablet: tablet 2789a1195e7344c18dd226e196e2f302 deleted and replaced by tablet f37ab96f13444fcbb5cfc3ad92d53c35
W20260318 02:51:25.313848 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 42a6983dce4e476cae97b3ecb1133077 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42a6983dce4e476cae97b3ecb1133077 already in progress: creating tablet
W20260318 02:51:25.314086 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 65c50b0813b04f30896568ab2b680ba8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65c50b0813b04f30896568ab2b680ba8 already in progress: creating tablet
I20260318 02:51:25.314059 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 2789a1195e7344c18dd226e196e2f302 with delete_type TABLET_DATA_DELETED (replaced by tablet f37ab96f13444fcbb5cfc3ad92d53c35) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.314587 1175 log.cc:1199] T 45fddf78fc834d20908696b980d394a2 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/45fddf78fc834d20908696b980d394a2
W20260318 02:51:25.314661 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2789a1195e7344c18dd226e196e2f302 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2789a1195e7344c18dd226e196e2f302 already in progress: creating tablet
I20260318 02:51:25.314987 1175 ts_tablet_manager.cc:1950] T 45fddf78fc834d20908696b980d394a2 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:25.315052 766 tablet_service.cc:1558] Processing DeleteTablet for tablet a6f42462ed9c49c797f5115b3ca6c423 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:25.315659 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet a6f42462ed9c49c797f5115b3ca6c423 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6f42462ed9c49c797f5115b3ca6c423 already in progress: creating tablet
I20260318 02:51:25.316480 1175 tablet_replica.cc:333] T 31d493650d07437c9f1d657bb08a98d7 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:25.316687 1175 raft_consensus.cc:2243] T 31d493650d07437c9f1d657bb08a98d7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.317477 1175 raft_consensus.cc:2272] T 31d493650d07437c9f1d657bb08a98d7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.321272 892 tablet_service.cc:1558] Processing DeleteTablet for tablet a6f42462ed9c49c797f5115b3ca6c423 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.322069 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 2789a1195e7344c18dd226e196e2f302 with delete_type TABLET_DATA_DELETED (replaced by tablet f37ab96f13444fcbb5cfc3ad92d53c35) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.322443 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 2789a1195e7344c18dd226e196e2f302 with delete_type TABLET_DATA_DELETED (replaced by tablet f37ab96f13444fcbb5cfc3ad92d53c35) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.322713 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet a6f42462ed9c49c797f5115b3ca6c423 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.323264 1174 tablet_bootstrap.cc:492] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:25.323503 1174 ts_tablet_manager.cc:1403] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.103s user 0.015s sys 0.026s
W20260318 02:51:25.323845 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3fccf1f2bc3547e9ba8cc5fe9419f70b consensus state has no leader
I20260318 02:51:25.324323 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 5db76f996b094bf99b6c6fe33f02b9f3
I20260318 02:51:25.324448 1174 raft_consensus.cc:359] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.324682 1174 raft_consensus.cc:385] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.324817 1174 raft_consensus.cc:740] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.324891 448 catalog_manager.cc:6741] ReplaceTablet: tablet 5db76f996b094bf99b6c6fe33f02b9f3 deleted and replaced by tablet 89a76fc237fc4bb8a891e3151efb3106
I20260318 02:51:25.325217 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 45fddf78fc834d20908696b980d394a2 (table default.Table_b4c6c515fa1b469bad29515911177508 [id=895bbd90cf47462ab116ee3f37e94982]) successfully deleted
I20260318 02:51:25.325182 1174 consensus_queue.cc:260] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.325842 1174 ts_tablet_manager.cc:1434] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:25.326190 1174 tablet_bootstrap.cc:492] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:25.326262 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 5db76f996b094bf99b6c6fe33f02b9f3 with delete_type TABLET_DATA_DELETED (replaced by tablet 89a76fc237fc4bb8a891e3151efb3106) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.326725 1184 ts_tablet_manager.cc:1916] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.328809 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 5db76f996b094bf99b6c6fe33f02b9f3 with delete_type TABLET_DATA_DELETED (replaced by tablet 89a76fc237fc4bb8a891e3151efb3106) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.330386 1174 tablet_bootstrap.cc:654] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.339332 1175 ts_tablet_manager.cc:1916] T 31d493650d07437c9f1d657bb08a98d7 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.340456 1174 tablet_bootstrap.cc:492] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:25.341403 1172 tablet_bootstrap.cc:492] T 24c66e2cc96f458fb3279827cea4ca9e P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:25.341689 1172 ts_tablet_manager.cc:1403] T 24c66e2cc96f458fb3279827cea4ca9e P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.047s user 0.009s sys 0.004s
I20260318 02:51:25.342505 1172 raft_consensus.cc:359] T 24c66e2cc96f458fb3279827cea4ca9e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.342742 1172 raft_consensus.cc:385] T 24c66e2cc96f458fb3279827cea4ca9e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.342841 1172 raft_consensus.cc:740] T 24c66e2cc96f458fb3279827cea4ca9e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.343174 1172 consensus_queue.cc:260] T 24c66e2cc96f458fb3279827cea4ca9e P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.343976 1172 ts_tablet_manager.cc:1434] T 24c66e2cc96f458fb3279827cea4ca9e P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:25.344260 1174 ts_tablet_manager.cc:1403] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.001s
I20260318 02:51:25.344815 1172 tablet_bootstrap.cc:492] T 3ff487cba236491eb22becf0dc591925 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:25.346041 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_09099cfaa5e34f5fb01556055c6d72f2" } new_table_name: "default.Table_1f0867f6b8cd42bc9fb963f5349feed4" modify_external_catalogs: true
I20260318 02:51:25.346599 1174 raft_consensus.cc:359] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.346786 1174 raft_consensus.cc:385] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.346884 1174 raft_consensus.cc:740] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.348906 1172 tablet_bootstrap.cc:654] T 3ff487cba236491eb22becf0dc591925 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.353245 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 7480b1fa026242d7bb6ddbf8df563116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.355028 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet c7c4257a54d3487aa520531a64fc721c
I20260318 02:51:25.353219 1174 consensus_queue.cc:260] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.357184 1174 ts_tablet_manager.cc:1434] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260318 02:51:25.357295 892 tablet_service.cc:1558] Processing DeleteTablet for tablet c7c4257a54d3487aa520531a64fc721c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.357612 1174 tablet_bootstrap.cc:492] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:25.357684 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet c7c4257a54d3487aa520531a64fc721c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.358750 1176 tablet_replica.cc:333] T 7480b1fa026242d7bb6ddbf8df563116 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:25.358981 1176 raft_consensus.cc:2243] T 7480b1fa026242d7bb6ddbf8df563116 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.359174 1176 raft_consensus.cc:2272] T 7480b1fa026242d7bb6ddbf8df563116 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.359750 1176 ts_tablet_manager.cc:1916] T 7480b1fa026242d7bb6ddbf8df563116 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.359947 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a1b9dc84de4a42288ee7754f4a110daa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.360562 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1b9dc84de4a42288ee7754f4a110daa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.362681 759 tablet_service.cc:1558] Processing DeleteTablet for tablet c7c4257a54d3487aa520531a64fc721c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.366328 1174 tablet_bootstrap.cc:654] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.367657 1184 ts_tablet_manager.cc:1929] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.367806 1184 log.cc:1199] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/d604cd634a1c470ba3896cf02d2804d4
I20260318 02:51:25.368144 1172 tablet_bootstrap.cc:492] T 3ff487cba236491eb22becf0dc591925 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:25.368294 1172 ts_tablet_manager.cc:1403] T 3ff487cba236491eb22becf0dc591925 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.001s
I20260318 02:51:25.369129 1172 raft_consensus.cc:359] T 3ff487cba236491eb22becf0dc591925 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.369365 1172 raft_consensus.cc:385] T 3ff487cba236491eb22becf0dc591925 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.369462 1172 raft_consensus.cc:740] T 3ff487cba236491eb22becf0dc591925 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.369679 1172 consensus_queue.cc:260] T 3ff487cba236491eb22becf0dc591925 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.372350 1173 tablet_bootstrap.cc:492] T 88eeb101a1734271973cd7d4c756b356 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:25.372581 1173 ts_tablet_manager.cc:1403] T 88eeb101a1734271973cd7d4c756b356 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.116s user 0.023s sys 0.039s
I20260318 02:51:25.373440 1173 raft_consensus.cc:359] T 88eeb101a1734271973cd7d4c756b356 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.373680 1173 raft_consensus.cc:385] T 88eeb101a1734271973cd7d4c756b356 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.373777 1173 raft_consensus.cc:740] T 88eeb101a1734271973cd7d4c756b356 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.374025 1173 consensus_queue.cc:260] T 88eeb101a1734271973cd7d4c756b356 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.374553 1173 ts_tablet_manager.cc:1434] T 88eeb101a1734271973cd7d4c756b356 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:25.375165 1173 tablet_bootstrap.cc:492] T 959faf1fbb224434b896c0f21e9715be P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:25.375588 1176 ts_tablet_manager.cc:1929] T 7480b1fa026242d7bb6ddbf8df563116 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.377166 1173 tablet_bootstrap.cc:654] T 959faf1fbb224434b896c0f21e9715be P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.377530 1184 ts_tablet_manager.cc:1950] T d604cd634a1c470ba3896cf02d2804d4 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:25.377592 1172 ts_tablet_manager.cc:1434] T 3ff487cba236491eb22becf0dc591925 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260318 02:51:25.380663 1172 tablet_bootstrap.cc:492] T 45fddf78fc834d20908696b980d394a2 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:25.382462 1172 tablet_bootstrap.cc:654] T 45fddf78fc834d20908696b980d394a2 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.384356 1184 tablet_replica.cc:333] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:25.384523 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet d604cd634a1c470ba3896cf02d2804d4 (table default.Table_215d98fc906d466d8c0d334250547c34 [id=1165495ee0884badba5bd95f87987e33]) successfully deleted
I20260318 02:51:25.385278 1184 raft_consensus.cc:2243] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.385574 1184 raft_consensus.cc:2272] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.387920 1586 tablet.cc:1718] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18: Skipping requested alter to schema version 4, tablet already version 4
I20260318 02:51:25.389415 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet e55bbc320b0e4f9595bae9816e594b82
I20260318 02:51:25.390125 892 tablet_service.cc:1558] Processing DeleteTablet for tablet e55bbc320b0e4f9595bae9816e594b82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.390090 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d8631b4230fc46efaaee519421401f19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:25.390286 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7da4bcebfec04c4daede16eec31b5497"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.390717 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8631b4230fc46efaaee519421401f19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:25.390825 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7da4bcebfec04c4daede16eec31b5497 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.392618 1184 ts_tablet_manager.cc:1916] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.393198 1566 tablet.cc:1718] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d: Skipping requested alter to schema version 4, tablet already version 4
I20260318 02:51:25.394268 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_76edb5c5aa524eda83e05de00631650c" } new_table_name: "default.Table_f6484117e54a4f2298a8d7365770c153" modify_external_catalogs: true
I20260318 02:51:25.395771 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ff487cba236491eb22becf0dc591925 with delete_type TABLET_DATA_DELETED (replaced by tablet ab158343adb14eab85c595fa5405145d) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.396806 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet e55bbc320b0e4f9595bae9816e594b82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.397826 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet cf27c8d69f41431e9fab12e605e15b9c
I20260318 02:51:25.398573 892 tablet_service.cc:1558] Processing DeleteTablet for tablet cf27c8d69f41431e9fab12e605e15b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.398921 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5ed5970032fe44119b015cb6bbcd91d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.399600 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ed5970032fe44119b015cb6bbcd91d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.402282 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet cf27c8d69f41431e9fab12e605e15b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.385407 1174 tablet_bootstrap.cc:492] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:25.403184 1176 log.cc:1199] T 7480b1fa026242d7bb6ddbf8df563116 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/7480b1fa026242d7bb6ddbf8df563116
I20260318 02:51:25.403276 1174 ts_tablet_manager.cc:1403] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.002s
I20260318 02:51:25.403621 1176 ts_tablet_manager.cc:1950] T 7480b1fa026242d7bb6ddbf8df563116 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:25.404206 1174 raft_consensus.cc:359] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.404407 1174 raft_consensus.cc:385] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.404474 1174 raft_consensus.cc:740] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.404693 1174 consensus_queue.cc:260] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.405272 1174 ts_tablet_manager.cc:1434] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260318 02:51:25.405654 1174 tablet_bootstrap.cc:492] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:25.405896 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 549b3929ea33417bbe50e749bbfe223d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.406445 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b9ac6b9d4a245ec8d8aed1db976123b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.406440 1496 raft_consensus.cc:493] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:25.406596 1496 raft_consensus.cc:515] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.407281 1496 leader_election.cc:290] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:25.407449 1174 tablet_bootstrap.cc:654] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.396478 1587 tablet.cc:1718] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad: Skipping requested alter to schema version 4, tablet already version 4
I20260318 02:51:25.408385 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aebb91ff6b0416fac2ef2d056ca897a" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:25.408959 719 leader_election.cc:343] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.409282 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a73cffc7e068465bace900fc6b92c44e" } new_table_name: "default.Table_3f656b3bee94423f80dd692ce3481733" modify_external_catalogs: true
I20260318 02:51:25.409667 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aebb91ff6b0416fac2ef2d056ca897a" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:25.410374 719 leader_election.cc:343] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.410516 719 leader_election.cc:304] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:25.410753 1561 raft_consensus.cc:2749] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:25.411619 1184 ts_tablet_manager.cc:1929] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
W20260318 02:51:25.412074 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf73a9f8f67b42d9baf1396d70a1a3a9 consensus state has no leader
I20260318 02:51:25.414062 1586 tablet.cc:1718] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18: Skipping requested alter to schema version 4, tablet already version 4
I20260318 02:51:25.415884 1587 tablet.cc:1718] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad: Skipping requested alter to schema version 4, tablet already version 4
I20260318 02:51:25.416745 1174 tablet_bootstrap.cc:492] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:25.416961 1174 ts_tablet_manager.cc:1403] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.004s
I20260318 02:51:25.418188 1174 raft_consensus.cc:359] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.418442 1174 raft_consensus.cc:385] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.418567 1174 raft_consensus.cc:740] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.418848 1174 consensus_queue.cc:260] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.417584 1566 tablet.cc:1718] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d: Skipping requested alter to schema version 4, tablet already version 4
I20260318 02:51:25.419564 1174 ts_tablet_manager.cc:1434] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260318 02:51:25.419862 1174 tablet_bootstrap.cc:492] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:25.411782 1184 log.cc:1199] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/549b3929ea33417bbe50e749bbfe223d
I20260318 02:51:25.420785 1184 ts_tablet_manager.cc:1950] T 549b3929ea33417bbe50e749bbfe223d P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:25.421312 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_600a629a518c46678144af62a75ea690"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.421955 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_600a629a518c46678144af62a75ea690 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.422073 1174 tablet_bootstrap.cc:654] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.423465 1184 tablet_replica.cc:333] T b69dd1653a304f3d99346e89dacf9208 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:25.425247 759 tablet_service.cc:1558] Processing DeleteTablet for tablet e55bbc320b0e4f9595bae9816e594b82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.425441 752 tablet_service.cc:1558] Processing DeleteTablet for tablet cf27c8d69f41431e9fab12e605e15b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.426587 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 7480b1fa026242d7bb6ddbf8df563116 (table default.Table_3e4d4a8323da4e20a12b2b6a9f7fd54c [id=71930ef490a446019e86d9159e1f67d3]) successfully deleted
W20260318 02:51:25.426908 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet c7c4257a54d3487aa520531a64fc721c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7c4257a54d3487aa520531a64fc721c already in progress: creating tablet
W20260318 02:51:25.428031 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet e55bbc320b0e4f9595bae9816e594b82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e55bbc320b0e4f9595bae9816e594b82 already in progress: creating tablet
W20260318 02:51:25.428376 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet cf27c8d69f41431e9fab12e605e15b9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf27c8d69f41431e9fab12e605e15b9c already in progress: creating tablet
I20260318 02:51:25.429203 1184 raft_consensus.cc:2243] T b69dd1653a304f3d99346e89dacf9208 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.429774 1184 raft_consensus.cc:2272] T b69dd1653a304f3d99346e89dacf9208 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.430951 1184 ts_tablet_manager.cc:1916] T b69dd1653a304f3d99346e89dacf9208 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:25.431010 1536 lock_manager.cc:585] Waited 1 seconds to obtain row lock on key '<redacted>' (key hash 15616205254053262682) tablet 00000000000000000000000000000000 cur holder 0x61700005fd80
I20260318 02:51:25.431768 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 7480b1fa026242d7bb6ddbf8df563116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.431968 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 88eeb101a1734271973cd7d4c756b356 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.432260 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 323e4b1e9aee449f9402b1712b1444d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 8c20810ad3354126bf49bbeeb6edb098) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.432662 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 549b3929ea33417bbe50e749bbfe223d (table default.Table_46fb019cb5d14d49b14ad13be0a6bd41 [id=f62386b6ad9441eeafff054f00ee0423]) successfully deleted
I20260318 02:51:25.439926 452 catalog_manager.cc:5671] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a903d876086423b8016d705b98895ad (127.0.104.129). New cstate: current_term: 1 leader_uuid: "6a903d876086423b8016d705b98895ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:25.440448 452 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 6b82751cbcbb4c39a6942b6856412fc8 (table default.Table_9faefa2c0ceb4495935b65b6869b4b7a [id=84a657155372475db438c6eb3119b595]). Expected version 2 got 0
I20260318 02:51:25.442137 1175 ts_tablet_manager.cc:1929] T 31d493650d07437c9f1d657bb08a98d7 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.442389 1175 log.cc:1199] T 31d493650d07437c9f1d657bb08a98d7 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/31d493650d07437c9f1d657bb08a98d7
I20260318 02:51:25.442804 1175 ts_tablet_manager.cc:1950] T 31d493650d07437c9f1d657bb08a98d7 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:25.443141 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 97655cb5968b4c819273068818d5cab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.443706 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cfaf92570b34b2bb1f52aea06187c83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.443971 752 tablet_service.cc:1558] Processing DeleteTablet for tablet af802894346443669f1cc549a1ba401b with delete_type TABLET_DATA_DELETED (replaced by tablet 30205728339f4bcf8b7d94d6f373e01c) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.444217 759 tablet_service.cc:1558] Processing DeleteTablet for tablet bf09f8234f36402bb9129d524637b5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.444777 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 977b95a3442a405d90385cdb4d6dd5dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.444962 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 31d493650d07437c9f1d657bb08a98d7 (table default.Table_ea08fcfa1efe4bc2a486fc1423ce06ce [id=58354360683d422dbdcc43826b39dbc8]) successfully deleted
I20260318 02:51:25.445096 1176 tablet_replica.cc:333] T 97655cb5968b4c819273068818d5cab8 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:25.445345 1176 raft_consensus.cc:2243] T 97655cb5968b4c819273068818d5cab8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.445549 1176 raft_consensus.cc:2272] T 97655cb5968b4c819273068818d5cab8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:25.445713 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 42a6983dce4e476cae97b3ecb1133077 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42a6983dce4e476cae97b3ecb1133077 already in progress: creating tablet
I20260318 02:51:25.446166 1176 ts_tablet_manager.cc:1916] T 97655cb5968b4c819273068818d5cab8 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:25.446349 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 65c50b0813b04f30896568ab2b680ba8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65c50b0813b04f30896568ab2b680ba8 already in progress: creating tablet
I20260318 02:51:25.447212 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 88eeb101a1734271973cd7d4c756b356 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.447492 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 5db76f996b094bf99b6c6fe33f02b9f3 with delete_type TABLET_DATA_DELETED (replaced by tablet 89a76fc237fc4bb8a891e3151efb3106) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:25.447516 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet a6f42462ed9c49c797f5115b3ca6c423 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6f42462ed9c49c797f5115b3ca6c423 already in progress: creating tablet
I20260318 02:51:25.447717 1174 tablet_bootstrap.cc:492] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
W20260318 02:51:25.448108 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2789a1195e7344c18dd226e196e2f302 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2789a1195e7344c18dd226e196e2f302 already in progress: creating tablet
I20260318 02:51:25.448346 1174 ts_tablet_manager.cc:1403] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.015s
W20260318 02:51:25.448649 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 5db76f996b094bf99b6c6fe33f02b9f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5db76f996b094bf99b6c6fe33f02b9f3 already in progress: creating tablet
W20260318 02:51:25.449250 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet c7c4257a54d3487aa520531a64fc721c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7c4257a54d3487aa520531a64fc721c already in progress: creating tablet
W20260318 02:51:25.449815 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet e55bbc320b0e4f9595bae9816e594b82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e55bbc320b0e4f9595bae9816e594b82 already in progress: creating tablet
I20260318 02:51:25.450249 1174 raft_consensus.cc:359] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:25.450394 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet cf27c8d69f41431e9fab12e605e15b9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf27c8d69f41431e9fab12e605e15b9c already in progress: creating tablet
I20260318 02:51:25.449891 1184 ts_tablet_manager.cc:1929] T b69dd1653a304f3d99346e89dacf9208 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.450891 1174 raft_consensus.cc:385] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260318 02:51:25.450903 441 catalog_manager.cc:4969] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 549b3929ea33417bbe50e749bbfe223d because the tablet was not found. No further retry: Not found: Tablet not found: 549b3929ea33417bbe50e749bbfe223d
I20260318 02:51:25.451196 1175 tablet_replica.cc:333] T 3b9ac6b9d4a245ec8d8aed1db976123b P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:25.451246 1174 raft_consensus.cc:740] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.451263 448 master_service.cc:954] ReplaceTablet: received request to replace tablet 549b3929ea33417bbe50e749bbfe223d from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:25.451797 1174 consensus_queue.cc:260] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.452093 1175 raft_consensus.cc:2243] T 3b9ac6b9d4a245ec8d8aed1db976123b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.452162 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_4705349319a44d5bacd1bef24fa49c2b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:25.452555 1175 raft_consensus.cc:2272] T 3b9ac6b9d4a245ec8d8aed1db976123b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:25.452771 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4705349319a44d5bacd1bef24fa49c2b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.454058 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c283efbac08468c8c20f4caba90164c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.454231 1175 ts_tablet_manager.cc:1916] T 3b9ac6b9d4a245ec8d8aed1db976123b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.455536 1184 log.cc:1199] T b69dd1653a304f3d99346e89dacf9208 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/b69dd1653a304f3d99346e89dacf9208
I20260318 02:51:25.456214 1184 ts_tablet_manager.cc:1950] T b69dd1653a304f3d99346e89dacf9208 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:25.457754 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet b69dd1653a304f3d99346e89dacf9208 (table default.Table_422656b6b8b4438e9d2000352503c6b9 [id=57dcabdb56b84275bb202ad3decd8b15]) successfully deleted
I20260318 02:51:25.458897 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f4736cb671be4feda1ede6bc973d14c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.459321 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 42a6983dce4e476cae97b3ecb1133077 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42a6983dce4e476cae97b3ecb1133077 already in progress: creating tablet
W20260318 02:51:25.459646 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4736cb671be4feda1ede6bc973d14c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:25.460297 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 65c50b0813b04f30896568ab2b680ba8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65c50b0813b04f30896568ab2b680ba8 already in progress: creating tablet
I20260318 02:51:25.460062 1176 ts_tablet_manager.cc:1929] T 97655cb5968b4c819273068818d5cab8 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.460532 1176 log.cc:1199] T 97655cb5968b4c819273068818d5cab8 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/97655cb5968b4c819273068818d5cab8
I20260318 02:51:25.460930 1176 ts_tablet_manager.cc:1950] T 97655cb5968b4c819273068818d5cab8 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:25.461023 1173 tablet_bootstrap.cc:492] T 959faf1fbb224434b896c0f21e9715be P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:25.461215 1173 ts_tablet_manager.cc:1403] T 959faf1fbb224434b896c0f21e9715be P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.086s user 0.013s sys 0.030s
W20260318 02:51:25.461453 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2789a1195e7344c18dd226e196e2f302 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2789a1195e7344c18dd226e196e2f302 already in progress: creating tablet
I20260318 02:51:25.462149 1173 raft_consensus.cc:359] T 959faf1fbb224434b896c0f21e9715be P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:25.462244 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet a6f42462ed9c49c797f5115b3ca6c423 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a6f42462ed9c49c797f5115b3ca6c423 already in progress: creating tablet
I20260318 02:51:25.462435 1173 raft_consensus.cc:385] T 959faf1fbb224434b896c0f21e9715be P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.462564 1173 raft_consensus.cc:740] T 959faf1fbb224434b896c0f21e9715be P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.462877 1173 consensus_queue.cc:260] T 959faf1fbb224434b896c0f21e9715be P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:25.463434 1173 ts_tablet_manager.cc:1434] T 959faf1fbb224434b896c0f21e9715be P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260318 02:51:25.463434 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 5db76f996b094bf99b6c6fe33f02b9f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5db76f996b094bf99b6c6fe33f02b9f3 already in progress: creating tablet
I20260318 02:51:25.463794 1173 tablet_bootstrap.cc:492] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:25.464303 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet c7c4257a54d3487aa520531a64fc721c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7c4257a54d3487aa520531a64fc721c already in progress: creating tablet
I20260318 02:51:25.464928 1184 tablet_replica.cc:333] T 3ff487cba236491eb22becf0dc591925 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:25.465569 1173 tablet_bootstrap.cc:654] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.466143 895 tablet_service.cc:1511] Processing CreateTablet for tablet c0c33cfa1c194a65bfc64d0e1e9434ff (DEFAULT_TABLE table=default.Table_c8ea19bed9e54eaf91af95c365e46851 [id=551f7031c6b84904836a915c07704492]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.466478 1035 tablet_service.cc:1511] Processing CreateTablet for tablet c0c33cfa1c194a65bfc64d0e1e9434ff (DEFAULT_TABLE table=default.Table_c8ea19bed9e54eaf91af95c365e46851 [id=551f7031c6b84904836a915c07704492]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.466781 1184 raft_consensus.cc:2243] T 3ff487cba236491eb22becf0dc591925 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.467450 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c33cfa1c194a65bfc64d0e1e9434ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.467504 1184 raft_consensus.cc:2272] T 3ff487cba236491eb22becf0dc591925 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.468171 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0c33cfa1c194a65bfc64d0e1e9434ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.469336 1184 ts_tablet_manager.cc:1916] T 3ff487cba236491eb22becf0dc591925 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.472105 1176 tablet_replica.cc:333] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:25.472218 892 tablet_service.cc:1511] Processing CreateTablet for tablet f72023f5408f4ef4b628568da0c008d6 (DEFAULT_TABLE table=default.Table_f4faa0e71fbe408f9bc811fe2a9c62e4 [id=50010510ab9a432a9861d13efaaa9e6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.472332 1176 raft_consensus.cc:2243] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.472507 1176 raft_consensus.cc:2272] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.472617 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72023f5408f4ef4b628568da0c008d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.460178 1174 ts_tablet_manager.cc:1434] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260318 02:51:25.473057 1174 tablet_bootstrap.cc:492] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:25.475000 1174 tablet_bootstrap.cc:654] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.473316 1176 ts_tablet_manager.cc:1916] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.478013 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 97655cb5968b4c819273068818d5cab8 (table default.Table_db9a2182adab412682721c74365227db [id=b6525a69ead04b8ca17dfa20eb38d663]) successfully deleted
I20260318 02:51:25.478634 766 tablet_service.cc:1511] Processing CreateTablet for tablet f72023f5408f4ef4b628568da0c008d6 (DEFAULT_TABLE table=default.Table_f4faa0e71fbe408f9bc811fe2a9c62e4 [id=50010510ab9a432a9861d13efaaa9e6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.479120 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72023f5408f4ef4b628568da0c008d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.485230 1175 ts_tablet_manager.cc:1929] T 3b9ac6b9d4a245ec8d8aed1db976123b P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.485495 1175 log.cc:1199] T 3b9ac6b9d4a245ec8d8aed1db976123b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/3b9ac6b9d4a245ec8d8aed1db976123b
I20260318 02:51:25.485956 1175 ts_tablet_manager.cc:1950] T 3b9ac6b9d4a245ec8d8aed1db976123b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:25.486788 1176 ts_tablet_manager.cc:1929] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.487035 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 3b9ac6b9d4a245ec8d8aed1db976123b (table default.Table_1e6ea5dc81d34a03b5135f4caeef56f5 [id=a2ddfb27f7ea4388b92f5b5703c88fdd]) successfully deleted
I20260318 02:51:25.487144 1175 tablet_replica.cc:333] T 7480b1fa026242d7bb6ddbf8df563116 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:25.487362 1175 raft_consensus.cc:2243] T 7480b1fa026242d7bb6ddbf8df563116 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.487371 1176 log.cc:1199] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/7cfaf92570b34b2bb1f52aea06187c83
I20260318 02:51:25.487521 1175 raft_consensus.cc:2272] T 7480b1fa026242d7bb6ddbf8df563116 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.487705 1176 ts_tablet_manager.cc:1950] T 7cfaf92570b34b2bb1f52aea06187c83 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:25.488965 1173 tablet_bootstrap.cc:492] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:25.489197 1176 tablet_replica.cc:333] T af802894346443669f1cc549a1ba401b P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:25.489184 1173 ts_tablet_manager.cc:1403] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.002s
I20260318 02:51:25.489375 1176 raft_consensus.cc:2243] T af802894346443669f1cc549a1ba401b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.489555 1176 raft_consensus.cc:2272] T af802894346443669f1cc549a1ba401b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.490284 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_230b6a19c7e444708603d97cc5d96155" } new_table_name: "default.Table_a9ca2b8e5b9042279576e9b9c6701069" modify_external_catalogs: true
I20260318 02:51:25.490442 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 959faf1fbb224434b896c0f21e9715be with delete_type TABLET_DATA_DELETED (replaced by tablet c7c4257a54d3487aa520531a64fc721c) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.490687 1173 raft_consensus.cc:359] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.490869 1173 raft_consensus.cc:385] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.490942 1173 raft_consensus.cc:740] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.491186 1173 consensus_queue.cc:260] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.491820 1173 ts_tablet_manager.cc:1434] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260318 02:51:25.491945 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_07df9bd10c594e0ea40840e6f7e5d1c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.492522 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07df9bd10c594e0ea40840e6f7e5d1c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.492882 1176 ts_tablet_manager.cc:1916] T af802894346443669f1cc549a1ba401b P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.494196 1175 ts_tablet_manager.cc:1916] T 7480b1fa026242d7bb6ddbf8df563116 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.496305 1173 tablet_bootstrap.cc:492] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:25.497201 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3e38dec0d2e9417e8571e202036e7117 consensus state has no leader
I20260318 02:51:25.497582 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7da4bcebfec04c4daede16eec31b5497" } modify_external_catalogs: true
I20260318 02:51:25.497763 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7da4bcebfec04c4daede16eec31b5497" } modify_external_catalogs: true
I20260318 02:51:25.500483 1173 tablet_bootstrap.cc:654] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.501703 1184 ts_tablet_manager.cc:1929] T 3ff487cba236491eb22becf0dc591925 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.501854 1184 log.cc:1199] T 3ff487cba236491eb22becf0dc591925 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/3ff487cba236491eb22becf0dc591925
I20260318 02:51:25.503968 972 heartbeater.cc:344] Connected to a master server at 127.0.104.188:41593
I20260318 02:51:25.508587 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 7cfaf92570b34b2bb1f52aea06187c83 (table default.Table_2d7043580f83421ca8d7039923dc441e [id=aca08645de7c4fec8ffc5dbda004973b]) successfully deleted
I20260318 02:51:25.519239 1184 ts_tablet_manager.cc:1950] T 3ff487cba236491eb22becf0dc591925 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:25.524529 1561 raft_consensus.cc:493] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:25.524770 1561 raft_consensus.cc:515] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.525489 1561 leader_election.cc:290] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:25.526263 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 3ff487cba236491eb22becf0dc591925 (table default.Table_b76c4b353fbe45c8a866d4cd2c4e264c [id=d20f8f1bd66d4dceab3b7bc72608da2a]) successfully deleted
I20260318 02:51:25.526631 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9372f8871b473caa024512e936a6e5" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:25.527240 719 leader_election.cc:343] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:25.527310 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet e55bbc320b0e4f9595bae9816e594b82 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e55bbc320b0e4f9595bae9816e594b82 already in progress: creating tablet
I20260318 02:51:25.527326 1035 tablet_service.cc:1511] Processing CreateTablet for tablet f72023f5408f4ef4b628568da0c008d6 (DEFAULT_TABLE table=default.Table_f4faa0e71fbe408f9bc811fe2a9c62e4 [id=50010510ab9a432a9861d13efaaa9e6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.528465 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72023f5408f4ef4b628568da0c008d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.528509 895 tablet_service.cc:1511] Processing CreateTablet for tablet 2a3a36a7fd4742c9827b334ce31d4a7c (DEFAULT_TABLE table=default.Table_607fac50cf4a4239bff8616d7176493d [id=f84167772dc74b15a01306e41817f3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.528960 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3a36a7fd4742c9827b334ce31d4a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.529233 1175 ts_tablet_manager.cc:1929] T 7480b1fa026242d7bb6ddbf8df563116 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.529381 1175 log.cc:1199] T 7480b1fa026242d7bb6ddbf8df563116 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/7480b1fa026242d7bb6ddbf8df563116
I20260318 02:51:25.529758 1175 ts_tablet_manager.cc:1950] T 7480b1fa026242d7bb6ddbf8df563116 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
W20260318 02:51:25.530803 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet cf27c8d69f41431e9fab12e605e15b9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf27c8d69f41431e9fab12e605e15b9c already in progress: creating tablet
I20260318 02:51:25.532243 1176 ts_tablet_manager.cc:1929] T af802894346443669f1cc549a1ba401b P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.532418 1176 log.cc:1199] T af802894346443669f1cc549a1ba401b P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/af802894346443669f1cc549a1ba401b
I20260318 02:51:25.532812 1176 ts_tablet_manager.cc:1950] T af802894346443669f1cc549a1ba401b P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:25.533578 1174 tablet_bootstrap.cc:492] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:25.533722 1174 ts_tablet_manager.cc:1403] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.061s user 0.004s sys 0.001s
I20260318 02:51:25.533784 1176 tablet_replica.cc:333] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:25.533990 1176 raft_consensus.cc:2243] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.534147 1176 raft_consensus.cc:2272] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.534638 1172 tablet_bootstrap.cc:492] T 45fddf78fc834d20908696b980d394a2 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:25.534581 1174 raft_consensus.cc:359] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.534754 1174 raft_consensus.cc:385] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.534814 1172 ts_tablet_manager.cc:1403] T 45fddf78fc834d20908696b980d394a2 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.154s user 0.013s sys 0.020s
I20260318 02:51:25.534834 1174 raft_consensus.cc:740] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.535087 1175 tablet_replica.cc:333] T 88eeb101a1734271973cd7d4c756b356 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:25.535053 1174 consensus_queue.cc:260] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.535275 1175 raft_consensus.cc:2243] T 88eeb101a1734271973cd7d4c756b356 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.535449 1175 raft_consensus.cc:2272] T 88eeb101a1734271973cd7d4c756b356 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.535621 1174 ts_tablet_manager.cc:1434] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:25.535936 1174 tablet_bootstrap.cc:492] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:25.536226 1176 ts_tablet_manager.cc:1916] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.536250 1175 ts_tablet_manager.cc:1916] T 88eeb101a1734271973cd7d4c756b356 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.537599 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet af802894346443669f1cc549a1ba401b (table default.Table_7442f04ad30e435b84996fb8990e0a44 [id=40612e2dc3b7447f8f4f753bf5474c22]) successfully deleted
I20260318 02:51:25.535553 1172 raft_consensus.cc:359] T 45fddf78fc834d20908696b980d394a2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.537982 1172 raft_consensus.cc:385] T 45fddf78fc834d20908696b980d394a2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.538045 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 7480b1fa026242d7bb6ddbf8df563116 (table default.Table_3e4d4a8323da4e20a12b2b6a9f7fd54c [id=71930ef490a446019e86d9159e1f67d3]) successfully deleted
I20260318 02:51:25.538059 1172 raft_consensus.cc:740] T 45fddf78fc834d20908696b980d394a2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.538487 1172 consensus_queue.cc:260] T 45fddf78fc834d20908696b980d394a2 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.538650 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9372f8871b473caa024512e936a6e5" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:25.539013 1172 ts_tablet_manager.cc:1434] T 45fddf78fc834d20908696b980d394a2 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260318 02:51:25.540987 1172 tablet_bootstrap.cc:492] T 8319efcfa31b45afb4dbd90cb5f13e97 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:25.525516 759 tablet_service.cc:1511] Processing CreateTablet for tablet 2a3a36a7fd4742c9827b334ce31d4a7c (DEFAULT_TABLE table=default.Table_607fac50cf4a4239bff8616d7176493d [id=f84167772dc74b15a01306e41817f3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.544580 1423 raft_consensus.cc:493] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:25.544764 1423 raft_consensus.cc:515] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.545430 1423 leader_election.cc:290] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:25.544055 719 leader_election.cc:343] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.546942 719 leader_election.cc:304] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:25.547556 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3a36a7fd4742c9827b334ce31d4a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.548369 831 heartbeater.cc:344] Connected to a master server at 127.0.104.188:41593
I20260318 02:51:25.549994 1561 raft_consensus.cc:2749] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:25.550946 862 leader_election.cc:343] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 323e4b1e9aee449f9402b1712b1444d9
I20260318 02:51:25.552047 1174 tablet_bootstrap.cc:654] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:25.553556 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7cdd554113bf4a7092da876365a89456 consensus state has no leader
I20260318 02:51:25.555261 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_764057148a0945d0a7a4f9e497808d92" } modify_external_catalogs: true
I20260318 02:51:25.555464 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_764057148a0945d0a7a4f9e497808d92" } modify_external_catalogs: true
I20260318 02:51:25.557456 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 45fddf78fc834d20908696b980d394a2 with delete_type TABLET_DATA_DELETED (replaced by tablet d2fb9c8f339444bc8d7c6479e7d87f44) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.557745 1184 tablet_replica.cc:333] T 45fddf78fc834d20908696b980d394a2 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:25.557927 1184 raft_consensus.cc:2243] T 45fddf78fc834d20908696b980d394a2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.558125 1184 raft_consensus.cc:2272] T 45fddf78fc834d20908696b980d394a2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.558264 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_73bd00aac389472ba24f2baa8f23b550" } new_table_name: "default.Table_88caf570ec6a4dfea94952fb5718c9c6" modify_external_catalogs: true
I20260318 02:51:25.559166 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323e4b1e9aee449f9402b1712b1444d9" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:25.559861 860 leader_election.cc:343] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.560042 860 leader_election.cc:304] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:25.562371 1174 tablet_bootstrap.cc:492] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:25.562633 1174 ts_tablet_manager.cc:1403] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.002s
I20260318 02:51:25.563529 1174 raft_consensus.cc:359] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.563772 895 tablet_service.cc:1558] Processing DeleteTablet for tablet e61c374078854d589219dfa4c20e4222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.563812 1174 raft_consensus.cc:385] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.563983 1174 raft_consensus.cc:740] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.564265 1174 consensus_queue.cc:260] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.564771 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f41e180b423949a7a0f65976f1b993ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:25.564940 1176 ts_tablet_manager.cc:1929] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.565084 1176 log.cc:1199] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/bf09f8234f36402bb9129d524637b5b5
I20260318 02:51:25.565121 1174 ts_tablet_manager.cc:1434] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:25.565445 1423 raft_consensus.cc:2749] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:25.565557 1176 ts_tablet_manager.cc:1950] T bf09f8234f36402bb9129d524637b5b5 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:25.565614 1174 tablet_bootstrap.cc:492] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:25.566226 1176 tablet_replica.cc:333] T 977b95a3442a405d90385cdb4d6dd5dd P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:25.566982 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet bf09f8234f36402bb9129d524637b5b5 (table default.Table_3fbf83db2cc447889b1a1d67741ca227 [id=cf74ccfff792402d87f23ac8a4988e5a]) successfully deleted
I20260318 02:51:25.567444 1174 tablet_bootstrap.cc:654] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.571381 1176 raft_consensus.cc:2243] T 977b95a3442a405d90385cdb4d6dd5dd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.574671 892 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff188f25ff146fab121ebfab1af8467 (DEFAULT_TABLE table=default.Table_33930f6668f341159c318db9160c142a [id=a5613244ee434bc88b23181c7bf23e0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.575209 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff188f25ff146fab121ebfab1af8467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.577381 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 2a3a36a7fd4742c9827b334ce31d4a7c (DEFAULT_TABLE table=default.Table_607fac50cf4a4239bff8616d7176493d [id=f84167772dc74b15a01306e41817f3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.577559 895 tablet_service.cc:1511] Processing CreateTablet for tablet 9aeb492564a94a569f70506712dad4ed (DEFAULT_TABLE table=default.Table_f664e51423be4580b3ebf91d14e66886 [id=f0a505a78b8e4ea695e1c3da2f9a0e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.577857 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3a36a7fd4742c9827b334ce31d4a7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.579862 1037 tablet_service.cc:1511] Processing CreateTablet for tablet cf73a9f8f67b42d9baf1396d70a1a3a9 (DEFAULT_TABLE table=default.Table_1f0867f6b8cd42bc9fb963f5349feed4 [id=75621b04db1d4c67bd2d2f5fe76c8a25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.580260 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf73a9f8f67b42d9baf1396d70a1a3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.580230 1036 tablet_service.cc:1511] Processing CreateTablet for tablet de2bc2f79e8b49248de3e7eca1a600cf (DEFAULT_TABLE table=default.Table_28ea1894a58c438785ae9e4b8b414447 [id=b71fc31bca0a449296c3e0a0b8ceb6e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.580612 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2bc2f79e8b49248de3e7eca1a600cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.580928 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 9aeb492564a94a569f70506712dad4ed (DEFAULT_TABLE table=default.Table_f664e51423be4580b3ebf91d14e66886 [id=f0a505a78b8e4ea695e1c3da2f9a0e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.581279 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aeb492564a94a569f70506712dad4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.581398 1033 tablet_service.cc:1511] Processing CreateTablet for tablet b8973d8930ef4b65be7b4ff990bf9d72 (DEFAULT_TABLE table=default.Table_2fb448f2651542d980b9c8f124ca5530 [id=997461446ec8473382964afdb61aafb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.581763 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8973d8930ef4b65be7b4ff990bf9d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.582437 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff188f25ff146fab121ebfab1af8467 (DEFAULT_TABLE table=default.Table_33930f6668f341159c318db9160c142a [id=a5613244ee434bc88b23181c7bf23e0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.582829 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff188f25ff146fab121ebfab1af8467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.580896 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 68b0f0cd89234e72a052f3f9f964aa35 (DEFAULT_TABLE table=default.Table_b572b82f174a48ad969343a2df8b9bfe [id=9a52b01ffd5b4f7e8a7a20a817aa842f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.585811 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b0f0cd89234e72a052f3f9f964aa35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.586207 897 tablet_service.cc:1511] Processing CreateTablet for tablet b8973d8930ef4b65be7b4ff990bf9d72 (DEFAULT_TABLE table=default.Table_2fb448f2651542d980b9c8f124ca5530 [id=997461446ec8473382964afdb61aafb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.586421 759 tablet_service.cc:1511] Processing CreateTablet for tablet 9aeb492564a94a569f70506712dad4ed (DEFAULT_TABLE table=default.Table_f664e51423be4580b3ebf91d14e66886 [id=f0a505a78b8e4ea695e1c3da2f9a0e80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.586901 898 tablet_service.cc:1511] Processing CreateTablet for tablet 608df0ce4e1d4ed6b7655802a6f7f6bc (DEFAULT_TABLE table=default.Table_8cbba3ff6714425fa1c800098813892d [id=ae4df4d179134efc82a2504d8ec91814]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.587062 752 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff188f25ff146fab121ebfab1af8467 (DEFAULT_TABLE table=default.Table_33930f6668f341159c318db9160c142a [id=a5613244ee434bc88b23181c7bf23e0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.587853 1184 ts_tablet_manager.cc:1916] T 45fddf78fc834d20908696b980d394a2 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.588922 760 tablet_service.cc:1511] Processing CreateTablet for tablet b8973d8930ef4b65be7b4ff990bf9d72 (DEFAULT_TABLE table=default.Table_2fb448f2651542d980b9c8f124ca5530 [id=997461446ec8473382964afdb61aafb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.589591 756 tablet_service.cc:1511] Processing CreateTablet for tablet de2bc2f79e8b49248de3e7eca1a600cf (DEFAULT_TABLE table=default.Table_28ea1894a58c438785ae9e4b8b414447 [id=b71fc31bca0a449296c3e0a0b8ceb6e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.590910 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aeb492564a94a569f70506712dad4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.592446 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2bc2f79e8b49248de3e7eca1a600cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.592475 1176 raft_consensus.cc:2272] T 977b95a3442a405d90385cdb4d6dd5dd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.593890 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8973d8930ef4b65be7b4ff990bf9d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.597410 763 tablet_service.cc:1511] Processing CreateTablet for tablet 608df0ce4e1d4ed6b7655802a6f7f6bc (DEFAULT_TABLE table=default.Table_8cbba3ff6714425fa1c800098813892d [id=ae4df4d179134efc82a2504d8ec91814]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.598043 758 tablet_service.cc:1511] Processing CreateTablet for tablet cf73a9f8f67b42d9baf1396d70a1a3a9 (DEFAULT_TABLE table=default.Table_1f0867f6b8cd42bc9fb963f5349feed4 [id=75621b04db1d4c67bd2d2f5fe76c8a25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.598438 762 tablet_service.cc:1511] Processing CreateTablet for tablet 68b0f0cd89234e72a052f3f9f964aa35 (DEFAULT_TABLE table=default.Table_b572b82f174a48ad969343a2df8b9bfe [id=9a52b01ffd5b4f7e8a7a20a817aa842f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.600898 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff188f25ff146fab121ebfab1af8467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.601132 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf73a9f8f67b42d9baf1396d70a1a3a9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:25.602766 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f41e180b423949a7a0f65976f1b993ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.608584 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_46d782df1eb242b081563aeb0ae51278" } modify_external_catalogs: true
I20260318 02:51:25.608851 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_46d782df1eb242b081563aeb0ae51278" } modify_external_catalogs: true
I20260318 02:51:25.609163 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b0f0cd89234e72a052f3f9f964aa35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.610726 448 master_service.cc:954] ReplaceTablet: received request to replace tablet 20c6f1790ed34581b7507ec63ec66718 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:25.612417 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8fdbd48eef374965b592274f14ea8ee1" } modify_external_catalogs: true
I20260318 02:51:25.612687 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8fdbd48eef374965b592274f14ea8ee1" } modify_external_catalogs: true
I20260318 02:51:25.615943 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608df0ce4e1d4ed6b7655802a6f7f6bc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:25.635417 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f37ab96f13444fcbb5cfc3ad92d53c35 has no consensus state
I20260318 02:51:25.635900 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1e9e471c1715493487baf6ce6eab167a" } modify_external_catalogs: true
I20260318 02:51:25.636116 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1e9e471c1715493487baf6ce6eab167a" } modify_external_catalogs: true
I20260318 02:51:25.638183 1172 tablet_bootstrap.cc:654] T 8319efcfa31b45afb4dbd90cb5f13e97 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.638935 454 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 48f0639d4d304c6589ac1505a2c1b03a
I20260318 02:51:25.639312 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3e1530524c914f3c9889d9523d232dc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.639882 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e1530524c914f3c9889d9523d232dc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.645330 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aeb492564a94a569f70506712dad4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.647850 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8973d8930ef4b65be7b4ff990bf9d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.648870 907 tablet_service.cc:1511] Processing CreateTablet for tablet 68b0f0cd89234e72a052f3f9f964aa35 (DEFAULT_TABLE table=default.Table_b572b82f174a48ad969343a2df8b9bfe [id=9a52b01ffd5b4f7e8a7a20a817aa842f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.649267 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68b0f0cd89234e72a052f3f9f964aa35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.649559 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608df0ce4e1d4ed6b7655802a6f7f6bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.649600 901 tablet_service.cc:1511] Processing CreateTablet for tablet cf73a9f8f67b42d9baf1396d70a1a3a9 (DEFAULT_TABLE table=default.Table_1f0867f6b8cd42bc9fb963f5349feed4 [id=75621b04db1d4c67bd2d2f5fe76c8a25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.649931 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf73a9f8f67b42d9baf1396d70a1a3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.651170 888 tablet_service.cc:1511] Processing CreateTablet for tablet de2bc2f79e8b49248de3e7eca1a600cf (DEFAULT_TABLE table=default.Table_28ea1894a58c438785ae9e4b8b414447 [id=b71fc31bca0a449296c3e0a0b8ceb6e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.651494 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de2bc2f79e8b49248de3e7eca1a600cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.651834 1184 ts_tablet_manager.cc:1929] T 45fddf78fc834d20908696b980d394a2 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.651947 1184 log.cc:1199] T 45fddf78fc834d20908696b980d394a2 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/45fddf78fc834d20908696b980d394a2
I20260318 02:51:25.652288 1184 ts_tablet_manager.cc:1950] T 45fddf78fc834d20908696b980d394a2 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:25.654743 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 608df0ce4e1d4ed6b7655802a6f7f6bc (DEFAULT_TABLE table=default.Table_8cbba3ff6714425fa1c800098813892d [id=ae4df4d179134efc82a2504d8ec91814]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.655191 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608df0ce4e1d4ed6b7655802a6f7f6bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.657327 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 45fddf78fc834d20908696b980d394a2 (table default.Table_b4c6c515fa1b469bad29515911177508 [id=895bbd90cf47462ab116ee3f37e94982]) successfully deleted
I20260318 02:51:25.666052 1176 ts_tablet_manager.cc:1916] T 977b95a3442a405d90385cdb4d6dd5dd P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.667943 1172 tablet_bootstrap.cc:492] T 8319efcfa31b45afb4dbd90cb5f13e97 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:25.668203 1172 ts_tablet_manager.cc:1403] T 8319efcfa31b45afb4dbd90cb5f13e97 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.127s user 0.002s sys 0.003s
I20260318 02:51:25.668793 1174 tablet_bootstrap.cc:492] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:25.669103 1172 raft_consensus.cc:359] T 8319efcfa31b45afb4dbd90cb5f13e97 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.669454 1174 ts_tablet_manager.cc:1403] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.104s user 0.015s sys 0.003s
I20260318 02:51:25.669996 1172 raft_consensus.cc:385] T 8319efcfa31b45afb4dbd90cb5f13e97 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.670212 1172 raft_consensus.cc:740] T 8319efcfa31b45afb4dbd90cb5f13e97 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.670542 1172 consensus_queue.cc:260] T 8319efcfa31b45afb4dbd90cb5f13e97 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.672904 1172 ts_tablet_manager.cc:1434] T 8319efcfa31b45afb4dbd90cb5f13e97 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:25.673249 1172 tablet_bootstrap.cc:492] T 31d493650d07437c9f1d657bb08a98d7 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:25.675060 1109 heartbeater.cc:344] Connected to a master server at 127.0.104.188:41593
I20260318 02:51:25.675412 1172 tablet_bootstrap.cc:654] T 31d493650d07437c9f1d657bb08a98d7 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.682742 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 5aebb91ff6b0416fac2ef2d056ca897a
I20260318 02:51:25.683049 1174 raft_consensus.cc:359] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.683323 1174 raft_consensus.cc:385] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.684810 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aebb91ff6b0416fac2ef2d056ca897a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.684893 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aebb91ff6b0416fac2ef2d056ca897a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:25.685029 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 061ebb62f4c54a2a8c24b90ec15402d3 consensus state has no leader
W20260318 02:51:25.686450 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 5aebb91ff6b0416fac2ef2d056ca897a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5aebb91ff6b0416fac2ef2d056ca897a already in progress: creating tablet
I20260318 02:51:25.691478 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 1b439fa2481a43c78d2c486d8711175f
I20260318 02:51:25.692365 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b439fa2481a43c78d2c486d8711175f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.692545 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b439fa2481a43c78d2c486d8711175f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:25.693181 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 1b439fa2481a43c78d2c486d8711175f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b439fa2481a43c78d2c486d8711175f already in progress: creating tablet
I20260318 02:51:25.694118 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 20c6f1790ed34581b7507ec63ec66718
I20260318 02:51:25.694545 448 catalog_manager.cc:6741] ReplaceTablet: tablet 20c6f1790ed34581b7507ec63ec66718 deleted and replaced by tablet ce82c595e30a4878be25be8eb3d30790
I20260318 02:51:25.695238 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2adcc9f1ad69458c997475111bb787cf
I20260318 02:51:25.696553 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 20c6f1790ed34581b7507ec63ec66718 with delete_type TABLET_DATA_DELETED (replaced by tablet ce82c595e30a4878be25be8eb3d30790) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.697863 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 2adcc9f1ad69458c997475111bb787cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.698002 456 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 89a76fc237fc4bb8a891e3151efb3106
I20260318 02:51:25.698068 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 2adcc9f1ad69458c997475111bb787cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.698504 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 20c6f1790ed34581b7507ec63ec66718 with delete_type TABLET_DATA_DELETED (replaced by tablet ce82c595e30a4878be25be8eb3d30790) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.698491 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c0575dfd049e44b09fca9eb2f7ea0308"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.699144 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0575dfd049e44b09fca9eb2f7ea0308 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.699505 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aebb91ff6b0416fac2ef2d056ca897a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.700737 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b3839730b36c41868e3760527839bafb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.701267 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3839730b36c41868e3760527839bafb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.702104 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6eeca0066a9946e1b4dcfac117aad4b6" } new_table_name: "default.Table_d9fd8f01d59b47d9bc3053e485415619" modify_external_catalogs: true
I20260318 02:51:25.702715 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b439fa2481a43c78d2c486d8711175f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.704155 1174 raft_consensus.cc:740] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.706496 1173 tablet_bootstrap.cc:492] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:25.708642 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 2adcc9f1ad69458c997475111bb787cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.708930 1174 consensus_queue.cc:260] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.710944 762 tablet_service.cc:1558] Processing DeleteTablet for tablet ec32c25ae14b406cb6ab4d913b575091 with delete_type TABLET_DATA_DELETED (replaced by tablet a0a6f4b34ff14714892ed9e9b3604dc9) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.714236 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e9372f8871b473caa024512e936a6e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 20c6f1790ed34581b7507ec63ec66718) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.714783 752 tablet_service.cc:1558] Processing DeleteTablet for tablet d4a54d0daa9f48a89b3f114367750826 with delete_type TABLET_DATA_DELETED (replaced by tablet 061ebb62f4c54a2a8c24b90ec15402d3) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.716243 1174 ts_tablet_manager.cc:1434] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.044s user 0.001s sys 0.001s
I20260318 02:51:25.716570 1174 tablet_bootstrap.cc:492] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:25.717304 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 20c6f1790ed34581b7507ec63ec66718 with delete_type TABLET_DATA_DELETED (replaced by tablet ce82c595e30a4878be25be8eb3d30790) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.720012 1172 tablet_bootstrap.cc:492] T 31d493650d07437c9f1d657bb08a98d7 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:25.720292 1172 ts_tablet_manager.cc:1403] T 31d493650d07437c9f1d657bb08a98d7 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.047s user 0.015s sys 0.004s
I20260318 02:51:25.721195 1172 raft_consensus.cc:359] T 31d493650d07437c9f1d657bb08a98d7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.721488 1172 raft_consensus.cc:385] T 31d493650d07437c9f1d657bb08a98d7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.721603 1172 raft_consensus.cc:740] T 31d493650d07437c9f1d657bb08a98d7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.721949 1174 tablet_bootstrap.cc:654] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.721895 1172 consensus_queue.cc:260] T 31d493650d07437c9f1d657bb08a98d7 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.722533 1172 ts_tablet_manager.cc:1434] T 31d493650d07437c9f1d657bb08a98d7 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:25.722908 1172 tablet_bootstrap.cc:492] T 3b9ac6b9d4a245ec8d8aed1db976123b P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:25.725430 1172 tablet_bootstrap.cc:654] T 3b9ac6b9d4a245ec8d8aed1db976123b P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.730894 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 677f33f9e4ad4859ab85692f7b7aad2a with delete_type TABLET_DATA_DELETED (replaced by tablet c5765355efaa4ef4ab3b68ea33f51536) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.734287 1172 tablet_bootstrap.cc:492] T 3b9ac6b9d4a245ec8d8aed1db976123b P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:25.734551 1172 ts_tablet_manager.cc:1403] T 3b9ac6b9d4a245ec8d8aed1db976123b P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.003s
I20260318 02:51:25.736191 1173 ts_tablet_manager.cc:1403] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.210s user 0.012s sys 0.005s
I20260318 02:51:25.737928 1173 raft_consensus.cc:359] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.738121 1173 raft_consensus.cc:385] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.738202 1173 raft_consensus.cc:740] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.738422 1173 consensus_queue.cc:260] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.738873 1173 ts_tablet_manager.cc:1434] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:25.739203 1173 tablet_bootstrap.cc:492] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:25.740854 1172 raft_consensus.cc:359] T 3b9ac6b9d4a245ec8d8aed1db976123b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.741039 1172 raft_consensus.cc:385] T 3b9ac6b9d4a245ec8d8aed1db976123b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.741132 1172 raft_consensus.cc:740] T 3b9ac6b9d4a245ec8d8aed1db976123b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.741362 1172 consensus_queue.cc:260] T 3b9ac6b9d4a245ec8d8aed1db976123b P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.745493 1176 ts_tablet_manager.cc:1929] T 977b95a3442a405d90385cdb4d6dd5dd P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.745680 1172 ts_tablet_manager.cc:1434] T 3b9ac6b9d4a245ec8d8aed1db976123b P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260318 02:51:25.745744 1176 log.cc:1199] T 977b95a3442a405d90385cdb4d6dd5dd P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/977b95a3442a405d90385cdb4d6dd5dd
I20260318 02:51:25.746238 1176 ts_tablet_manager.cc:1950] T 977b95a3442a405d90385cdb4d6dd5dd P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:25.750506 1176 tablet_replica.cc:333] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:25.750712 1172 tablet_bootstrap.cc:492] T 977b95a3442a405d90385cdb4d6dd5dd P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:25.752851 1176 raft_consensus.cc:2243] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.753185 1176 raft_consensus.cc:2272] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.753304 1172 tablet_bootstrap.cc:654] T 977b95a3442a405d90385cdb4d6dd5dd P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.753899 1176 ts_tablet_manager.cc:1916] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.756140 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 977b95a3442a405d90385cdb4d6dd5dd (table default.Table_429d1a716ae64decac39f45685e90b00 [id=89a90617176b4035a465731d37aa795e]) successfully deleted
I20260318 02:51:25.761853 1561 raft_consensus.cc:493] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:25.762053 1561 raft_consensus.cc:515] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.762800 1561 leader_election.cc:290] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:25.763787 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d953e1ae2f47fc8016a2f9a791141d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:25.764662 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d953e1ae2f47fc8016a2f9a791141d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:25.765851 719 leader_election.cc:343] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:25.766134 719 leader_election.cc:343] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.766228 719 leader_election.cc:304] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:25.769057 1561 raft_consensus.cc:2749] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:25.775547 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 8319efcfa31b45afb4dbd90cb5f13e97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.775878 1184 tablet_replica.cc:333] T 8319efcfa31b45afb4dbd90cb5f13e97 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:25.776099 1184 raft_consensus.cc:2243] T 8319efcfa31b45afb4dbd90cb5f13e97 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.776263 1184 raft_consensus.cc:2272] T 8319efcfa31b45afb4dbd90cb5f13e97 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.776540 456 master_service.cc:954] ReplaceTablet: received request to replace tablet a0a6f4b34ff14714892ed9e9b3604dc9 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:25.776852 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b112fd9168ad494183800cd6263a6347" } new_table_name: "default.Table_e98fb9b903bf4e13ac51cea6130b1042" modify_external_catalogs: true
W20260318 02:51:25.776971 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2adcc9f1ad69458c997475111bb787cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2adcc9f1ad69458c997475111bb787cf already in progress: creating tablet
I20260318 02:51:25.777165 1184 ts_tablet_manager.cc:1916] T 8319efcfa31b45afb4dbd90cb5f13e97 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.777087 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_be8f0eb1bb5b4ec8964d987ede6b0947"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.777240 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 20c6f1790ed34581b7507ec63ec66718 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20c6f1790ed34581b7507ec63ec66718 already in progress: creating tablet
W20260318 02:51:25.777697 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be8f0eb1bb5b4ec8964d987ede6b0947 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.777848 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 31d493650d07437c9f1d657bb08a98d7 with delete_type TABLET_DATA_DELETED (replaced by tablet 105326aea9f744779ca76e0cbb2448cd) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.778249 452 master_service.cc:954] ReplaceTablet: received request to replace tablet a8b44b68094344f7a694ae4d985f56a6 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:25.778586 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f6bd74ee469e431eb8367558134a24b5" } new_table_name: "default.Table_6b2724daa36d47579acf844f9f284444" modify_external_catalogs: true
I20260318 02:51:25.784102 1184 ts_tablet_manager.cc:1929] T 8319efcfa31b45afb4dbd90cb5f13e97 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.793177 1555 raft_consensus.cc:493] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:25.793421 1175 ts_tablet_manager.cc:1929] T 88eeb101a1734271973cd7d4c756b356 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.793561 1175 log.cc:1199] T 88eeb101a1734271973cd7d4c756b356 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/88eeb101a1734271973cd7d4c756b356
I20260318 02:51:25.796002 1175 ts_tablet_manager.cc:1950] T 88eeb101a1734271973cd7d4c756b356 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:25.797326 1175 tablet_replica.cc:333] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:25.797906 1175 raft_consensus.cc:2243] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.798125 1175 raft_consensus.cc:2272] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.801301 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 88eeb101a1734271973cd7d4c756b356 (table default.Table_6725b184c1db4933ba6f28668b0031fa [id=847bc952406640b1b5a4c3e55a0ee1b2]) successfully deleted
I20260318 02:51:25.802625 1555 raft_consensus.cc:515] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.803380 1555 leader_election.cc:290] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:25.805222 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cc1543d0e1b1431baf6d2ab6a0484ca6 consensus state has no leader
I20260318 02:51:25.807178 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5ceb6bf88c4743ee88d4fe26441e46ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.807850 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ceb6bf88c4743ee88d4fe26441e46ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.803771 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61c374078854d589219dfa4c20e4222" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:25.807937 862 leader_election.cc:343] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: e61c374078854d589219dfa4c20e4222
I20260318 02:51:25.808166 1173 tablet_bootstrap.cc:654] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:25.808492 860 leader_election.cc:343] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.808745 1184 log.cc:1199] T 8319efcfa31b45afb4dbd90cb5f13e97 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/8319efcfa31b45afb4dbd90cb5f13e97
I20260318 02:51:25.808745 860 leader_election.cc:304] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:25.809151 1184 ts_tablet_manager.cc:1950] T 8319efcfa31b45afb4dbd90cb5f13e97 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:25.809507 450 master_service.cc:954] ReplaceTablet: received request to replace tablet 2adcc9f1ad69458c997475111bb787cf from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:25.809844 1555 raft_consensus.cc:2749] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:25.810046 1175 ts_tablet_manager.cc:1916] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.810127 1184 tablet_replica.cc:333] T 31d493650d07437c9f1d657bb08a98d7 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:25.810305 1184 raft_consensus.cc:2243] T 31d493650d07437c9f1d657bb08a98d7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.810506 1184 raft_consensus.cc:2272] T 31d493650d07437c9f1d657bb08a98d7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.811226 1184 ts_tablet_manager.cc:1916] T 31d493650d07437c9f1d657bb08a98d7 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.812932 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b9ac6b9d4a245ec8d8aed1db976123b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.814415 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d20052125a004fa088aea68c2ec6d98f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.814968 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d20052125a004fa088aea68c2ec6d98f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.816773 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 8319efcfa31b45afb4dbd90cb5f13e97 (table default.Table_2faebbd7206f45ebb8c858d1a5936cb3 [id=985db776346840d0afa3544d24902aa7]) successfully deleted
W20260318 02:51:25.819473 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49afed40c7aa4f2d913daed8055a098e has no consensus state
I20260318 02:51:25.819876 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ca1cb05e473b4ee39a8175c8aee653a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:25.820686 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_fceb58989e784893aefdc7fb9497f621"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.821352 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 813702e53eee4a54a7d693fd6e03bbbb consensus state has no leader
I20260318 02:51:25.824668 1174 tablet_bootstrap.cc:492] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
W20260318 02:51:25.824858 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca1cb05e473b4ee39a8175c8aee653a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.825098 1174 ts_tablet_manager.cc:1403] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.109s user 0.005s sys 0.004s
I20260318 02:51:25.825976 1174 raft_consensus.cc:359] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.827139 1174 raft_consensus.cc:385] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.827253 1174 raft_consensus.cc:740] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
W20260318 02:51:25.824870 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fceb58989e784893aefdc7fb9497f621 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.828019 1174 consensus_queue.cc:260] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.830718 1184 ts_tablet_manager.cc:1929] T 31d493650d07437c9f1d657bb08a98d7 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.831629 1514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee6aa91804a2401fa0ceb31b196ec40a. Latest consensus state: current_term: 2 leader_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:25.831866 1514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [sys.catalog]: This master's current role is: FOLLOWER
I20260318 02:51:25.832048 1563 raft_consensus.cc:493] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6aa91804a2401fa0ceb31b196ec40a)
I20260318 02:51:25.832295 1563 raft_consensus.cc:515] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:25.832576 1184 log.cc:1199] T 31d493650d07437c9f1d657bb08a98d7 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/31d493650d07437c9f1d657bb08a98d7
I20260318 02:51:25.832980 1184 ts_tablet_manager.cc:1950] T 31d493650d07437c9f1d657bb08a98d7 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:25.833668 453 master_service.cc:954] ReplaceTablet: received request to replace tablet 3c283efbac08468c8c20f4caba90164c from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:25.833977 1184 tablet_replica.cc:333] T 3b9ac6b9d4a245ec8d8aed1db976123b P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:25.834193 1184 raft_consensus.cc:2243] T 3b9ac6b9d4a245ec8d8aed1db976123b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.834355 1184 raft_consensus.cc:2272] T 3b9ac6b9d4a245ec8d8aed1db976123b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.836062 1563 leader_election.cc:290] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6aa91804a2401fa0ceb31b196ec40a (127.0.104.190:39451), 8b701993861d4c11b3394a2d6588b3b7 (127.0.104.189:45933)
I20260318 02:51:25.836222 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 31d493650d07437c9f1d657bb08a98d7 (table default.Table_ea08fcfa1efe4bc2a486fc1423ce06ce [id=58354360683d422dbdcc43826b39dbc8]) successfully deleted
I20260318 02:51:25.838958 1174 ts_tablet_manager.cc:1434] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260318 02:51:25.843587 1174 tablet_bootstrap.cc:492] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:25.843843 1561 raft_consensus.cc:493] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:25.845306 1561 raft_consensus.cc:515] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.846004 1561 leader_election.cc:290] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:25.846984 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c283efbac08468c8c20f4caba90164c" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:25.847671 719 leader_election.cc:343] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.847910 1561 raft_consensus.cc:493] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:25.848055 1561 raft_consensus.cc:515] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.849427 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c25ae14b406cb6ab4d913b575091" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:25.850000 719 leader_election.cc:343] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.850106 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6b2724daa36d47579acf844f9f284444" } new_table_name: "default.Table_1acdeb444a404cb0b89ac6450e835639" modify_external_catalogs: true
I20260318 02:51:25.850561 1184 ts_tablet_manager.cc:1916] T 3b9ac6b9d4a245ec8d8aed1db976123b P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.850731 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c283efbac08468c8c20f4caba90164c" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:25.851060 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec32c25ae14b406cb6ab4d913b575091" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:25.851778 719 leader_election.cc:343] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.851905 719 leader_election.cc:304] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:25.852603 719 leader_election.cc:343] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.852770 719 leader_election.cc:304] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:25.853183 1496 raft_consensus.cc:2749] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:25.853976 1496 raft_consensus.cc:2749] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:25.848670 1561 leader_election.cc:290] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:25.857028 1184 ts_tablet_manager.cc:1929] T 3b9ac6b9d4a245ec8d8aed1db976123b P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.857214 1184 log.cc:1199] T 3b9ac6b9d4a245ec8d8aed1db976123b P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/3b9ac6b9d4a245ec8d8aed1db976123b
I20260318 02:51:25.857584 1184 ts_tablet_manager.cc:1950] T 3b9ac6b9d4a245ec8d8aed1db976123b P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:25.858692 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 3b9ac6b9d4a245ec8d8aed1db976123b (table default.Table_1e6ea5dc81d34a03b5135f4caeef56f5 [id=a2ddfb27f7ea4388b92f5b5703c88fdd]) successfully deleted
I20260318 02:51:25.864648 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c0575dfd049e44b09fca9eb2f7ea0308" } modify_external_catalogs: true
I20260318 02:51:25.864941 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c0575dfd049e44b09fca9eb2f7ea0308" } modify_external_catalogs: true
W20260318 02:51:25.876281 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 813702e53eee4a54a7d693fd6e03bbbb consensus state has no leader
I20260318 02:51:25.880261 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 19f0750985d947a3a9323944540abbac (DEFAULT_TABLE table=default.Table_4705349319a44d5bacd1bef24fa49c2b [id=50a14c6ee4d94b9d8dbed47babdb14ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.880784 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19f0750985d947a3a9323944540abbac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.881678 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 62af8b953213412bb0c3bd1c68042ec9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.881801 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 00d953e1ae2f47fc8016a2f9a791141d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.885931 763 tablet_service.cc:1558] Processing DeleteTablet for tablet f447cab3445c451d8ef8746966cfcd42 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c5038e9e1074f46976a1a5bb4282944) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.887988 1174 tablet_bootstrap.cc:654] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.891148 1449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42002 (request call id 0) took 1722 ms. Trace:
I20260318 02:51:25.894044 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a8591dbe29954c789b3bb7ece252f89e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.894876 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8591dbe29954c789b3bb7ece252f89e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.895557 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e98fb9b903bf4e13ac51cea6130b1042" } new_table_name: "default.Table_11fb574b8c6a45fca4af288fcc47bfd8" modify_external_catalogs: true
I20260318 02:51:25.896477 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7f6deccea357456489e67b7be47c0c18" } modify_external_catalogs: true
I20260318 02:51:25.896679 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7f6deccea357456489e67b7be47c0c18" } modify_external_catalogs: true
I20260318 02:51:25.877236 1176 ts_tablet_manager.cc:1929] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.893890 1561 consensus_queue.cc:1048] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:25.901443 1176 log.cc:1199] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/88eeb101a1734271973cd7d4c756b356
I20260318 02:51:25.901875 1176 ts_tablet_manager.cc:1950] T 88eeb101a1734271973cd7d4c756b356 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:25.903353 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 88eeb101a1734271973cd7d4c756b356 (table default.Table_6725b184c1db4933ba6f28668b0031fa [id=847bc952406640b1b5a4c3e55a0ee1b2]) successfully deleted
I20260318 02:51:25.905194 1176 tablet_replica.cc:333] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:25.913277 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_86b70df7bd76402aaa4c0b1faa730a62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.914036 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86b70df7bd76402aaa4c0b1faa730a62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.914641 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1ca30903a9ca4d31b9ad481adc6e3016" } modify_external_catalogs: true
I20260318 02:51:25.914835 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1ca30903a9ca4d31b9ad481adc6e3016" } modify_external_catalogs: true
I20260318 02:51:25.917658 1173 tablet_bootstrap.cc:492] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:25.917847 1173 ts_tablet_manager.cc:1403] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.179s user 0.001s sys 0.008s
I20260318 02:51:25.918686 1173 raft_consensus.cc:359] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.918923 1173 raft_consensus.cc:385] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.919003 1173 raft_consensus.cc:740] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.921243 1176 raft_consensus.cc:2243] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.921473 1176 raft_consensus.cc:2272] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.922058 1176 ts_tablet_manager.cc:1916] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.922178 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_62dcfd8adef34929a08c11dfcf174ff7" } modify_external_catalogs: true
I20260318 02:51:25.922416 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_62dcfd8adef34929a08c11dfcf174ff7" } modify_external_catalogs: true
I20260318 02:51:25.924961 448 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet d70c42975f6445a9a9b71a20f83dd89c
I20260318 02:51:25.931885 1173 consensus_queue.cc:260] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.933195 1175 ts_tablet_manager.cc:1929] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:25.933362 1175 log.cc:1199] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/323e4b1e9aee449f9402b1712b1444d9
I20260318 02:51:25.933751 1175 ts_tablet_manager.cc:1950] T 323e4b1e9aee449f9402b1712b1444d9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:25.935195 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet a0a6f4b34ff14714892ed9e9b3604dc9
I20260318 02:51:25.935771 456 catalog_manager.cc:6741] ReplaceTablet: tablet a0a6f4b34ff14714892ed9e9b3604dc9 deleted and replaced by tablet fb5d1d828899472e8f48723b35e94d62
I20260318 02:51:25.936789 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet a8b44b68094344f7a694ae4d985f56a6
I20260318 02:51:25.937223 452 catalog_manager.cc:6741] ReplaceTablet: tablet a8b44b68094344f7a694ae4d985f56a6 deleted and replaced by tablet 18a512a8b2aa43679f3faf78d749ca52
I20260318 02:51:25.937450 763 tablet_service.cc:1558] Processing DeleteTablet for tablet a0a6f4b34ff14714892ed9e9b3604dc9 with delete_type TABLET_DATA_DELETED (replaced by tablet fb5d1d828899472e8f48723b35e94d62) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:25.937582 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49afed40c7aa4f2d913daed8055a098e consensus state has no leader
I20260318 02:51:25.937968 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet e916c5419e3c457f98a47c6a1c6cdd56
I20260318 02:51:25.939443 763 tablet_service.cc:1558] Processing DeleteTablet for tablet a8b44b68094344f7a694ae4d985f56a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 18a512a8b2aa43679f3faf78d749ca52) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.939455 760 tablet_service.cc:1558] Processing DeleteTablet for tablet e916c5419e3c457f98a47c6a1c6cdd56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:25.940197 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet a0a6f4b34ff14714892ed9e9b3604dc9 with delete_type TABLET_DATA_DELETED (replaced by tablet fb5d1d828899472e8f48723b35e94d62) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.940454 901 tablet_service.cc:1558] Processing DeleteTablet for tablet a0a6f4b34ff14714892ed9e9b3604dc9 with delete_type TABLET_DATA_DELETED (replaced by tablet fb5d1d828899472e8f48723b35e94d62) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.941684 1174 tablet_bootstrap.cc:492] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:25.941859 1174 ts_tablet_manager.cc:1403] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.098s user 0.003s sys 0.002s
I20260318 02:51:25.942971 1174 raft_consensus.cc:359] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.943176 1174 raft_consensus.cc:385] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.943250 1174 raft_consensus.cc:740] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.943487 1174 consensus_queue.cc:260] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.948566 1557 raft_consensus.cc:493] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:25.948802 1557 raft_consensus.cc:515] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.949610 1557 leader_election.cc:290] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:25.950419 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9372f8871b473caa024512e936a6e5" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:25.951292 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9372f8871b473caa024512e936a6e5" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:25.951565 784 raft_consensus.cc:2468] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:25.952097 862 leader_election.cc:304] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
W20260318 02:51:25.953437 860 leader_election.cc:343] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.955432 1173 ts_tablet_manager.cc:1434] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.037s user 0.000s sys 0.003s
I20260318 02:51:25.956213 1557 raft_consensus.cc:2804] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:25.956422 1557 raft_consensus.cc:493] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:25.956519 1557 raft_consensus.cc:3060] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:25.958953 1173 tablet_bootstrap.cc:492] T 977b95a3442a405d90385cdb4d6dd5dd P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:25.959692 1557 raft_consensus.cc:515] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.962636 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9372f8871b473caa024512e936a6e5" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
W20260318 02:51:25.963465 860 leader_election.cc:343] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:25.964542 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9372f8871b473caa024512e936a6e5" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:25.964843 784 raft_consensus.cc:3060] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:25.968192 784 raft_consensus.cc:2468] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:25.969246 862 leader_election.cc:304] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:25.969632 1423 raft_consensus.cc:2804] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:25.969738 1423 raft_consensus.cc:697] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:25.970034 1423 consensus_queue.cc:237] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.970587 1172 tablet_bootstrap.cc:492] T 977b95a3442a405d90385cdb4d6dd5dd P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:25.970767 1172 ts_tablet_manager.cc:1403] T 977b95a3442a405d90385cdb4d6dd5dd P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.220s user 0.042s sys 0.093s
I20260318 02:51:25.971315 1175 tablet_replica.cc:333] T 959faf1fbb224434b896c0f21e9715be P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:25.971576 1175 raft_consensus.cc:2243] T 959faf1fbb224434b896c0f21e9715be P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.971563 1172 raft_consensus.cc:359] T 977b95a3442a405d90385cdb4d6dd5dd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.971762 1172 raft_consensus.cc:385] T 977b95a3442a405d90385cdb4d6dd5dd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:25.971855 1172 raft_consensus.cc:740] T 977b95a3442a405d90385cdb4d6dd5dd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:25.971884 1175 raft_consensus.cc:2272] T 959faf1fbb224434b896c0f21e9715be P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.972090 1172 consensus_queue.cc:260] T 977b95a3442a405d90385cdb4d6dd5dd P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.972533 1175 ts_tablet_manager.cc:1916] T 959faf1fbb224434b896c0f21e9715be P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.974313 1557 leader_election.cc:290] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:25.974851 1173 tablet_bootstrap.cc:654] T 977b95a3442a405d90385cdb4d6dd5dd P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:25.975605 1172 ts_tablet_manager.cc:1434] T 977b95a3442a405d90385cdb4d6dd5dd P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260318 02:51:25.976639 1534 raft_consensus.cc:493] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:25.976819 1534 raft_consensus.cc:515] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:25.977480 1534 leader_election.cc:290] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:25.978225 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b82751cbcbb4c39a6942b6856412fc8" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:25.978515 925 raft_consensus.cc:2393] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9422bb7011f342b08be0b073a88c4c4d in current term 1: Already voted for candidate 6a903d876086423b8016d705b98895ad in this term.
I20260318 02:51:25.978591 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet a8b44b68094344f7a694ae4d985f56a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 18a512a8b2aa43679f3faf78d749ca52) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.979001 1172 tablet_bootstrap.cc:492] T 88eeb101a1734271973cd7d4c756b356 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:25.980222 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet e916c5419e3c457f98a47c6a1c6cdd56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.980326 901 tablet_service.cc:1558] Processing DeleteTablet for tablet a8b44b68094344f7a694ae4d985f56a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 18a512a8b2aa43679f3faf78d749ca52) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.981166 901 tablet_service.cc:1558] Processing DeleteTablet for tablet e916c5419e3c457f98a47c6a1c6cdd56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:25.981503 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 323e4b1e9aee449f9402b1712b1444d9 (table default.Table_4775eaa0e7e84642aa0a8f8b2885610e [id=463a6721eb0d43d09deeb283d1cc4233]) successfully deleted
I20260318 02:51:25.984416 451 master_service.cc:954] ReplaceTablet: received request to replace tablet 065ebc3c000a4ad3873ee031ecf9986b from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:25.985128 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_fc98457cd89d4e7386e8668c917c0db5" } modify_external_catalogs: true
I20260318 02:51:25.985304 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_fc98457cd89d4e7386e8668c917c0db5" } modify_external_catalogs: true
W20260318 02:51:25.991091 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet a0a6f4b34ff14714892ed9e9b3604dc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0a6f4b34ff14714892ed9e9b3604dc9 already in progress: creating tablet
W20260318 02:51:25.991341 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet a8b44b68094344f7a694ae4d985f56a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8b44b68094344f7a694ae4d985f56a6 already in progress: creating tablet
I20260318 02:51:25.991541 1172 tablet_bootstrap.cc:654] T 88eeb101a1734271973cd7d4c756b356 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:25.991740 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet e916c5419e3c457f98a47c6a1c6cdd56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e916c5419e3c457f98a47c6a1c6cdd56 already in progress: creating tablet
I20260318 02:51:25.991757 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ed19d9231be44ca5acea8b9a1cad67de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:25.992322 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed19d9231be44ca5acea8b9a1cad67de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:25.992417 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 977b95a3442a405d90385cdb4d6dd5dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:25.992677 1184 tablet_replica.cc:333] T 977b95a3442a405d90385cdb4d6dd5dd P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:25.992898 1184 raft_consensus.cc:2243] T 977b95a3442a405d90385cdb4d6dd5dd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:25.993104 1184 raft_consensus.cc:2272] T 977b95a3442a405d90385cdb4d6dd5dd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:25.993798 1184 ts_tablet_manager.cc:1916] T 977b95a3442a405d90385cdb4d6dd5dd P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:25.994043 901 tablet_service.cc:1511] Processing CreateTablet for tablet 19f0750985d947a3a9323944540abbac (DEFAULT_TABLE table=default.Table_4705349319a44d5bacd1bef24fa49c2b [id=50a14c6ee4d94b9d8dbed47babdb14ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.994460 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19f0750985d947a3a9323944540abbac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:25.996261 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 461adcc8bbd94d30b9b84d1010430829 (DEFAULT_TABLE table=default.Table_600a629a518c46678144af62a75ea690 [id=9de656e677a540ad90ccd30ab1d092e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:25.996672 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 461adcc8bbd94d30b9b84d1010430829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.000053 1561 raft_consensus.cc:493] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:26.001086 895 tablet_service.cc:1511] Processing CreateTablet for tablet 461adcc8bbd94d30b9b84d1010430829 (DEFAULT_TABLE table=default.Table_600a629a518c46678144af62a75ea690 [id=9de656e677a540ad90ccd30ab1d092e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.001299 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 6d938a2eefe4471cb94a9544647f8e3e (DEFAULT_TABLE table=default.Table_1fb3a44bfb2f4aac917af6b4684d7668 [id=d0c05683decb4a5bbf2e3eab386a1116]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.001511 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 461adcc8bbd94d30b9b84d1010430829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.001643 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d938a2eefe4471cb94a9544647f8e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.002450 1561 raft_consensus.cc:515] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.003111 1561 leader_election.cc:290] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:26.003345 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b82751cbcbb4c39a6942b6856412fc8" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:26.003973 999 leader_election.cc:304] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:26.004171 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e9372f8871b473caa024512e936a6e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 20c6f1790ed34581b7507ec63ec66718) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:26.004606 1534 raft_consensus.cc:3060] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:26.005311 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f447cab3445c451d8ef8746966cfcd42" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:26.005972 719 leader_election.cc:343] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:26.006337 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f447cab3445c451d8ef8746966cfcd42" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:26.006877 719 leader_election.cc:343] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:26.007041 719 leader_election.cc:304] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:26.007601 1534 raft_consensus.cc:2749] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:26.007906 1561 raft_consensus.cc:2749] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:26.008891 1184 ts_tablet_manager.cc:1929] T 977b95a3442a405d90385cdb4d6dd5dd P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.009039 1184 log.cc:1199] T 977b95a3442a405d90385cdb4d6dd5dd P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/977b95a3442a405d90385cdb4d6dd5dd
I20260318 02:51:26.009970 1184 ts_tablet_manager.cc:1950] T 977b95a3442a405d90385cdb4d6dd5dd P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:26.011018 1621 raft_consensus.cc:493] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:26.011241 1621 raft_consensus.cc:515] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.011831 758 tablet_service.cc:1511] Processing CreateTablet for tablet 46ce65cca47f48db94e70226494cfbae (DEFAULT_TABLE table=default.Table_a1b9dc84de4a42288ee7754f4a110daa [id=a858f67286ca4fe09d8e64e68b31337a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.011966 1621 leader_election.cc:290] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:26.012272 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ce65cca47f48db94e70226494cfbae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.014837 897 tablet_service.cc:1511] Processing CreateTablet for tablet 6d938a2eefe4471cb94a9544647f8e3e (DEFAULT_TABLE table=default.Table_1fb3a44bfb2f4aac917af6b4684d7668 [id=d0c05683decb4a5bbf2e3eab386a1116]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.015300 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d938a2eefe4471cb94a9544647f8e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.015625 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677f33f9e4ad4859ab85692f7b7aad2a" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:26.016016 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 46ce65cca47f48db94e70226494cfbae (DEFAULT_TABLE table=default.Table_a1b9dc84de4a42288ee7754f4a110daa [id=a858f67286ca4fe09d8e64e68b31337a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.017076 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ce65cca47f48db94e70226494cfbae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.021445 888 tablet_service.cc:1511] Processing CreateTablet for tablet 46ce65cca47f48db94e70226494cfbae (DEFAULT_TABLE table=default.Table_a1b9dc84de4a42288ee7754f4a110daa [id=a858f67286ca4fe09d8e64e68b31337a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.021868 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ce65cca47f48db94e70226494cfbae. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:26.022150 719 leader_election.cc:343] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:26.026014 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677f33f9e4ad4859ab85692f7b7aad2a" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:26.026647 719 leader_election.cc:343] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:26.026862 719 leader_election.cc:304] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:26.027359 1621 raft_consensus.cc:2749] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:26.031278 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f04f057571584d31b1821e690ae7c75c
I20260318 02:51:26.031716 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5d3901a8928a4e858feab8b7c1fc5545" } new_table_name: "default.Table_594a288e26f245c8a9c365f583bced74" modify_external_catalogs: true
I20260318 02:51:26.035351 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2697bc78fa724b77aca8e7b6b4c7b938"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:26.035526 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b6cc0e95556348868fc31e5d4ae173cb" } new_table_name: "default.Table_f7c512acb00946069cb735b743f8b2af" modify_external_catalogs: true
I20260318 02:51:26.036072 758 tablet_service.cc:1558] Processing DeleteTablet for tablet f04f057571584d31b1821e690ae7c75c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.036427 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 5db76f996b094bf99b6c6fe33f02b9f3 with delete_type TABLET_DATA_DELETED (replaced by tablet 89a76fc237fc4bb8a891e3151efb3106) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.036572 754 tablet_service.cc:1511] Processing CreateTablet for tablet 461adcc8bbd94d30b9b84d1010430829 (DEFAULT_TABLE table=default.Table_600a629a518c46678144af62a75ea690 [id=9de656e677a540ad90ccd30ab1d092e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.037092 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 461adcc8bbd94d30b9b84d1010430829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.038650 752 tablet_service.cc:1511] Processing CreateTablet for tablet 6d938a2eefe4471cb94a9544647f8e3e (DEFAULT_TABLE table=default.Table_1fb3a44bfb2f4aac917af6b4684d7668 [id=d0c05683decb4a5bbf2e3eab386a1116]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.039125 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d938a2eefe4471cb94a9544647f8e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.042178 760 tablet_service.cc:1511] Processing CreateTablet for tablet 19f0750985d947a3a9323944540abbac (DEFAULT_TABLE table=default.Table_4705349319a44d5bacd1bef24fa49c2b [id=50a14c6ee4d94b9d8dbed47babdb14ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.042724 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19f0750985d947a3a9323944540abbac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:26.042820 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2697bc78fa724b77aca8e7b6b4c7b938 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.045706 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_51ec88321a154803836994b4c5430993"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:26.046562 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51ec88321a154803836994b4c5430993 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.046639 1061 raft_consensus.cc:3060] T 24c66e2cc96f458fb3279827cea4ca9e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:26.050767 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 977b95a3442a405d90385cdb4d6dd5dd (table default.Table_429d1a716ae64decac39f45685e90b00 [id=89a90617176b4035a465731d37aa795e]) successfully deleted
I20260318 02:51:26.051215 1621 consensus_queue.cc:1048] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:26.051640 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2fb448f2651542d980b9c8f124ca5530" } new_table_name: "default.Table_571feb453416404b8733d890a9336fc4" modify_external_catalogs: true
I20260318 02:51:26.051824 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_4c142ec468934e08bfc73a90761bb104"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:26.052515 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c142ec468934e08bfc73a90761bb104 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.051640 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_fe78e4c0a6624b86a4ce7ec2c634c5ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:26.053202 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe78e4c0a6624b86a4ce7ec2c634c5ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.057513 897 tablet_service.cc:1558] Processing DeleteTablet for tablet f04f057571584d31b1821e690ae7c75c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:26.057866 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet f04f057571584d31b1821e690ae7c75c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:26.058270 1174 ts_tablet_manager.cc:1434] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.059s user 0.001s sys 0.001s
I20260318 02:51:26.058926 1174 tablet_bootstrap.cc:492] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:26.061542 897 tablet_service.cc:1511] Processing CreateTablet for tablet 783c886a99994d6c8d9add724277819a (DEFAULT_TABLE table=default.Table_cfd83086efd94aeeac453573d0c9350b [id=f1416944463a4ad98086e63fe84cf76f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.062120 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 783c886a99994d6c8d9add724277819a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.067283 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 64c2a579264e43b9a1e25ded000d4d9f (DEFAULT_TABLE table=default.Table_c662869530134cb08ab6cc52957d07d9 [id=fda071b90fe64716b46fd1ab46f4b934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.067751 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c2a579264e43b9a1e25ded000d4d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.076107 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 60dedba077d34435b30061bfba737412 (DEFAULT_TABLE table=default.Table_374dfe5a11944231bc786a2cb0c66a84 [id=6449f780fd6a4361960f0a62d81dd60d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.076092 897 tablet_service.cc:1511] Processing CreateTablet for tablet 64c2a579264e43b9a1e25ded000d4d9f (DEFAULT_TABLE table=default.Table_c662869530134cb08ab6cc52957d07d9 [id=fda071b90fe64716b46fd1ab46f4b934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.076565 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c2a579264e43b9a1e25ded000d4d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.077173 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60dedba077d34435b30061bfba737412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.077226 901 tablet_service.cc:1511] Processing CreateTablet for tablet 60dedba077d34435b30061bfba737412 (DEFAULT_TABLE table=default.Table_374dfe5a11944231bc786a2cb0c66a84 [id=6449f780fd6a4361960f0a62d81dd60d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.077869 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60dedba077d34435b30061bfba737412. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:26.078896 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f04f057571584d31b1821e690ae7c75c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f04f057571584d31b1821e690ae7c75c already in progress: creating tablet
I20260318 02:51:26.079771 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 49afed40c7aa4f2d913daed8055a098e (DEFAULT_TABLE table=default.Table_11fb574b8c6a45fca4af288fcc47bfd8 [id=df327d7be3fc46d0b969529acb5684c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.080324 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49afed40c7aa4f2d913daed8055a098e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.088276 763 tablet_service.cc:1511] Processing CreateTablet for tablet 64c2a579264e43b9a1e25ded000d4d9f (DEFAULT_TABLE table=default.Table_c662869530134cb08ab6cc52957d07d9 [id=fda071b90fe64716b46fd1ab46f4b934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.090497 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c2a579264e43b9a1e25ded000d4d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.091270 756 tablet_service.cc:1511] Processing CreateTablet for tablet 49afed40c7aa4f2d913daed8055a098e (DEFAULT_TABLE table=default.Table_11fb574b8c6a45fca4af288fcc47bfd8 [id=df327d7be3fc46d0b969529acb5684c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.093549 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49afed40c7aa4f2d913daed8055a098e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.096832 901 tablet_service.cc:1511] Processing CreateTablet for tablet 49afed40c7aa4f2d913daed8055a098e (DEFAULT_TABLE table=default.Table_11fb574b8c6a45fca4af288fcc47bfd8 [id=df327d7be3fc46d0b969529acb5684c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.097177 754 tablet_service.cc:1511] Processing CreateTablet for tablet 783c886a99994d6c8d9add724277819a (DEFAULT_TABLE table=default.Table_cfd83086efd94aeeac453573d0c9350b [id=f1416944463a4ad98086e63fe84cf76f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.097299 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 783c886a99994d6c8d9add724277819a (DEFAULT_TABLE table=default.Table_cfd83086efd94aeeac453573d0c9350b [id=f1416944463a4ad98086e63fe84cf76f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.097472 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49afed40c7aa4f2d913daed8055a098e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.098507 1174 tablet_bootstrap.cc:654] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.099385 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 783c886a99994d6c8d9add724277819a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.101769 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet abfdba1f21e44652b2bce62cd3e6681f
I20260318 02:51:26.103327 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3064939f4dfb44dba19bb6f8f9c6f250"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:26.103876 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3064939f4dfb44dba19bb6f8f9c6f250 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.103791 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_844d0b7797464d27aafe5c1e9f0b3492"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:26.104292 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_844d0b7797464d27aafe5c1e9f0b3492 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.105094 454 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 18a512a8b2aa43679f3faf78d749ca52
I20260318 02:51:26.105392 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_103c65f4b0d64732bb96cb99459082e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:26.105896 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_103c65f4b0d64732bb96cb99459082e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.106989 762 tablet_service.cc:1511] Processing CreateTablet for tablet 3aa05403966349ae9056777d913a0db6 (DEFAULT_TABLE table=default.Table_f4736cb671be4feda1ede6bc973d14c2 [id=5b2e7b122a394e058dc5b2fd84a0f558]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.108562 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 783c886a99994d6c8d9add724277819a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.109835 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aa05403966349ae9056777d913a0db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.112643 758 tablet_service.cc:1511] Processing CreateTablet for tablet 60dedba077d34435b30061bfba737412 (DEFAULT_TABLE table=default.Table_374dfe5a11944231bc786a2cb0c66a84 [id=6449f780fd6a4361960f0a62d81dd60d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.113281 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60dedba077d34435b30061bfba737412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.114727 752 tablet_service.cc:1558] Processing DeleteTablet for tablet abfdba1f21e44652b2bce62cd3e6681f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.119100 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 3aa05403966349ae9056777d913a0db6 (DEFAULT_TABLE table=default.Table_f4736cb671be4feda1ede6bc973d14c2 [id=5b2e7b122a394e058dc5b2fd84a0f558]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.120944 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aa05403966349ae9056777d913a0db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.123703 1616 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260318 02:51:26.126215 1176 ts_tablet_manager.cc:1929] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.126376 1176 log.cc:1199] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/3c283efbac08468c8c20f4caba90164c
I20260318 02:51:26.126721 1176 ts_tablet_manager.cc:1950] T 3c283efbac08468c8c20f4caba90164c P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:26.127418 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 3c283efbac08468c8c20f4caba90164c (table default.Table_376ed96eff2f4d13a0872f0984da4828 [id=7ac79bf8374d4166b204274f50a1db67]) successfully deleted
I20260318 02:51:26.129021 1621 consensus_queue.cc:1048] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:26.131112 752 tablet_service.cc:1511] Processing CreateTablet for tablet bcb731f97a764183aba7408bae969331 (DEFAULT_TABLE table=default.Table_6fe999cf7db144f0ba846e7bb973d709 [id=11573552923d46149af2228cd8435a40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.131680 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb731f97a764183aba7408bae969331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.141347 897 tablet_service.cc:1511] Processing CreateTablet for tablet 3aa05403966349ae9056777d913a0db6 (DEFAULT_TABLE table=default.Table_f4736cb671be4feda1ede6bc973d14c2 [id=5b2e7b122a394e058dc5b2fd84a0f558]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.142264 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aa05403966349ae9056777d913a0db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.144001 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet abfdba1f21e44652b2bce62cd3e6681f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:26.147037 1621 consensus_queue.cc:1048] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:26.149320 901 tablet_service.cc:1558] Processing DeleteTablet for tablet abfdba1f21e44652b2bce62cd3e6681f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:26.153055 536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" candidate_term: 3 candidate_status { last_received { term: 2 index: 383 } } ignore_live_leader: false dest_uuid: "8b701993861d4c11b3394a2d6588b3b7" is_pre_election: true
I20260318 02:51:26.158010 1426 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" instance_seqno: 1773802278982506) as {username='slave'} at 127.0.104.131:32795; Asking this server to re-register.
W20260318 02:51:26.159011 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet abfdba1f21e44652b2bce62cd3e6681f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet abfdba1f21e44652b2bce62cd3e6681f already in progress: creating tablet
I20260318 02:51:26.159229 1109 heartbeater.cc:461] Registering TS with master...
I20260318 02:51:26.160240 1034 tablet_service.cc:1511] Processing CreateTablet for tablet bcb731f97a764183aba7408bae969331 (DEFAULT_TABLE table=default.Table_6fe999cf7db144f0ba846e7bb973d709 [id=11573552923d46149af2228cd8435a40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.161044 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb731f97a764183aba7408bae969331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.163304 1426 ts_manager.cc:194] Registered new tserver with Master: 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:26.175894 763 tablet_service.cc:1511] Processing CreateTablet for tablet 2ebcf120100349319d27615b6e0c7550 (DEFAULT_TABLE table=default.Table_1424aa1a08ae4f3584a9f415cd41b6e7 [id=566d84b4953c4753a0b3a2bc060aae3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.176455 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebcf120100349319d27615b6e0c7550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.177205 756 tablet_service.cc:1511] Processing CreateTablet for tablet 184ce58aa96d4e70ad7b2783f19ccdeb (DEFAULT_TABLE table=default.Table_b6cc0e95556348868fc31e5d4ae173cb [id=3e7b4f46e6c04379b32c2d39de6aa759]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.177687 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184ce58aa96d4e70ad7b2783f19ccdeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.175899 760 tablet_service.cc:1511] Processing CreateTablet for tablet 85e6ad2a9817444caecb78eabde5d222 (DEFAULT_TABLE table=default.Table_c23e7504b2474f1686592467b684da52 [id=96801ef3b02b4ab6b22d34157d05bb49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.184193 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85e6ad2a9817444caecb78eabde5d222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.186285 1423 raft_consensus.cc:493] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:26.186471 1423 raft_consensus.cc:515] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.187184 1423 leader_election.cc:290] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:26.187150 897 tablet_service.cc:1511] Processing CreateTablet for tablet bcb731f97a764183aba7408bae969331 (DEFAULT_TABLE table=default.Table_6fe999cf7db144f0ba846e7bb973d709 [id=11573552923d46149af2228cd8435a40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.187574 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb731f97a764183aba7408bae969331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.188174 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aebb91ff6b0416fac2ef2d056ca897a" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:26.188411 784 raft_consensus.cc:2468] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:26.188930 862 leader_election.cc:304] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:26.189263 1423 raft_consensus.cc:2804] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:26.189347 1423 raft_consensus.cc:493] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:26.189448 1423 raft_consensus.cc:3060] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:26.189826 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a384923c86ee42d6a47ed3f68e6811df consensus state has no leader
I20260318 02:51:26.191525 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1411aed3bcfc46efa721b7be6886f33f" } new_table_name: "default.Table_8e59e35b5d3a48269cc70d7be773117b" modify_external_catalogs: true
I20260318 02:51:26.192272 1423 raft_consensus.cc:515] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:26.193360 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 184ce58aa96d4e70ad7b2783f19ccdeb consensus state has no leader
I20260318 02:51:26.194010 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aebb91ff6b0416fac2ef2d056ca897a" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:26.194185 784 raft_consensus.cc:3060] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:26.194648 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b8973d8930ef4b65be7b4ff990bf9d72 consensus state has no leader
I20260318 02:51:26.196594 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aebb91ff6b0416fac2ef2d056ca897a" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:26.196883 784 raft_consensus.cc:2468] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:26.197050 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aebb91ff6b0416fac2ef2d056ca897a" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:26.197561 862 leader_election.cc:304] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:26.197866 1557 raft_consensus.cc:2804] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:26.197979 1557 raft_consensus.cc:697] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:26.198240 1557 consensus_queue.cc:237] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:26.199059 860 leader_election.cc:343] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:26.199442 860 leader_election.cc:343] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:26.200229 1423 leader_election.cc:290] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:26.203840 455 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 6b82751cbcbb4c39a6942b6856412fc8 (table default.Table_9faefa2c0ceb4495935b65b6869b4b7a [id=84a657155372475db438c6eb3119b595]). Expected version 2 got 0
I20260318 02:51:26.204371 451 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 6b82751cbcbb4c39a6942b6856412fc8 (table default.Table_9faefa2c0ceb4495935b65b6869b4b7a [id=84a657155372475db438c6eb3119b595]). Expected version 2 got 0
I20260318 02:51:26.207425 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e81f3622048c415e977ce897e4edcacf" } modify_external_catalogs: true
I20260318 02:51:26.207654 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e81f3622048c415e977ce897e4edcacf" } modify_external_catalogs: true
I20260318 02:51:26.208105 1561 raft_consensus.cc:493] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:26.208316 1561 raft_consensus.cc:515] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.209005 1561 leader_election.cc:290] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:26.209579 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_cd3a5e50d5224cf59e0d62be2fa27753"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:26.209681 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_25a5e0aa32c245ff957460a7a51caa4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:26.210198 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd3a5e50d5224cf59e0d62be2fa27753 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:26.210338 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25a5e0aa32c245ff957460a7a51caa4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.211917 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5711987324e24023b68377247e832cc2" } new_table_name: "default.Table_992b9f90aa8c4e51959ca139974f10fe" modify_external_catalogs: true
I20260318 02:51:26.213081 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62af8b953213412bb0c3bd1c68042ec9" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:26.213666 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_600a629a518c46678144af62a75ea690" } modify_external_catalogs: true
I20260318 02:51:26.213874 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_600a629a518c46678144af62a75ea690" } modify_external_catalogs: true
I20260318 02:51:26.214360 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62af8b953213412bb0c3bd1c68042ec9" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:26.215833 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 85e6ad2a9817444caecb78eabde5d222 (DEFAULT_TABLE table=default.Table_c23e7504b2474f1686592467b684da52 [id=96801ef3b02b4ab6b22d34157d05bb49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.215978 1561 raft_consensus.cc:493] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:26.216125 1561 raft_consensus.cc:515] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.216424 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85e6ad2a9817444caecb78eabde5d222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.216775 1561 leader_election.cc:290] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:26.217150 719 leader_election.cc:343] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:26.218199 719 leader_election.cc:343] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:26.218698 719 leader_election.cc:304] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:26.219558 1561 raft_consensus.cc:2749] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:26.220361 443 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 2adcc9f1ad69458c997475111bb787cf (table default.Table_8fdbd48eef374965b592274f14ea8ee1 [id=e7071ce844664614a646a3554c38ae41], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2adcc9f1ad69458c997475111bb787cf consensus state has no leader
I20260318 02:51:26.220889 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed4350e0fde4c8690970bc69830fcb3" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:26.222298 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed4350e0fde4c8690970bc69830fcb3" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:26.223847 719 leader_election.cc:343] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:26.228672 1174 tablet_bootstrap.cc:492] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:26.228878 1174 ts_tablet_manager.cc:1403] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.170s user 0.005s sys 0.001s
W20260318 02:51:26.229733 719 leader_election.cc:343] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:26.230723 719 leader_election.cc:304] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:26.230118 1176 tablet_replica.cc:333] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:26.231575 1176 raft_consensus.cc:2243] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.232052 1561 raft_consensus.cc:2749] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:26.232411 1176 raft_consensus.cc:2272] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.232795 897 tablet_service.cc:1511] Processing CreateTablet for tablet 85e6ad2a9817444caecb78eabde5d222 (DEFAULT_TABLE table=default.Table_c23e7504b2474f1686592467b684da52 [id=96801ef3b02b4ab6b22d34157d05bb49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.233132 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 184ce58aa96d4e70ad7b2783f19ccdeb (DEFAULT_TABLE table=default.Table_b6cc0e95556348868fc31e5d4ae173cb [id=3e7b4f46e6c04379b32c2d39de6aa759]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.233328 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85e6ad2a9817444caecb78eabde5d222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.233546 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184ce58aa96d4e70ad7b2783f19ccdeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.236590 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 2ebcf120100349319d27615b6e0c7550 (DEFAULT_TABLE table=default.Table_1424aa1a08ae4f3584a9f415cd41b6e7 [id=566d84b4953c4753a0b3a2bc060aae3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.236968 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebcf120100349319d27615b6e0c7550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.241649 1176 ts_tablet_manager.cc:1916] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.241909 901 tablet_service.cc:1511] Processing CreateTablet for tablet 2ebcf120100349319d27615b6e0c7550 (DEFAULT_TABLE table=default.Table_1424aa1a08ae4f3584a9f415cd41b6e7 [id=566d84b4953c4753a0b3a2bc060aae3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.237722 1174 raft_consensus.cc:359] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.242362 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebcf120100349319d27615b6e0c7550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.242333 1174 raft_consensus.cc:385] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.242533 1174 raft_consensus.cc:740] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.245043 895 tablet_service.cc:1511] Processing CreateTablet for tablet 184ce58aa96d4e70ad7b2783f19ccdeb (DEFAULT_TABLE table=default.Table_b6cc0e95556348868fc31e5d4ae173cb [id=3e7b4f46e6c04379b32c2d39de6aa759]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.245476 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184ce58aa96d4e70ad7b2783f19ccdeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.250517 1426 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" instance_seqno: 1773802278480685) as {username='slave'} at 127.0.104.130:50363; Asking this server to re-register.
I20260318 02:51:26.251667 972 heartbeater.cc:461] Registering TS with master...
I20260318 02:51:26.265730 466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" candidate_term: 3 candidate_status { last_received { term: 2 index: 383 } } ignore_live_leader: false dest_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" is_pre_election: true
I20260318 02:51:26.267583 1172 tablet_bootstrap.cc:492] T 88eeb101a1734271973cd7d4c756b356 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:26.267728 1172 ts_tablet_manager.cc:1403] T 88eeb101a1734271973cd7d4c756b356 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.289s user 0.029s sys 0.033s
I20260318 02:51:26.267722 1561 raft_consensus.cc:493] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:26.268496 1172 raft_consensus.cc:359] T 88eeb101a1734271973cd7d4c756b356 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.268517 757 tablet_service.cc:1511] Processing CreateTablet for tablet b317cc133346412fb981b1c8e5b99c4d (DEFAULT_TABLE table=default.Table_39aee165029f47559776d7610e509b6a [id=dbaa2341227b48d19ec73a413513358a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.268671 1172 raft_consensus.cc:385] T 88eeb101a1734271973cd7d4c756b356 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.268517 759 tablet_service.cc:1511] Processing CreateTablet for tablet 169f97b2320e4a5baae1dec29a1c7c36 (DEFAULT_TABLE table=default.Table_b6e28e78c8ce47bc8a4b3a78f29d43ba [id=6eab717971914229a4386a1579b11b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.268792 1172 raft_consensus.cc:740] T 88eeb101a1734271973cd7d4c756b356 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.268786 764 tablet_service.cc:1511] Processing CreateTablet for tablet 21e6e89e5a0a4d1bb952e74be1b7e551 (DEFAULT_TABLE table=default.Table_997fb2399fa943e9b940ce4e2b1f31ca [id=e3ae42e4eb124dcebd6692574f6d0a9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.269028 1172 consensus_queue.cc:260] T 88eeb101a1734271973cd7d4c756b356 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.270725 1172 ts_tablet_manager.cc:1434] T 88eeb101a1734271973cd7d4c756b356 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:26.271067 1172 tablet_bootstrap.cc:492] T 3c283efbac08468c8c20f4caba90164c P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:26.273097 1174 consensus_queue.cc:260] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.273996 1174 ts_tablet_manager.cc:1434] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.045s user 0.003s sys 0.000s
I20260318 02:51:26.274392 1172 tablet_bootstrap.cc:654] T 3c283efbac08468c8c20f4caba90164c P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.275063 1174 tablet_bootstrap.cc:492] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:26.274963 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 9777963ff20c4a799de2870555f6b335 (DEFAULT_TABLE table=default.Table_837986fdf0204eea89656e0edb23e67c [id=f8c2021fcd4c4fb2b807bf8fa92088dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.275650 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9777963ff20c4a799de2870555f6b335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.275682 752 tablet_service.cc:1511] Processing CreateTablet for tablet 9777963ff20c4a799de2870555f6b335 (DEFAULT_TABLE table=default.Table_837986fdf0204eea89656e0edb23e67c [id=f8c2021fcd4c4fb2b807bf8fa92088dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.276151 762 tablet_service.cc:1511] Processing CreateTablet for tablet 59c6741a6d154d8f99d487c6590d2d26 (DEFAULT_TABLE table=default.Table_f4978db62ff94982b1fbb4afc8e96b29 [id=9c9b005136654a8e874925b6bbef33a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.279625 897 tablet_service.cc:1511] Processing CreateTablet for tablet 9777963ff20c4a799de2870555f6b335 (DEFAULT_TABLE table=default.Table_837986fdf0204eea89656e0edb23e67c [id=f8c2021fcd4c4fb2b807bf8fa92088dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.280635 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9777963ff20c4a799de2870555f6b335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.281004 766 tablet_service.cc:1511] Processing CreateTablet for tablet c4051c8e4d3d49829f9eac8e36baab2f (DEFAULT_TABLE table=default.Table_b27c31a9cf2c4e53b57bff83bb0ff243 [id=3665ac075f964d4c8e2cdda80cbef8a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.281481 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b317cc133346412fb981b1c8e5b99c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.281750 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 169f97b2320e4a5baae1dec29a1c7c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.281963 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4051c8e4d3d49829f9eac8e36baab2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.282253 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e6e89e5a0a4d1bb952e74be1b7e551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.282339 1561 raft_consensus.cc:515] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.289438 1174 tablet_bootstrap.cc:654] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.289903 1561 leader_election.cc:290] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:26.291280 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 59c6741a6d154d8f99d487c6590d2d26 (DEFAULT_TABLE table=default.Table_f4978db62ff94982b1fbb4afc8e96b29 [id=9c9b005136654a8e874925b6bbef33a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.291751 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c6741a6d154d8f99d487c6590d2d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.294467 1176 ts_tablet_manager.cc:1929] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.294620 1176 log.cc:1199] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/5aebb91ff6b0416fac2ef2d056ca897a
I20260318 02:51:26.294946 1176 ts_tablet_manager.cc:1950] T 5aebb91ff6b0416fac2ef2d056ca897a P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:26.295800 1176 tablet_replica.cc:333] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:26.295989 1176 raft_consensus.cc:2243] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.296181 1176 raft_consensus.cc:2272] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.296280 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 5aebb91ff6b0416fac2ef2d056ca897a (table default.Table_764057148a0945d0a7a4f9e497808d92 [id=e91dc919c98843a7b31ed85f73ab5774]) successfully deleted
W20260318 02:51:26.296568 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 1b439fa2481a43c78d2c486d8711175f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b439fa2481a43c78d2c486d8711175f already in progress: creating tablet
I20260318 02:51:26.296890 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9777963ff20c4a799de2870555f6b335. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:26.296877 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2adcc9f1ad69458c997475111bb787cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2adcc9f1ad69458c997475111bb787cf already in progress: creating tablet
I20260318 02:51:26.300864 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c6741a6d154d8f99d487c6590d2d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.302093 895 tablet_service.cc:1511] Processing CreateTablet for tablet 59c6741a6d154d8f99d487c6590d2d26 (DEFAULT_TABLE table=default.Table_f4978db62ff94982b1fbb4afc8e96b29 [id=9c9b005136654a8e874925b6bbef33a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.302649 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c6741a6d154d8f99d487c6590d2d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.311668 1034 tablet_service.cc:1511] Processing CreateTablet for tablet c4051c8e4d3d49829f9eac8e36baab2f (DEFAULT_TABLE table=default.Table_b27c31a9cf2c4e53b57bff83bb0ff243 [id=3665ac075f964d4c8e2cdda80cbef8a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.313009 1175 ts_tablet_manager.cc:1929] T 959faf1fbb224434b896c0f21e9715be P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.316367 766 tablet_service.cc:1511] Processing CreateTablet for tablet d7f21df58fac437da5747becfa3f28b4 (DEFAULT_TABLE table=default.Table_7726804d85124e99b24f46fd5169aed5 [id=48b004d4295f40f0ac9ff77d7bb31720]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.316803 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f21df58fac437da5747becfa3f28b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.318754 756 tablet_service.cc:1558] Processing DeleteTablet for tablet cf27c8d69f41431e9fab12e605e15b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.319365 1409 leader_election.cc:304] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 971baf5b9e4644c990dbf4d4fc7ba900; no voters: 8b701993861d4c11b3394a2d6588b3b7, ee6aa91804a2401fa0ceb31b196ec40a
I20260318 02:51:26.319823 1563 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260318 02:51:26.320438 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d9fd8f01d59b47d9bc3053e485415619" } modify_external_catalogs: true
I20260318 02:51:26.320664 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d9fd8f01d59b47d9bc3053e485415619" } modify_external_catalogs: true
W20260318 02:51:26.322022 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 918c542a51864e54871efc5e7f62ef61 consensus state has no leader
I20260318 02:51:26.322084 1175 log.cc:1199] T 959faf1fbb224434b896c0f21e9715be P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/959faf1fbb224434b896c0f21e9715be
I20260318 02:51:26.322232 907 tablet_service.cc:1511] Processing CreateTablet for tablet d7f21df58fac437da5747becfa3f28b4 (DEFAULT_TABLE table=default.Table_7726804d85124e99b24f46fd5169aed5 [id=48b004d4295f40f0ac9ff77d7bb31720]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.322499 1175 ts_tablet_manager.cc:1950] T 959faf1fbb224434b896c0f21e9715be P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:26.322667 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f21df58fac437da5747becfa3f28b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.322955 1175 tablet_replica.cc:333] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:26.323167 1175 raft_consensus.cc:2243] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.323375 1175 raft_consensus.cc:2272] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.323328 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db76f996b094bf99b6c6fe33f02b9f3" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:26.340871 1561 raft_consensus.cc:493] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:26.341099 1561 raft_consensus.cc:515] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.341943 1561 leader_election.cc:290] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:26.314908 901 tablet_service.cc:1511] Processing CreateTablet for tablet 169f97b2320e4a5baae1dec29a1c7c36 (DEFAULT_TABLE table=default.Table_b6e28e78c8ce47bc8a4b3a78f29d43ba [id=6eab717971914229a4386a1579b11b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.343331 1176 ts_tablet_manager.cc:1916] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.317128 888 tablet_service.cc:1511] Processing CreateTablet for tablet 21e6e89e5a0a4d1bb952e74be1b7e551 (DEFAULT_TABLE table=default.Table_997fb2399fa943e9b940ce4e2b1f31ca [id=e3ae42e4eb124dcebd6692574f6d0a9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.318508 898 tablet_service.cc:1511] Processing CreateTablet for tablet b317cc133346412fb981b1c8e5b99c4d (DEFAULT_TABLE table=default.Table_39aee165029f47559776d7610e509b6a [id=dbaa2341227b48d19ec73a413513358a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.349040 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4051c8e4d3d49829f9eac8e36baab2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.315668 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 169f97b2320e4a5baae1dec29a1c7c36 (DEFAULT_TABLE table=default.Table_b6e28e78c8ce47bc8a4b3a78f29d43ba [id=6eab717971914229a4386a1579b11b4a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:26.352165 719 leader_election.cc:343] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:26.316494 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 21e6e89e5a0a4d1bb952e74be1b7e551 (DEFAULT_TABLE table=default.Table_997fb2399fa943e9b940ce4e2b1f31ca [id=e3ae42e4eb124dcebd6692574f6d0a9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.356549 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e6e89e5a0a4d1bb952e74be1b7e551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.318011 1033 tablet_service.cc:1511] Processing CreateTablet for tablet b317cc133346412fb981b1c8e5b99c4d (DEFAULT_TABLE table=default.Table_39aee165029f47559776d7610e509b6a [id=dbaa2341227b48d19ec73a413513358a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.357010 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b317cc133346412fb981b1c8e5b99c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.319486 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 88eeb101a1734271973cd7d4c756b356 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:26.360055 756 tablet_service.cc:1511] Processing CreateTablet for tablet 6bb381f10d87414f9c1a99942216adc7 (DEFAULT_TABLE table=default.Table_944b58673e2348228ec36d8ba31e25b4 [id=b175f925e78640e586132f07ed6e44c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.360361 1184 tablet_replica.cc:333] T 88eeb101a1734271973cd7d4c756b356 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:26.360563 1184 raft_consensus.cc:2243] T 88eeb101a1734271973cd7d4c756b356 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.360762 1184 raft_consensus.cc:2272] T 88eeb101a1734271973cd7d4c756b356 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.361174 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bb381f10d87414f9c1a99942216adc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.365283 1184 ts_tablet_manager.cc:1916] T 88eeb101a1734271973cd7d4c756b356 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.365931 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 959faf1fbb224434b896c0f21e9715be (table default.Table_ebd103e5fbf4484597076b02ffd82044 [id=4067c18ce85f44d7993786a3e9bda883]) successfully deleted
I20260318 02:51:26.376763 1561 raft_consensus.cc:493] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:26.377321 1561 raft_consensus.cc:515] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.377923 1561 leader_election.cc:290] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:26.379128 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf27c8d69f41431e9fab12e605e15b9c" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:26.380331 1184 ts_tablet_manager.cc:1929] T 88eeb101a1734271973cd7d4c756b356 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.321496 1037 tablet_service.cc:1511] Processing CreateTablet for tablet d7f21df58fac437da5747becfa3f28b4 (DEFAULT_TABLE table=default.Table_7726804d85124e99b24f46fd5169aed5 [id=48b004d4295f40f0ac9ff77d7bb31720]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.347219 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a54d0daa9f48a89b3f114367750826" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:26.321239 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db76f996b094bf99b6c6fe33f02b9f3" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:26.383977 757 tablet_service.cc:1511] Processing CreateTablet for tablet 7e6f40a5d3f14a779c26d73bf58f302b (DEFAULT_TABLE table=default.Table_d8631b4230fc46efaaee519421401f19 [id=05445eb067cb46a5803415774772c91e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.384759 450 master_service.cc:954] ReplaceTablet: received request to replace tablet b8973d8930ef4b65be7b4ff990bf9d72 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:26.385869 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9cec0b03f7c349e796f0e677adc54d0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:26.386504 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9cec0b03f7c349e796f0e677adc54d0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.387562 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1acdeb444a404cb0b89ac6450e835639" } modify_external_catalogs: true
I20260318 02:51:26.387771 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1acdeb444a404cb0b89ac6450e835639" } modify_external_catalogs: true
I20260318 02:51:26.388918 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e6f40a5d3f14a779c26d73bf58f302b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.389161 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9c0322ee5c694253958b5d9583c3708e" } modify_external_catalogs: true
I20260318 02:51:26.389343 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9c0322ee5c694253958b5d9583c3708e" } modify_external_catalogs: true
I20260318 02:51:26.389637 1176 ts_tablet_manager.cc:1929] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.389756 1176 log.cc:1199] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/ec32c25ae14b406cb6ab4d913b575091
I20260318 02:51:26.389847 764 tablet_service.cc:1511] Processing CreateTablet for tablet f37ab96f13444fcbb5cfc3ad92d53c35 (DEFAULT_TABLE table=default.Table_a9ca2b8e5b9042279576e9b9c6701069 [id=3066ad66b0914b759c32fe9296ca90bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.390417 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f37ab96f13444fcbb5cfc3ad92d53c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.391366 1176 ts_tablet_manager.cc:1950] T ec32c25ae14b406cb6ab4d913b575091 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:26.391940 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet ec32c25ae14b406cb6ab4d913b575091 (table default.Table_7692f02c62f94771bc39331507161bb2 [id=60f0afdd0f9f4c5196ea491b90991241]) successfully deleted
I20260318 02:51:26.392027 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 6bb381f10d87414f9c1a99942216adc7 (DEFAULT_TABLE table=default.Table_944b58673e2348228ec36d8ba31e25b4 [id=b175f925e78640e586132f07ed6e44c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.392258 1176 tablet_replica.cc:333] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:26.393720 1176 raft_consensus.cc:2243] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.393922 1176 raft_consensus.cc:2272] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.394161 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 82858fd64d534d1abcad12bc4a93cda7
I20260318 02:51:26.394531 1176 ts_tablet_manager.cc:1916] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.394897 451 master_service.cc:954] ReplaceTablet: received request to replace tablet 3c283efbac08468c8c20f4caba90164c from {username='slave'} at 127.0.0.1:47158
W20260318 02:51:26.396289 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bfb352bce9cc4e8aa899d691954d28d2 consensus state has no leader
I20260318 02:51:26.396639 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 461adcc8bbd94d30b9b84d1010430829
W20260318 02:51:26.396669 719 leader_election.cc:343] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:26.397835 719 leader_election.cc:343] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:26.398329 719 leader_election.cc:343] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:26.399008 719 leader_election.cc:304] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:26.400350 1561 raft_consensus.cc:2749] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:26.403439 759 tablet_service.cc:1511] Processing CreateTablet for tablet 2f04e5699531479d8b76edb0e2d2873c (DEFAULT_TABLE table=default.Table_9e6e77bf748f460894d85c701ccfad5b [id=ddd8b0b49c334776b49a59c18e75453c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.404039 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 461adcc8bbd94d30b9b84d1010430829 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.404175 1184 log.cc:1199] T 88eeb101a1734271973cd7d4c756b356 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/88eeb101a1734271973cd7d4c756b356
I20260318 02:51:26.404220 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 82858fd64d534d1abcad12bc4a93cda7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.404834 1561 raft_consensus.cc:493] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:26.405054 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f04e5699531479d8b76edb0e2d2873c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.406661 1561 raft_consensus.cc:515] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.407558 1561 leader_election.cc:290] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:26.413923 1175 ts_tablet_manager.cc:1916] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.416347 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 169f97b2320e4a5baae1dec29a1c7c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.422346 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet cc1543d0e1b1431baf6d2ab6a0484ca6
I20260318 02:51:26.423146 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b8973d8930ef4b65be7b4ff990bf9d72
I20260318 02:51:26.423748 450 catalog_manager.cc:6741] ReplaceTablet: tablet b8973d8930ef4b65be7b4ff990bf9d72 deleted and replaced by tablet 5c89f413a26a43ef95c850d7c44f85b2
I20260318 02:51:26.426111 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e0c54b3f1b44e4bea7253473714e94" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:26.426460 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 169f97b2320e4a5baae1dec29a1c7c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.426168 753 tablet_service.cc:1511] Processing CreateTablet for tablet 20a492fdea6c44ba8439614b0dcc2ba6 (DEFAULT_TABLE table=default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.426782 763 tablet_service.cc:1558] Processing DeleteTablet for tablet cc1543d0e1b1431baf6d2ab6a0484ca6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.427127 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a492fdea6c44ba8439614b0dcc2ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.427203 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 7e6f40a5d3f14a779c26d73bf58f302b (DEFAULT_TABLE table=default.Table_d8631b4230fc46efaaee519421401f19 [id=05445eb067cb46a5803415774772c91e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.428915 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 82858fd64d534d1abcad12bc4a93cda7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:26.429206 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet cc1543d0e1b1431baf6d2ab6a0484ca6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:26.426169 754 tablet_service.cc:1558] Processing DeleteTablet for tablet b8973d8930ef4b65be7b4ff990bf9d72 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c89f413a26a43ef95c850d7c44f85b2) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.429386 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 20a492fdea6c44ba8439614b0dcc2ba6 (DEFAULT_TABLE table=default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:26.430135 719 leader_election.cc:343] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:26.432667 452 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 6b82751cbcbb4c39a6942b6856412fc8 (table default.Table_9faefa2c0ceb4495935b65b6869b4b7a [id=84a657155372475db438c6eb3119b595]). Expected version 2 got 0
I20260318 02:51:26.434527 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bb381f10d87414f9c1a99942216adc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.435220 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 2f04e5699531479d8b76edb0e2d2873c (DEFAULT_TABLE table=default.Table_9e6e77bf748f460894d85c701ccfad5b [id=ddd8b0b49c334776b49a59c18e75453c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.435665 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 461adcc8bbd94d30b9b84d1010430829 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:26.436002 1036 tablet_service.cc:1511] Processing CreateTablet for tablet f37ab96f13444fcbb5cfc3ad92d53c35 (DEFAULT_TABLE table=default.Table_a9ca2b8e5b9042279576e9b9c6701069 [id=3066ad66b0914b759c32fe9296ca90bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.437139 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e6f40a5d3f14a779c26d73bf58f302b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.437773 1184 ts_tablet_manager.cc:1950] T 88eeb101a1734271973cd7d4c756b356 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:26.438455 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a492fdea6c44ba8439614b0dcc2ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.441632 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet b8973d8930ef4b65be7b4ff990bf9d72 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c89f413a26a43ef95c850d7c44f85b2) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:26.442265 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f04e5699531479d8b76edb0e2d2873c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.442504 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f21df58fac437da5747becfa3f28b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.443825 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f37ab96f13444fcbb5cfc3ad92d53c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.444995 895 tablet_service.cc:1511] Processing CreateTablet for tablet c4051c8e4d3d49829f9eac8e36baab2f (DEFAULT_TABLE table=default.Table_b27c31a9cf2c4e53b57bff83bb0ff243 [id=3665ac075f964d4c8e2cdda80cbef8a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.445256 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e6e89e5a0a4d1bb952e74be1b7e551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.445943 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf27c8d69f41431e9fab12e605e15b9c" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:26.446846 892 tablet_service.cc:1511] Processing CreateTablet for tablet 6bb381f10d87414f9c1a99942216adc7 (DEFAULT_TABLE table=default.Table_944b58673e2348228ec36d8ba31e25b4 [id=b175f925e78640e586132f07ed6e44c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.448122 905 tablet_service.cc:1511] Processing CreateTablet for tablet f37ab96f13444fcbb5cfc3ad92d53c35 (DEFAULT_TABLE table=default.Table_a9ca2b8e5b9042279576e9b9c6701069 [id=3066ad66b0914b759c32fe9296ca90bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.448172 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e0c54b3f1b44e4bea7253473714e94" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:26.449205 902 tablet_service.cc:1511] Processing CreateTablet for tablet 7e6f40a5d3f14a779c26d73bf58f302b (DEFAULT_TABLE table=default.Table_d8631b4230fc46efaaee519421401f19 [id=05445eb067cb46a5803415774772c91e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.443377 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a54d0daa9f48a89b3f114367750826" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:26.449929 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b317cc133346412fb981b1c8e5b99c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.450134 889 tablet_service.cc:1511] Processing CreateTablet for tablet 2f04e5699531479d8b76edb0e2d2873c (DEFAULT_TABLE table=default.Table_9e6e77bf748f460894d85c701ccfad5b [id=ddd8b0b49c334776b49a59c18e75453c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.450372 1176 ts_tablet_manager.cc:1929] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.450512 1176 log.cc:1199] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/6e9372f8871b473caa024512e936a6e5
I20260318 02:51:26.450838 1176 ts_tablet_manager.cc:1950] T 6e9372f8871b473caa024512e936a6e5 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:26.451825 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f04e5699531479d8b76edb0e2d2873c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.455725 452 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 6b82751cbcbb4c39a6942b6856412fc8 (table default.Table_9faefa2c0ceb4495935b65b6869b4b7a [id=84a657155372475db438c6eb3119b595]). Expected version 2 got 0
I20260318 02:51:26.457116 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 82858fd64d534d1abcad12bc4a93cda7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:26.460637 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 461adcc8bbd94d30b9b84d1010430829 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:26.451660 719 leader_election.cc:343] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:26.457865 1174 tablet_bootstrap.cc:492] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:26.461675 719 leader_election.cc:304] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:26.462235 719 leader_election.cc:343] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:26.462425 719 leader_election.cc:304] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:26.462716 1561 raft_consensus.cc:2749] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:26.462947 1621 raft_consensus.cc:2749] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:26.461786 1174 ts_tablet_manager.cc:1403] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.187s user 0.012s sys 0.008s
W20260318 02:51:26.463199 719 leader_election.cc:343] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:26.463409 719 leader_election.cc:304] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:26.463995 1174 raft_consensus.cc:359] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:26.464433 1174 raft_consensus.cc:385] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.464576 1174 raft_consensus.cc:740] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.464840 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 6e9372f8871b473caa024512e936a6e5 (table default.Table_06e760051f3b473f99521e4da99f8288 [id=c532f0623efe4c3f8d9c90ae9c3d02c3]) successfully deleted
I20260318 02:51:26.464921 1174 consensus_queue.cc:260] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:26.460366 753 tablet_service.cc:1511] Processing CreateTablet for tablet 4df7d75e696a4aec981de3963c282b0d (DEFAULT_TABLE table=default.Table_5ed5970032fe44119b015cb6bbcd91d0 [id=5b9c6b78b2a94e55af6944b71dd51850]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.465436 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df7d75e696a4aec981de3963c282b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.465842 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f37ab96f13444fcbb5cfc3ad92d53c35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.465870 1176 tablet_replica.cc:333] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:26.464331 1621 raft_consensus.cc:2749] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:26.472826 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bb381f10d87414f9c1a99942216adc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.475410 452 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet bd077319b3c443849de087eb61da6a77 (table default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]). Expected version 1 got 0
I20260318 02:51:26.475734 1176 raft_consensus.cc:2243] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.475944 1176 raft_consensus.cc:2272] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:26.475972 452 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet bd077319b3c443849de087eb61da6a77 (table default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet bd077319b3c443849de087eb61da6a77 consensus state has no leader
I20260318 02:51:26.477252 1174 ts_tablet_manager.cc:1434] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260318 02:51:26.478586 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e6f40a5d3f14a779c26d73bf58f302b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.480386 1175 ts_tablet_manager.cc:1929] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.481670 1176 ts_tablet_manager.cc:1916] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.488088 1176 ts_tablet_manager.cc:1929] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.488859 1176 log.cc:1199] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/d4a54d0daa9f48a89b3f114367750826
I20260318 02:51:26.489136 452 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet bd077319b3c443849de087eb61da6a77 (table default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]). Expected version 1 got 0
I20260318 02:51:26.489377 1176 ts_tablet_manager.cc:1950] T d4a54d0daa9f48a89b3f114367750826 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:26.490639 1176 tablet_replica.cc:333] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:26.490653 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet d4a54d0daa9f48a89b3f114367750826 (table default.Table_88caf570ec6a4dfea94952fb5718c9c6 [id=5a3571f0765948588578d8e5185807a8]) successfully deleted
I20260318 02:51:26.490862 1176 raft_consensus.cc:2243] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.491036 1176 raft_consensus.cc:2272] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:26.491165 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 20c6f1790ed34581b7507ec63ec66718 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20c6f1790ed34581b7507ec63ec66718 already in progress: creating tablet
I20260318 02:51:26.491608 1176 ts_tablet_manager.cc:1916] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.493145 1174 tablet_bootstrap.cc:492] T a8b44b68094344f7a694ae4d985f56a6 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:26.501510 1174 tablet_bootstrap.cc:654] T a8b44b68094344f7a694ae4d985f56a6 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.504643 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4051c8e4d3d49829f9eac8e36baab2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.504762 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 88eeb101a1734271973cd7d4c756b356 (table default.Table_6725b184c1db4933ba6f28668b0031fa [id=847bc952406640b1b5a4c3e55a0ee1b2]) successfully deleted
W20260318 02:51:26.505059 441 catalog_manager.cc:4969] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 82858fd64d534d1abcad12bc4a93cda7 because the tablet was not found. No further retry: Not found: Tablet not found: 82858fd64d534d1abcad12bc4a93cda7
W20260318 02:51:26.506688 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet cc1543d0e1b1431baf6d2ab6a0484ca6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc1543d0e1b1431baf6d2ab6a0484ca6 already in progress: creating tablet
W20260318 02:51:26.506954 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 461adcc8bbd94d30b9b84d1010430829 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 461adcc8bbd94d30b9b84d1010430829 already in progress: creating tablet
W20260318 02:51:26.507150 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet b8973d8930ef4b65be7b4ff990bf9d72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8973d8930ef4b65be7b4ff990bf9d72 already in progress: creating tablet
I20260318 02:51:26.507974 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6a5db8c928804fa283f723cd481e8e8d" } new_table_name: "default.Table_d2f73355578d4f4391b25e72718cfa1e" modify_external_catalogs: true
I20260318 02:51:26.508181 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 5aeffffd34f047eeaa9a8a5100c7aad2 (DEFAULT_TABLE table=default.Table_281e478e833f4d13a05ddcf65d026047 [id=1622bac5bf0d47f1a91406ff11a0e116]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.508639 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 4df7d75e696a4aec981de3963c282b0d (DEFAULT_TABLE table=default.Table_5ed5970032fe44119b015cb6bbcd91d0 [id=5b9c6b78b2a94e55af6944b71dd51850]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.512317 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_11fb574b8c6a45fca4af288fcc47bfd8" } new_table_name: "default.Table_8e1825ed6ac14c60b72e23cbbce1b677" modify_external_catalogs: true
I20260318 02:51:26.514082 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_039d1d42521f4f9f8be161d0b97004f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:26.514513 764 tablet_service.cc:1511] Processing CreateTablet for tablet a384923c86ee42d6a47ed3f68e6811df (DEFAULT_TABLE table=default.Table_594a288e26f245c8a9c365f583bced74 [id=a653573522fe43da9c796fc1c7c638f9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:26.514688 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_039d1d42521f4f9f8be161d0b97004f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.515444 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a384923c86ee42d6a47ed3f68e6811df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.516129 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_176fa1820ca44b3cbdfad38228b9dc7b" } new_table_name: "default.Table_9e89e17e334a44b79f81c72c38ae6e68" modify_external_catalogs: true
I20260318 02:51:26.517359 757 tablet_service.cc:1511] Processing CreateTablet for tablet 82858fd64d534d1abcad12bc4a93cda7 (DEFAULT_TABLE table=default.Table_e81f3622048c415e977ce897e4edcacf [id=74f992023abb491eb564bdfd68b19b98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.517935 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82858fd64d534d1abcad12bc4a93cda7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.517917 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c0b6d8ff98e2450f8518f5f6a80c82fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:26.518451 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0b6d8ff98e2450f8518f5f6a80c82fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.519930 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1874597fd7ed4dfd86db402da16e53e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:26.520493 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1874597fd7ed4dfd86db402da16e53e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.522485 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f4cd103bfd1d46beb3655a4dc4c8c3b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:26.523104 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4cd103bfd1d46beb3655a4dc4c8c3b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.525434 1172 tablet_bootstrap.cc:492] T 3c283efbac08468c8c20f4caba90164c P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:26.525630 1172 ts_tablet_manager.cc:1403] T 3c283efbac08468c8c20f4caba90164c P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.255s user 0.029s sys 0.044s
I20260318 02:51:26.526480 1172 raft_consensus.cc:359] T 3c283efbac08468c8c20f4caba90164c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.526714 1172 raft_consensus.cc:385] T 3c283efbac08468c8c20f4caba90164c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.526795 1172 raft_consensus.cc:740] T 3c283efbac08468c8c20f4caba90164c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.527031 1172 consensus_queue.cc:260] T 3c283efbac08468c8c20f4caba90164c P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.527040 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_20b2dbf580454a4a993130bde0ae0265"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:26.527544 1172 ts_tablet_manager.cc:1434] T 3c283efbac08468c8c20f4caba90164c P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260318 02:51:26.527629 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20b2dbf580454a4a993130bde0ae0265 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.527933 1172 tablet_bootstrap.cc:492] T 97655cb5968b4c819273068818d5cab8 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:26.530258 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aeffffd34f047eeaa9a8a5100c7aad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.532871 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df7d75e696a4aec981de3963c282b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.533790 1176 ts_tablet_manager.cc:1929] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.533951 1176 log.cc:1199] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/677f33f9e4ad4859ab85692f7b7aad2a
I20260318 02:51:26.534281 1176 ts_tablet_manager.cc:1950] T 677f33f9e4ad4859ab85692f7b7aad2a P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:26.535503 1172 tablet_bootstrap.cc:654] T 97655cb5968b4c819273068818d5cab8 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.537931 753 tablet_service.cc:1511] Processing CreateTablet for tablet 5aeffffd34f047eeaa9a8a5100c7aad2 (DEFAULT_TABLE table=default.Table_281e478e833f4d13a05ddcf65d026047 [id=1622bac5bf0d47f1a91406ff11a0e116]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.538372 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aeffffd34f047eeaa9a8a5100c7aad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.545676 1176 tablet_replica.cc:333] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:26.545830 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 677f33f9e4ad4859ab85692f7b7aad2a (table default.Table_a61fc584a9fb41fa9d17ab0aef58582d [id=a1611aa744774532bf8c16d8cc701c49]) successfully deleted
I20260318 02:51:26.545888 1176 raft_consensus.cc:2243] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.546082 1176 raft_consensus.cc:2272] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.546581 1176 ts_tablet_manager.cc:1916] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.551658 1174 tablet_bootstrap.cc:492] T a8b44b68094344f7a694ae4d985f56a6 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:26.551878 1174 ts_tablet_manager.cc:1403] T a8b44b68094344f7a694ae4d985f56a6 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.059s user 0.001s sys 0.004s
I20260318 02:51:26.552664 1174 raft_consensus.cc:359] T a8b44b68094344f7a694ae4d985f56a6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.552964 1174 raft_consensus.cc:385] T a8b44b68094344f7a694ae4d985f56a6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.553110 1174 raft_consensus.cc:740] T a8b44b68094344f7a694ae4d985f56a6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.553426 1174 consensus_queue.cc:260] T a8b44b68094344f7a694ae4d985f56a6 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.556241 1174 ts_tablet_manager.cc:1434] T a8b44b68094344f7a694ae4d985f56a6 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260318 02:51:26.556595 1174 tablet_bootstrap.cc:492] T 71c518c87bdd4a63aa1016e8de6bafdc P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:26.558688 897 tablet_service.cc:1558] Processing DeleteTablet for tablet cc1543d0e1b1431baf6d2ab6a0484ca6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:26.559358 1174 tablet_bootstrap.cc:654] T 71c518c87bdd4a63aa1016e8de6bafdc P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.565806 901 tablet_service.cc:1558] Processing DeleteTablet for tablet b8973d8930ef4b65be7b4ff990bf9d72 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c89f413a26a43ef95c850d7c44f85b2) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:26.566010 896 tablet_service.cc:1511] Processing CreateTablet for tablet 20a492fdea6c44ba8439614b0dcc2ba6 (DEFAULT_TABLE table=default.Table_6a5db8c928804fa283f723cd481e8e8d [id=0bd115a0960941ff9d49b4566fe1c666]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.566452 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a492fdea6c44ba8439614b0dcc2ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.569612 1174 tablet_bootstrap.cc:492] T 71c518c87bdd4a63aa1016e8de6bafdc P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:26.569859 1174 ts_tablet_manager.cc:1403] T 71c518c87bdd4a63aa1016e8de6bafdc P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260318 02:51:26.569921 906 tablet_service.cc:1511] Processing CreateTablet for tablet 5aeffffd34f047eeaa9a8a5100c7aad2 (DEFAULT_TABLE table=default.Table_281e478e833f4d13a05ddcf65d026047 [id=1622bac5bf0d47f1a91406ff11a0e116]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.570356 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aeffffd34f047eeaa9a8a5100c7aad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.570842 1174 raft_consensus.cc:359] T 71c518c87bdd4a63aa1016e8de6bafdc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.571095 1174 raft_consensus.cc:385] T 71c518c87bdd4a63aa1016e8de6bafdc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.571235 1174 raft_consensus.cc:740] T 71c518c87bdd4a63aa1016e8de6bafdc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.571553 1174 consensus_queue.cc:260] T 71c518c87bdd4a63aa1016e8de6bafdc P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.573231 1174 ts_tablet_manager.cc:1434] T 71c518c87bdd4a63aa1016e8de6bafdc P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:26.573562 1174 tablet_bootstrap.cc:492] T fda9f1fe47e04688bde80ebe23494d08 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:26.571628 1176 ts_tablet_manager.cc:1929] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.574772 1176 log.cc:1199] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/62af8b953213412bb0c3bd1c68042ec9
I20260318 02:51:26.575227 1176 ts_tablet_manager.cc:1950] T 62af8b953213412bb0c3bd1c68042ec9 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:26.576437 1174 tablet_bootstrap.cc:654] T fda9f1fe47e04688bde80ebe23494d08 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.576460 891 tablet_service.cc:1511] Processing CreateTablet for tablet 4df7d75e696a4aec981de3963c282b0d (DEFAULT_TABLE table=default.Table_5ed5970032fe44119b015cb6bbcd91d0 [id=5b9c6b78b2a94e55af6944b71dd51850]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.577096 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df7d75e696a4aec981de3963c282b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.579975 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 62af8b953213412bb0c3bd1c68042ec9 (table default.Table_64fa6aaaa46242f3a737f4da65eb1947 [id=de39610433af488e9fc732cbb5dd7523]) successfully deleted
I20260318 02:51:26.580430 1176 tablet_replica.cc:333] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:26.584990 1176 raft_consensus.cc:2243] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.585415 1176 raft_consensus.cc:2272] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.586680 1176 ts_tablet_manager.cc:1916] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.598644 1176 ts_tablet_manager.cc:1929] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.601737 1176 log.cc:1199] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/00d953e1ae2f47fc8016a2f9a791141d
I20260318 02:51:26.602173 1176 ts_tablet_manager.cc:1950] T 00d953e1ae2f47fc8016a2f9a791141d P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:26.603168 1176 tablet_replica.cc:333] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:26.603375 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 00d953e1ae2f47fc8016a2f9a791141d (table default.Table_87b1b608a1414098af9c5136bf508ab7 [id=b3f661ab32bc4941805f8c4018d47435]) successfully deleted
I20260318 02:51:26.603438 1176 raft_consensus.cc:2243] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.603801 1176 raft_consensus.cc:2272] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.604377 1176 ts_tablet_manager.cc:1916] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.603598 1174 tablet_bootstrap.cc:492] T fda9f1fe47e04688bde80ebe23494d08 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:26.604909 1174 ts_tablet_manager.cc:1403] T fda9f1fe47e04688bde80ebe23494d08 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.024s
I20260318 02:51:26.605971 1174 raft_consensus.cc:359] T fda9f1fe47e04688bde80ebe23494d08 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.606241 1174 raft_consensus.cc:385] T fda9f1fe47e04688bde80ebe23494d08 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.606354 1174 raft_consensus.cc:740] T fda9f1fe47e04688bde80ebe23494d08 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.606658 1426 ts_manager.cc:194] Registered new tserver with Master: b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:26.606653 1174 consensus_queue.cc:260] T fda9f1fe47e04688bde80ebe23494d08 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.608248 1174 ts_tablet_manager.cc:1434] T fda9f1fe47e04688bde80ebe23494d08 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:26.608597 1174 tablet_bootstrap.cc:492] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:26.614727 1426 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6a903d876086423b8016d705b98895ad" instance_seqno: 1773802277965329) as {username='slave'} at 127.0.104.129:34411; Asking this server to re-register.
I20260318 02:51:26.614990 1173 tablet_bootstrap.cc:492] T 977b95a3442a405d90385cdb4d6dd5dd P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:26.618655 1176 ts_tablet_manager.cc:1929] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.619027 1174 tablet_bootstrap.cc:654] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.620115 831 heartbeater.cc:461] Registering TS with master...
I20260318 02:51:26.623536 1175 log.cc:1199] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/e61c374078854d589219dfa4c20e4222
I20260318 02:51:26.623595 1176 log.cc:1199] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/f447cab3445c451d8ef8746966cfcd42
I20260318 02:51:26.624002 1176 ts_tablet_manager.cc:1950] T f447cab3445c451d8ef8746966cfcd42 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:26.625087 1176 tablet_replica.cc:333] T a8b44b68094344f7a694ae4d985f56a6 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:26.625106 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet f447cab3445c451d8ef8746966cfcd42 (table default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]) successfully deleted
W20260318 02:51:26.626181 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet a0a6f4b34ff14714892ed9e9b3604dc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0a6f4b34ff14714892ed9e9b3604dc9 already in progress: creating tablet
I20260318 02:51:26.626324 1173 ts_tablet_manager.cc:1403] T 977b95a3442a405d90385cdb4d6dd5dd P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.657s user 0.007s sys 0.000s
I20260318 02:51:26.626981 1176 raft_consensus.cc:2243] T a8b44b68094344f7a694ae4d985f56a6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.627169 1176 raft_consensus.cc:2272] T a8b44b68094344f7a694ae4d985f56a6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.628978 1176 ts_tablet_manager.cc:1916] T a8b44b68094344f7a694ae4d985f56a6 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.633556 1175 ts_tablet_manager.cc:1950] T e61c374078854d589219dfa4c20e4222 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:26.634589 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 370) took 1070 ms. Trace:
I20260318 02:51:26.634788 1175 rpcz_store.cc:276] 0318 02:51:25.563602 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:25.563666 (+ 64us) service_pool.cc:225] Handling call
0318 02:51:26.322890 (+759224us) ts_tablet_manager.cc:1151] Deleting tablet e61c374078854d589219dfa4c20e4222
0318 02:51:26.322897 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:26.464581 (+141684us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:26.480249 (+ 15668us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:26.634480 (+154231us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":758974}
I20260318 02:51:26.637216 1174 tablet_bootstrap.cc:492] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:26.637377 1174 ts_tablet_manager.cc:1403] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.003s
I20260318 02:51:26.638171 1174 raft_consensus.cc:359] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:26.638361 1174 raft_consensus.cc:385] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.638445 1174 raft_consensus.cc:740] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.638659 1174 consensus_queue.cc:260] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:26.639199 1174 ts_tablet_manager.cc:1434] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:26.639477 1174 tablet_bootstrap.cc:492] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:26.642810 1173 raft_consensus.cc:359] T 977b95a3442a405d90385cdb4d6dd5dd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.643131 1174 tablet_bootstrap.cc:654] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.643136 1173 raft_consensus.cc:385] T 977b95a3442a405d90385cdb4d6dd5dd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.643276 1173 raft_consensus.cc:740] T 977b95a3442a405d90385cdb4d6dd5dd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.643553 1173 consensus_queue.cc:260] T 977b95a3442a405d90385cdb4d6dd5dd P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.644853 1176 ts_tablet_manager.cc:1929] T a8b44b68094344f7a694ae4d985f56a6 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.645336 1176 log.cc:1199] T a8b44b68094344f7a694ae4d985f56a6 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/a8b44b68094344f7a694ae4d985f56a6
I20260318 02:51:26.645464 1172 tablet_bootstrap.cc:492] T 97655cb5968b4c819273068818d5cab8 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:26.645678 1172 ts_tablet_manager.cc:1403] T 97655cb5968b4c819273068818d5cab8 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.118s user 0.005s sys 0.000s
I20260318 02:51:26.646314 1176 ts_tablet_manager.cc:1950] T a8b44b68094344f7a694ae4d985f56a6 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:26.646545 1172 raft_consensus.cc:359] T 97655cb5968b4c819273068818d5cab8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.646811 1172 raft_consensus.cc:385] T 97655cb5968b4c819273068818d5cab8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.646936 1172 raft_consensus.cc:740] T 97655cb5968b4c819273068818d5cab8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.647258 1172 consensus_queue.cc:260] T 97655cb5968b4c819273068818d5cab8 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.647837 1176 tablet_replica.cc:333] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:26.649111 1172 ts_tablet_manager.cc:1434] T 97655cb5968b4c819273068818d5cab8 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:26.649344 1176 raft_consensus.cc:2243] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.649459 1172 tablet_bootstrap.cc:492] T 323e4b1e9aee449f9402b1712b1444d9 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:26.649791 1426 ts_manager.cc:194] Registered new tserver with Master: 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:26.649811 1176 raft_consensus.cc:2272] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.650424 1176 ts_tablet_manager.cc:1916] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.651212 1172 tablet_bootstrap.cc:654] T 323e4b1e9aee449f9402b1712b1444d9 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:26.651269 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet e916c5419e3c457f98a47c6a1c6cdd56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e916c5419e3c457f98a47c6a1c6cdd56 already in progress: creating tablet
W20260318 02:51:26.651583 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f04f057571584d31b1821e690ae7c75c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f04f057571584d31b1821e690ae7c75c already in progress: creating tablet
I20260318 02:51:26.652287 1173 ts_tablet_manager.cc:1434] T 977b95a3442a405d90385cdb4d6dd5dd P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260318 02:51:26.652386 1175 tablet_replica.cc:333] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:26.654894 1175 raft_consensus.cc:2243] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:26.655278 1175 pending_rounds.cc:70] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18: Trying to abort 1 pending ops.
I20260318 02:51:26.655411 1175 pending_rounds.cc:77] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494164273172480 op_type: NO_OP noop_request { }
I20260318 02:51:26.655611 1175 raft_consensus.cc:2889] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:26.655776 1175 raft_consensus.cc:2272] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.656852 1175 ts_tablet_manager.cc:1916] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.657514 1173 tablet_bootstrap.cc:492] T 3c283efbac08468c8c20f4caba90164c P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:26.660081 1173 tablet_bootstrap.cc:654] T 3c283efbac08468c8c20f4caba90164c P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.666302 1175 ts_tablet_manager.cc:1929] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:26.668048 1174 tablet_bootstrap.cc:492] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:26.668292 1174 ts_tablet_manager.cc:1403] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.029s user 0.008s sys 0.002s
I20260318 02:51:26.669215 1174 raft_consensus.cc:359] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:26.669479 1174 raft_consensus.cc:385] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.669584 1174 raft_consensus.cc:740] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.669878 1174 consensus_queue.cc:260] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:26.671571 1174 ts_tablet_manager.cc:1434] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:26.671631 1172 tablet_bootstrap.cc:492] T 323e4b1e9aee449f9402b1712b1444d9 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:26.671869 1172 ts_tablet_manager.cc:1403] T 323e4b1e9aee449f9402b1712b1444d9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.001s
I20260318 02:51:26.671972 1174 tablet_bootstrap.cc:492] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:26.672822 1172 raft_consensus.cc:359] T 323e4b1e9aee449f9402b1712b1444d9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.673105 1172 raft_consensus.cc:385] T 323e4b1e9aee449f9402b1712b1444d9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.674993 1175 log.cc:1199] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/5aebb91ff6b0416fac2ef2d056ca897a
I20260318 02:51:26.675537 1175 ts_tablet_manager.cc:1950] T 5aebb91ff6b0416fac2ef2d056ca897a P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:26.675853 1174 tablet_bootstrap.cc:654] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.677794 1172 raft_consensus.cc:740] T 323e4b1e9aee449f9402b1712b1444d9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.678359 1172 consensus_queue.cc:260] T 323e4b1e9aee449f9402b1712b1444d9 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.680761 1176 ts_tablet_manager.cc:1929] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.680891 1176 log.cc:1199] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/5db76f996b094bf99b6c6fe33f02b9f3
I20260318 02:51:26.680819 1172 ts_tablet_manager.cc:1434] T 323e4b1e9aee449f9402b1712b1444d9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260318 02:51:26.681273 1172 tablet_bootstrap.cc:492] T e61c374078854d589219dfa4c20e4222 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:26.681718 1176 ts_tablet_manager.cc:1950] T 5db76f996b094bf99b6c6fe33f02b9f3 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:26.682924 1176 tablet_replica.cc:333] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:26.682861 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 5db76f996b094bf99b6c6fe33f02b9f3 (table default.Table_1e9e471c1715493487baf6ce6eab167a [id=a6f1506993614ec5904423ac309abf1a]) successfully deleted
W20260318 02:51:26.683320 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet abfdba1f21e44652b2bce62cd3e6681f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet abfdba1f21e44652b2bce62cd3e6681f already in progress: creating tablet
I20260318 02:51:26.683372 1176 raft_consensus.cc:2243] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.683739 1176 raft_consensus.cc:2272] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.684701 1176 ts_tablet_manager.cc:1916] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.688932 1175 tablet_replica.cc:333] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:26.689256 1175 raft_consensus.cc:2243] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:26.689554 1175 pending_rounds.cc:70] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18: Trying to abort 1 pending ops.
I20260318 02:51:26.690987 1172 tablet_bootstrap.cc:654] T e61c374078854d589219dfa4c20e4222 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.693660 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet e61c374078854d589219dfa4c20e4222 (table default.Table_347e676321aa483fa750cfa91235cbe7 [id=02ceb29568c548ffaf48bc6c5e78c929]) successfully deleted
I20260318 02:51:26.694588 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 813702e53eee4a54a7d693fd6e03bbbb
I20260318 02:51:26.693481 891 tablet_service.cc:1511] Processing CreateTablet for tablet 82858fd64d534d1abcad12bc4a93cda7 (DEFAULT_TABLE table=default.Table_e81f3622048c415e977ce897e4edcacf [id=74f992023abb491eb564bdfd68b19b98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.695300 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 813702e53eee4a54a7d693fd6e03bbbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.695564 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82858fd64d534d1abcad12bc4a93cda7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.698311 753 tablet_service.cc:1558] Processing DeleteTablet for tablet a8b44b68094344f7a694ae4d985f56a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.700937 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet e57dbb1276114cd6b7d26f7167b99f25
I20260318 02:51:26.701625 753 tablet_service.cc:1558] Processing DeleteTablet for tablet e57dbb1276114cd6b7d26f7167b99f25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.701607 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_998db7d1aec14ebb8599ab941d9e29f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:26.702059 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 5aebb91ff6b0416fac2ef2d056ca897a (table default.Table_764057148a0945d0a7a4f9e497808d92 [id=e91dc919c98843a7b31ed85f73ab5774]) successfully deleted
W20260318 02:51:26.703022 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 1b439fa2481a43c78d2c486d8711175f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b439fa2481a43c78d2c486d8711175f already in progress: creating tablet
W20260318 02:51:26.703326 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 20c6f1790ed34581b7507ec63ec66718 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20c6f1790ed34581b7507ec63ec66718 already in progress: creating tablet
W20260318 02:51:26.708997 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2adcc9f1ad69458c997475111bb787cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2adcc9f1ad69458c997475111bb787cf already in progress: creating tablet
W20260318 02:51:26.709335 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet a0a6f4b34ff14714892ed9e9b3604dc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0a6f4b34ff14714892ed9e9b3604dc9 already in progress: creating tablet
W20260318 02:51:26.709640 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet e916c5419e3c457f98a47c6a1c6cdd56 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e916c5419e3c457f98a47c6a1c6cdd56 already in progress: creating tablet
W20260318 02:51:26.702167 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_998db7d1aec14ebb8599ab941d9e29f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.712132 1174 tablet_bootstrap.cc:492] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:26.712293 1174 ts_tablet_manager.cc:1403] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.000s
I20260318 02:51:26.713115 1174 raft_consensus.cc:359] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.713291 1174 raft_consensus.cc:385] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.713378 1174 raft_consensus.cc:740] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.713616 1174 consensus_queue.cc:260] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.714135 1174 ts_tablet_manager.cc:1434] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:26.714440 1174 tablet_bootstrap.cc:492] T 2e16272bcf9c435a80b32ba9cba9c738 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:26.716109 1174 tablet_bootstrap.cc:654] T 2e16272bcf9c435a80b32ba9cba9c738 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.693925 906 tablet_service.cc:1511] Processing CreateTablet for tablet a384923c86ee42d6a47ed3f68e6811df (DEFAULT_TABLE table=default.Table_594a288e26f245c8a9c365f583bced74 [id=a653573522fe43da9c796fc1c7c638f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.721192 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a384923c86ee42d6a47ed3f68e6811df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.724622 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 813702e53eee4a54a7d693fd6e03bbbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:26.729385 896 tablet_service.cc:1558] Processing DeleteTablet for tablet e57dbb1276114cd6b7d26f7167b99f25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:26.730046 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 977b95a3442a405d90385cdb4d6dd5dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:26.730902 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20a492fdea6c44ba8439614b0dcc2ba6 consensus state has no leader
I20260318 02:51:26.732581 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a23a3971bb3546c6ad6966b77bf7a8ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:26.733219 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a23a3971bb3546c6ad6966b77bf7a8ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:26.734447 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 49afed40c7aa4f2d913daed8055a098e consensus state has no leader
I20260318 02:51:26.734714 450 master_service.cc:954] ReplaceTablet: received request to replace tablet 1ef3181adc0542229897369591a30465 from {username='slave'} at 127.0.0.1:47158
W20260318 02:51:26.735148 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a7ddc0807d742cea258f889390e2142 consensus state has no leader
I20260318 02:51:26.735407 455 master_service.cc:954] ReplaceTablet: received request to replace tablet 7c0d87304c41481299f1e2ddfdfcfdec from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:26.735991 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_608fb034b49c4aadb49a3dd915aee472" } new_table_name: "default.Table_d7033fee66fc4e33b922723a18a78236" modify_external_catalogs: true
I20260318 02:51:26.737468 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_cfd83086efd94aeeac453573d0c9350b" } modify_external_catalogs: true
I20260318 02:51:26.738201 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_cfd83086efd94aeeac453573d0c9350b" } modify_external_catalogs: true
I20260318 02:51:26.738999 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b361769933b047a094f2220b0eb496c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:26.739493 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b361769933b047a094f2220b0eb496c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.740955 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bd0d5769f59b4b0d87629167dcf22094" } new_table_name: "default.Table_bd753ce876de4105aa926dbfd9211391" modify_external_catalogs: true
I20260318 02:51:26.749002 1175 pending_rounds.cc:77] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494163335901184 op_type: NO_OP noop_request { }
I20260318 02:51:26.749289 1175 raft_consensus.cc:2889] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:26.749461 1175 raft_consensus.cc:2272] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.750946 1173 tablet_bootstrap.cc:492] T 3c283efbac08468c8c20f4caba90164c P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:26.750998 1175 ts_tablet_manager.cc:1916] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.751159 1173 ts_tablet_manager.cc:1403] T 3c283efbac08468c8c20f4caba90164c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.094s user 0.004s sys 0.000s
I20260318 02:51:26.758008 1173 raft_consensus.cc:359] T 3c283efbac08468c8c20f4caba90164c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.758325 1173 raft_consensus.cc:385] T 3c283efbac08468c8c20f4caba90164c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.758448 1173 raft_consensus.cc:740] T 3c283efbac08468c8c20f4caba90164c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.758751 1173 consensus_queue.cc:260] T 3c283efbac08468c8c20f4caba90164c P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.759927 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_28a12ac7769744d1ba2c07c2b335e41e" } modify_external_catalogs: true
I20260318 02:51:26.760120 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_28a12ac7769744d1ba2c07c2b335e41e" } modify_external_catalogs: true
I20260318 02:51:26.760826 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_31b24fd18b9b40ab89543ca570eac050"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:26.761369 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31b24fd18b9b40ab89543ca570eac050 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.761507 1173 ts_tablet_manager.cc:1434] T 3c283efbac08468c8c20f4caba90164c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260318 02:51:26.761828 1173 tablet_bootstrap.cc:492] T 97655cb5968b4c819273068818d5cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:26.694342 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 82858fd64d534d1abcad12bc4a93cda7 (DEFAULT_TABLE table=default.Table_e81f3622048c415e977ce897e4edcacf [id=74f992023abb491eb564bdfd68b19b98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.767637 1176 ts_tablet_manager.cc:1929] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.767720 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82858fd64d534d1abcad12bc4a93cda7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.767874 1176 log.cc:1199] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/cf27c8d69f41431e9fab12e605e15b9c
I20260318 02:51:26.695081 1042 tablet_service.cc:1511] Processing CreateTablet for tablet a384923c86ee42d6a47ed3f68e6811df (DEFAULT_TABLE table=default.Table_594a288e26f245c8a9c365f583bced74 [id=a653573522fe43da9c796fc1c7c638f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.724998 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 813702e53eee4a54a7d693fd6e03bbbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:26.726701 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet e57dbb1276114cd6b7d26f7167b99f25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:26.775043 1176 ts_tablet_manager.cc:1950] T cf27c8d69f41431e9fab12e605e15b9c P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:26.726869 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c283efbac08468c8c20f4caba90164c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:26.727051 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 323e4b1e9aee449f9402b1712b1444d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 8c20810ad3354126bf49bbeeb6edb098) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:26.727188 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 97655cb5968b4c819273068818d5cab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:26.775862 1184 tablet_replica.cc:333] T 3c283efbac08468c8c20f4caba90164c P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:26.776055 1184 raft_consensus.cc:2243] T 3c283efbac08468c8c20f4caba90164c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.776242 1184 raft_consensus.cc:2272] T 3c283efbac08468c8c20f4caba90164c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:26.776757 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9451d57fad72413c81443623c7995d4e consensus state has no leader
I20260318 02:51:26.777073 1184 ts_tablet_manager.cc:1916] T 3c283efbac08468c8c20f4caba90164c P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:26.777179 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d1a67e637d934c0f99c00d04fb26df0d consensus state has no leader
I20260318 02:51:26.777956 454 master_service.cc:954] ReplaceTablet: received request to replace tablet 96a6d1808417419dac0d2b2e80c5ca22 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:26.779318 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet cf27c8d69f41431e9fab12e605e15b9c (table default.Table_1d2a493334714a809ca348d380f97577 [id=313b847f9c15442198f034c266da8078]) successfully deleted
W20260318 02:51:26.779589 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 461adcc8bbd94d30b9b84d1010430829 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 461adcc8bbd94d30b9b84d1010430829 already in progress: creating tablet
W20260318 02:51:26.779599 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 813702e53eee4a54a7d693fd6e03bbbb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 813702e53eee4a54a7d693fd6e03bbbb already in progress: creating tablet
W20260318 02:51:26.780066 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 82858fd64d534d1abcad12bc4a93cda7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82858fd64d534d1abcad12bc4a93cda7 already in progress: creating tablet
W20260318 02:51:26.780296 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet cc1543d0e1b1431baf6d2ab6a0484ca6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc1543d0e1b1431baf6d2ab6a0484ca6 already in progress: creating tablet
I20260318 02:51:26.780450 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_98ff851e3ed0463cb3ef7f1907fa7711" } modify_external_catalogs: true
I20260318 02:51:26.784014 1184 ts_tablet_manager.cc:1929] T 3c283efbac08468c8c20f4caba90164c P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.784130 1184 log.cc:1199] T 3c283efbac08468c8c20f4caba90164c P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/3c283efbac08468c8c20f4caba90164c
I20260318 02:51:26.784471 1184 ts_tablet_manager.cc:1950] T 3c283efbac08468c8c20f4caba90164c P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:26.786506 906 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c283efbac08468c8c20f4caba90164c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:26.788065 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_98ff851e3ed0463cb3ef7f1907fa7711" } modify_external_catalogs: true
I20260318 02:51:26.788300 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a384923c86ee42d6a47ed3f68e6811df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.788816 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8b91091dce7d43b9b2abf2ef5262b12c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:26.789227 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet e57dbb1276114cd6b7d26f7167b99f25 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e57dbb1276114cd6b7d26f7167b99f25 already in progress: creating tablet
W20260318 02:51:26.789381 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b91091dce7d43b9b2abf2ef5262b12c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.789510 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 3c283efbac08468c8c20f4caba90164c (table default.Table_376ed96eff2f4d13a0872f0984da4828 [id=7ac79bf8374d4166b204274f50a1db67]) successfully deleted
I20260318 02:51:26.792888 1184 tablet_replica.cc:333] T 323e4b1e9aee449f9402b1712b1444d9 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:26.793090 1184 raft_consensus.cc:2243] T 323e4b1e9aee449f9402b1712b1444d9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.793265 1184 raft_consensus.cc:2272] T 323e4b1e9aee449f9402b1712b1444d9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.794824 1184 ts_tablet_manager.cc:1916] T 323e4b1e9aee449f9402b1712b1444d9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:26.796399 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet b8973d8930ef4b65be7b4ff990bf9d72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8973d8930ef4b65be7b4ff990bf9d72 already in progress: creating tablet
W20260318 02:51:26.796661 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 813702e53eee4a54a7d693fd6e03bbbb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 813702e53eee4a54a7d693fd6e03bbbb already in progress: creating tablet
W20260318 02:51:26.796936 443 catalog_manager.cc:4969] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet a8b44b68094344f7a694ae4d985f56a6 because the tablet was not found. No further retry: Not found: Tablet not found: a8b44b68094344f7a694ae4d985f56a6
W20260318 02:51:26.797143 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet e57dbb1276114cd6b7d26f7167b99f25 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e57dbb1276114cd6b7d26f7167b99f25 already in progress: creating tablet
I20260318 02:51:26.798837 1174 tablet_bootstrap.cc:492] T 2e16272bcf9c435a80b32ba9cba9c738 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:26.799033 1174 ts_tablet_manager.cc:1403] T 2e16272bcf9c435a80b32ba9cba9c738 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.085s user 0.010s sys 0.022s
I20260318 02:51:26.799823 1174 raft_consensus.cc:359] T 2e16272bcf9c435a80b32ba9cba9c738 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.800030 1174 raft_consensus.cc:385] T 2e16272bcf9c435a80b32ba9cba9c738 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.800104 1174 raft_consensus.cc:740] T 2e16272bcf9c435a80b32ba9cba9c738 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.800326 1174 consensus_queue.cc:260] T 2e16272bcf9c435a80b32ba9cba9c738 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.802744 453 master_service.cc:954] ReplaceTablet: received request to replace tablet b230018a95a54ababfe5ecf2ca1e2e49 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:26.803108 1174 ts_tablet_manager.cc:1434] T 2e16272bcf9c435a80b32ba9cba9c738 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260318 02:51:26.803411 1174 tablet_bootstrap.cc:492] T a4f891043b7d468da3e808980690354d P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:26.806677 1173 tablet_bootstrap.cc:654] T 97655cb5968b4c819273068818d5cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.807572 1174 tablet_bootstrap.cc:654] T a4f891043b7d468da3e808980690354d P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.811039 451 master_service.cc:954] ReplaceTablet: received request to replace tablet 547762347d7843e989e55e0449ad9fcb from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:25.898612 1449 rpcz_store.cc:276] 0318 02:51:24.168864 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:24.168922 (+ 58us) service_pool.cc:225] Handling call
0318 02:51:24.178224 (+ 9302us) raft_consensus.cc:1471] Updating replica for 371 ops
0318 02:51:24.368283 (+190059us) raft_consensus.cc:1534] Early marking committed up to index 0
0318 02:51:24.368293 (+ 10us) raft_consensus.cc:1539] Triggering prepare for 371 ops
0318 02:51:24.380314 (+ 12021us) write_op.cc:270] Start()
0318 02:51:24.380389 (+ 75us) write_op.cc:276] Timestamp: P: 1773802279147198 usec, L: 0
0318 02:51:24.416267 (+ 35878us) write_op.cc:270] Start()
0318 02:51:24.416308 (+ 41us) write_op.cc:276] Timestamp: P: 1773802279147858 usec, L: 0
0318 02:51:24.416589 (+ 281us) write_op.cc:270] Start()
0318 02:51:24.416638 (+ 49us) write_op.cc:276] Timestamp: P: 1773802279149911 usec, L: 0
0318 02:51:24.416942 (+ 304us) write_op.cc:270] Start()
0318 02:51:24.416965 (+ 23us) write_op.cc:276] Timestamp: P: 1773802279150504 usec, L: 0
0318 02:51:24.417168 (+ 203us) write_op.cc:270] Start()
0318 02:51:24.417190 (+ 22us) write_op.cc:276] Timestamp: P: 1773802279151597 usec, L: 0
0318 02:51:24.417331 (+ 141us) write_op.cc:270] Start()
0318 02:51:24.417351 (+ 20us) write_op.cc:276] Timestamp: P: 1773802279152503 usec, L: 0
0318 02:51:24.417499 (+ 148us) write_op.cc:270] Start()
0318 02:51:24.417550 (+ 51us) write_op.cc:276] Timestamp: P: 1773802279153349 usec, L: 0
0318 02:51:24.417716 (+ 166us) write_op.cc:270] Start()
0318 02:51:24.417735 (+ 19us) write_op.cc:276] Timestamp: P: 1773802279154139 usec, L: 0
0318 02:51:24.417874 (+ 139us) write_op.cc:270] Start()
0318 02:51:24.417901 (+ 27us) write_op.cc:276] Timestamp: P: 1773802279154540 usec, L: 0
0318 02:51:24.418035 (+ 134us) write_op.cc:270] Start()
0318 02:51:24.418054 (+ 19us) write_op.cc:276] Timestamp: P: 1773802279154922 usec, L: 0
0318 02:51:24.418221 (+ 167us) write_op.cc:270] Start()
0318 02:51:24.418241 (+ 20us) write_op.cc:276] Timestamp: P: 1773802279155350 usec, L: 0
0318 02:51:24.418376 (+ 135us) write_op.cc:270] Start()
0318 02:51:24.418395 (+ 19us) write_op.cc:276] Timestamp: P: 1773802279156719 usec, L: 0
0318 02:51:24.418534 (+ 139us) write_op.cc:270] Start()
0318 02:51:24.418553 (+ 19us) write_op.cc:276] Timestamp: P: 1773802279163742 usec, L: 0
0318 02:51:24.418687 (+ 134us) write_op.cc:270] Start()
0318 02:51:24.418706 (+ 19us) write_op.cc:276] Timestamp: P: 1773802279164359 usec, L: 0
0318 02:51:24.418846 (+ 140us) write_op.cc:270] Start()
0318 02:51:24.418867 (+ 21us) write_op.cc:276] Timestamp: P: 1773802279201773 usec, L: 0
0318 02:51:24.418989 (+ 122us) write_op.cc:270] Start()
0318 02:51:24.419007 (+ 18us) write_op.cc:276] Timestamp: P: 1773802279260761 usec, L: 0
0318 02:51:24.419176 (+ 169us) write_op.cc:270] Start()
0318 02:51:24.419203 (+ 27us) write_op.cc:276] Timestamp: P: 1773802279270364 usec, L: 0
0318 02:51:24.419344 (+ 141us) write_op.cc:270] Start()
0318 02:51:24.419365 (+ 21us) write_op.cc:276] Timestamp: P: 1773802279286718 usec, L: 0
0318 02:51:24.419510 (+ 145us) write_op.cc:270] Start()
0318 02:51:24.419531 (+ 21us) write_op.cc:276] Timestamp: P: 1773802279301006 usec, L: 0
0318 02:51:24.419688 (+ 157us) write_op.cc:270] Start()
0318 02:51:24.419706 (+ 18us) write_op.cc:276] Timestamp: P: 1773802279322140 usec, L: 0
0318 02:51:24.419837 (+ 131us) write_op.cc:270] Start()
0318 02:51:24.419856 (+ 19us) write_op.cc:276] Timestamp: P: 1773802279326966 usec, L: 0
0318 02:51:24.419968 (+ 112us) write_op.cc:270] Start()
0318 02:51:24.419993 (+ 25us) write_op.cc:276] Timestamp: P: 1773802279329230 usec, L: 0
0318 02:51:24.420140 (+ 147us) write_op.cc:270] Start()
0318 02:51:24.420159 (+ 19us) write_op.cc:276] Timestamp: P: 1773802279331187 usec, L: 0
0318 02:51:24.431176 (+ 11017us) write_op.cc:270] Start()
0318 02:51:24.431220 (+ 44us) write_op.cc:276] Timestamp: P: 1773802279339884 usec, L: 0
0318 02:51:24.431454 (+ 234us) write_op.cc:270] Start()
0318 02:51:24.432751 (+ 1297us) write_op.cc:276] Timestamp: P: 1773802279344807 usec, L: 0
0318 02:51:24.432964 (+ 213us) write_op.cc:270] Start()
0318 02:51:24.433004 (+ 40us) write_op.cc:276] Timestamp: P: 1773802279346190 usec, L: 0
0318 02:51:24.433145 (+ 141us) write_op.cc:270] Start()
0318 02:51:24.433166 (+ 21us) write_op.cc:276] Timestamp: P: 1773802279358135 usec, L: 0
0318 02:51:24.434832 (+ 1666us) write_op.cc:270] Start()
0318 02:51:24.434867 (+ 35us) write_op.cc:276] Timestamp: P: 1773802279385247 usec, L: 0
0318 02:51:24.435072 (+ 205us) write_op.cc:270] Start()
0318 02:51:24.435093 (+ 21us) write_op.cc:276] Timestamp: P: 1773802279386438 usec, L: 0
0318 02:51:24.435217 (+ 124us) write_op.cc:270] Start()
0318 02:51:24.435237 (+ 20us) write_op.cc:276] Timestamp: P: 1773802279387244 usec, L: 0
0318 02:51:24.435359 (+ 122us) write_op.cc:270] Start()
0318 02:51:24.435377 (+ 18us) write_op.cc:276] Timestamp: P: 1773802279388026 usec, L: 0
0318 02:51:24.435509 (+ 132us) write_op.cc:270] Start()
0318 02:51:24.435527 (+ 18us) write_op.cc:276] Timestamp: P: 1773802279400451 usec, L: 0
0318 02:51:24.435744 (+ 217us) write_op.cc:270] Start()
0318 02:51:24.435767 (+ 23us) write_op.cc:276] Timestamp: P: 1773802279404797 usec, L: 0
0318 02:51:24.435901 (+ 134us) write_op.cc:270] Start()
0318 02:51:24.435929 (+ 28us) write_op.cc:276] Timestamp: P: 1773802279413569 usec, L: 0
0318 02:51:24.436058 (+ 129us) write_op.cc:270] Start()
0318 02:51:24.436076 (+ 18us) write_op.cc:276] Timestamp: P: 1773802279416112 usec, L: 0
0318 02:51:24.436275 (+ 199us) write_op.cc:270] Start()
0318 02:51:24.436298 (+ 23us) write_op.cc:276] Timestamp: P: 1773802279419122 usec, L: 0
0318 02:51:24.436452 (+ 154us) write_op.cc:270] Start()
0318 02:51:24.436493 (+ 41us) write_op.cc:276] Timestamp: P: 1773802279427964 usec, L: 0
0318 02:51:24.437635 (+ 1142us) write_op.cc:270] Start()
0318 02:51:24.437661 (+ 26us) write_op.cc:276] Timestamp: P: 1773802279428635 usec, L: 0
0318 02:51:24.437818 (+ 157us) write_op.cc:270] Start()
0318 02:51:24.437842 (+ 24us) write_op.cc:276] Timestamp: P: 1773802279430160 usec, L: 0
0318 02:51:24.437973 (+ 131us) write_op.cc:270] Start()
0318 02:51:24.437996 (+ 23us) write_op.cc:276] Timestamp: P: 1773802279436444 usec, L: 0
0318 02:51:24.438121 (+ 125us) write_op.cc:270] Start()
0318 02:51:24.438137 (+ 16us) write_op.cc:276] Timestamp: P: 1773802279460900 usec, L: 0
0318 02:51:24.438268 (+ 131us) write_op.cc:270] Start()
0318 02:51:24.438286 (+ 18us) write_op.cc:276] Timestamp: P: 1773802279473558 usec, L: 0
0318 02:51:24.438403 (+ 117us) write_op.cc:270] Start()
0318 02:51:24.438422 (+ 19us) write_op.cc:276] Timestamp: P: 1773802279493595 usec, L: 0
0318 02:51:24.438556 (+ 134us) write_op.cc:270] Start()
0318 02:51:24.438577 (+ 21us) write_op.cc:276] Timestamp: P: 1773802279520951 usec, L: 0
0318 02:51:24.438703 (+ 126us) write_op.cc:270] Start()
0318 02:51:24.438722 (+ 19us) write_op.cc:276] Timestamp: P: 1773802279570638 usec, L: 0
0318 02:51:24.438868 (+ 146us) write_op.cc:270] Start()
0318 02:51:24.438889 (+ 21us) write_op.cc:276] Timestamp: P: 1773802279598048 usec, L: 0
0318 02:51:24.439108 (+ 219us) write_op.cc:270] Start()
0318 02:51:24.439130 (+ 22us) write_op.cc:276] Timestamp: P: 1773802279603559 usec, L: 0
0318 02:51:24.439365 (+ 235us) write_op.cc:270] Start()
0318 02:51:24.439388 (+ 23us) write_op.cc:276] Timestamp: P: 1773802279654406 usec, L: 0
0318 02:51:24.439560 (+ 172us) write_op.cc:270] Start()
0318 02:51:24.439581 (+ 21us) write_op.cc:276] Timestamp: P: 1773802279655181 usec, L: 0
0318 02:51:24.566580 (+126999us) write_op.cc:270] Start()
0318 02:51:24.566629 (+ 49us) write_op.cc:276] Timestamp: P: 1773802279667238 usec, L: 0
0318 02:51:24.569365 (+ 2736us) write_op.cc:270] Start()
0318 02:51:24.569515 (+ 150us) write_op.cc:276] Timestamp: P: 1773802279668563 usec, L: 0
0318 02:51:24.570088 (+ 573us) write_op.cc:270] Start()
0318 02:51:24.570116 (+ 28us) write_op.cc:276] Timestamp: P: 1773802279669713 usec, L: 0
0318 02:51:24.570253 (+ 137us) write_op.cc:270] Start()
0318 02:51:24.570274 (+ 21us) write_op.cc:276] Timestamp: P: 1773802279670688 usec, L: 0
0318 02:51:24.570380 (+ 106us) write_op.cc:270] Start()
0318 02:51:24.570397 (+ 17us) write_op.cc:276] Timestamp: P: 1773802279671592 usec, L: 0
0318 02:51:24.573453 (+ 3056us) write_op.cc:270] Start()
0318 02:51:24.573486 (+ 33us) write_op.cc:276] Timestamp: P: 1773802279674026 usec, L: 0
0318 02:51:24.573622 (+ 136us) write_op.cc:270] Start()
0318 02:51:24.573640 (+ 18us) write_op.cc:276] Timestamp: P: 1773802279675004 usec, L: 0
0318 02:51:24.573741 (+ 101us) write_op.cc:270] Start()
0318 02:51:24.573756 (+ 15us) write_op.cc:276] Timestamp: P: 1773802279676576 usec, L: 0
0318 02:51:24.573858 (+ 102us) write_op.cc:270] Start()
0318 02:51:24.573877 (+ 19us) write_op.cc:276] Timestamp: P: 1773802279686061 usec, L: 0
0318 02:51:24.573987 (+ 110us) write_op.cc:270] Start()
0318 02:51:24.574004 (+ 17us) write_op.cc:276] Timestamp: P: 1773802279694393 usec, L: 0
0318 02:51:24.574115 (+ 111us) write_op.cc:270] Start()
0318 02:51:24.574154 (+ 39us) write_op.cc:276] Timestamp: P: 1773802279695044 usec, L: 0
0318 02:51:24.574271 (+ 117us) write_op.cc:270] Start()
0318 02:51:24.574287 (+ 16us) write_op.cc:276] Timestamp: P: 1773802279719498 usec, L: 0
0318 02:51:24.574407 (+ 120us) write_op.cc:270] Start()
0318 02:51:24.574423 (+ 16us) write_op.cc:276] Timestamp: P: 1773802279736838 usec, L: 0
0318 02:51:24.574547 (+ 124us) write_op.cc:270] Start()
0318 02:51:24.574567 (+ 20us) write_op.cc:276] Timestamp: P: 1773802279799365 usec, L: 0
0318 02:51:24.574701 (+ 134us) write_op.cc:270] Start()
0318 02:51:24.574718 (+ 17us) write_op.cc:276] Timestamp: P: 1773802279820310 usec, L: 0
0318 02:51:24.574836 (+ 118us) write_op.cc:270] Start()
0318 02:51:24.574854 (+ 18us) write_op.cc:276] Timestamp: P: 1773802279820998 usec, L: 0
0318 02:51:24.574970 (+ 116us) write_op.cc:270] Start()
0318 02:51:24.574988 (+ 18us) write_op.cc:276] Timestamp: P: 1773802279821558 usec, L: 0
0318 02:51:24.575104 (+ 116us) write_op.cc:270] Start()
0318 02:51:24.575122 (+ 18us) write_op.cc:276] Timestamp: P: 1773802279872972 usec, L: 0
0318 02:51:24.575250 (+ 128us) write_op.cc:270] Start()
0318 02:51:24.575267 (+ 17us) write_op.cc:276] Timestamp: P: 1773802279904438 usec, L: 0
0318 02:51:24.575384 (+ 117us) write_op.cc:270] Start()
0318 02:51:24.575402 (+ 18us) write_op.cc:276] Timestamp: P: 1773802279906552 usec, L: 0
0318 02:51:24.575523 (+ 121us) write_op.cc:270] Start()
0318 02:51:24.575541 (+ 18us) write_op.cc:276] Timestamp: P: 1773802279911112 usec, L: 0
0318 02:51:24.575653 (+ 112us) write_op.cc:270] Start()
0318 02:51:24.575670 (+ 17us) write_op.cc:276] Timestamp: P: 1773802279945046 usec, L: 0
0318 02:51:24.575776 (+ 106us) write_op.cc:270] Start()
0318 02:51:24.575792 (+ 16us) write_op.cc:276] Timestamp: P: 1773802279946686 usec, L: 0
0318 02:51:24.590863 (+ 15071us) write_op.cc:270] Start()
0318 02:51:24.590906 (+ 43us) write_op.cc:276] Timestamp: P: 1773802279947968 usec, L: 0
0318 02:51:24.591137 (+ 231us) write_op.cc:270] Start()
0318 02:51:24.591163 (+ 26us) write_op.cc:276] Timestamp: P: 1773802279951097 usec, L: 0
0318 02:51:24.592009 (+ 846us) write_op.cc:270] Start()
0318 02:51:24.592040 (+ 31us) write_op.cc:276] Timestamp: P: 1773802279963962 usec, L: 0
0318 02:51:24.592356 (+ 316us) write_op.cc:270] Start()
0318 02:51:24.592387 (+ 31us) write_op.cc:276] Timestamp: P: 1773802279965107 usec, L: 0
0318 02:51:24.592557 (+ 170us) write_op.cc:270] Start()
0318 02:51:24.592580 (+ 23us) write_op.cc:276] Timestamp: P: 1773802279965721 usec, L: 0
0318 02:51:24.592761 (+ 181us) write_op.cc:270] Start()
0318 02:51:24.592784 (+ 23us) write_op.cc:276] Timestamp: P: 1773802279966690 usec, L: 0
0318 02:51:24.592906 (+ 122us) write_op.cc:270] Start()
0318 02:51:24.592943 (+ 37us) write_op.cc:276] Timestamp: P: 1773802279967365 usec, L: 0
0318 02:51:24.593102 (+ 159us) write_op.cc:270] Start()
0318 02:51:24.593123 (+ 21us) write_op.cc:276] Timestamp: P: 1773802280034928 usec, L: 0
0318 02:51:24.593261 (+ 138us) write_op.cc:270] Start()
0318 02:51:24.593280 (+ 19us) write_op.cc:276] Timestamp: P: 1773802280053274 usec, L: 0
0318 02:51:24.593414 (+ 134us) write_op.cc:270] Start()
0318 02:51:24.593436 (+ 22us) write_op.cc:276] Timestamp: P: 1773802280054008 usec, L: 0
0318 02:51:24.593564 (+ 128us) write_op.cc:270] Start()
0318 02:51:24.593584 (+ 20us) write_op.cc:276] Timestamp: P: 1773802280061597 usec, L: 0
0318 02:51:24.593721 (+ 137us) write_op.cc:270] Start()
0318 02:51:24.593740 (+ 19us) write_op.cc:276] Timestamp: P: 1773802280062221 usec, L: 0
0318 02:51:24.593852 (+ 112us) write_op.cc:270] Start()
0318 02:51:24.593869 (+ 17us) write_op.cc:276] Timestamp: P: 1773802280062754 usec, L: 0
0318 02:51:24.593983 (+ 114us) write_op.cc:270] Start()
0318 02:51:24.594000 (+ 17us) write_op.cc:276] Timestamp: P: 1773802280063282 usec, L: 0
0318 02:51:24.594128 (+ 128us) write_op.cc:270] Start()
0318 02:51:24.594146 (+ 18us) write_op.cc:276] Timestamp: P: 1773802280100194 usec, L: 0
0318 02:51:24.594317 (+ 171us) write_op.cc:270] Start()
0318 02:51:24.594336 (+ 19us) write_op.cc:276] Timestamp: P: 1773802280100919 usec, L: 0
0318 02:51:24.594455 (+ 119us) write_op.cc:270] Start()
0318 02:51:24.594473 (+ 18us) write_op.cc:276] Timestamp: P: 1773802280116375 usec, L: 0
0318 02:51:24.594591 (+ 118us) write_op.cc:270] Start()
0318 02:51:24.594609 (+ 18us) write_op.cc:276] Timestamp: P: 1773802280124637 usec, L: 0
0318 02:51:24.594737 (+ 128us) write_op.cc:270] Start()
0318 02:51:24.594756 (+ 19us) write_op.cc:276] Timestamp: P: 1773802280138056 usec, L: 0
0318 02:51:24.594879 (+ 123us) write_op.cc:270] Start()
0318 02:51:24.594898 (+ 19us) write_op.cc:276] Timestamp: P: 1773802280154464 usec, L: 0
0318 02:51:24.595821 (+ 923us) write_op.cc:270] Start()
0318 02:51:24.595846 (+ 25us) write_op.cc:276] Timestamp: P: 1773802280156211 usec, L: 0
0318 02:51:24.596098 (+ 252us) write_op.cc:270] Start()
0318 02:51:24.596120 (+ 22us) write_op.cc:276] Timestamp: P: 1773802280167372 usec, L: 0
0318 02:51:24.596276 (+ 156us) write_op.cc:270] Start()
0318 02:51:24.596302 (+ 26us) write_op.cc:276] Timestamp: P: 1773802280181220 usec, L: 0
0318 02:51:24.596738 (+ 436us) write_op.cc:270] Start()
0318 02:51:24.596769 (+ 31us) write_op.cc:276] Timestamp: P: 1773802280185637 usec, L: 0
0318 02:51:24.597066 (+ 297us) write_op.cc:270] Start()
0318 02:51:24.597343 (+ 277us) write_op.cc:276] Timestamp: P: 1773802280211398 usec, L: 0
0318 02:51:24.597625 (+ 282us) write_op.cc:270] Start()
0318 02:51:24.597650 (+ 25us) write_op.cc:276] Timestamp: P: 1773802280212152 usec, L: 0
0318 02:51:24.601571 (+ 3921us) write_op.cc:270] Start()
0318 02:51:24.601607 (+ 36us) write_op.cc:276] Timestamp: P: 1773802280222612 usec, L: 0
0318 02:51:24.601820 (+ 213us) write_op.cc:270] Start()
0318 02:51:24.601847 (+ 27us) write_op.cc:276] Timestamp: P: 1773802280233985 usec, L: 0
0318 02:51:24.601978 (+ 131us) write_op.cc:270] Start()
0318 02:51:24.601997 (+ 19us) write_op.cc:276] Timestamp: P: 1773802280246599 usec, L: 0
0318 02:51:24.602130 (+ 133us) write_op.cc:270] Start()
0318 02:51:24.602155 (+ 25us) write_op.cc:276] Timestamp: P: 1773802280264236 usec, L: 0
0318 02:51:24.602299 (+ 144us) write_op.cc:270] Start()
0318 02:51:24.602319 (+ 20us) write_op.cc:276] Timestamp: P: 1773802280278877 usec, L: 0
0318 02:51:24.602437 (+ 118us) write_op.cc:270] Start()
0318 02:51:24.602457 (+ 20us) write_op.cc:276] Timestamp: P: 1773802280292573 usec, L: 0
0318 02:51:24.602614 (+ 157us) write_op.cc:270] Start()
0318 02:51:24.602637 (+ 23us) write_op.cc:276] Timestamp: P: 1773802280319753 usec, L: 0
0318 02:51:24.602773 (+ 136us) write_op.cc:270] Start()
0318 02:51:24.602795 (+ 22us) write_op.cc:276] Timestamp: P: 1773802280352480 usec, L: 0
0318 02:51:24.602926 (+ 131us) write_op.cc:270] Start()
0318 02:51:24.602952 (+ 26us) write_op.cc:276] Timestamp: P: 1773802280355870 usec, L: 0
0318 02:51:24.637391 (+ 34439us) write_op.cc:270] Start()
0318 02:51:24.637438 (+ 47us) write_op.cc:276] Timestamp: P: 1773802280356853 usec, L: 0
0318 02:51:24.638352 (+ 914us) write_op.cc:270] Start()
0318 02:51:24.638394 (+ 42us) write_op.cc:276] Timestamp: P: 1773802280358594 usec, L: 0
0318 02:51:24.638605 (+ 211us) write_op.cc:270] Start()
0318 02:51:24.638628 (+ 23us) write_op.cc:276] Timestamp: P: 1773802280373930 usec, L: 0
0318 02:51:24.638767 (+ 139us) write_op.cc:270] Start()
0318 02:51:24.638788 (+ 21us) write_op.cc:276] Timestamp: P: 1773802280404277 usec, L: 0
0318 02:51:24.638912 (+ 124us) write_op.cc:270] Start()
0318 02:51:24.638931 (+ 19us) write_op.cc:276] Timestamp: P: 1773802280410376 usec, L: 0
0318 02:51:24.639056 (+ 125us) write_op.cc:270] Start()
0318 02:51:24.639074 (+ 18us) write_op.cc:276] Timestamp: P: 1773802280493440 usec, L: 0
0318 02:51:24.639218 (+ 144us) write_op.cc:270] Start()
0318 02:51:24.639237 (+ 19us) write_op.cc:276] Timestamp: P: 1773802280558374 usec, L: 0
0318 02:51:24.639346 (+ 109us) write_op.cc:270] Start()
0318 02:51:24.639364 (+ 18us) write_op.cc:276] Timestamp: P: 1773802280559185 usec, L: 0
0318 02:51:24.639489 (+ 125us) write_op.cc:270] Start()
0318 02:51:24.639509 (+ 20us) write_op.cc:276] Timestamp: P: 1773802280559814 usec, L: 0
0318 02:51:24.639647 (+ 138us) write_op.cc:270] Start()
0318 02:51:24.639667 (+ 20us) write_op.cc:276] Timestamp: P: 1773802280565880 usec, L: 0
0318 02:51:24.639796 (+ 129us) write_op.cc:270] Start()
0318 02:51:24.639815 (+ 19us) write_op.cc:276] Timestamp: P: 1773802280566633 usec, L: 0
0318 02:51:24.639938 (+ 123us) write_op.cc:270] Start()
0318 02:51:24.639956 (+ 18us) write_op.cc:276] Timestamp: P: 1773802280567173 usec, L: 0
0318 02:51:24.640092 (+ 136us) write_op.cc:270] Start()
0318 02:51:24.640111 (+ 19us) write_op.cc:276] Timestamp: P: 1773802280567808 usec, L: 0
0318 02:51:24.640268 (+ 157us) write_op.cc:270] Start()
0318 02:51:24.640289 (+ 21us) write_op.cc:276] Timestamp: P: 1773802280568492 usec, L: 0
0318 02:51:24.640432 (+ 143us) write_op.cc:270] Start()
0318 02:51:24.640452 (+ 20us) write_op.cc:276] Timestamp: P: 1773802280655607 usec, L: 0
0318 02:51:24.640571 (+ 119us) write_op.cc:270] Start()
0318 02:51:24.640587 (+ 16us) write_op.cc:276] Timestamp: P: 1773802280685721 usec, L: 0
0318 02:51:24.652622 (+ 12035us) write_op.cc:270] Start()
0318 02:51:24.652663 (+ 41us) write_op.cc:276] Timestamp: P: 1773802280694705 usec, L: 0
0318 02:51:24.652953 (+ 290us) write_op.cc:270] Start()
0318 02:51:24.653265 (+ 312us) write_op.cc:276] Timestamp: P: 1773802280735722 usec, L: 0
0318 02:51:24.653537 (+ 272us) write_op.cc:270] Start()
0318 02:51:24.653563 (+ 26us) write_op.cc:276] Timestamp: P: 1773802280736921 usec, L: 0
0318 02:51:24.653710 (+ 147us) write_op.cc:270] Start()
0318 02:51:24.653729 (+ 19us) write_op.cc:276] Timestamp: P: 1773802280738730 usec, L: 0
0318 02:51:24.653851 (+ 122us) write_op.cc:270] Start()
0318 02:51:24.653869 (+ 18us) write_op.cc:276] Timestamp: P: 1773802280747655 usec, L: 0
0318 02:51:24.666590 (+ 12721us) write_op.cc:270] Start()
0318 02:51:24.666634 (+ 44us) write_op.cc:276] Timestamp: P: 1773802280771433 usec, L: 0
0318 02:51:24.666866 (+ 232us) write_op.cc:270] Start()
0318 02:51:24.666889 (+ 23us) write_op.cc:276] Timestamp: P: 1773802280772487 usec, L: 0
0318 02:51:24.667025 (+ 136us) write_op.cc:270] Start()
0318 02:51:24.667064 (+ 39us) write_op.cc:276] Timestamp: P: 1773802280825440 usec, L: 0
0318 02:51:24.670700 (+ 3636us) write_op.cc:270] Start()
0318 02:51:24.670749 (+ 49us) write_op.cc:276] Timestamp: P: 1773802280826139 usec, L: 0
0318 02:51:24.670954 (+ 205us) write_op.cc:270] Start()
0318 02:51:24.670979 (+ 25us) write_op.cc:276] Timestamp: P: 1773802280827312 usec, L: 0
0318 02:51:24.671106 (+ 127us) write_op.cc:270] Start()
0318 02:51:24.671124 (+ 18us) write_op.cc:276] Timestamp: P: 1773802280846840 usec, L: 0
0318 02:51:24.671283 (+ 159us) write_op.cc:270] Start()
0318 02:51:24.671304 (+ 21us) write_op.cc:276] Timestamp: P: 1773802280847663 usec, L: 0
0318 02:51:24.671432 (+ 128us) write_op.cc:270] Start()
0318 02:51:24.671451 (+ 19us) write_op.cc:276] Timestamp: P: 1773802280857251 usec, L: 0
0318 02:51:24.671559 (+ 108us) write_op.cc:270] Start()
0318 02:51:24.671579 (+ 20us) write_op.cc:276] Timestamp: P: 1773802280896752 usec, L: 0
0318 02:51:24.671695 (+ 116us) write_op.cc:270] Start()
0318 02:51:24.671714 (+ 19us) write_op.cc:276] Timestamp: P: 1773802280898107 usec, L: 0
0318 02:51:24.676046 (+ 4332us) write_op.cc:270] Start()
0318 02:51:24.676087 (+ 41us) write_op.cc:276] Timestamp: P: 1773802280928051 usec, L: 0
0318 02:51:24.678942 (+ 2855us) write_op.cc:270] Start()
0318 02:51:24.678978 (+ 36us) write_op.cc:276] Timestamp: P: 1773802280929308 usec, L: 0
0318 02:51:24.682477 (+ 3499us) write_op.cc:270] Start()
0318 02:51:24.682514 (+ 37us) write_op.cc:276] Timestamp: P: 1773802280948462 usec, L: 0
0318 02:51:24.682710 (+ 196us) write_op.cc:270] Start()
0318 02:51:24.682733 (+ 23us) write_op.cc:276] Timestamp: P: 1773802280962643 usec, L: 0
0318 02:51:24.686655 (+ 3922us) write_op.cc:270] Start()
0318 02:51:24.686685 (+ 30us) write_op.cc:276] Timestamp: P: 1773802280964345 usec, L: 0
0318 02:51:24.734757 (+ 48072us) write_op.cc:270] Start()
0318 02:51:24.734799 (+ 42us) write_op.cc:276] Timestamp: P: 1773802280971139 usec, L: 0
0318 02:51:24.738555 (+ 3756us) write_op.cc:270] Start()
0318 02:51:24.738603 (+ 48us) write_op.cc:276] Timestamp: P: 1773802280972129 usec, L: 0
0318 02:51:24.738850 (+ 247us) write_op.cc:270] Start()
0318 02:51:24.738872 (+ 22us) write_op.cc:276] Timestamp: P: 1773802281037357 usec, L: 0
0318 02:51:24.739001 (+ 129us) write_op.cc:270] Start()
0318 02:51:24.739021 (+ 20us) write_op.cc:276] Timestamp: P: 1773802281055249 usec, L: 0
0318 02:51:24.739168 (+ 147us) write_op.cc:270] Start()
0318 02:51:24.739189 (+ 21us) write_op.cc:276] Timestamp: P: 1773802281059795 usec, L: 0
0318 02:51:24.739316 (+ 127us) write_op.cc:270] Start()
0318 02:51:24.739336 (+ 20us) write_op.cc:276] Timestamp: P: 1773802281064066 usec, L: 0
0318 02:51:24.739458 (+ 122us) write_op.cc:270] Start()
0318 02:51:24.739476 (+ 18us) write_op.cc:276] Timestamp: P: 1773802281068443 usec, L: 0
0318 02:51:24.742708 (+ 3232us) write_op.cc:270] Start()
0318 02:51:24.742760 (+ 52us) write_op.cc:276] Timestamp: P: 1773802281069696 usec, L: 0
0318 02:51:24.742958 (+ 198us) write_op.cc:270] Start()
0318 02:51:24.742982 (+ 24us) write_op.cc:276] Timestamp: P: 1773802281088992 usec, L: 0
0318 02:51:24.743153 (+ 171us) write_op.cc:270] Start()
0318 02:51:24.743175 (+ 22us) write_op.cc:276] Timestamp: P: 1773802281089593 usec, L: 0
0318 02:51:24.743306 (+ 131us) write_op.cc:270] Start()
0318 02:51:24.743326 (+ 20us) write_op.cc:276] Timestamp: P: 1773802281090593 usec, L: 0
0318 02:51:24.743478 (+ 152us) write_op.cc:270] Start()
0318 02:51:24.743496 (+ 18us) write_op.cc:276] Timestamp: P: 1773802281136478 usec, L: 0
0318 02:51:24.743620 (+ 124us) write_op.cc:270] Start()
0318 02:51:24.743638 (+ 18us) write_op.cc:276] Timestamp: P: 1773802281137964 usec, L: 0
0318 02:51:24.743762 (+ 124us) write_op.cc:270] Start()
0318 02:51:24.743779 (+ 17us) write_op.cc:276] Timestamp: P: 1773802281138906 usec, L: 0
0318 02:51:24.743899 (+ 120us) write_op.cc:270] Start()
0318 02:51:24.743917 (+ 18us) write_op.cc:276] Timestamp: P: 1773802281140076 usec, L: 0
0318 02:51:24.744057 (+ 140us) write_op.cc:270] Start()
0318 02:51:24.744075 (+ 18us) write_op.cc:276] Timestamp: P: 1773802281153274 usec, L: 0
0318 02:51:24.744221 (+ 146us) write_op.cc:270] Start()
0318 02:51:24.744242 (+ 21us) write_op.cc:276] Timestamp: P: 1773802281154688 usec, L: 0
0318 02:51:24.744368 (+ 126us) write_op.cc:270] Start()
0318 02:51:24.744394 (+ 26us) write_op.cc:276] Timestamp: P: 1773802281156731 usec, L: 0
0318 02:51:24.744511 (+ 117us) write_op.cc:270] Start()
0318 02:51:24.744529 (+ 18us) write_op.cc:276] Timestamp: P: 1773802281169499 usec, L: 0
0318 02:51:24.744647 (+ 118us) write_op.cc:270] Start()
0318 02:51:24.744665 (+ 18us) write_op.cc:276] Timestamp: P: 1773802281205989 usec, L: 0
0318 02:51:24.744816 (+ 151us) write_op.cc:270] Start()
0318 02:51:24.744835 (+ 19us) write_op.cc:276] Timestamp: P: 1773802281208636 usec, L: 0
0318 02:51:24.744959 (+ 124us) write_op.cc:270] Start()
0318 02:51:24.744977 (+ 18us) write_op.cc:276] Timestamp: P: 1773802281232286 usec, L: 0
0318 02:51:24.745090 (+ 113us) write_op.cc:270] Start()
0318 02:51:24.745106 (+ 16us) write_op.cc:276] Timestamp: P: 1773802281234501 usec, L: 0
0318 02:51:24.745276 (+ 170us) write_op.cc:270] Start()
0318 02:51:24.745344 (+ 68us) write_op.cc:276] Timestamp: P: 1773802281238006 usec, L: 0
0318 02:51:24.745547 (+ 203us) write_op.cc:270] Start()
0318 02:51:24.745566 (+ 19us) write_op.cc:276] Timestamp: P: 1773802281262660 usec, L: 0
0318 02:51:24.745693 (+ 127us) write_op.cc:270] Start()
0318 02:51:24.745710 (+ 17us) write_op.cc:276] Timestamp: P: 1773802281266538 usec, L: 0
0318 02:51:24.745831 (+ 121us) write_op.cc:270] Start()
0318 02:51:24.745849 (+ 18us) write_op.cc:276] Timestamp: P: 1773802281307186 usec, L: 0
0318 02:51:24.745988 (+ 139us) write_op.cc:270] Start()
0318 02:51:24.746009 (+ 21us) write_op.cc:276] Timestamp: P: 1773802281353362 usec, L: 0
0318 02:51:24.746138 (+ 129us) write_op.cc:270] Start()
0318 02:51:24.746159 (+ 21us) write_op.cc:276] Timestamp: P: 1773802281354068 usec, L: 0
0318 02:51:24.746300 (+ 141us) write_op.cc:270] Start()
0318 02:51:24.746320 (+ 20us) write_op.cc:276] Timestamp: P: 1773802281358287 usec, L: 0
0318 02:51:24.746430 (+ 110us) write_op.cc:270] Start()
0318 02:51:24.746448 (+ 18us) write_op.cc:276] Timestamp: P: 1773802281359109 usec, L: 0
0318 02:51:24.753538 (+ 7090us) write_op.cc:270] Start()
0318 02:51:24.753575 (+ 37us) write_op.cc:276] Timestamp: P: 1773802281359685 usec, L: 0
0318 02:51:24.753772 (+ 197us) write_op.cc:270] Start()
0318 02:51:24.753794 (+ 22us) write_op.cc:276] Timestamp: P: 1773802281360210 usec, L: 0
0318 02:51:24.766858 (+ 13064us) write_op.cc:270] Start()
0318 02:51:24.766899 (+ 41us) write_op.cc:276] Timestamp: P: 1773802281363278 usec, L: 0
0318 02:51:24.767097 (+ 198us) write_op.cc:270] Start()
0318 02:51:24.767120 (+ 23us) write_op.cc:276] Timestamp: P: 1773802281364009 usec, L: 0
0318 02:51:24.767265 (+ 145us) write_op.cc:270] Start()
0318 02:51:24.767284 (+ 19us) write_op.cc:276] Timestamp: P: 1773802281372064 usec, L: 0
0318 02:51:24.767422 (+ 138us) write_op.cc:270] Start()
0318 02:51:24.767442 (+ 20us) write_op.cc:276] Timestamp: P: 1773802281389021 usec, L: 0
0318 02:51:24.795392 (+ 27950us) write_op.cc:270] Start()
0318 02:51:24.795436 (+ 44us) write_op.cc:276] Timestamp: P: 1773802281390066 usec, L: 0
0318 02:51:24.835900 (+ 40464us) write_op.cc:270] Start()
0318 02:51:24.835945 (+ 45us) write_op.cc:276] Timestamp: P: 1773802281390942 usec, L: 0
0318 02:51:24.836162 (+ 217us) write_op.cc:270] Start()
0318 02:51:24.836188 (+ 26us) write_op.cc:276] Timestamp: P: 1773802281437612 usec, L: 0
0318 02:51:24.836337 (+ 149us) write_op.cc:270] Start()
0318 02:51:24.836357 (+ 20us) write_op.cc:276] Timestamp: P: 1773802281446459 usec, L: 0
0318 02:51:24.836495 (+ 138us) write_op.cc:270] Start()
0318 02:51:24.836515 (+ 20us) write_op.cc:276] Timestamp: P: 1773802281447891 usec, L: 0
0318 02:51:24.836673 (+ 158us) write_op.cc:270] Start()
0318 02:51:24.836696 (+ 23us) write_op.cc:276] Timestamp: P: 1773802281449244 usec, L: 0
0318 02:51:24.836860 (+ 164us) write_op.cc:270] Start()
0318 02:51:24.836881 (+ 21us) write_op.cc:276] Timestamp: P: 1773802281453553 usec, L: 0
0318 02:51:24.837043 (+ 162us) write_op.cc:270] Start()
0318 02:51:24.837065 (+ 22us) write_op.cc:276] Timestamp: P: 1773802281582915 usec, L: 0
0318 02:51:24.837201 (+ 136us) write_op.cc:270] Start()
0318 02:51:24.837288 (+ 87us) write_op.cc:276] Timestamp: P: 1773802281599521 usec, L: 0
0318 02:51:24.837448 (+ 160us) write_op.cc:270] Start()
0318 02:51:24.837470 (+ 22us) write_op.cc:276] Timestamp: P: 1773802281605399 usec, L: 0
0318 02:51:24.837598 (+ 128us) write_op.cc:270] Start()
0318 02:51:24.837617 (+ 19us) write_op.cc:276] Timestamp: P: 1773802281613180 usec, L: 0
0318 02:51:24.837776 (+ 159us) write_op.cc:270] Start()
0318 02:51:24.837797 (+ 21us) write_op.cc:276] Timestamp: P: 1773802281613904 usec, L: 0
0318 02:51:24.838251 (+ 454us) write_op.cc:270] Start()
0318 02:51:24.838319 (+ 68us) write_op.cc:276] Timestamp: P: 1773802281614521 usec, L: 0
0318 02:51:24.926275 (+ 87956us) write_op.cc:270] Start()
0318 02:51:24.926323 (+ 48us) write_op.cc:276] Timestamp: P: 1773802281615200 usec, L: 0
0318 02:51:24.926518 (+ 195us) write_op.cc:270] Start()
0318 02:51:24.926542 (+ 24us) write_op.cc:276] Timestamp: P: 1773802281626966 usec, L: 0
0318 02:51:24.926700 (+ 158us) write_op.cc:270] Start()
0318 02:51:24.926721 (+ 21us) write_op.cc:276] Timestamp: P: 1773802281627701 usec, L: 0
0318 02:51:24.926844 (+ 123us) write_op.cc:270] Start()
0318 02:51:24.926862 (+ 18us) write_op.cc:276] Timestamp: P: 17738022
I20260318 02:51:26.817890 1621 raft_consensus.cc:493] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:26.818944 1173 tablet_bootstrap.cc:492] T 97655cb5968b4c819273068818d5cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:26.819702 1173 ts_tablet_manager.cc:1403] T 97655cb5968b4c819273068818d5cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.057s user 0.002s sys 0.002s
I20260318 02:51:26.819698 1621 raft_consensus.cc:515] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:26.820504 1621 leader_election.cc:290] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:26.820538 1173 raft_consensus.cc:359] T 97655cb5968b4c819273068818d5cab8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.820794 1173 raft_consensus.cc:385] T 97655cb5968b4c819273068818d5cab8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.820930 1173 raft_consensus.cc:740] T 97655cb5968b4c819273068818d5cab8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.824541 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab158343adb14eab85c595fa5405145d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:26.825145 719 leader_election.cc:343] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:26.829977 1174 tablet_bootstrap.cc:492] T a4f891043b7d468da3e808980690354d P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:26.830171 1174 ts_tablet_manager.cc:1403] T a4f891043b7d468da3e808980690354d P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.003s
I20260318 02:51:26.821424 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab158343adb14eab85c595fa5405145d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:26.830981 719 leader_election.cc:343] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:26.831219 719 leader_election.cc:304] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:26.831627 1621 raft_consensus.cc:2749] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:26.831046 1174 raft_consensus.cc:359] T a4f891043b7d468da3e808980690354d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.831760 1173 consensus_queue.cc:260] T 97655cb5968b4c819273068818d5cab8 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.831959 1174 raft_consensus.cc:385] T a4f891043b7d468da3e808980690354d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.832060 1174 raft_consensus.cc:740] T a4f891043b7d468da3e808980690354d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.832314 1174 consensus_queue.cc:260] T a4f891043b7d468da3e808980690354d P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.833166 1184 ts_tablet_manager.cc:1929] T 323e4b1e9aee449f9402b1712b1444d9 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.833384 1184 log.cc:1199] T 323e4b1e9aee449f9402b1712b1444d9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/323e4b1e9aee449f9402b1712b1444d9
I20260318 02:51:26.833814 1184 ts_tablet_manager.cc:1950] T 323e4b1e9aee449f9402b1712b1444d9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:26.836311 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 323e4b1e9aee449f9402b1712b1444d9 (table default.Table_4775eaa0e7e84642aa0a8f8b2885610e [id=463a6721eb0d43d09deeb283d1cc4233]) successfully deleted
I20260318 02:51:26.838761 1173 ts_tablet_manager.cc:1434] T 97655cb5968b4c819273068818d5cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260318 02:51:26.823500 1175 ts_tablet_manager.cc:1929] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:26.839069 1175 log.cc:1199] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/6e9372f8871b473caa024512e936a6e5
I20260318 02:51:26.839414 1174 ts_tablet_manager.cc:1434] T a4f891043b7d468da3e808980690354d P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260318 02:51:26.839550 1175 ts_tablet_manager.cc:1950] T 6e9372f8871b473caa024512e936a6e5 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:26.843286 1554 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:26.843443 906 tablet_service.cc:1558] Processing DeleteTablet for tablet 97655cb5968b4c819273068818d5cab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:26.844309 1554 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: This master's current role is: LEADER
I20260318 02:51:26.843745 1173 tablet_bootstrap.cc:492] T af802894346443669f1cc549a1ba401b P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:26.845516 1174 tablet_bootstrap.cc:492] T 30205728339f4bcf8b7d94d6f373e01c P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:26.846930 1173 tablet_bootstrap.cc:654] T af802894346443669f1cc549a1ba401b P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.847194 1174 tablet_bootstrap.cc:654] T 30205728339f4bcf8b7d94d6f373e01c P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.848877 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 6e9372f8871b473caa024512e936a6e5 (table default.Table_06e760051f3b473f99521e4da99f8288 [id=c532f0623efe4c3f8d9c90ae9c3d02c3]) successfully deleted
W20260318 02:51:26.860546 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f04f057571584d31b1821e690ae7c75c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f04f057571584d31b1821e690ae7c75c already in progress: creating tablet
W20260318 02:51:26.861186 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet abfdba1f21e44652b2bce62cd3e6681f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet abfdba1f21e44652b2bce62cd3e6681f already in progress: creating tablet
W20260318 02:51:26.863117 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 82858fd64d534d1abcad12bc4a93cda7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82858fd64d534d1abcad12bc4a93cda7 already in progress: creating tablet
W20260318 02:51:26.863384 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 461adcc8bbd94d30b9b84d1010430829 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 461adcc8bbd94d30b9b84d1010430829 already in progress: creating tablet
W20260318 02:51:26.863600 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet cc1543d0e1b1431baf6d2ab6a0484ca6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc1543d0e1b1431baf6d2ab6a0484ca6 already in progress: creating tablet
W20260318 02:51:26.863775 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet b8973d8930ef4b65be7b4ff990bf9d72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8973d8930ef4b65be7b4ff990bf9d72 already in progress: creating tablet
W20260318 02:51:26.863967 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 813702e53eee4a54a7d693fd6e03bbbb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 813702e53eee4a54a7d693fd6e03bbbb already in progress: creating tablet
W20260318 02:51:26.864199 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet e57dbb1276114cd6b7d26f7167b99f25 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e57dbb1276114cd6b7d26f7167b99f25 already in progress: creating tablet
I20260318 02:51:26.865252 1184 tablet_replica.cc:333] T 97655cb5968b4c819273068818d5cab8 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:26.865510 1184 raft_consensus.cc:2243] T 97655cb5968b4c819273068818d5cab8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.865741 1184 raft_consensus.cc:2272] T 97655cb5968b4c819273068818d5cab8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.866532 1184 ts_tablet_manager.cc:1916] T 97655cb5968b4c819273068818d5cab8 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.864080 1175 tablet_replica.cc:333] T 977b95a3442a405d90385cdb4d6dd5dd P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:26.873034 1175 raft_consensus.cc:2243] T 977b95a3442a405d90385cdb4d6dd5dd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.873342 1175 raft_consensus.cc:2272] T 977b95a3442a405d90385cdb4d6dd5dd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.874176 1175 ts_tablet_manager.cc:1916] T 977b95a3442a405d90385cdb4d6dd5dd P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.883602 1175 ts_tablet_manager.cc:1929] T 977b95a3442a405d90385cdb4d6dd5dd P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.886498 1184 ts_tablet_manager.cc:1929] T 97655cb5968b4c819273068818d5cab8 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.887316 1184 log.cc:1199] T 97655cb5968b4c819273068818d5cab8 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/97655cb5968b4c819273068818d5cab8
I20260318 02:51:26.887850 1184 ts_tablet_manager.cc:1950] T 97655cb5968b4c819273068818d5cab8 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:26.889385 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 97655cb5968b4c819273068818d5cab8 (table default.Table_db9a2182adab412682721c74365227db [id=b6525a69ead04b8ca17dfa20eb38d663]) successfully deleted
I20260318 02:51:26.890810 1175 log.cc:1199] T 977b95a3442a405d90385cdb4d6dd5dd P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/977b95a3442a405d90385cdb4d6dd5dd
I20260318 02:51:26.891600 1175 ts_tablet_manager.cc:1950] T 977b95a3442a405d90385cdb4d6dd5dd P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:26.893107 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 977b95a3442a405d90385cdb4d6dd5dd (table default.Table_429d1a716ae64decac39f45685e90b00 [id=89a90617176b4035a465731d37aa795e]) successfully deleted
I20260318 02:51:26.894035 1175 tablet_replica.cc:333] T 3c283efbac08468c8c20f4caba90164c P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:26.894546 1175 raft_consensus.cc:2243] T 3c283efbac08468c8c20f4caba90164c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.895041 1175 raft_consensus.cc:2272] T 3c283efbac08468c8c20f4caba90164c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.896337 1172 tablet_bootstrap.cc:492] T e61c374078854d589219dfa4c20e4222 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:26.896552 1172 ts_tablet_manager.cc:1403] T e61c374078854d589219dfa4c20e4222 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.215s user 0.013s sys 0.007s
I20260318 02:51:26.897567 1172 raft_consensus.cc:359] T e61c374078854d589219dfa4c20e4222 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.897742 1172 raft_consensus.cc:385] T e61c374078854d589219dfa4c20e4222 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.897846 1172 raft_consensus.cc:740] T e61c374078854d589219dfa4c20e4222 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.898082 1172 consensus_queue.cc:260] T e61c374078854d589219dfa4c20e4222 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.900416 1174 tablet_bootstrap.cc:492] T 30205728339f4bcf8b7d94d6f373e01c P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:26.900635 1174 ts_tablet_manager.cc:1403] T 30205728339f4bcf8b7d94d6f373e01c P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.055s user 0.019s sys 0.031s
I20260318 02:51:26.901489 1172 ts_tablet_manager.cc:1434] T e61c374078854d589219dfa4c20e4222 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:26.901461 1174 raft_consensus.cc:359] T 30205728339f4bcf8b7d94d6f373e01c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:26.901755 1174 raft_consensus.cc:385] T 30205728339f4bcf8b7d94d6f373e01c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.901860 1172 tablet_bootstrap.cc:492] T 959faf1fbb224434b896c0f21e9715be P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:26.901921 1174 raft_consensus.cc:740] T 30205728339f4bcf8b7d94d6f373e01c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.902316 1174 consensus_queue.cc:260] T 30205728339f4bcf8b7d94d6f373e01c P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:26.902441 1175 ts_tablet_manager.cc:1916] T 3c283efbac08468c8c20f4caba90164c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.904762 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet e61c374078854d589219dfa4c20e4222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:26.905095 1184 tablet_replica.cc:333] T e61c374078854d589219dfa4c20e4222 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:26.907253 1184 raft_consensus.cc:2243] T e61c374078854d589219dfa4c20e4222 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.907485 1184 raft_consensus.cc:2272] T e61c374078854d589219dfa4c20e4222 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.908563 1184 ts_tablet_manager.cc:1916] T e61c374078854d589219dfa4c20e4222 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.908674 1174 ts_tablet_manager.cc:1434] T 30205728339f4bcf8b7d94d6f373e01c P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260318 02:51:26.912864 1174 tablet_bootstrap.cc:492] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:26.914187 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 1ef3181adc0542229897369591a30465
I20260318 02:51:26.914733 450 catalog_manager.cc:6741] ReplaceTablet: tablet 1ef3181adc0542229897369591a30465 deleted and replaced by tablet defda79dd0f34c37ae16ea808df0754b
I20260318 02:51:26.915458 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ef3181adc0542229897369591a30465 with delete_type TABLET_DATA_DELETED (replaced by tablet defda79dd0f34c37ae16ea808df0754b) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.916000 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ef3181adc0542229897369591a30465 with delete_type TABLET_DATA_DELETED (replaced by tablet defda79dd0f34c37ae16ea808df0754b) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:26.916082 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 1ef3181adc0542229897369591a30465 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ef3181adc0542229897369591a30465 already in progress: creating tablet
I20260318 02:51:26.907085 1173 tablet_bootstrap.cc:492] T af802894346443669f1cc549a1ba401b P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:26.917299 1172 tablet_bootstrap.cc:654] T 959faf1fbb224434b896c0f21e9715be P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.917819 1174 tablet_bootstrap.cc:654] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.918262 906 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ef3181adc0542229897369591a30465 with delete_type TABLET_DATA_DELETED (replaced by tablet defda79dd0f34c37ae16ea808df0754b) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:26.918704 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2882569524e74a308e9fabf533a8a87c
I20260318 02:51:26.919713 1173 ts_tablet_manager.cc:1403] T af802894346443669f1cc549a1ba401b P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.073s user 0.003s sys 0.001s
I20260318 02:51:26.919953 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet 2882569524e74a308e9fabf533a8a87c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:26.919961 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 2882569524e74a308e9fabf533a8a87c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.920548 906 tablet_service.cc:1558] Processing DeleteTablet for tablet 2882569524e74a308e9fabf533a8a87c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:26.920599 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2882569524e74a308e9fabf533a8a87c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2882569524e74a308e9fabf533a8a87c already in progress: creating tablet
I20260318 02:51:26.921497 1173 raft_consensus.cc:359] T af802894346443669f1cc549a1ba401b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.922322 1173 raft_consensus.cc:385] T af802894346443669f1cc549a1ba401b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.922428 1173 raft_consensus.cc:740] T af802894346443669f1cc549a1ba401b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.922816 1184 ts_tablet_manager.cc:1929] T e61c374078854d589219dfa4c20e4222 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.922757 1173 consensus_queue.cc:260] T af802894346443669f1cc549a1ba401b P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.922863 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 56335a4a2c294f67a22206e6a59e29a8
I20260318 02:51:26.924083 1173 ts_tablet_manager.cc:1434] T af802894346443669f1cc549a1ba401b P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260318 02:51:26.924307 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 56335a4a2c294f67a22206e6a59e29a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.925040 1173 tablet_bootstrap.cc:492] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:26.925028 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 56335a4a2c294f67a22206e6a59e29a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56335a4a2c294f67a22206e6a59e29a8 already in progress: creating tablet
I20260318 02:51:26.928169 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet 56335a4a2c294f67a22206e6a59e29a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:26.928444 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a1b9dc84de4a42288ee7754f4a110daa" } modify_external_catalogs: true
I20260318 02:51:26.928632 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a1b9dc84de4a42288ee7754f4a110daa" } modify_external_catalogs: true
I20260318 02:51:26.928918 1184 log.cc:1199] T e61c374078854d589219dfa4c20e4222 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/e61c374078854d589219dfa4c20e4222
I20260318 02:51:26.929399 1184 ts_tablet_manager.cc:1950] T e61c374078854d589219dfa4c20e4222 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:26.930284 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f664e51423be4580b3ebf91d14e66886" } modify_external_catalogs: true
I20260318 02:51:26.930474 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f664e51423be4580b3ebf91d14e66886" } modify_external_catalogs: true
I20260318 02:51:26.930485 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet e61c374078854d589219dfa4c20e4222 (table default.Table_347e676321aa483fa750cfa91235cbe7 [id=02ceb29568c548ffaf48bc6c5e78c929]) successfully deleted
W20260318 02:51:26.934099 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 1ef3181adc0542229897369591a30465 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ef3181adc0542229897369591a30465 already in progress: creating tablet
W20260318 02:51:26.934383 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2882569524e74a308e9fabf533a8a87c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2882569524e74a308e9fabf533a8a87c already in progress: creating tablet
I20260318 02:51:26.935194 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 783c886a99994d6c8d9add724277819a
I20260318 02:51:26.936173 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet 783c886a99994d6c8d9add724277819a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:26.936334 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 783c886a99994d6c8d9add724277819a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:26.936578 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 56335a4a2c294f67a22206e6a59e29a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56335a4a2c294f67a22206e6a59e29a8 already in progress: creating tablet
I20260318 02:51:26.936787 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e4e8936ba8634b8e8ac79e1c70e97845" } new_table_name: "default.Table_5ed9c43cfcf94d058b59ec604059817b" modify_external_catalogs: true
I20260318 02:51:26.937059 1172 tablet_bootstrap.cc:492] T 959faf1fbb224434b896c0f21e9715be P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:26.937230 1172 ts_tablet_manager.cc:1403] T 959faf1fbb224434b896c0f21e9715be P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.000s
W20260318 02:51:26.938304 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 783c886a99994d6c8d9add724277819a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 783c886a99994d6c8d9add724277819a already in progress: creating tablet
I20260318 02:51:26.938352 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3852466c8ce14d2caee518fe948fbdfc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:26.938881 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3852466c8ce14d2caee518fe948fbdfc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.939728 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4bc7b15f91fb4bea8bb33ba125c8ae5a" } new_table_name: "default.Table_10f6937d0016448caceef24711896b5f" modify_external_catalogs: true
I20260318 02:51:26.939776 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3188dcbe312043c3a4d363f0efa90709"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:26.939961 1172 raft_consensus.cc:359] T 959faf1fbb224434b896c0f21e9715be P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:26.940169 1172 raft_consensus.cc:385] T 959faf1fbb224434b896c0f21e9715be P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.940254 1172 raft_consensus.cc:740] T 959faf1fbb224434b896c0f21e9715be P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
W20260318 02:51:26.940402 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3188dcbe312043c3a4d363f0efa90709 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.940487 1172 consensus_queue.cc:260] T 959faf1fbb224434b896c0f21e9715be P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:26.942134 1172 ts_tablet_manager.cc:1434] T 959faf1fbb224434b896c0f21e9715be P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:26.942148 456 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet ab158343adb14eab85c595fa5405145d (table default.Table_b76c4b353fbe45c8a866d4cd2c4e264c [id=d20f8f1bd66d4dceab3b7bc72608da2a]). Expected version 2 got 0
I20260318 02:51:26.942457 1172 tablet_bootstrap.cc:492] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:26.943813 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_358abbb589e2401b867ed3d33640193e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:26.944310 1172 tablet_bootstrap.cc:654] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:26.944341 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_358abbb589e2401b867ed3d33640193e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:26.945200 906 tablet_service.cc:1558] Processing DeleteTablet for tablet 56335a4a2c294f67a22206e6a59e29a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:26.946149 891 tablet_service.cc:1558] Processing DeleteTablet for tablet af802894346443669f1cc549a1ba401b with delete_type TABLET_DATA_DELETED (replaced by tablet 30205728339f4bcf8b7d94d6f373e01c) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:26.946389 906 tablet_service.cc:1558] Processing DeleteTablet for tablet 783c886a99994d6c8d9add724277819a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:26.946990 757 tablet_service.cc:1558] Processing DeleteTablet for tablet fda9f1fe47e04688bde80ebe23494d08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.947254 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 71c518c87bdd4a63aa1016e8de6bafdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.947408 1176 tablet_replica.cc:333] T fda9f1fe47e04688bde80ebe23494d08 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:26.947630 1176 raft_consensus.cc:2243] T fda9f1fe47e04688bde80ebe23494d08 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.947835 1176 raft_consensus.cc:2272] T fda9f1fe47e04688bde80ebe23494d08 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.948776 1176 ts_tablet_manager.cc:1916] T fda9f1fe47e04688bde80ebe23494d08 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.949837 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_fe927bc33c094a8bbec3557ad85c8e15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:26.950488 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe927bc33c094a8bbec3557ad85c8e15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:26.953358 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 783c886a99994d6c8d9add724277819a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 783c886a99994d6c8d9add724277819a already in progress: creating tablet
I20260318 02:51:26.954737 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet 959faf1fbb224434b896c0f21e9715be with delete_type TABLET_DATA_DELETED (replaced by tablet c7c4257a54d3487aa520531a64fc721c) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:26.955081 1184 tablet_replica.cc:333] T 959faf1fbb224434b896c0f21e9715be P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:26.955327 1184 raft_consensus.cc:2243] T 959faf1fbb224434b896c0f21e9715be P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.955843 1184 raft_consensus.cc:2272] T 959faf1fbb224434b896c0f21e9715be P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.956673 1184 ts_tablet_manager.cc:1916] T 959faf1fbb224434b896c0f21e9715be P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.958103 1174 tablet_bootstrap.cc:492] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:26.958282 1174 ts_tablet_manager.cc:1403] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.005s
I20260318 02:51:26.958252 1042 tablet_service.cc:1511] Processing CreateTablet for tablet e998e290291c443394f478c4ac1cfbd2 (DEFAULT_TABLE table=default.Table_cd3a5e50d5224cf59e0d62be2fa27753 [id=00651cbebdb046c9975ecfa30f08fce5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.958490 753 tablet_service.cc:1511] Processing CreateTablet for tablet e998e290291c443394f478c4ac1cfbd2 (DEFAULT_TABLE table=default.Table_cd3a5e50d5224cf59e0d62be2fa27753 [id=00651cbebdb046c9975ecfa30f08fce5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.958590 1176 ts_tablet_manager.cc:1929] T fda9f1fe47e04688bde80ebe23494d08 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.958699 1176 log.cc:1199] T fda9f1fe47e04688bde80ebe23494d08 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/fda9f1fe47e04688bde80ebe23494d08
I20260318 02:51:26.958712 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e998e290291c443394f478c4ac1cfbd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.958853 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e998e290291c443394f478c4ac1cfbd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.959100 1176 ts_tablet_manager.cc:1950] T fda9f1fe47e04688bde80ebe23494d08 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:26.959183 1174 raft_consensus.cc:359] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.959367 1174 raft_consensus.cc:385] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:26.959466 1174 raft_consensus.cc:740] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:26.959769 1174 consensus_queue.cc:260] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:26.960289 1176 tablet_replica.cc:333] T 71c518c87bdd4a63aa1016e8de6bafdc P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:26.961203 1174 ts_tablet_manager.cc:1434] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:26.961210 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet fda9f1fe47e04688bde80ebe23494d08 (table default.Table_3027337e0c384f2b868ff5550be99c07 [id=39b15a578c754e29b3e4f28015859a73]) successfully deleted
I20260318 02:51:26.961503 1174 tablet_bootstrap.cc:492] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:26.962750 1035 tablet_service.cc:1511] Processing CreateTablet for tablet fe82e581368c4d8a894f0283c1a710fe (DEFAULT_TABLE table=default.Table_25a5e0aa32c245ff957460a7a51caa4d [id=831b3293b7eb44c6acb5de02d0769c1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.963097 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe82e581368c4d8a894f0283c1a710fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.964107 757 tablet_service.cc:1511] Processing CreateTablet for tablet fe82e581368c4d8a894f0283c1a710fe (DEFAULT_TABLE table=default.Table_25a5e0aa32c245ff957460a7a51caa4d [id=831b3293b7eb44c6acb5de02d0769c1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.964474 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe82e581368c4d8a894f0283c1a710fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.971532 762 tablet_service.cc:1558] Processing DeleteTablet for tablet a4f891043b7d468da3e808980690354d with delete_type TABLET_DATA_DELETED (replaced by tablet 4fa6bf38381740a1bab1088ede6ede1c) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.972482 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e16272bcf9c435a80b32ba9cba9c738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.974617 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 7c0d87304c41481299f1e2ddfdfcfdec
I20260318 02:51:26.975718 455 catalog_manager.cc:6741] ReplaceTablet: tablet 7c0d87304c41481299f1e2ddfdfcfdec deleted and replaced by tablet 565add8c21f343f2b11c12a9bb7ff111
I20260318 02:51:26.976612 1174 tablet_bootstrap.cc:654] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:26.977252 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 453a1c6f16194cab91c0223e2eeda7ab (DEFAULT_TABLE table=default.Table_844d0b7797464d27aafe5c1e9f0b3492 [id=02da6366b9c8415baa5e0c95617dd4df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.977731 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 453a1c6f16194cab91c0223e2eeda7ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.979552 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 30205728339f4bcf8b7d94d6f373e01c with delete_type TABLET_DATA_DELETED (replaced by tablet e3999f53c1cc4cb5a1d91eed23785cc6) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:26.979715 1176 raft_consensus.cc:2243] T 71c518c87bdd4a63aa1016e8de6bafdc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.979892 1176 raft_consensus.cc:2272] T 71c518c87bdd4a63aa1016e8de6bafdc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.984499 1044 tablet_service.cc:1511] Processing CreateTablet for tablet c58290c2d1c742d3b45dfb5caf52c75b (DEFAULT_TABLE table=default.Table_4c142ec468934e08bfc73a90761bb104 [id=18d79b10f75b43efa4946ca8979a4235]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.985001 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c58290c2d1c742d3b45dfb5caf52c75b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.986528 1176 ts_tablet_manager.cc:1916] T 71c518c87bdd4a63aa1016e8de6bafdc P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:26.990442 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 9aeb492564a94a569f70506712dad4ed
I20260318 02:51:26.990742 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 2f80f29dfd814acd8b7e143a72231dfd (DEFAULT_TABLE table=default.Table_103c65f4b0d64732bb96cb99459082e6 [id=4dee1f40fb2b4b698dba47eb6c70cab2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:26.991166 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f80f29dfd814acd8b7e143a72231dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:26.993063 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 9aeb492564a94a569f70506712dad4ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:26.992656 1176 ts_tablet_manager.cc:1929] T 71c518c87bdd4a63aa1016e8de6bafdc P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:26.996928 1176 log.cc:1199] T 71c518c87bdd4a63aa1016e8de6bafdc P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/71c518c87bdd4a63aa1016e8de6bafdc
I20260318 02:51:26.997352 1176 ts_tablet_manager.cc:1950] T 71c518c87bdd4a63aa1016e8de6bafdc P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:26.998315 1176 tablet_replica.cc:333] T a4f891043b7d468da3e808980690354d P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:26.998561 1176 raft_consensus.cc:2243] T a4f891043b7d468da3e808980690354d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:26.998816 1176 raft_consensus.cc:2272] T a4f891043b7d468da3e808980690354d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:26.999902 1174 tablet_bootstrap.cc:492] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:27.000761 1174 ts_tablet_manager.cc:1403] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.006s
I20260318 02:51:27.001941 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 46ce65cca47f48db94e70226494cfbae
I20260318 02:51:27.002389 1174 raft_consensus.cc:359] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.002580 1174 raft_consensus.cc:385] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:27.002666 1174 raft_consensus.cc:740] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:27.000545 1176 ts_tablet_manager.cc:1916] T a4f891043b7d468da3e808980690354d P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:27.003908 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 71c518c87bdd4a63aa1016e8de6bafdc (table default.Table_346cff4fabb54f2ebef24b9eb0cf3be6 [id=dc28d96d1b5741de820129003145794b]) successfully deleted
I20260318 02:51:27.004491 764 tablet_service.cc:1511] Processing CreateTablet for tablet 453a1c6f16194cab91c0223e2eeda7ab (DEFAULT_TABLE table=default.Table_844d0b7797464d27aafe5c1e9f0b3492 [id=02da6366b9c8415baa5e0c95617dd4df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.004951 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 453a1c6f16194cab91c0223e2eeda7ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.005733 1174 consensus_queue.cc:260] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.007236 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 46ce65cca47f48db94e70226494cfbae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.007791 1174 ts_tablet_manager.cc:1434] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260318 02:51:27.008846 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 9aeb492564a94a569f70506712dad4ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:27.009239 752 tablet_service.cc:1511] Processing CreateTablet for tablet 2f80f29dfd814acd8b7e143a72231dfd (DEFAULT_TABLE table=default.Table_103c65f4b0d64732bb96cb99459082e6 [id=4dee1f40fb2b4b698dba47eb6c70cab2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.009588 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 46ce65cca47f48db94e70226494cfbae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:27.009902 762 tablet_service.cc:1511] Processing CreateTablet for tablet c58290c2d1c742d3b45dfb5caf52c75b (DEFAULT_TABLE table=default.Table_4c142ec468934e08bfc73a90761bb104 [id=18d79b10f75b43efa4946ca8979a4235]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.010406 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c58290c2d1c742d3b45dfb5caf52c75b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.010632 1174 tablet_bootstrap.cc:492] T 2b6267d3f6e142579c62bbb4b14da4b0 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:27.011291 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f80f29dfd814acd8b7e143a72231dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.012284 1174 tablet_bootstrap.cc:654] T 2b6267d3f6e142579c62bbb4b14da4b0 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:27.014032 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 5dd894706cc2466a8cd4e4df67856862 (DEFAULT_TABLE table=default.Table_51ec88321a154803836994b4c5430993 [id=f4308b8efe454170bce7eff85fab0959]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.014513 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dd894706cc2466a8cd4e4df67856862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.016062 757 tablet_service.cc:1511] Processing CreateTablet for tablet 6f527a0ba0914924bc7f604ae8a48393 (DEFAULT_TABLE table=default.Table_3064939f4dfb44dba19bb6f8f9c6f250 [id=b56547120b2645cc9c7cbd6078f7a039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.016559 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c0d87304c41481299f1e2ddfdfcfdec with delete_type TABLET_DATA_DELETED (replaced by tablet 565add8c21f343f2b11c12a9bb7ff111) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:27.017521 1037 tablet_service.cc:1511] Processing CreateTablet for tablet bac04b3e4ad448b09a1a25a754b44aad (DEFAULT_TABLE table=default.Table_2697bc78fa724b77aca8e7b6b4c7b938 [id=1532d6dc2cc641998f9c120075fa04b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.017879 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac04b3e4ad448b09a1a25a754b44aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.021616 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f527a0ba0914924bc7f604ae8a48393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.025971 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c0d87304c41481299f1e2ddfdfcfdec with delete_type TABLET_DATA_DELETED (replaced by tablet 565add8c21f343f2b11c12a9bb7ff111) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.026465 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 6f527a0ba0914924bc7f604ae8a48393 (DEFAULT_TABLE table=default.Table_3064939f4dfb44dba19bb6f8f9c6f250 [id=b56547120b2645cc9c7cbd6078f7a039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.026892 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f527a0ba0914924bc7f604ae8a48393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.028760 1176 ts_tablet_manager.cc:1929] T a4f891043b7d468da3e808980690354d P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:27.028892 1176 log.cc:1199] T a4f891043b7d468da3e808980690354d P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/a4f891043b7d468da3e808980690354d
I20260318 02:51:27.029300 1176 ts_tablet_manager.cc:1950] T a4f891043b7d468da3e808980690354d P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:27.030134 753 tablet_service.cc:1511] Processing CreateTablet for tablet 5dd894706cc2466a8cd4e4df67856862 (DEFAULT_TABLE table=default.Table_51ec88321a154803836994b4c5430993 [id=f4308b8efe454170bce7eff85fab0959]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.030565 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dd894706cc2466a8cd4e4df67856862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.034076 764 tablet_service.cc:1511] Processing CreateTablet for tablet bac04b3e4ad448b09a1a25a754b44aad (DEFAULT_TABLE table=default.Table_2697bc78fa724b77aca8e7b6b4c7b938 [id=1532d6dc2cc641998f9c120075fa04b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.034503 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac04b3e4ad448b09a1a25a754b44aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.038429 752 tablet_service.cc:1511] Processing CreateTablet for tablet 6e2a586892a24c71a956dbbe382484c9 (DEFAULT_TABLE table=default.Table_fe78e4c0a6624b86a4ce7ec2c634c5ee [id=ddf50b21f8b14d108f8527c3a634cd6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.039255 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e2a586892a24c71a956dbbe382484c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.044778 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 6e2a586892a24c71a956dbbe382484c9 (DEFAULT_TABLE table=default.Table_fe78e4c0a6624b86a4ce7ec2c634c5ee [id=ddf50b21f8b14d108f8527c3a634cd6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.045228 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e2a586892a24c71a956dbbe382484c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.050734 1174 tablet_bootstrap.cc:492] T 2b6267d3f6e142579c62bbb4b14da4b0 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:27.050906 1174 ts_tablet_manager.cc:1403] T 2b6267d3f6e142579c62bbb4b14da4b0 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.043s user 0.000s sys 0.009s
I20260318 02:51:27.051774 1174 raft_consensus.cc:359] T 2b6267d3f6e142579c62bbb4b14da4b0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.051988 1174 raft_consensus.cc:385] T 2b6267d3f6e142579c62bbb4b14da4b0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:27.052089 1174 raft_consensus.cc:740] T 2b6267d3f6e142579c62bbb4b14da4b0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:27.052381 1174 consensus_queue.cc:260] T 2b6267d3f6e142579c62bbb4b14da4b0 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.053334 1174 ts_tablet_manager.cc:1434] T 2b6267d3f6e142579c62bbb4b14da4b0 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:27.054066 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 46ce65cca47f48db94e70226494cfbae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:27.054474 901 tablet_service.cc:1511] Processing CreateTablet for tablet 5dd894706cc2466a8cd4e4df67856862 (DEFAULT_TABLE table=default.Table_51ec88321a154803836994b4c5430993 [id=f4308b8efe454170bce7eff85fab0959]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.030229 1176 tablet_replica.cc:333] T 2e16272bcf9c435a80b32ba9cba9c738 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:27.054934 1176 raft_consensus.cc:2243] T 2e16272bcf9c435a80b32ba9cba9c738 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:27.055099 1176 raft_consensus.cc:2272] T 2e16272bcf9c435a80b32ba9cba9c738 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:27.055892 1176 ts_tablet_manager.cc:1916] T 2e16272bcf9c435a80b32ba9cba9c738 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:27.057195 1174 tablet_bootstrap.cc:492] T 2adcc9f1ad69458c997475111bb787cf P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:27.058913 1174 tablet_bootstrap.cc:654] T 2adcc9f1ad69458c997475111bb787cf P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:27.062649 1176 ts_tablet_manager.cc:1929] T 2e16272bcf9c435a80b32ba9cba9c738 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:27.062788 1176 log.cc:1199] T 2e16272bcf9c435a80b32ba9cba9c738 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/2e16272bcf9c435a80b32ba9cba9c738
I20260318 02:51:27.063103 1176 ts_tablet_manager.cc:1950] T 2e16272bcf9c435a80b32ba9cba9c738 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:27.064482 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet a4f891043b7d468da3e808980690354d (table default.Table_607d1941968145a6a336b9a5bb85b43e [id=85784a23699343ee80e0adb9e5f82413]) successfully deleted
I20260318 02:51:27.064567 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_efdf3191da2441f598cdd7efdbd49a09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:27.064651 892 tablet_service.cc:1511] Processing CreateTablet for tablet 6e2a586892a24c71a956dbbe382484c9 (DEFAULT_TABLE table=default.Table_fe78e4c0a6624b86a4ce7ec2c634c5ee [id=ddf50b21f8b14d108f8527c3a634cd6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.065973 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c0d87304c41481299f1e2ddfdfcfdec with delete_type TABLET_DATA_DELETED (replaced by tablet 565add8c21f343f2b11c12a9bb7ff111) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:27.066212 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 9aeb492564a94a569f70506712dad4ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:27.066534 889 tablet_service.cc:1511] Processing CreateTablet for tablet 6f527a0ba0914924bc7f604ae8a48393 (DEFAULT_TABLE table=default.Table_3064939f4dfb44dba19bb6f8f9c6f250 [id=b56547120b2645cc9c7cbd6078f7a039]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.066747 1172 tablet_bootstrap.cc:492] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:27.066854 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 2e16272bcf9c435a80b32ba9cba9c738 (table default.Table_c15b5791e7ca4928bfeccb13448f1cf9 [id=259a4cc85c2f4ecdbf865398fefcb0e9]) successfully deleted
I20260318 02:51:27.066902 1172 ts_tablet_manager.cc:1403] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.125s user 0.001s sys 0.004s
I20260318 02:51:27.066934 891 tablet_service.cc:1511] Processing CreateTablet for tablet fe82e581368c4d8a894f0283c1a710fe (DEFAULT_TABLE table=default.Table_25a5e0aa32c245ff957460a7a51caa4d [id=831b3293b7eb44c6acb5de02d0769c1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.067279 907 tablet_service.cc:1511] Processing CreateTablet for tablet bac04b3e4ad448b09a1a25a754b44aad (DEFAULT_TABLE table=default.Table_2697bc78fa724b77aca8e7b6b4c7b938 [id=1532d6dc2cc641998f9c120075fa04b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.067545 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9a40c252bf664c028621b2e116ccc09a" } new_table_name: "default.Table_496e7d616c09464a884078334d256839" modify_external_catalogs: true
I20260318 02:51:27.068610 906 tablet_service.cc:1511] Processing CreateTablet for tablet e998e290291c443394f478c4ac1cfbd2 (DEFAULT_TABLE table=default.Table_cd3a5e50d5224cf59e0d62be2fa27753 [id=00651cbebdb046c9975ecfa30f08fce5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.069012 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0d5c3ad34b094deb9c076110a43cbe09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:27.069123 888 tablet_service.cc:1511] Processing CreateTablet for tablet 453a1c6f16194cab91c0223e2eeda7ab (DEFAULT_TABLE table=default.Table_844d0b7797464d27aafe5c1e9f0b3492 [id=02da6366b9c8415baa5e0c95617dd4df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.069399 902 tablet_service.cc:1511] Processing CreateTablet for tablet 2f80f29dfd814acd8b7e143a72231dfd (DEFAULT_TABLE table=default.Table_103c65f4b0d64732bb96cb99459082e6 [id=4dee1f40fb2b4b698dba47eb6c70cab2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.069821 1173 tablet_bootstrap.cc:654] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:27.070785 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 2bd6ac47ba044099ad9bd211ef8d26a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 7c4eca5e16f84564b31933b8227fd980) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:27.070814 1172 raft_consensus.cc:359] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.071015 1172 raft_consensus.cc:385] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:27.071102 1172 raft_consensus.cc:740] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:27.071364 1172 consensus_queue.cc:260] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.073261 1172 ts_tablet_manager.cc:1434] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s
I20260318 02:51:27.073549 1172 tablet_bootstrap.cc:492] T af802894346443669f1cc549a1ba401b P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:27.073609 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a5ebcddffd1546179104ffa49b666ca6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:27.074149 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5ebcddffd1546179104ffa49b666ca6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.075486 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 33d90a619ae54227aaf95acd180af119 (DEFAULT_TABLE table=default.Table_a8591dbe29954c789b3bb7ece252f89e [id=5d3de8b6b902412f900bbc2c35a4c2b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.076279 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d90a619ae54227aaf95acd180af119. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:27.079458 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_efdf3191da2441f598cdd7efdbd49a09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.080624 905 tablet_service.cc:1511] Processing CreateTablet for tablet c58290c2d1c742d3b45dfb5caf52c75b (DEFAULT_TABLE table=default.Table_4c142ec468934e08bfc73a90761bb104 [id=18d79b10f75b43efa4946ca8979a4235]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.081655 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e2a586892a24c71a956dbbe382484c9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:27.084813 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d5c3ad34b094deb9c076110a43cbe09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.089021 764 tablet_service.cc:1511] Processing CreateTablet for tablet 33d90a619ae54227aaf95acd180af119 (DEFAULT_TABLE table=default.Table_a8591dbe29954c789b3bb7ece252f89e [id=5d3de8b6b902412f900bbc2c35a4c2b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.089252 897 tablet_service.cc:1511] Processing CreateTablet for tablet 33d90a619ae54227aaf95acd180af119 (DEFAULT_TABLE table=default.Table_a8591dbe29954c789b3bb7ece252f89e [id=5d3de8b6b902412f900bbc2c35a4c2b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.089900 1172 tablet_bootstrap.cc:654] T af802894346443669f1cc549a1ba401b P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:27.091152 898 tablet_service.cc:1511] Processing CreateTablet for tablet fd1284c6e90d4beb8223fd807d7888ec (DEFAULT_TABLE table=default.Table_86b70df7bd76402aaa4c0b1faa730a62 [id=d1dd0940c55b4a4a97cf0f8543ebcaf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.091535 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c58290c2d1c742d3b45dfb5caf52c75b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.092149 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f527a0ba0914924bc7f604ae8a48393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.092862 1184 ts_tablet_manager.cc:1929] T 959faf1fbb224434b896c0f21e9715be P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:27.093067 1184 log.cc:1199] T 959faf1fbb224434b896c0f21e9715be P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/959faf1fbb224434b896c0f21e9715be
I20260318 02:51:27.093484 1184 ts_tablet_manager.cc:1950] T 959faf1fbb224434b896c0f21e9715be P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:27.091284 1176 tablet_replica.cc:333] T 30205728339f4bcf8b7d94d6f373e01c P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:27.095764 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 959faf1fbb224434b896c0f21e9715be (table default.Table_ebd103e5fbf4484597076b02ffd82044 [id=4067c18ce85f44d7993786a3e9bda883]) successfully deleted
I20260318 02:51:27.095992 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d90a619ae54227aaf95acd180af119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.096222 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd1284c6e90d4beb8223fd807d7888ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.098690 1034 tablet_service.cc:1511] Processing CreateTablet for tablet fd1284c6e90d4beb8223fd807d7888ec (DEFAULT_TABLE table=default.Table_86b70df7bd76402aaa4c0b1faa730a62 [id=d1dd0940c55b4a4a97cf0f8543ebcaf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.099084 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd1284c6e90d4beb8223fd807d7888ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.100798 753 tablet_service.cc:1511] Processing CreateTablet for tablet fd1284c6e90d4beb8223fd807d7888ec (DEFAULT_TABLE table=default.Table_86b70df7bd76402aaa4c0b1faa730a62 [id=d1dd0940c55b4a4a97cf0f8543ebcaf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.101233 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd1284c6e90d4beb8223fd807d7888ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.104228 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 824b9dc6982f425c9518c0ea3560bf84 (DEFAULT_TABLE table=default.Table_d20052125a004fa088aea68c2ec6d98f [id=64bdf02991a64246b7431e6e3c0e1268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.104734 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 824b9dc6982f425c9518c0ea3560bf84. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:27.106379 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b383fd49049c4c1daba3f1ed60899f3e consensus state has no leader
I20260318 02:51:27.106384 762 tablet_service.cc:1511] Processing CreateTablet for tablet 498f592fa2fb46748f7752004780fe46 (DEFAULT_TABLE table=default.Table_ca1cb05e473b4ee39a8175c8aee653a2 [id=4befe81a3de741b3b793c035b15547b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.106776 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 498f592fa2fb46748f7752004780fe46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.109011 757 tablet_service.cc:1511] Processing CreateTablet for tablet 824b9dc6982f425c9518c0ea3560bf84 (DEFAULT_TABLE table=default.Table_d20052125a004fa088aea68c2ec6d98f [id=64bdf02991a64246b7431e6e3c0e1268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.109335 1534 raft_consensus.cc:493] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:27.109413 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 824b9dc6982f425c9518c0ea3560bf84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.109521 1534 raft_consensus.cc:515] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.110152 1534 leader_election.cc:290] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:27.111096 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca23d4d0d3734fceb14966a4f2ad9c35 consensus state has no leader
W20260318 02:51:27.112993 999 leader_election.cc:343] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 677f33f9e4ad4859ab85692f7b7aad2a
I20260318 02:51:27.113020 758 tablet_service.cc:1511] Processing CreateTablet for tablet d8b956e389134a4485434a819a5df2e7 (DEFAULT_TABLE table=default.Table_5ceb6bf88c4743ee88d4fe26441e46ec [id=711aeebd6e7b4620b53d44b7692de91a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.113399 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b956e389134a4485434a819a5df2e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.115782 1044 tablet_service.cc:1511] Processing CreateTablet for tablet d8b956e389134a4485434a819a5df2e7 (DEFAULT_TABLE table=default.Table_5ceb6bf88c4743ee88d4fe26441e46ec [id=711aeebd6e7b4620b53d44b7692de91a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.116968 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 895aa252b9f243d89e972d1b717ee910 (DEFAULT_TABLE table=default.Table_3e1530524c914f3c9889d9523d232dc7 [id=6f9eb9fbda9846d495f3e70e229a5590]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.117444 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895aa252b9f243d89e972d1b717ee910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.115418 1176 raft_consensus.cc:2243] T 30205728339f4bcf8b7d94d6f373e01c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:27.116969 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 (DEFAULT_TABLE table=default.Table_be8f0eb1bb5b4ec8964d987ede6b0947 [id=aa309b4ad7d6425d853518c95e0e0461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.119240 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a65ccfd73234e8fb2bea5b6911cb3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.120519 895 tablet_service.cc:1511] Processing CreateTablet for tablet 824b9dc6982f425c9518c0ea3560bf84 (DEFAULT_TABLE table=default.Table_d20052125a004fa088aea68c2ec6d98f [id=64bdf02991a64246b7431e6e3c0e1268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.121250 904 tablet_service.cc:1511] Processing CreateTablet for tablet d8b956e389134a4485434a819a5df2e7 (DEFAULT_TABLE table=default.Table_5ceb6bf88c4743ee88d4fe26441e46ec [id=711aeebd6e7b4620b53d44b7692de91a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.121770 903 tablet_service.cc:1511] Processing CreateTablet for tablet 895aa252b9f243d89e972d1b717ee910 (DEFAULT_TABLE table=default.Table_3e1530524c914f3c9889d9523d232dc7 [id=6f9eb9fbda9846d495f3e70e229a5590]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.122301 900 tablet_service.cc:1511] Processing CreateTablet for tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 (DEFAULT_TABLE table=default.Table_be8f0eb1bb5b4ec8964d987ede6b0947 [id=aa309b4ad7d6425d853518c95e0e0461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.123238 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d90a619ae54227aaf95acd180af119. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.124087 896 tablet_service.cc:1511] Processing CreateTablet for tablet 498f592fa2fb46748f7752004780fe46 (DEFAULT_TABLE table=default.Table_ca1cb05e473b4ee39a8175c8aee653a2 [id=4befe81a3de741b3b793c035b15547b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.124374 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac04b3e4ad448b09a1a25a754b44aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.124969 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b956e389134a4485434a819a5df2e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.125299 760 tablet_service.cc:1511] Processing CreateTablet for tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 (DEFAULT_TABLE table=default.Table_be8f0eb1bb5b4ec8964d987ede6b0947 [id=aa309b4ad7d6425d853518c95e0e0461]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.125697 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a65ccfd73234e8fb2bea5b6911cb3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.126515 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895aa252b9f243d89e972d1b717ee910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.126709 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 453a1c6f16194cab91c0223e2eeda7ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.126784 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677f33f9e4ad4859ab85692f7b7aad2a" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:27.127765 997 leader_election.cc:343] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:27.127941 997 leader_election.cc:304] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:27.128981 1534 raft_consensus.cc:2749] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:27.129617 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a65ccfd73234e8fb2bea5b6911cb3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.129813 1172 tablet_bootstrap.cc:492] T af802894346443669f1cc549a1ba401b P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:27.129976 1172 ts_tablet_manager.cc:1403] T af802894346443669f1cc549a1ba401b P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.000s
I20260318 02:51:27.130733 1172 raft_consensus.cc:359] T af802894346443669f1cc549a1ba401b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.131582 1172 raft_consensus.cc:385] T af802894346443669f1cc549a1ba401b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:27.131652 1172 raft_consensus.cc:740] T af802894346443669f1cc549a1ba401b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:27.131687 756 tablet_service.cc:1511] Processing CreateTablet for tablet 895aa252b9f243d89e972d1b717ee910 (DEFAULT_TABLE table=default.Table_3e1530524c914f3c9889d9523d232dc7 [id=6f9eb9fbda9846d495f3e70e229a5590]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.131883 1172 consensus_queue.cc:260] T af802894346443669f1cc549a1ba401b P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.132082 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895aa252b9f243d89e972d1b717ee910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.133410 1172 ts_tablet_manager.cc:1434] T af802894346443669f1cc549a1ba401b P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:27.133713 1172 tablet_bootstrap.cc:492] T 6e9372f8871b473caa024512e936a6e5 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:27.134649 1176 raft_consensus.cc:2272] T 30205728339f4bcf8b7d94d6f373e01c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:27.137877 1172 tablet_bootstrap.cc:654] T 6e9372f8871b473caa024512e936a6e5 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:27.144237 766 tablet_service.cc:1511] Processing CreateTablet for tablet 2dab268da5e843cab5c28a521217df97 (DEFAULT_TABLE table=default.Table_ed19d9231be44ca5acea8b9a1cad67de [id=b8168c5ff40940f4ad3d544513810e9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.146106 1037 tablet_service.cc:1511] Processing CreateTablet for tablet ce82c595e30a4878be25be8eb3d30790 (DEFAULT_TABLE table=default.Table_06e760051f3b473f99521e4da99f8288 [id=c532f0623efe4c3f8d9c90ae9c3d02c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.146541 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce82c595e30a4878be25be8eb3d30790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.147526 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 5c89f413a26a43ef95c850d7c44f85b2 (DEFAULT_TABLE table=default.Table_571feb453416404b8733d890a9336fc4 [id=997461446ec8473382964afdb61aafb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.147739 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 2dab268da5e843cab5c28a521217df97 (DEFAULT_TABLE table=default.Table_ed19d9231be44ca5acea8b9a1cad67de [id=b8168c5ff40940f4ad3d544513810e9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.147955 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c89f413a26a43ef95c850d7c44f85b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.148561 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dab268da5e843cab5c28a521217df97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.149009 1041 tablet_service.cc:1511] Processing CreateTablet for tablet d0b01131720748688ca6c28985a3b3ff (DEFAULT_TABLE table=default.Table_9cec0b03f7c349e796f0e677adc54d0c [id=c21facd3dbe74a239960adf801256801]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.149353 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b01131720748688ca6c28985a3b3ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.152513 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 9c05f7a75527410e9c5cde0dbc6bc10e (DEFAULT_TABLE table=default.Table_07df9bd10c594e0ea40840e6f7e5d1c1 [id=113b6b3abc1a4dcc91c49be4704a159c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.152881 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c05f7a75527410e9c5cde0dbc6bc10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.156234 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dab268da5e843cab5c28a521217df97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.156315 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e998e290291c443394f478c4ac1cfbd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.158082 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_696d62e7ef59402ca5878b9a43539cc2" } new_table_name: "default.Table_fd8edd9c8882403f8541f00d0728e3b7" modify_external_catalogs: true
I20260318 02:51:27.158233 754 tablet_service.cc:1511] Processing CreateTablet for tablet 9c05f7a75527410e9c5cde0dbc6bc10e (DEFAULT_TABLE table=default.Table_07df9bd10c594e0ea40840e6f7e5d1c1 [id=113b6b3abc1a4dcc91c49be4704a159c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.158644 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c05f7a75527410e9c5cde0dbc6bc10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.158344 1176 ts_tablet_manager.cc:1916] T 30205728339f4bcf8b7d94d6f373e01c P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:27.158934 759 tablet_service.cc:1511] Processing CreateTablet for tablet ce82c595e30a4878be25be8eb3d30790 (DEFAULT_TABLE table=default.Table_06e760051f3b473f99521e4da99f8288 [id=c532f0623efe4c3f8d9c90ae9c3d02c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.159258 899 tablet_service.cc:1511] Processing CreateTablet for tablet 2dab268da5e843cab5c28a521217df97 (DEFAULT_TABLE table=default.Table_ed19d9231be44ca5acea8b9a1cad67de [id=b8168c5ff40940f4ad3d544513810e9b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.160329 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce82c595e30a4878be25be8eb3d30790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.161227 451 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 918c542a51864e54871efc5e7f62ef61 (table default.Table_8e59e35b5d3a48269cc70d7be773117b [id=ee10bea676fa4d1a837737c939f3306b]). Expected version 2 got 0
I20260318 02:51:27.162345 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_06e760051f3b473f99521e4da99f8288" } new_table_name: "default.Table_cf5f0ff49fa24bf18b21a4ebbe45d2e4" modify_external_catalogs: true
I20260318 02:51:27.164075 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 824b9dc6982f425c9518c0ea3560bf84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.164179 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_fb278b4a85874854972d2d299d913aec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:27.164748 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb278b4a85874854972d2d299d913aec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.165202 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dab268da5e843cab5c28a521217df97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.166051 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe82e581368c4d8a894f0283c1a710fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.167212 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_08987cfd708d4bb2b783719d46212566"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:27.167699 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08987cfd708d4bb2b783719d46212566 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.164426 764 tablet_service.cc:1511] Processing CreateTablet for tablet d0b01131720748688ca6c28985a3b3ff (DEFAULT_TABLE table=default.Table_9cec0b03f7c349e796f0e677adc54d0c [id=c21facd3dbe74a239960adf801256801]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.168902 763 tablet_service.cc:1511] Processing CreateTablet for tablet fb5d1d828899472e8f48723b35e94d62 (DEFAULT_TABLE table=default.Table_7692f02c62f94771bc39331507161bb2 [id=60f0afdd0f9f4c5196ea491b90991241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.169561 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b956e389134a4485434a819a5df2e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.170720 890 tablet_service.cc:1511] Processing CreateTablet for tablet ce82c595e30a4878be25be8eb3d30790 (DEFAULT_TABLE table=default.Table_06e760051f3b473f99521e4da99f8288 [id=c532f0623efe4c3f8d9c90ae9c3d02c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.170799 894 tablet_service.cc:1511] Processing CreateTablet for tablet 9c05f7a75527410e9c5cde0dbc6bc10e (DEFAULT_TABLE table=default.Table_07df9bd10c594e0ea40840e6f7e5d1c1 [id=113b6b3abc1a4dcc91c49be4704a159c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.171840 893 tablet_service.cc:1511] Processing CreateTablet for tablet d0b01131720748688ca6c28985a3b3ff (DEFAULT_TABLE table=default.Table_9cec0b03f7c349e796f0e677adc54d0c [id=c21facd3dbe74a239960adf801256801]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.173877 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b01131720748688ca6c28985a3b3ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.174150 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b6267d3f6e142579c62bbb4b14da4b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:27.174646 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce82c595e30a4878be25be8eb3d30790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.174896 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb5d1d828899472e8f48723b35e94d62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.175411 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9051f0735dad4cef8cbce07f27319d58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:27.175961 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9051f0735dad4cef8cbce07f27319d58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.176086 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f80f29dfd814acd8b7e143a72231dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.176595 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c05f7a75527410e9c5cde0dbc6bc10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.176997 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dd894706cc2466a8cd4e4df67856862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.179450 747 tablet_service.cc:1511] Processing CreateTablet for tablet b698d732a905469caaf564d9512ba02c (DEFAULT_TABLE table=default.Table_fceb58989e784893aefdc7fb9497f621 [id=eb11e3d1c3ef4295ac9b6ee657ac233a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.183064 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 498f592fa2fb46748f7752004780fe46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.192080 892 tablet_service.cc:1511] Processing CreateTablet for tablet 5c89f413a26a43ef95c850d7c44f85b2 (DEFAULT_TABLE table=default.Table_571feb453416404b8733d890a9336fc4 [id=997461446ec8473382964afdb61aafb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.192173 1040 tablet_service.cc:1511] Processing CreateTablet for tablet b894f0772a754196a3e651b38c46f001 (DEFAULT_TABLE table=default.Table_b3839730b36c41868e3760527839bafb [id=c5fda294c63f4731b2890404b92def44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.192549 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c89f413a26a43ef95c850d7c44f85b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.192909 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 498f592fa2fb46748f7752004780fe46 (DEFAULT_TABLE table=default.Table_ca1cb05e473b4ee39a8175c8aee653a2 [id=4befe81a3de741b3b793c035b15547b7]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:27.197983 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 9aeb492564a94a569f70506712dad4ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9aeb492564a94a569f70506712dad4ed already in progress: creating tablet
I20260318 02:51:27.202890 1029 tablet_service.cc:1511] Processing CreateTablet for tablet b698d732a905469caaf564d9512ba02c (DEFAULT_TABLE table=default.Table_fceb58989e784893aefdc7fb9497f621 [id=eb11e3d1c3ef4295ac9b6ee657ac233a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.203759 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 8e578c7498b6404cb87f493127005500 (DEFAULT_TABLE table=default.Table_f41e180b423949a7a0f65976f1b993ed [id=c0c36670f3a04ac8a2a792bc64a8249f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.203714 1044 tablet_service.cc:1511] Processing CreateTablet for tablet fb5d1d828899472e8f48723b35e94d62 (DEFAULT_TABLE table=default.Table_7692f02c62f94771bc39331507161bb2 [id=60f0afdd0f9f4c5196ea491b90991241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.205484 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b894f0772a754196a3e651b38c46f001. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:27.206073 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 46ce65cca47f48db94e70226494cfbae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46ce65cca47f48db94e70226494cfbae already in progress: creating tablet
W20260318 02:51:27.207362 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 7c0d87304c41481299f1e2ddfdfcfdec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c0d87304c41481299f1e2ddfdfcfdec already in progress: creating tablet
I20260318 02:51:27.208153 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 677f33f9e4ad4859ab85692f7b7aad2a with delete_type TABLET_DATA_DELETED (replaced by tablet c5765355efaa4ef4ab3b68ea33f51536) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.208573 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 498f592fa2fb46748f7752004780fe46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.208822 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e578c7498b6404cb87f493127005500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.212461 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f4978db62ff94982b1fbb4afc8e96b29" } modify_external_catalogs: true
I20260318 02:51:27.212682 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f4978db62ff94982b1fbb4afc8e96b29" } modify_external_catalogs: true
I20260318 02:51:27.215740 1184 tablet_replica.cc:333] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:27.216060 1184 raft_consensus.cc:2243] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:27.216195 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b01131720748688ca6c28985a3b3ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.216341 1184 raft_consensus.cc:2272] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:27.217612 1174 tablet_bootstrap.cc:492] T 2adcc9f1ad69458c997475111bb787cf P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:27.218266 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb5d1d828899472e8f48723b35e94d62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.218734 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b698d732a905469caaf564d9512ba02c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.222375 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet af802894346443669f1cc549a1ba401b with delete_type TABLET_DATA_DELETED (replaced by tablet 30205728339f4bcf8b7d94d6f373e01c) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:27.222586 443 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet b383fd49049c4c1daba3f1ed60899f3e (table default.Table_5ed9c43cfcf94d058b59ec604059817b [id=fc9e568fb3884c3ca8575e591393560e], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet b383fd49049c4c1daba3f1ed60899f3e consensus state has no leader
I20260318 02:51:27.239178 761 tablet_service.cc:1511] Processing CreateTablet for tablet 8e578c7498b6404cb87f493127005500 (DEFAULT_TABLE table=default.Table_f41e180b423949a7a0f65976f1b993ed [id=c0c36670f3a04ac8a2a792bc64a8249f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:27.242415 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 785f6728f94d41f3997961e3d1ebee34 consensus state has no leader
I20260318 02:51:27.245424 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e285c48a68a04ddca6c3da148d0f43f1" } modify_external_catalogs: true
I20260318 02:51:27.245653 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e285c48a68a04ddca6c3da148d0f43f1" } modify_external_catalogs: true
I20260318 02:51:27.247509 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7671b3be1e0c4259a325679c394aae2c" } modify_external_catalogs: true
I20260318 02:51:27.247673 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7671b3be1e0c4259a325679c394aae2c" } modify_external_catalogs: true
I20260318 02:51:27.248265 760 tablet_service.cc:1511] Processing CreateTablet for tablet 5c89f413a26a43ef95c850d7c44f85b2 (DEFAULT_TABLE table=default.Table_571feb453416404b8733d890a9336fc4 [id=997461446ec8473382964afdb61aafb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.249742 1175 ts_tablet_manager.cc:1929] T 3c283efbac08468c8c20f4caba90164c P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:27.250005 1184 ts_tablet_manager.cc:1916] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:27.250859 1175 log.cc:1199] T 3c283efbac08468c8c20f4caba90164c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/3c283efbac08468c8c20f4caba90164c
I20260318 02:51:27.251242 1175 ts_tablet_manager.cc:1950] T 3c283efbac08468c8c20f4caba90164c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:27.251767 1175 tablet_replica.cc:333] T 97655cb5968b4c819273068818d5cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:27.251947 1175 raft_consensus.cc:2243] T 97655cb5968b4c819273068818d5cab8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:27.252130 1175 raft_consensus.cc:2272] T 97655cb5968b4c819273068818d5cab8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:27.252610 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 3c283efbac08468c8c20f4caba90164c (table default.Table_376ed96eff2f4d13a0872f0984da4828 [id=7ac79bf8374d4166b204274f50a1db67]) successfully deleted
I20260318 02:51:27.253343 1175 ts_tablet_manager.cc:1916] T 97655cb5968b4c819273068818d5cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:27.257871 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_cfe05462158449cca7f529d5a37270be" } modify_external_catalogs: true
I20260318 02:51:27.258136 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_cfe05462158449cca7f529d5a37270be" } modify_external_catalogs: true
I20260318 02:51:27.248126 889 tablet_service.cc:1511] Processing CreateTablet for tablet fb5d1d828899472e8f48723b35e94d62 (DEFAULT_TABLE table=default.Table_7692f02c62f94771bc39331507161bb2 [id=60f0afdd0f9f4c5196ea491b90991241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.262058 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_103c65f4b0d64732bb96cb99459082e6" } modify_external_catalogs: true
I20260318 02:51:27.262274 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_103c65f4b0d64732bb96cb99459082e6" } modify_external_catalogs: true
W20260318 02:51:27.262894 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 99e807c8ff5e457fb6c97c6d1b277eab consensus state has no leader
I20260318 02:51:27.264775 898 tablet_service.cc:1511] Processing CreateTablet for tablet b698d732a905469caaf564d9512ba02c (DEFAULT_TABLE table=default.Table_fceb58989e784893aefdc7fb9497f621 [id=eb11e3d1c3ef4295ac9b6ee657ac233a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.265945 1173 tablet_bootstrap.cc:492] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:27.266093 1173 ts_tablet_manager.cc:1403] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.341s user 0.006s sys 0.011s
I20260318 02:51:27.266880 1173 raft_consensus.cc:359] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.267061 1173 raft_consensus.cc:385] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:27.267144 1173 raft_consensus.cc:740] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:27.267356 1173 consensus_queue.cc:260] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.267867 1173 ts_tablet_manager.cc:1434] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:27.268187 1173 tablet_bootstrap.cc:492] T ec32c25ae14b406cb6ab4d913b575091 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:27.265648 1174 ts_tablet_manager.cc:1403] T 2adcc9f1ad69458c997475111bb787cf P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.161s user 0.003s sys 0.000s
I20260318 02:51:27.270260 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b698d732a905469caaf564d9512ba02c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.275084 750 tablet_service.cc:1511] Processing CreateTablet for tablet b894f0772a754196a3e651b38c46f001 (DEFAULT_TABLE table=default.Table_b3839730b36c41868e3760527839bafb [id=c5fda294c63f4731b2890404b92def44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.279050 1667 raft_consensus.cc:493] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:27.281172 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e578c7498b6404cb87f493127005500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.286214 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b698d732a905469caaf564d9512ba02c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.279254 1667 raft_consensus.cc:515] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:27.295112 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb5d1d828899472e8f48723b35e94d62. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:27.299659 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce82c595e30a4878be25be8eb3d30790 consensus state has no leader
I20260318 02:51:27.311304 893 tablet_service.cc:1511] Processing CreateTablet for tablet b894f0772a754196a3e651b38c46f001 (DEFAULT_TABLE table=default.Table_b3839730b36c41868e3760527839bafb [id=c5fda294c63f4731b2890404b92def44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.311812 1616 catalog_manager.cc:1269] Loaded cluster ID: 97dfc1ee825e4087980ac883e1ff8527
I20260318 02:51:27.312392 1616 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900: loading cluster ID for follower catalog manager: success
I20260318 02:51:27.314421 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b894f0772a754196a3e651b38c46f001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.316308 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3e1530524c914f3c9889d9523d232dc7" } new_table_name: "default.Table_2afe66e6b2374e3c9b8e4692abb54d07" modify_external_catalogs: true
I20260318 02:51:27.319269 1173 tablet_bootstrap.cc:654] T ec32c25ae14b406cb6ab4d913b575091 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:27.319850 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bd753ce876de4105aa926dbfd9211391" } new_table_name: "default.Table_734eb14f943e4eab8ff7d14d00729858" modify_external_catalogs: true
I20260318 02:51:27.321414 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ecc8c866d2154ffbbb606dba2a14c2c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:27.322057 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecc8c866d2154ffbbb606dba2a14c2c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.322952 1172 tablet_bootstrap.cc:492] T 6e9372f8871b473caa024512e936a6e5 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:27.324069 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_88ba4f1da1534e4681a3d48f6ae0c52b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:27.323899 1172 ts_tablet_manager.cc:1403] T 6e9372f8871b473caa024512e936a6e5 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.190s user 0.007s sys 0.021s
W20260318 02:51:27.324601 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88ba4f1da1534e4681a3d48f6ae0c52b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.324048 1184 ts_tablet_manager.cc:1929] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:27.325016 1184 log.cc:1199] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/677f33f9e4ad4859ab85692f7b7aad2a
I20260318 02:51:27.326483 1184 ts_tablet_manager.cc:1950] T 677f33f9e4ad4859ab85692f7b7aad2a P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:27.327554 1172 raft_consensus.cc:359] T 6e9372f8871b473caa024512e936a6e5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.328296 1172 raft_consensus.cc:385] T 6e9372f8871b473caa024512e936a6e5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:27.328778 1172 raft_consensus.cc:740] T 6e9372f8871b473caa024512e936a6e5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:27.330111 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 677f33f9e4ad4859ab85692f7b7aad2a (table default.Table_a61fc584a9fb41fa9d17ab0aef58582d [id=a1611aa744774532bf8c16d8cc701c49]) successfully deleted
I20260318 02:51:27.331702 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b894f0772a754196a3e651b38c46f001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.329604 1172 consensus_queue.cc:260] T 6e9372f8871b473caa024512e936a6e5 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.332013 1184 tablet_replica.cc:333] T af802894346443669f1cc549a1ba401b P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:27.333313 903 tablet_service.cc:1511] Processing CreateTablet for tablet 8e578c7498b6404cb87f493127005500 (DEFAULT_TABLE table=default.Table_f41e180b423949a7a0f65976f1b993ed [id=c0c36670f3a04ac8a2a792bc64a8249f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.333468 1174 raft_consensus.cc:359] T 2adcc9f1ad69458c997475111bb787cf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.337766 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c89f413a26a43ef95c850d7c44f85b2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:27.338853 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 217781us
I20260318 02:51:27.338776 1667 leader_election.cc:290] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:27.340761 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd077319b3c443849de087eb61da6a77" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:27.344065 1174 raft_consensus.cc:385] T 2adcc9f1ad69458c997475111bb787cf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:27.344187 1174 raft_consensus.cc:740] T 2adcc9f1ad69458c997475111bb787cf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:27.344467 1174 consensus_queue.cc:260] T 2adcc9f1ad69458c997475111bb787cf P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.364606 1184 raft_consensus.cc:2243] T af802894346443669f1cc549a1ba401b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:27.364884 1621 raft_consensus.cc:493] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:27.365048 1621 raft_consensus.cc:515] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.365630 1621 leader_election.cc:290] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:27.366218 1174 ts_tablet_manager.cc:1434] T 2adcc9f1ad69458c997475111bb787cf P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.098s user 0.001s sys 0.001s
I20260318 02:51:27.366561 1174 tablet_bootstrap.cc:492] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:27.367168 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 59c6741a6d154d8f99d487c6590d2d26
I20260318 02:51:27.367897 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 8a0af3aecf4f485ebc54e1955eca8c92
I20260318 02:51:27.368342 1174 tablet_bootstrap.cc:654] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:27.374513 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a0af3aecf4f485ebc54e1955eca8c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:27.376595 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 59c6741a6d154d8f99d487c6590d2d26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:27.381012 719 leader_election.cc:343] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:27.376356 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a0af3aecf4f485ebc54e1955eca8c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.376977 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 59c6741a6d154d8f99d487c6590d2d26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.381899 1184 raft_consensus.cc:2272] T af802894346443669f1cc549a1ba401b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:27.381394 1172 ts_tablet_manager.cc:1434] T 6e9372f8871b473caa024512e936a6e5 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.057s user 0.000s sys 0.002s
I20260318 02:51:27.382531 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a08d8bbe3a4234b97203536db32078" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:27.383667 1172 tablet_bootstrap.cc:492] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:27.382118 1174 tablet_bootstrap.cc:492] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:27.385332 1174 ts_tablet_manager.cc:1403] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.001s
I20260318 02:51:27.386317 1174 raft_consensus.cc:359] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:27.386590 1174 raft_consensus.cc:385] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:27.386730 1174 raft_consensus.cc:740] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:27.387022 1174 consensus_queue.cc:260] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:27.390538 1174 ts_tablet_manager.cc:1434] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260318 02:51:27.391769 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet dea25aaad60a4b2483a8832f995d1316
W20260318 02:51:27.392660 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 895aa252b9f243d89e972d1b717ee910 consensus state has no leader
W20260318 02:51:27.393182 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9451d57fad72413c81443623c7995d4e consensus state has no leader
I20260318 02:51:27.394080 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet dea25aaad60a4b2483a8832f995d1316 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.394367 750 tablet_service.cc:1558] Processing DeleteTablet for tablet dea25aaad60a4b2483a8832f995d1316 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:27.395064 450 master_service.cc:954] ReplaceTablet: received request to replace tablet 785f6728f94d41f3997961e3d1ebee34 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:27.339908 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd077319b3c443849de087eb61da6a77" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:27.395891 1174 tablet_bootstrap.cc:492] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:27.350387 888 tablet_service.cc:1558] Processing DeleteTablet for tablet bf09f8234f36402bb9129d524637b5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:27.375880 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a0af3aecf4f485ebc54e1955eca8c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:27.376056 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 59c6741a6d154d8f99d487c6590d2d26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:27.397712 719 leader_election.cc:343] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:27.398167 899 tablet_service.cc:1558] Processing DeleteTablet for tablet dea25aaad60a4b2483a8832f995d1316 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:27.400007 1184 ts_tablet_manager.cc:1916] T af802894346443669f1cc549a1ba401b P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:27.401379 1172 tablet_bootstrap.cc:654] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:27.399191 1174 tablet_bootstrap.cc:654] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:27.403219 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 65f63eb5e114464988b3b89e3af61b61
I20260318 02:51:27.404228 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 65f63eb5e114464988b3b89e3af61b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.404453 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a08d8bbe3a4234b97203536db32078" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:27.404799 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 65f63eb5e114464988b3b89e3af61b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:27.405185 719 leader_election.cc:343] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:27.405376 719 leader_election.cc:304] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:27.405685 1673 raft_consensus.cc:2749] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:27.406445 719 leader_election.cc:343] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:27.406775 719 leader_election.cc:304] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:27.407028 1673 raft_consensus.cc:2749] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:27.409230 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 65f63eb5e114464988b3b89e3af61b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:27.410375 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e578c7498b6404cb87f493127005500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.421779 1176 ts_tablet_manager.cc:1929] T 30205728339f4bcf8b7d94d6f373e01c P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:27.421939 1176 log.cc:1199] T 30205728339f4bcf8b7d94d6f373e01c P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/30205728339f4bcf8b7d94d6f373e01c
I20260318 02:51:27.422334 1176 ts_tablet_manager.cc:1950] T 30205728339f4bcf8b7d94d6f373e01c P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:27.423446 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 30205728339f4bcf8b7d94d6f373e01c (table default.Table_7442f04ad30e435b84996fb8990e0a44 [id=40612e2dc3b7447f8f4f753bf5474c22]) successfully deleted
I20260318 02:51:27.431170 1175 ts_tablet_manager.cc:1929] T 97655cb5968b4c819273068818d5cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:27.431476 1175 log.cc:1199] T 97655cb5968b4c819273068818d5cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/97655cb5968b4c819273068818d5cab8
I20260318 02:51:27.431981 1175 ts_tablet_manager.cc:1950] T 97655cb5968b4c819273068818d5cab8 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:27.432663 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 97655cb5968b4c819273068818d5cab8 (table default.Table_db9a2182adab412682721c74365227db [id=b6525a69ead04b8ca17dfa20eb38d663]) successfully deleted
W20260318 02:51:27.433197 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 1ef3181adc0542229897369591a30465 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ef3181adc0542229897369591a30465 already in progress: creating tablet
W20260318 02:51:27.433609 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2882569524e74a308e9fabf533a8a87c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2882569524e74a308e9fabf533a8a87c already in progress: creating tablet
W20260318 02:51:27.434059 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 56335a4a2c294f67a22206e6a59e29a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56335a4a2c294f67a22206e6a59e29a8 already in progress: creating tablet
I20260318 02:51:27.434088 1175 tablet_replica.cc:333] T af802894346443669f1cc549a1ba401b P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:27.434418 1175 raft_consensus.cc:2243] T af802894346443669f1cc549a1ba401b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:27.434403 1172 tablet_bootstrap.cc:492] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:27.435570 1172 ts_tablet_manager.cc:1403] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.052s user 0.005s sys 0.002s
W20260318 02:51:27.436193 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 9aeb492564a94a569f70506712dad4ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9aeb492564a94a569f70506712dad4ed already in progress: creating tablet
W20260318 02:51:27.437055 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 46ce65cca47f48db94e70226494cfbae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46ce65cca47f48db94e70226494cfbae already in progress: creating tablet
W20260318 02:51:27.438840 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 7c0d87304c41481299f1e2ddfdfcfdec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c0d87304c41481299f1e2ddfdfcfdec already in progress: creating tablet
I20260318 02:51:27.440016 1176 tablet_replica.cc:333] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:27.441012 1176 raft_consensus.cc:2243] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:27.440335 1172 raft_consensus.cc:359] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.442771 1176 raft_consensus.cc:2272] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:27.445530 1175 raft_consensus.cc:2272] T af802894346443669f1cc549a1ba401b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:27.443003 1172 raft_consensus.cc:385] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:27.446015 1172 raft_consensus.cc:740] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:27.446686 1175 ts_tablet_manager.cc:1916] T af802894346443669f1cc549a1ba401b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:27.447625 1172 consensus_queue.cc:260] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.448635 1534 raft_consensus.cc:493] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:27.448796 1534 raft_consensus.cc:515] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.449440 1534 leader_election.cc:290] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:27.450011 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf09f8234f36402bb9129d524637b5b5" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:27.450212 927 raft_consensus.cc:2468] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:27.450671 997 leader_election.cc:304] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:27.450973 1534 raft_consensus.cc:2804] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:27.451050 1534 raft_consensus.cc:493] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:27.451170 1534 raft_consensus.cc:3060] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:27.454002 1534 raft_consensus.cc:515] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.454620 1173 tablet_bootstrap.cc:492] T ec32c25ae14b406cb6ab4d913b575091 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:27.454957 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a6a2143355de4e07bdbabc02ba2f188a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:27.455391 1534 leader_election.cc:290] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:27.455677 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6a2143355de4e07bdbabc02ba2f188a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.455850 1173 ts_tablet_manager.cc:1403] T ec32c25ae14b406cb6ab4d913b575091 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.187s user 0.000s sys 0.009s
I20260318 02:51:27.456656 1173 raft_consensus.cc:359] T ec32c25ae14b406cb6ab4d913b575091 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.456930 1173 raft_consensus.cc:385] T ec32c25ae14b406cb6ab4d913b575091 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:27.457019 1173 raft_consensus.cc:740] T ec32c25ae14b406cb6ab4d913b575091 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:27.457212 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e9372f8871b473caa024512e936a6e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 20c6f1790ed34581b7507ec63ec66718) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.457322 1173 consensus_queue.cc:260] T ec32c25ae14b406cb6ab4d913b575091 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.454973 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f22fc65d829b4c129f1c6e6f0ed2d066"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:27.458010 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f22fc65d829b4c129f1c6e6f0ed2d066 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.457029 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf09f8234f36402bb9129d524637b5b5" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:27.458267 927 raft_consensus.cc:3060] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:27.460863 452 master_service.cc:954] ReplaceTablet: received request to replace tablet ee07c93213d44d9bb156d9ad7937facf from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:27.460978 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_505f7e2e2efb42adbd4093b77505b13c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:27.461529 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_505f7e2e2efb42adbd4093b77505b13c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.462538 1173 ts_tablet_manager.cc:1434] T ec32c25ae14b406cb6ab4d913b575091 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260318 02:51:27.463542 927 raft_consensus.cc:2468] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:27.465166 997 leader_election.cc:304] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:27.465516 1534 raft_consensus.cc:2804] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:27.465667 1534 raft_consensus.cc:697] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:27.465924 1534 consensus_queue.cc:237] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.466511 1173 tablet_bootstrap.cc:492] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:27.468206 1173 tablet_bootstrap.cc:654] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:27.468977 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ee4a90e9175d492abacfccb2acf7c108" } new_table_name: "default.Table_1852ce7593344cc790f3c957fb56cd32" modify_external_catalogs: true
I20260318 02:51:27.469106 1685 tablet.cc:1723] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:27.470659 1175 ts_tablet_manager.cc:1929] T af802894346443669f1cc549a1ba401b P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:27.470909 1175 log.cc:1199] T af802894346443669f1cc549a1ba401b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/af802894346443669f1cc549a1ba401b
I20260318 02:51:27.471338 1175 ts_tablet_manager.cc:1950] T af802894346443669f1cc549a1ba401b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
W20260318 02:51:27.468627 999 leader_election.cc:343] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: bf09f8234f36402bb9129d524637b5b5
W20260318 02:51:27.472335 999 leader_election.cc:343] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: bf09f8234f36402bb9129d524637b5b5
I20260318 02:51:27.473624 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet af802894346443669f1cc549a1ba401b (table default.Table_7442f04ad30e435b84996fb8990e0a44 [id=40612e2dc3b7447f8f4f753bf5474c22]) successfully deleted
W20260318 02:51:27.473934 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 783c886a99994d6c8d9add724277819a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 783c886a99994d6c8d9add724277819a already in progress: creating tablet
I20260318 02:51:27.474447 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 2adcc9f1ad69458c997475111bb787cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:27.475804 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 46ce65cca47f48db94e70226494cfbae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46ce65cca47f48db94e70226494cfbae already in progress: creating tablet
W20260318 02:51:27.476152 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 7c0d87304c41481299f1e2ddfdfcfdec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c0d87304c41481299f1e2ddfdfcfdec already in progress: creating tablet
I20260318 02:51:27.476342 1175 tablet_replica.cc:333] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
W20260318 02:51:27.476472 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 9aeb492564a94a569f70506712dad4ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9aeb492564a94a569f70506712dad4ed already in progress: creating tablet
I20260318 02:51:27.476635 1175 raft_consensus.cc:2243] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:27.476918 1175 raft_consensus.cc:2272] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:27.481832 457 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 8c20810ad3354126bf49bbeeb6edb098 (table default.Table_4775eaa0e7e84642aa0a8f8b2885610e [id=463a6721eb0d43d09deeb283d1cc4233]). Expected version 1 got 0
I20260318 02:51:27.483894 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_deecd27166cf4d969acab284d9e382e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:27.484088 1174 tablet_bootstrap.cc:492] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:27.484261 1174 ts_tablet_manager.cc:1403] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.089s user 0.006s sys 0.006s
W20260318 02:51:27.484560 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_deecd27166cf4d969acab284d9e382e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.485682 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet bf09f8234f36402bb9129d524637b5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.487854 1044 tablet_service.cc:1511] Processing CreateTablet for tablet e418df45882c435a8276e46a8abf6bdd (DEFAULT_TABLE table=default.Table_3852466c8ce14d2caee518fe948fbdfc [id=3b169945a7bc477bb1a48b662948f322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.488335 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e418df45882c435a8276e46a8abf6bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.488296 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6c3be173e88b405ba8a9872aff3b8da7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:27.489506 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8e59e35b5d3a48269cc70d7be773117b" } new_table_name: "default.Table_52b5bed3ea5049e6801d3b8d3a8f39e1" modify_external_catalogs: true
I20260318 02:51:27.490067 903 tablet_service.cc:1511] Processing CreateTablet for tablet e418df45882c435a8276e46a8abf6bdd (DEFAULT_TABLE table=default.Table_3852466c8ce14d2caee518fe948fbdfc [id=3b169945a7bc477bb1a48b662948f322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.490475 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e418df45882c435a8276e46a8abf6bdd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:27.490657 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c3be173e88b405ba8a9872aff3b8da7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.492143 760 tablet_service.cc:1511] Processing CreateTablet for tablet e418df45882c435a8276e46a8abf6bdd (DEFAULT_TABLE table=default.Table_3852466c8ce14d2caee518fe948fbdfc [id=3b169945a7bc477bb1a48b662948f322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.492581 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e418df45882c435a8276e46a8abf6bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.492875 761 tablet_service.cc:1511] Processing CreateTablet for tablet 14c35d41da7146faa89d8af3bb5f5140 (DEFAULT_TABLE table=default.Table_c0b6d8ff98e2450f8518f5f6a80c82fd [id=7af9af044a264da9a9ea47523d6eeab3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.492931 750 tablet_service.cc:1511] Processing CreateTablet for tablet b10fd13bf3ea48b0896b34fce478e25a (DEFAULT_TABLE table=default.Table_b361769933b047a094f2220b0eb496c3 [id=a06743180c9e418590b66e4476eba4d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.493261 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c35d41da7146faa89d8af3bb5f5140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.497970 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet ee07c93213d44d9bb156d9ad7937facf
I20260318 02:51:27.498546 452 catalog_manager.cc:6741] ReplaceTablet: tablet ee07c93213d44d9bb156d9ad7937facf deleted and replaced by tablet fa077243d5634d888f3a191b7f9d2d19
I20260318 02:51:27.500756 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10fd13bf3ea48b0896b34fce478e25a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.501464 893 tablet_service.cc:1558] Processing DeleteTablet for tablet ec32c25ae14b406cb6ab4d913b575091 with delete_type TABLET_DATA_DELETED (replaced by tablet a0a6f4b34ff14714892ed9e9b3604dc9) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:27.501704 1035 tablet_service.cc:1511] Processing CreateTablet for tablet b10fd13bf3ea48b0896b34fce478e25a (DEFAULT_TABLE table=default.Table_b361769933b047a094f2220b0eb496c3 [id=a06743180c9e418590b66e4476eba4d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.501907 904 tablet_service.cc:1511] Processing CreateTablet for tablet b10fd13bf3ea48b0896b34fce478e25a (DEFAULT_TABLE table=default.Table_b361769933b047a094f2220b0eb496c3 [id=a06743180c9e418590b66e4476eba4d5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:27.501987 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a20b9dc70b5147ff8798946eda3131ca consensus state has no leader
I20260318 02:51:27.502099 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10fd13bf3ea48b0896b34fce478e25a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.502300 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10fd13bf3ea48b0896b34fce478e25a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.511658 1175 ts_tablet_manager.cc:1916] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:27.511950 1176 ts_tablet_manager.cc:1916] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:27.513067 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 3073fbe00c5d45b6b3100e927e0cc5c3 (DEFAULT_TABLE table=default.Table_1874597fd7ed4dfd86db402da16e53e8 [id=2c3964f728cc4231805fe553a37766ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.513543 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3073fbe00c5d45b6b3100e927e0cc5c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.514704 893 tablet_service.cc:1511] Processing CreateTablet for tablet 3073fbe00c5d45b6b3100e927e0cc5c3 (DEFAULT_TABLE table=default.Table_1874597fd7ed4dfd86db402da16e53e8 [id=2c3964f728cc4231805fe553a37766ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.516799 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3073fbe00c5d45b6b3100e927e0cc5c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.517841 1043 tablet_service.cc:1511] Processing CreateTablet for tablet a75f367cde75433d86a4ee9384e57761 (DEFAULT_TABLE table=default.Table_998db7d1aec14ebb8599ab941d9e29f0 [id=837cbf1e256f46f484ceb9ffa208891c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.518258 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75f367cde75433d86a4ee9384e57761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.521220 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet ee07c93213d44d9bb156d9ad7937facf with delete_type TABLET_DATA_DELETED (replaced by tablet fa077243d5634d888f3a191b7f9d2d19) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.522579 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 6deb99f7937144f39409929f99b135c5 (DEFAULT_TABLE table=default.Table_039d1d42521f4f9f8be161d0b97004f7 [id=19ba004fc5d143ffae445b129ce28b05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.522979 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6deb99f7937144f39409929f99b135c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.524037 898 tablet_service.cc:1511] Processing CreateTablet for tablet 6deb99f7937144f39409929f99b135c5 (DEFAULT_TABLE table=default.Table_039d1d42521f4f9f8be161d0b97004f7 [id=19ba004fc5d143ffae445b129ce28b05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.524487 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6deb99f7937144f39409929f99b135c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.525555 902 tablet_service.cc:1558] Processing DeleteTablet for tablet ee07c93213d44d9bb156d9ad7937facf with delete_type TABLET_DATA_DELETED (replaced by tablet fa077243d5634d888f3a191b7f9d2d19) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:27.526806 1184 ts_tablet_manager.cc:1929] T af802894346443669f1cc549a1ba401b P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:27.526947 1184 log.cc:1199] T af802894346443669f1cc549a1ba401b P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/af802894346443669f1cc549a1ba401b
I20260318 02:51:27.527361 1184 ts_tablet_manager.cc:1950] T af802894346443669f1cc549a1ba401b P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:27.528805 1173 tablet_bootstrap.cc:492] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:27.529042 1173 ts_tablet_manager.cc:1403] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.063s user 0.004s sys 0.002s
I20260318 02:51:27.529908 1173 raft_consensus.cc:359] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.530349 1173 raft_consensus.cc:385] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:27.530483 1173 raft_consensus.cc:740] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:27.515811 904 tablet_service.cc:1511] Processing CreateTablet for tablet 14c35d41da7146faa89d8af3bb5f5140 (DEFAULT_TABLE table=default.Table_c0b6d8ff98e2450f8518f5f6a80c82fd [id=7af9af044a264da9a9ea47523d6eeab3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.530757 1173 consensus_queue.cc:260] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.531252 1173 ts_tablet_manager.cc:1434] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:27.532081 1173 tablet_bootstrap.cc:492] T 7cfaf92570b34b2bb1f52aea06187c83 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:27.533795 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 918c542a51864e54871efc5e7f62ef61 consensus state has no leader
I20260318 02:51:27.534400 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2f80f29dfd814acd8b7e143a72231dfd
I20260318 02:51:27.536068 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 785f6728f94d41f3997961e3d1ebee34
I20260318 02:51:27.536471 450 catalog_manager.cc:6741] ReplaceTablet: tablet 785f6728f94d41f3997961e3d1ebee34 deleted and replaced by tablet ca4e1eec9a2148488295416cd68ca607
I20260318 02:51:27.537590 1686 tablet.cc:1723] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:27.546422 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f80f29dfd814acd8b7e143a72231dfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:27.546813 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 785f6728f94d41f3997961e3d1ebee34 with delete_type TABLET_DATA_DELETED (replaced by tablet ca4e1eec9a2148488295416cd68ca607) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:27.546777 747 tablet_service.cc:1511] Processing CreateTablet for tablet 6deb99f7937144f39409929f99b135c5 (DEFAULT_TABLE table=default.Table_039d1d42521f4f9f8be161d0b97004f7 [id=19ba004fc5d143ffae445b129ce28b05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.547173 1172 ts_tablet_manager.cc:1434] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.111s user 0.003s sys 0.003s
I20260318 02:51:27.548157 763 tablet_service.cc:1511] Processing CreateTablet for tablet 831a7cb00e7040a7ade210c755dbff4a (DEFAULT_TABLE table=default.Table_31b24fd18b9b40ab89543ca570eac050 [id=0cdd67bea79141b9b8dd73a581deb69c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.548509 761 tablet_service.cc:1511] Processing CreateTablet for tablet 3073fbe00c5d45b6b3100e927e0cc5c3 (DEFAULT_TABLE table=default.Table_1874597fd7ed4dfd86db402da16e53e8 [id=2c3964f728cc4231805fe553a37766ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.548815 753 tablet_service.cc:1511] Processing CreateTablet for tablet 5a92761edfe74a9798da4d93964383ea (DEFAULT_TABLE table=default.Table_8b91091dce7d43b9b2abf2ef5262b12c [id=519eccded71a4f229484640ce6c21a89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.548905 750 tablet_service.cc:1511] Processing CreateTablet for tablet a75f367cde75433d86a4ee9384e57761 (DEFAULT_TABLE table=default.Table_998db7d1aec14ebb8599ab941d9e29f0 [id=837cbf1e256f46f484ceb9ffa208891c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.549299 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6deb99f7937144f39409929f99b135c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.550876 1172 tablet_bootstrap.cc:492] T ec32c25ae14b406cb6ab4d913b575091 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:27.551155 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75f367cde75433d86a4ee9384e57761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.552507 1172 tablet_bootstrap.cc:654] T ec32c25ae14b406cb6ab4d913b575091 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:27.552866 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3073fbe00c5d45b6b3100e927e0cc5c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.553686 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c35d41da7146faa89d8af3bb5f5140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.553857 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a92761edfe74a9798da4d93964383ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.556375 893 tablet_service.cc:1511] Processing CreateTablet for tablet a75f367cde75433d86a4ee9384e57761 (DEFAULT_TABLE table=default.Table_998db7d1aec14ebb8599ab941d9e29f0 [id=837cbf1e256f46f484ceb9ffa208891c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.556830 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75f367cde75433d86a4ee9384e57761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.557041 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 831a7cb00e7040a7ade210c755dbff4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.557092 450 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_9faefa2c0ceb4495935b65b6869b4b7a [id=84a657155372475db438c6eb3119b595] alter complete (version 2)
I20260318 02:51:27.560223 764 tablet_service.cc:1511] Processing CreateTablet for tablet d3b37df330984378b81b367446d34748 (DEFAULT_TABLE table=default.Table_fe927bc33c094a8bbec3557ad85c8e15 [id=ee1d866cd2674882bf473a546725ff76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.560654 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b37df330984378b81b367446d34748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.568228 1173 tablet_bootstrap.cc:654] T 7cfaf92570b34b2bb1f52aea06187c83 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:27.569746 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b27c31a9cf2c4e53b57bff83bb0ff243" } new_table_name: "default.Table_fe03be40cbc54d21927bda17030ed005" modify_external_catalogs: true
I20260318 02:51:27.569950 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7852bda585cb4d9b99d507f2a7ddaec6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:27.570083 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet af802894346443669f1cc549a1ba401b (table default.Table_7442f04ad30e435b84996fb8990e0a44 [id=40612e2dc3b7447f8f4f753bf5474c22]) successfully deleted
W20260318 02:51:27.570533 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7852bda585cb4d9b99d507f2a7ddaec6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.571208 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_20ad72acdab447458f7b870f7a55b9ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:27.571410 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 14c35d41da7146faa89d8af3bb5f5140 (DEFAULT_TABLE table=default.Table_c0b6d8ff98e2450f8518f5f6a80c82fd [id=7af9af044a264da9a9ea47523d6eeab3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.571626 457 master_service.cc:954] ReplaceTablet: received request to replace tablet 29541950221544e396ada303fbbb5002 from {username='slave'} at 127.0.0.1:47158
W20260318 02:51:27.571681 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20ad72acdab447458f7b870f7a55b9ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.571815 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c35d41da7146faa89d8af3bb5f5140. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.569660 898 tablet_service.cc:1511] Processing CreateTablet for tablet 831a7cb00e7040a7ade210c755dbff4a (DEFAULT_TABLE table=default.Table_31b24fd18b9b40ab89543ca570eac050 [id=0cdd67bea79141b9b8dd73a581deb69c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.576505 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 831a7cb00e7040a7ade210c755dbff4a (DEFAULT_TABLE table=default.Table_31b24fd18b9b40ab89543ca570eac050 [id=0cdd67bea79141b9b8dd73a581deb69c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.577087 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 831a7cb00e7040a7ade210c755dbff4a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:27.570530 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 8a0af3aecf4f485ebc54e1955eca8c92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a0af3aecf4f485ebc54e1955eca8c92 already in progress: creating tablet
W20260318 02:51:27.581418 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 59c6741a6d154d8f99d487c6590d2d26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59c6741a6d154d8f99d487c6590d2d26 already in progress: creating tablet
I20260318 02:51:27.581494 1184 tablet_replica.cc:333] T 6e9372f8871b473caa024512e936a6e5 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:27.581694 1184 raft_consensus.cc:2243] T 6e9372f8871b473caa024512e936a6e5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:27.581753 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet dea25aaad60a4b2483a8832f995d1316 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dea25aaad60a4b2483a8832f995d1316 already in progress: creating tablet
I20260318 02:51:27.581887 1184 raft_consensus.cc:2272] T 6e9372f8871b473caa024512e936a6e5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:27.582657 1616 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900: acquiring CA information for follower catalog manager: success
W20260318 02:51:27.583416 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 65f63eb5e114464988b3b89e3af61b61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65f63eb5e114464988b3b89e3af61b61 already in progress: creating tablet
W20260318 02:51:27.586345 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c4051c8e4d3d49829f9eac8e36baab2f consensus state has no leader
I20260318 02:51:27.586746 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f80f29dfd814acd8b7e143a72231dfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.587317 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 5a92761edfe74a9798da4d93964383ea (DEFAULT_TABLE table=default.Table_8b91091dce7d43b9b2abf2ef5262b12c [id=519eccded71a4f229484640ce6c21a89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.587785 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a92761edfe74a9798da4d93964383ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.591089 1172 tablet_bootstrap.cc:492] T ec32c25ae14b406cb6ab4d913b575091 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:27.591305 1172 ts_tablet_manager.cc:1403] T ec32c25ae14b406cb6ab4d913b575091 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.001s
I20260318 02:51:27.591686 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 831a7cb00e7040a7ade210c755dbff4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.592262 1172 raft_consensus.cc:359] T ec32c25ae14b406cb6ab4d913b575091 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.592520 1172 raft_consensus.cc:385] T ec32c25ae14b406cb6ab4d913b575091 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:27.592655 1172 raft_consensus.cc:740] T ec32c25ae14b406cb6ab4d913b575091 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:27.592994 1172 consensus_queue.cc:260] T ec32c25ae14b406cb6ab4d913b575091 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.596549 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f80f29dfd814acd8b7e143a72231dfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:27.596921 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 785f6728f94d41f3997961e3d1ebee34 with delete_type TABLET_DATA_DELETED (replaced by tablet ca4e1eec9a2148488295416cd68ca607) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.597299 893 tablet_service.cc:1511] Processing CreateTablet for tablet 5a92761edfe74a9798da4d93964383ea (DEFAULT_TABLE table=default.Table_8b91091dce7d43b9b2abf2ef5262b12c [id=519eccded71a4f229484640ce6c21a89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.597735 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a92761edfe74a9798da4d93964383ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.597896 1029 tablet_service.cc:1511] Processing CreateTablet for tablet d3b37df330984378b81b367446d34748 (DEFAULT_TABLE table=default.Table_fe927bc33c094a8bbec3557ad85c8e15 [id=ee1d866cd2674882bf473a546725ff76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.598268 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b37df330984378b81b367446d34748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.598894 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 785f6728f94d41f3997961e3d1ebee34 with delete_type TABLET_DATA_DELETED (replaced by tablet ca4e1eec9a2148488295416cd68ca607) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:27.600075 903 tablet_service.cc:1511] Processing CreateTablet for tablet d3b37df330984378b81b367446d34748 (DEFAULT_TABLE table=default.Table_fe927bc33c094a8bbec3557ad85c8e15 [id=ee1d866cd2674882bf473a546725ff76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.600430 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3b37df330984378b81b367446d34748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.601090 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 677f33f9e4ad4859ab85692f7b7aad2a with delete_type TABLET_DATA_DELETED (replaced by tablet c5765355efaa4ef4ab3b68ea33f51536) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:27.601502 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 4052eede3f404b84ac27e21a204bf5a9 (DEFAULT_TABLE table=default.Table_f4cd103bfd1d46beb3655a4dc4c8c3b8 [id=9995967cb4594c8b89df60677db4cad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.601567 902 tablet_service.cc:1511] Processing CreateTablet for tablet 4052eede3f404b84ac27e21a204bf5a9 (DEFAULT_TABLE table=default.Table_f4cd103bfd1d46beb3655a4dc4c8c3b8 [id=9995967cb4594c8b89df60677db4cad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.601857 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4052eede3f404b84ac27e21a204bf5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.601891 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4052eede3f404b84ac27e21a204bf5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.602149 1176 ts_tablet_manager.cc:1929] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:27.602164 1673 raft_consensus.cc:493] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:27.609200 1557 raft_consensus.cc:493] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:27.609378 1557 raft_consensus.cc:515] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.609515 1176 log.cc:1199] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/2bd6ac47ba044099ad9bd211ef8d26a2
I20260318 02:51:27.609964 1176 ts_tablet_manager.cc:1950] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:27.610080 1557 leader_election.cc:290] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:27.611215 862 leader_election.cc:343] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 677f33f9e4ad4859ab85692f7b7aad2a
I20260318 02:51:27.613441 760 tablet_service.cc:1558] Processing DeleteTablet for tablet ee07c93213d44d9bb156d9ad7937facf with delete_type TABLET_DATA_DELETED (replaced by tablet fa077243d5634d888f3a191b7f9d2d19) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:27.614267 1673 raft_consensus.cc:515] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:27.614563 860 leader_election.cc:343] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 677f33f9e4ad4859ab85692f7b7aad2a
I20260318 02:51:27.614724 860 leader_election.cc:304] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:27.615190 1557 raft_consensus.cc:2749] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:27.615772 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 2bd6ac47ba044099ad9bd211ef8d26a2 (table default.Table_55d80bc4ac3d4e72b2c5e6a694968f83 [id=541170c7c4bf49deb86cd4c15ffdd04f]) successfully deleted
I20260318 02:51:27.618533 1176 tablet_replica.cc:333] T 2b6267d3f6e142579c62bbb4b14da4b0 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:27.618757 1176 raft_consensus.cc:2243] T 2b6267d3f6e142579c62bbb4b14da4b0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:27.619320 1176 raft_consensus.cc:2272] T 2b6267d3f6e142579c62bbb4b14da4b0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:27.619594 1172 ts_tablet_manager.cc:1434] T ec32c25ae14b406cb6ab4d913b575091 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
I20260318 02:51:27.621035 1176 ts_tablet_manager.cc:1916] T 2b6267d3f6e142579c62bbb4b14da4b0 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:27.621042 760 tablet_service.cc:1511] Processing CreateTablet for tablet cb29fd9d6fc845b2aaffe34c290fd5ca (DEFAULT_TABLE table=default.Table_3188dcbe312043c3a4d363f0efa90709 [id=cc1e96ac2459417795a39cf88dd1edcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.622422 747 tablet_service.cc:1511] Processing CreateTablet for tablet 4052eede3f404b84ac27e21a204bf5a9 (DEFAULT_TABLE table=default.Table_f4cd103bfd1d46beb3655a4dc4c8c3b8 [id=9995967cb4594c8b89df60677db4cad6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.622771 1673 leader_election.cc:290] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:27.624257 763 tablet_service.cc:1511] Processing CreateTablet for tablet 306367152e834668bbf5fcadd008b3ea (DEFAULT_TABLE table=default.Table_20b2dbf580454a4a993130bde0ae0265 [id=41496f910c434ed4a7affece7e7efb74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.626049 1184 ts_tablet_manager.cc:1916] T 6e9372f8871b473caa024512e936a6e5 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:27.626340 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4052eede3f404b84ac27e21a204bf5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.629530 761 tablet_service.cc:1511] Processing CreateTablet for tablet 77a17ef7cfee4d65808b11e9cb51e7df (DEFAULT_TABLE table=default.Table_a23a3971bb3546c6ad6966b77bf7a8ba [id=94a6d43822c04d3ba847366297c204f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.629956 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a17ef7cfee4d65808b11e9cb51e7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.631711 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb29fd9d6fc845b2aaffe34c290fd5ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.638075 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c20810ad3354126bf49bbeeb6edb098" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:27.639079 1174 raft_consensus.cc:359] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.640776 750 tablet_service.cc:1511] Processing CreateTablet for tablet defda79dd0f34c37ae16ea808df0754b (DEFAULT_TABLE table=default.Table_3aa749750bd542738790c713a8ff0713 [id=c6ec8a81c28d493396980349b4ea31d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.641346 753 tablet_service.cc:1511] Processing CreateTablet for tablet 565add8c21f343f2b11c12a9bb7ff111 (DEFAULT_TABLE table=default.Table_b4f791ee528d46b59428dc367b5be0a8 [id=e3979c7eefe84cd7bb1dd36fa9351b7e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:27.641877 719 leader_election.cc:343] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:27.642138 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 306367152e834668bbf5fcadd008b3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.642489 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet defda79dd0f34c37ae16ea808df0754b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.644220 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3fda21034cb44e32a46bd033d7e4aa55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:27.644465 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_394ace014c534ba89ca6accaf1363761" } new_table_name: "default.Table_8a612850d1784dda9f09b14b7e12b28c" modify_external_catalogs: true
W20260318 02:51:27.644907 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fda21034cb44e32a46bd033d7e4aa55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.645920 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9faefa2c0ceb4495935b65b6869b4b7a" } new_table_name: "default.Table_4a0d32e1914846ec81bdfcb8a0fd758e" modify_external_catalogs: true
I20260318 02:51:27.646095 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_30dc528b33264c9faed7f9f325d93738" } modify_external_catalogs: true
I20260318 02:51:27.646251 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_30dc528b33264c9faed7f9f325d93738" } modify_external_catalogs: true
I20260318 02:51:27.647127 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4ced5c1198ce406b85fbee4bbe6368c0" } modify_external_catalogs: true
I20260318 02:51:27.647300 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4ced5c1198ce406b85fbee4bbe6368c0" } modify_external_catalogs: true
I20260318 02:51:27.647480 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_944b58673e2348228ec36d8ba31e25b4" } modify_external_catalogs: true
I20260318 02:51:27.647652 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_944b58673e2348228ec36d8ba31e25b4" } modify_external_catalogs: true
I20260318 02:51:27.647727 451 master_service.cc:954] ReplaceTablet: received request to replace tablet 20c6f1790ed34581b7507ec63ec66718 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:27.648283 1175 ts_tablet_manager.cc:1929] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:27.648427 1175 log.cc:1199] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/bf09f8234f36402bb9129d524637b5b5
I20260318 02:51:27.626565 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c20810ad3354126bf49bbeeb6edb098" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:27.627777 1172 tablet_bootstrap.cc:492] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:27.651429 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f22fc65d829b4c129f1c6e6f0ed2d066" } modify_external_catalogs: true
I20260318 02:51:27.651629 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f22fc65d829b4c129f1c6e6f0ed2d066" } modify_external_catalogs: true
I20260318 02:51:27.652518 1175 ts_tablet_manager.cc:1950] T bf09f8234f36402bb9129d524637b5b5 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:27.652667 1172 tablet_bootstrap.cc:654] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:27.654687 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 41646d513e834600a209761392ac7fb1 consensus state has no leader
I20260318 02:51:27.655135 1175 tablet_replica.cc:333] T ec32c25ae14b406cb6ab4d913b575091 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:27.656188 449 master_service.cc:954] ReplaceTablet: received request to replace tablet c4051c8e4d3d49829f9eac8e36baab2f from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:27.657298 1041 tablet_service.cc:1511] Processing CreateTablet for tablet cb29fd9d6fc845b2aaffe34c290fd5ca (DEFAULT_TABLE table=default.Table_3188dcbe312043c3a4d363f0efa90709 [id=cc1e96ac2459417795a39cf88dd1edcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.657737 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb29fd9d6fc845b2aaffe34c290fd5ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.657913 902 tablet_service.cc:1511] Processing CreateTablet for tablet cb29fd9d6fc845b2aaffe34c290fd5ca (DEFAULT_TABLE table=default.Table_3188dcbe312043c3a4d363f0efa90709 [id=cc1e96ac2459417795a39cf88dd1edcf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:27.658092 719 leader_election.cc:343] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:27.658310 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb29fd9d6fc845b2aaffe34c290fd5ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.655345 1175 raft_consensus.cc:2243] T ec32c25ae14b406cb6ab4d913b575091 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:27.660967 1175 raft_consensus.cc:2272] T ec32c25ae14b406cb6ab4d913b575091 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:27.661832 1175 ts_tablet_manager.cc:1916] T ec32c25ae14b406cb6ab4d913b575091 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:27.665309 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 9d20847fa6f9461cb6137f56ea680cb6
I20260318 02:51:27.666378 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 6bb381f10d87414f9c1a99942216adc7
I20260318 02:51:27.666467 719 leader_election.cc:304] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:27.667032 1667 raft_consensus.cc:2749] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:27.667282 1673 raft_consensus.cc:493] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:27.667950 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 565add8c21f343f2b11c12a9bb7ff111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.668618 1621 raft_consensus.cc:493] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:27.668875 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d20847fa6f9461cb6137f56ea680cb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:27.668789 1621 raft_consensus.cc:515] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.671311 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet c4051c8e4d3d49829f9eac8e36baab2f
I20260318 02:51:27.671794 449 catalog_manager.cc:6741] ReplaceTablet: tablet c4051c8e4d3d49829f9eac8e36baab2f deleted and replaced by tablet 258dc29e4e4245289b7e450837edcd24
I20260318 02:51:27.672878 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c542a51864e54871efc5e7f62ef61" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:27.673154 1673 raft_consensus.cc:515] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:27.673460 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c542a51864e54871efc5e7f62ef61" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:27.674539 450 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet b86658b191bd4eaab3a24f0941a89fba
I20260318 02:51:27.675885 1673 leader_election.cc:290] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:27.682183 1621 leader_election.cc:290] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:27.682888 719 leader_election.cc:343] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:27.683776 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5765355efaa4ef4ab3b68ea33f51536" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:27.684088 719 leader_election.cc:343] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:27.684237 719 leader_election.cc:304] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:27.684338 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5765355efaa4ef4ab3b68ea33f51536" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:27.684655 1621 raft_consensus.cc:2749] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:27.685087 719 leader_election.cc:343] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:27.685384 719 leader_election.cc:343] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:27.685958 1175 ts_tablet_manager.cc:1929] T ec32c25ae14b406cb6ab4d913b575091 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:27.686702 719 leader_election.cc:304] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:27.687284 1621 raft_consensus.cc:2749] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:27.688194 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet ec32c25ae14b406cb6ab4d913b575091 with delete_type TABLET_DATA_DELETED (replaced by tablet a0a6f4b34ff14714892ed9e9b3604dc9) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.688804 1685 tablet.cc:1718] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad: Skipping requested alter to schema version 2, tablet already version 2
I20260318 02:51:27.689038 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 77a17ef7cfee4d65808b11e9cb51e7df (DEFAULT_TABLE table=default.Table_a23a3971bb3546c6ad6966b77bf7a8ba [id=94a6d43822c04d3ba847366297c204f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.689411 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a17ef7cfee4d65808b11e9cb51e7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.690325 1686 tablet.cc:1718] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d: Skipping requested alter to schema version 2, tablet already version 2
I20260318 02:51:27.692770 747 tablet_service.cc:1558] Processing DeleteTablet for tablet c4051c8e4d3d49829f9eac8e36baab2f with delete_type TABLET_DATA_DELETED (replaced by tablet 258dc29e4e4245289b7e450837edcd24) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:27.693008 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bb381f10d87414f9c1a99942216adc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:27.696017 1172 tablet_bootstrap.cc:492] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:27.696332 1686 tablet.cc:1723] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:27.697005 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 306367152e834668bbf5fcadd008b3ea (DEFAULT_TABLE table=default.Table_20b2dbf580454a4a993130bde0ae0265 [id=41496f910c434ed4a7affece7e7efb74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.697757 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 306367152e834668bbf5fcadd008b3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.703154 1685 tablet.cc:1723] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:27.705418 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet bf09f8234f36402bb9129d524637b5b5 (table default.Table_3fbf83db2cc447889b1a1d67741ca227 [id=cf74ccfff792402d87f23ac8a4988e5a]) successfully deleted
W20260318 02:51:27.705884 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 8a0af3aecf4f485ebc54e1955eca8c92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a0af3aecf4f485ebc54e1955eca8c92 already in progress: creating tablet
I20260318 02:51:27.706413 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 565add8c21f343f2b11c12a9bb7ff111 (DEFAULT_TABLE table=default.Table_b4f791ee528d46b59428dc367b5be0a8 [id=e3979c7eefe84cd7bb1dd36fa9351b7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.707496 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 565add8c21f343f2b11c12a9bb7ff111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.708375 1172 ts_tablet_manager.cc:1403] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.081s user 0.012s sys 0.003s
I20260318 02:51:27.709761 1172 raft_consensus.cc:359] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.710274 1176 ts_tablet_manager.cc:1929] T 2b6267d3f6e142579c62bbb4b14da4b0 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:27.710400 1172 raft_consensus.cc:385] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:27.710544 1172 raft_consensus.cc:740] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:27.686277 1694 tablet.cc:1723] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:27.711004 1172 consensus_queue.cc:260] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.711736 1035 tablet_service.cc:1511] Processing CreateTablet for tablet defda79dd0f34c37ae16ea808df0754b (DEFAULT_TABLE table=default.Table_3aa749750bd542738790c713a8ff0713 [id=c6ec8a81c28d493396980349b4ea31d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.712288 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet defda79dd0f34c37ae16ea808df0754b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.715441 1172 ts_tablet_manager.cc:1434] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.007s user 0.000s sys 0.003s
I20260318 02:51:27.716217 1175 log.cc:1199] T ec32c25ae14b406cb6ab4d913b575091 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/ec32c25ae14b406cb6ab4d913b575091
I20260318 02:51:27.717155 902 tablet_service.cc:1511] Processing CreateTablet for tablet 306367152e834668bbf5fcadd008b3ea (DEFAULT_TABLE table=default.Table_20b2dbf580454a4a993130bde0ae0265 [id=41496f910c434ed4a7affece7e7efb74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.717622 1172 tablet_bootstrap.cc:492] T 7cfaf92570b34b2bb1f52aea06187c83 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:27.717639 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 306367152e834668bbf5fcadd008b3ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.719121 1616 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260318 02:51:27.719070 1175 ts_tablet_manager.cc:1950] T ec32c25ae14b406cb6ab4d913b575091 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:27.721091 898 tablet_service.cc:1511] Processing CreateTablet for tablet 77a17ef7cfee4d65808b11e9cb51e7df (DEFAULT_TABLE table=default.Table_a23a3971bb3546c6ad6966b77bf7a8ba [id=94a6d43822c04d3ba847366297c204f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.721508 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a17ef7cfee4d65808b11e9cb51e7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.724747 893 tablet_service.cc:1511] Processing CreateTablet for tablet defda79dd0f34c37ae16ea808df0754b (DEFAULT_TABLE table=default.Table_3aa749750bd542738790c713a8ff0713 [id=c6ec8a81c28d493396980349b4ea31d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.725262 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet defda79dd0f34c37ae16ea808df0754b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.729208 903 tablet_service.cc:1511] Processing CreateTablet for tablet 565add8c21f343f2b11c12a9bb7ff111 (DEFAULT_TABLE table=default.Table_b4f791ee528d46b59428dc367b5be0a8 [id=e3979c7eefe84cd7bb1dd36fa9351b7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.729629 1184 ts_tablet_manager.cc:1929] T 6e9372f8871b473caa024512e936a6e5 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:27.729693 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 565add8c21f343f2b11c12a9bb7ff111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.732959 1175 tablet_replica.cc:333] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
W20260318 02:51:27.734429 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 59c6741a6d154d8f99d487c6590d2d26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59c6741a6d154d8f99d487c6590d2d26 already in progress: creating tablet
W20260318 02:51:27.734706 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet dea25aaad60a4b2483a8832f995d1316 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dea25aaad60a4b2483a8832f995d1316 already in progress: creating tablet
W20260318 02:51:27.734925 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 65f63eb5e114464988b3b89e3af61b61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65f63eb5e114464988b3b89e3af61b61 already in progress: creating tablet
I20260318 02:51:27.735231 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet ec32c25ae14b406cb6ab4d913b575091 (table default.Table_7692f02c62f94771bc39331507161bb2 [id=60f0afdd0f9f4c5196ea491b90991241]) successfully deleted
I20260318 02:51:27.734501 1175 raft_consensus.cc:2243] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:27.739483 1175 raft_consensus.cc:2272] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:27.742650 1175 ts_tablet_manager.cc:1916] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:27.744622 449 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 6b82751cbcbb4c39a6942b6856412fc8 (table default.Table_4a0d32e1914846ec81bdfcb8a0fd758e [id=84a657155372475db438c6eb3119b595]). Expected version 3 got 2
I20260318 02:51:27.747344 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d20847fa6f9461cb6137f56ea680cb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:27.747800 906 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bb381f10d87414f9c1a99942216adc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:27.747957 1184 log.cc:1199] T 6e9372f8871b473caa024512e936a6e5 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/6e9372f8871b473caa024512e936a6e5
I20260318 02:51:27.748034 891 tablet_service.cc:1558] Processing DeleteTablet for tablet c4051c8e4d3d49829f9eac8e36baab2f with delete_type TABLET_DATA_DELETED (replaced by tablet 258dc29e4e4245289b7e450837edcd24) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:27.748333 1184 ts_tablet_manager.cc:1950] T 6e9372f8871b473caa024512e936a6e5 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:27.747416 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bb381f10d87414f9c1a99942216adc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.747622 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet c4051c8e4d3d49829f9eac8e36baab2f with delete_type TABLET_DATA_DELETED (replaced by tablet 258dc29e4e4245289b7e450837edcd24) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.748664 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d20847fa6f9461cb6137f56ea680cb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.741159 1172 tablet_bootstrap.cc:654] T 7cfaf92570b34b2bb1f52aea06187c83 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:27.751230 1694 tablet.cc:1718] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18: Skipping requested alter to schema version 2, tablet already version 2
I20260318 02:51:27.755597 450 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_4a0d32e1914846ec81bdfcb8a0fd758e [id=84a657155372475db438c6eb3119b595] alter complete (version 3)
I20260318 02:51:27.760598 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c41a7b6dc05048439b0883d5077f5421"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:27.761263 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c41a7b6dc05048439b0883d5077f5421 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.764439 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_dbb2de6255ae4293a1c724e0d9e9f947"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:27.765049 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dbb2de6255ae4293a1c724e0d9e9f947 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.767273 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_554a425f9acb4c92ab87a63ff39b8790"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:27.768044 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_554a425f9acb4c92ab87a63ff39b8790 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.769371 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_afbc46e2a03c4c97918c5827a59796e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:27.769812 1694 tablet.cc:1723] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260318 02:51:27.769996 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afbc46e2a03c4c97918c5827a59796e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.772524 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7c0b9a5bc04944f2864ad7f7289ad8f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:27.772614 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_cd3a5e50d5224cf59e0d62be2fa27753" } new_table_name: "default.Table_6d2066ba32d84690be4eacdc5313a0d5" modify_external_catalogs: true
W20260318 02:51:27.773092 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c0b9a5bc04944f2864ad7f7289ad8f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.774184 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 6e9372f8871b473caa024512e936a6e5 (table default.Table_cf5f0ff49fa24bf18b21a4ebbe45d2e4 [id=c532f0623efe4c3f8d9c90ae9c3d02c3]) successfully deleted
I20260318 02:51:27.774909 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 7480b1fa026242d7bb6ddbf8df563116 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.777196 1184 tablet_replica.cc:333] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:27.777484 1184 raft_consensus.cc:2243] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:27.777827 1184 pending_rounds.cc:70] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d: Trying to abort 1 pending ops.
I20260318 02:51:27.777948 1184 pending_rounds.cc:77] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494169464102912 op_type: NO_OP noop_request { }
I20260318 02:51:27.778436 1184 raft_consensus.cc:2889] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:27.778653 1184 raft_consensus.cc:2272] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:27.780134 1184 ts_tablet_manager.cc:1916] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:27.789268 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e998e290291c443394f478c4ac1cfbd2 consensus state has no leader
I20260318 02:51:27.790421 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_dc6c21598a584c8cb3d4a6de3f7f5567"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:27.791123 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc6c21598a584c8cb3d4a6de3f7f5567 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.794610 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_52b5bed3ea5049e6801d3b8d3a8f39e1" } new_table_name: "default.Table_408acaf34cab438d92ffb9d939624018" modify_external_catalogs: true
I20260318 02:51:27.794996 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_eb858b839de14ff58abebe876d3ff752"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:27.795580 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb858b839de14ff58abebe876d3ff752 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.800946 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_607fac50cf4a4239bff8616d7176493d" } modify_external_catalogs: true
I20260318 02:51:27.801167 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_607fac50cf4a4239bff8616d7176493d" } modify_external_catalogs: true
W20260318 02:51:27.806617 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 918c542a51864e54871efc5e7f62ef61 consensus state has no leader
I20260318 02:51:27.808775 1184 ts_tablet_manager.cc:1929] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:27.809029 1184 log.cc:1199] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/bf09f8234f36402bb9129d524637b5b5
I20260318 02:51:27.809581 1184 ts_tablet_manager.cc:1950] T bf09f8234f36402bb9129d524637b5b5 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:27.812475 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet bf09f8234f36402bb9129d524637b5b5 (table default.Table_3fbf83db2cc447889b1a1d67741ca227 [id=cf74ccfff792402d87f23ac8a4988e5a]) successfully deleted
I20260318 02:51:27.817168 1184 tablet_replica.cc:333] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:27.823613 1043 tablet_service.cc:1511] Processing CreateTablet for tablet f5b55cf85d7842e59f0ed92aecdcd5d0 (DEFAULT_TABLE table=default.Table_6c3be173e88b405ba8a9872aff3b8da7 [id=c1a274b091ba4334ba2f6d983a0baf09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.824076 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b55cf85d7842e59f0ed92aecdcd5d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.824301 1175 ts_tablet_manager.cc:1929] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260318 02:51:27.824386 1174 raft_consensus.cc:385] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:27.824450 1175 log.cc:1199] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/ee07c93213d44d9bb156d9ad7937facf
I20260318 02:51:27.824506 1174 raft_consensus.cc:740] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:27.825331 1174 consensus_queue.cc:260] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.825927 1174 ts_tablet_manager.cc:1434] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.342s user 0.003s sys 0.000s
I20260318 02:51:27.827744 1176 log.cc:1199] T 2b6267d3f6e142579c62bbb4b14da4b0 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/2b6267d3f6e142579c62bbb4b14da4b0
I20260318 02:51:27.831212 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 41fb820f152748b093ca0e0a2f663a78 (DEFAULT_TABLE table=default.Table_a5ebcddffd1546179104ffa49b666ca6 [id=221276ae64ca49b7b4b02fd08f6bf5fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.831645 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41fb820f152748b093ca0e0a2f663a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.833388 902 tablet_service.cc:1511] Processing CreateTablet for tablet f5b55cf85d7842e59f0ed92aecdcd5d0 (DEFAULT_TABLE table=default.Table_6c3be173e88b405ba8a9872aff3b8da7 [id=c1a274b091ba4334ba2f6d983a0baf09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.834969 1173 tablet_bootstrap.cc:492] T 7cfaf92570b34b2bb1f52aea06187c83 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:27.839720 1041 tablet_service.cc:1511] Processing CreateTablet for tablet de38fe3eb88147eab65f3dfed37fbf7d (DEFAULT_TABLE table=default.Table_358abbb589e2401b867ed3d33640193e [id=86689429165c473fb0e44ba50d02daf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.840163 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de38fe3eb88147eab65f3dfed37fbf7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.840297 1174 tablet_bootstrap.cc:492] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:27.841054 1175 ts_tablet_manager.cc:1950] T ee07c93213d44d9bb156d9ad7937facf P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:27.841421 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b55cf85d7842e59f0ed92aecdcd5d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.844758 1173 ts_tablet_manager.cc:1403] T 7cfaf92570b34b2bb1f52aea06187c83 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.303s user 0.012s sys 0.015s
I20260318 02:51:27.844573 898 tablet_service.cc:1511] Processing CreateTablet for tablet 41fb820f152748b093ca0e0a2f663a78 (DEFAULT_TABLE table=default.Table_a5ebcddffd1546179104ffa49b666ca6 [id=221276ae64ca49b7b4b02fd08f6bf5fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.845772 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41fb820f152748b093ca0e0a2f663a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.849869 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 99b4933dda1e465bb1d14d20433f3772 (DEFAULT_TABLE table=default.Table_deecd27166cf4d969acab284d9e382e0 [id=1fb417c4159b4cab98eb4d3f308f88a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.850405 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b4933dda1e465bb1d14d20433f3772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.850601 1176 ts_tablet_manager.cc:1950] T 2b6267d3f6e142579c62bbb4b14da4b0 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:27.852173 1176 tablet_replica.cc:333] T 2adcc9f1ad69458c997475111bb787cf P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:27.853757 1044 tablet_service.cc:1511] Processing CreateTablet for tablet d26c7c573c40412f88b9c6cc71a3c648 (DEFAULT_TABLE table=default.Table_505f7e2e2efb42adbd4093b77505b13c [id=807a5b3e8d1f4221b8284faa1735f31b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.854219 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26c7c573c40412f88b9c6cc71a3c648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.856254 760 tablet_service.cc:1511] Processing CreateTablet for tablet f5b55cf85d7842e59f0ed92aecdcd5d0 (DEFAULT_TABLE table=default.Table_6c3be173e88b405ba8a9872aff3b8da7 [id=c1a274b091ba4334ba2f6d983a0baf09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.856290 893 tablet_service.cc:1511] Processing CreateTablet for tablet de38fe3eb88147eab65f3dfed37fbf7d (DEFAULT_TABLE table=default.Table_358abbb589e2401b867ed3d33640193e [id=86689429165c473fb0e44ba50d02daf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.856789 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de38fe3eb88147eab65f3dfed37fbf7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.857672 1038 tablet_service.cc:1511] Processing CreateTablet for tablet e993481bf55747b0a6a1c996c6917408 (DEFAULT_TABLE table=default.Table_9051f0735dad4cef8cbce07f27319d58 [id=c868efae5833440b90596b5de5d7b800]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.858064 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e993481bf55747b0a6a1c996c6917408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.860684 1176 raft_consensus.cc:2243] T 2adcc9f1ad69458c997475111bb787cf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:27.861752 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b55cf85d7842e59f0ed92aecdcd5d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.862143 1176 raft_consensus.cc:2272] T 2adcc9f1ad69458c997475111bb787cf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:27.862274 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 3cda2afa253041449b3c5dcb0547160b (DEFAULT_TABLE table=default.Table_88ba4f1da1534e4681a3d48f6ae0c52b [id=5650557102db4b8d817f64db612bb519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.862644 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cda2afa253041449b3c5dcb0547160b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.863900 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_efdf3191da2441f598cdd7efdbd49a09" } new_table_name: "default.Table_b3374f675c6b416e8a0c9f0450bb66c2" modify_external_catalogs: true
I20260318 02:51:27.865483 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 8b715c5a31ba4515996595de89f1d62c (DEFAULT_TABLE table=default.Table_efdf3191da2441f598cdd7efdbd49a09 [id=e98f510836594d8ebb0da395137875ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.865603 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 3291ecec94e642e3a995a2d7006619e7 (DEFAULT_TABLE table=default.Table_08987cfd708d4bb2b783719d46212566 [id=93f86e39848a4bd598b3154930bcaafb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.865782 1687 raft_consensus.cc:493] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:27.865929 1687 raft_consensus.cc:515] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.866211 1039 tablet_service.cc:1511] Processing CreateTablet for tablet ed193d1b80be496298dae6fafef94577 (DEFAULT_TABLE table=default.Table_fb278b4a85874854972d2d299d913aec [id=19c97904f14f4e7883a746c65506eaf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.866297 1036 tablet_service.cc:1511] Processing CreateTablet for tablet fa077243d5634d888f3a191b7f9d2d19 (DEFAULT_TABLE table=default.Table_ba651a71312242f98acb8a2229bfb548 [id=46bae779de56403ab810fc4dcde25233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.866792 1033 tablet_service.cc:1511] Processing CreateTablet for tablet f95ebc89fd2545b1835a1bc10414248d (DEFAULT_TABLE table=default.Table_7852bda585cb4d9b99d507f2a7ddaec6 [id=8695bce5538d4e1197fd227c3bd00d9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.866863 1687 leader_election.cc:290] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:27.867131 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 42fc3a9965804b5eb0c9f96eabc38553 (DEFAULT_TABLE table=default.Table_20ad72acdab447458f7b870f7a55b9ee [id=34ae57119f9549aeb0123c5d46118cf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.865934 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b715c5a31ba4515996595de89f1d62c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.867455 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42fc3a9965804b5eb0c9f96eabc38553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.867539 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 1ac9581312964ad6afcc96f798fa534a (DEFAULT_TABLE table=default.Table_0d5c3ad34b094deb9c076110a43cbe09 [id=cafdea84974648a2b072c366228502ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.868067 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ac9581312964ad6afcc96f798fa534a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.868443 1176 ts_tablet_manager.cc:1916] T 2adcc9f1ad69458c997475111bb787cf P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:27.868436 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 5f63108c062348b1ba995ea16f40a695 (DEFAULT_TABLE table=default.Table_a6a2143355de4e07bdbabc02ba2f188a [id=bc2b86c84e194e1ca11aa9724a09dec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.869037 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f63108c062348b1ba995ea16f40a695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.869199 1030 tablet_service.cc:1511] Processing CreateTablet for tablet ca4e1eec9a2148488295416cd68ca607 (DEFAULT_TABLE table=default.Table_496e7d616c09464a884078334d256839 [id=f6fae39c375b41e096459fe397b69b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.869623 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca4e1eec9a2148488295416cd68ca607. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:27.870019 999 leader_election.cc:343] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 7480b1fa026242d7bb6ddbf8df563116
I20260318 02:51:27.870134 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3291ecec94e642e3a995a2d7006619e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.870337 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f95ebc89fd2545b1835a1bc10414248d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.872020 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed193d1b80be496298dae6fafef94577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.872915 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2a3a36a7fd4742c9827b334ce31d4a7c
I20260318 02:51:27.873386 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 0ed4350e0fde4c8690970bc69830fcb3
I20260318 02:51:27.876488 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa077243d5634d888f3a191b7f9d2d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.877314 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 59ce7583e7f545f18145b4e55e1fbb81 (DEFAULT_TABLE table=default.Table_ecc8c866d2154ffbbb606dba2a14c2c9 [id=38d754fc7768404493abfcd27874f157]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.882807 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ce7583e7f545f18145b4e55e1fbb81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.885836 1174 tablet_bootstrap.cc:654] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:27.894500 1172 tablet_bootstrap.cc:492] T 7cfaf92570b34b2bb1f52aea06187c83 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:27.900166 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet ee07c93213d44d9bb156d9ad7937facf (table default.Table_ba651a71312242f98acb8a2229bfb548 [id=46bae779de56403ab810fc4dcde25233]) successfully deleted
I20260318 02:51:27.901180 903 tablet_service.cc:1511] Processing CreateTablet for tablet 99b4933dda1e465bb1d14d20433f3772 (DEFAULT_TABLE table=default.Table_deecd27166cf4d969acab284d9e382e0 [id=1fb417c4159b4cab98eb4d3f308f88a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.901647 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b4933dda1e465bb1d14d20433f3772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.903491 1176 ts_tablet_manager.cc:1929] T 2adcc9f1ad69458c997475111bb787cf P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:27.903630 1172 ts_tablet_manager.cc:1403] T 7cfaf92570b34b2bb1f52aea06187c83 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.181s user 0.001s sys 0.007s
I20260318 02:51:27.903810 1176 log.cc:1199] T 2adcc9f1ad69458c997475111bb787cf P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/2adcc9f1ad69458c997475111bb787cf
I20260318 02:51:27.905290 747 tablet_service.cc:1511] Processing CreateTablet for tablet e993481bf55747b0a6a1c996c6917408 (DEFAULT_TABLE table=default.Table_9051f0735dad4cef8cbce07f27319d58 [id=c868efae5833440b90596b5de5d7b800]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.905772 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e993481bf55747b0a6a1c996c6917408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.906133 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ed4350e0fde4c8690970bc69830fcb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:27.909060 761 tablet_service.cc:1511] Processing CreateTablet for tablet 3cda2afa253041449b3c5dcb0547160b (DEFAULT_TABLE table=default.Table_88ba4f1da1534e4681a3d48f6ae0c52b [id=5650557102db4b8d817f64db612bb519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.909122 758 tablet_service.cc:1511] Processing CreateTablet for tablet fa077243d5634d888f3a191b7f9d2d19 (DEFAULT_TABLE table=default.Table_ba651a71312242f98acb8a2229bfb548 [id=46bae779de56403ab810fc4dcde25233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.909538 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa077243d5634d888f3a191b7f9d2d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.909601 764 tablet_service.cc:1511] Processing CreateTablet for tablet 8b715c5a31ba4515996595de89f1d62c (DEFAULT_TABLE table=default.Table_efdf3191da2441f598cdd7efdbd49a09 [id=e98f510836594d8ebb0da395137875ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.909942 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b715c5a31ba4515996595de89f1d62c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.912170 751 tablet_service.cc:1558] Processing DeleteTablet for tablet e55bbc320b0e4f9595bae9816e594b82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:27.912432 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a3a36a7fd4742c9827b334ce31d4a7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:27.913053 754 tablet_service.cc:1511] Processing CreateTablet for tablet ed193d1b80be496298dae6fafef94577 (DEFAULT_TABLE table=default.Table_fb278b4a85874854972d2d299d913aec [id=19c97904f14f4e7883a746c65506eaf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.913216 752 tablet_service.cc:1511] Processing CreateTablet for tablet 3291ecec94e642e3a995a2d7006619e7 (DEFAULT_TABLE table=default.Table_08987cfd708d4bb2b783719d46212566 [id=93f86e39848a4bd598b3154930bcaafb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.913467 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed193d1b80be496298dae6fafef94577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.913866 763 tablet_service.cc:1511] Processing CreateTablet for tablet d26c7c573c40412f88b9c6cc71a3c648 (DEFAULT_TABLE table=default.Table_505f7e2e2efb42adbd4093b77505b13c [id=807a5b3e8d1f4221b8284faa1735f31b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.914309 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26c7c573c40412f88b9c6cc71a3c648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.917021 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cda2afa253041449b3c5dcb0547160b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.917050 759 tablet_service.cc:1511] Processing CreateTablet for tablet 5f63108c062348b1ba995ea16f40a695 (DEFAULT_TABLE table=default.Table_a6a2143355de4e07bdbabc02ba2f188a [id=bc2b86c84e194e1ca11aa9724a09dec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.917475 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f63108c062348b1ba995ea16f40a695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.920884 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3291ecec94e642e3a995a2d7006619e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.921077 766 tablet_service.cc:1511] Processing CreateTablet for tablet 42fc3a9965804b5eb0c9f96eabc38553 (DEFAULT_TABLE table=default.Table_20ad72acdab447458f7b870f7a55b9ee [id=34ae57119f9549aeb0123c5d46118cf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.921679 757 tablet_service.cc:1511] Processing CreateTablet for tablet f95ebc89fd2545b1835a1bc10414248d (DEFAULT_TABLE table=default.Table_7852bda585cb4d9b99d507f2a7ddaec6 [id=8695bce5538d4e1197fd227c3bd00d9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.922161 762 tablet_service.cc:1511] Processing CreateTablet for tablet 1ac9581312964ad6afcc96f798fa534a (DEFAULT_TABLE table=default.Table_0d5c3ad34b094deb9c076110a43cbe09 [id=cafdea84974648a2b072c366228502ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.922598 756 tablet_service.cc:1511] Processing CreateTablet for tablet ca4e1eec9a2148488295416cd68ca607 (DEFAULT_TABLE table=default.Table_496e7d616c09464a884078334d256839 [id=f6fae39c375b41e096459fe397b69b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.923084 755 tablet_service.cc:1511] Processing CreateTablet for tablet 59ce7583e7f545f18145b4e55e1fbb81 (DEFAULT_TABLE table=default.Table_ecc8c866d2154ffbbb606dba2a14c2c9 [id=38d754fc7768404493abfcd27874f157]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:27.923171 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2f80f29dfd814acd8b7e143a72231dfd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f80f29dfd814acd8b7e143a72231dfd already in progress: creating tablet
I20260318 02:51:27.927119 760 tablet_service.cc:1511] Processing CreateTablet for tablet 99b4933dda1e465bb1d14d20433f3772 (DEFAULT_TABLE table=default.Table_deecd27166cf4d969acab284d9e382e0 [id=1fb417c4159b4cab98eb4d3f308f88a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.928020 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ac9581312964ad6afcc96f798fa534a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.928568 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ce7583e7f545f18145b4e55e1fbb81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.928620 753 tablet_service.cc:1511] Processing CreateTablet for tablet 41fb820f152748b093ca0e0a2f663a78 (DEFAULT_TABLE table=default.Table_a5ebcddffd1546179104ffa49b666ca6 [id=221276ae64ca49b7b4b02fd08f6bf5fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.929143 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca4e1eec9a2148488295416cd68ca607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.929607 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f95ebc89fd2545b1835a1bc10414248d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.930047 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42fc3a9965804b5eb0c9f96eabc38553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.935322 1172 raft_consensus.cc:359] T 7cfaf92570b34b2bb1f52aea06187c83 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.935513 1172 raft_consensus.cc:385] T 7cfaf92570b34b2bb1f52aea06187c83 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:27.936353 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a3a36a7fd4742c9827b334ce31d4a7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.936833 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ed4350e0fde4c8690970bc69830fcb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.936594 1172 raft_consensus.cc:740] T 7cfaf92570b34b2bb1f52aea06187c83 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:27.947139 1172 consensus_queue.cc:260] T 7cfaf92570b34b2bb1f52aea06187c83 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.949321 1172 ts_tablet_manager.cc:1434] T 7cfaf92570b34b2bb1f52aea06187c83 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.046s user 0.000s sys 0.002s
I20260318 02:51:27.902451 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 2b6267d3f6e142579c62bbb4b14da4b0 (table default.Table_5ea72896ec3f438ca7ea9e8b599829f2 [id=a0b50d2be41f469f8e63545b054b9e33]) successfully deleted
W20260318 02:51:27.951429 443 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.104.129:46711, user_credentials={real_user=slave}} blocked reactor thread for 49006.8us
W20260318 02:51:27.951977 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 8a0af3aecf4f485ebc54e1955eca8c92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a0af3aecf4f485ebc54e1955eca8c92 already in progress: creating tablet
W20260318 02:51:27.954041 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 59c6741a6d154d8f99d487c6590d2d26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59c6741a6d154d8f99d487c6590d2d26 already in progress: creating tablet
I20260318 02:51:27.952471 1172 tablet_bootstrap.cc:492] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:27.954838 1184 raft_consensus.cc:2243] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:27.955188 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet dea25aaad60a4b2483a8832f995d1316 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dea25aaad60a4b2483a8832f995d1316 already in progress: creating tablet
I20260318 02:51:27.955614 1184 raft_consensus.cc:2272] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:27.957690 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 65f63eb5e114464988b3b89e3af61b61 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65f63eb5e114464988b3b89e3af61b61 already in progress: creating tablet
I20260318 02:51:27.958436 1184 ts_tablet_manager.cc:1916] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:27.965224 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b4933dda1e465bb1d14d20433f3772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.966265 750 tablet_service.cc:1511] Processing CreateTablet for tablet de38fe3eb88147eab65f3dfed37fbf7d (DEFAULT_TABLE table=default.Table_358abbb589e2401b867ed3d33640193e [id=86689429165c473fb0e44ba50d02daf0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.966769 891 tablet_service.cc:1511] Processing CreateTablet for tablet d26c7c573c40412f88b9c6cc71a3c648 (DEFAULT_TABLE table=default.Table_505f7e2e2efb42adbd4093b77505b13c [id=807a5b3e8d1f4221b8284faa1735f31b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:27.966933 1176 ts_tablet_manager.cc:1950] T 2adcc9f1ad69458c997475111bb787cf P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:27.957252 1172 tablet_bootstrap.cc:654] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:27.967330 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41fb820f152748b093ca0e0a2f663a78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.970784 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3064939f4dfb44dba19bb6f8f9c6f250" } modify_external_catalogs: true
I20260318 02:51:27.971050 1172 tablet_bootstrap.cc:492] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:27.971024 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f6484117e54a4f2298a8d7365770c153" } modify_external_catalogs: true
I20260318 02:51:27.971222 1172 ts_tablet_manager.cc:1403] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260318 02:51:27.970801 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_20ad72acdab447458f7b870f7a55b9ee" } new_table_name: "default.Table_4174268bc53e4124b60df6ac9ee39eae" modify_external_catalogs: true
I20260318 02:51:27.972057 1172 raft_consensus.cc:359] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.972259 1172 raft_consensus.cc:385] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:27.971267 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_86b70df7bd76402aaa4c0b1faa730a62" } modify_external_catalogs: true
I20260318 02:51:27.972599 1172 raft_consensus.cc:740] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:27.972596 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_86b70df7bd76402aaa4c0b1faa730a62" } modify_external_catalogs: true
I20260318 02:51:27.972923 1172 consensus_queue.cc:260] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.972939 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_bf9631ddcae948d899f328bac240c567"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:27.973423 1172 ts_tablet_manager.cc:1434] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260318 02:51:27.973470 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf9631ddcae948d899f328bac240c567 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.973780 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_636584fd33494a7d9fd584d2b6384496"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:27.974299 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_636584fd33494a7d9fd584d2b6384496 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.974429 1174 tablet_bootstrap.cc:492] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:27.974583 1174 ts_tablet_manager.cc:1403] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.148s user 0.012s sys 0.028s
I20260318 02:51:27.974628 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b4c6c515fa1b469bad29515911177508" } new_table_name: "default.Table_a1a0cf6e73df4034be50c53e585878c0" modify_external_catalogs: true
I20260318 02:51:27.975466 1174 raft_consensus.cc:359] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.975643 1174 raft_consensus.cc:385] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:27.975735 1174 raft_consensus.cc:740] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:27.971247 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f6484117e54a4f2298a8d7365770c153" } modify_external_catalogs: true
I20260318 02:51:27.971029 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3064939f4dfb44dba19bb6f8f9c6f250" } modify_external_catalogs: true
I20260318 02:51:27.976042 1174 consensus_queue.cc:260] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:27.976683 1174 ts_tablet_manager.cc:1434] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:27.977034 1174 tablet_bootstrap.cc:492] T f1ff303b23184d4b92994bde194229b4 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:27.978216 1172 tablet_bootstrap.cc:492] T 71c518c87bdd4a63aa1016e8de6bafdc P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:27.980211 1184 ts_tablet_manager.cc:1929] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260318 02:51:27.980285 1172 tablet_bootstrap.cc:654] T 71c518c87bdd4a63aa1016e8de6bafdc P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:27.980351 1184 log.cc:1199] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/ee07c93213d44d9bb156d9ad7937facf
I20260318 02:51:27.983965 1184 ts_tablet_manager.cc:1950] T ee07c93213d44d9bb156d9ad7937facf P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:27.984547 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de38fe3eb88147eab65f3dfed37fbf7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:27.985298 1184 tablet_replica.cc:333] T ec32c25ae14b406cb6ab4d913b575091 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:27.985502 1184 raft_consensus.cc:2243] T ec32c25ae14b406cb6ab4d913b575091 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:27.985653 1184 raft_consensus.cc:2272] T ec32c25ae14b406cb6ab4d913b575091 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:27.989851 1184 ts_tablet_manager.cc:1916] T ec32c25ae14b406cb6ab4d913b575091 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:27.992573 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e7940bdd0aa248b9bb9049e759f5d72e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:27.994525 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0215eed4500f4b01b0c52104e28e94f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:27.995162 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0215eed4500f4b01b0c52104e28e94f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:27.995741 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7940bdd0aa248b9bb9049e759f5d72e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:27.999087 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cfaf92570b34b2bb1f52aea06187c83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:28.000053 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b715c5a31ba4515996595de89f1d62c consensus state has no leader
I20260318 02:51:28.005607 904 tablet_service.cc:1511] Processing CreateTablet for tablet 3cda2afa253041449b3c5dcb0547160b (DEFAULT_TABLE table=default.Table_88ba4f1da1534e4681a3d48f6ae0c52b [id=5650557102db4b8d817f64db612bb519]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.006418 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet ee07c93213d44d9bb156d9ad7937facf (table default.Table_ba651a71312242f98acb8a2229bfb548 [id=46bae779de56403ab810fc4dcde25233]) successfully deleted
W20260318 02:51:28.006707 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2f80f29dfd814acd8b7e143a72231dfd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f80f29dfd814acd8b7e143a72231dfd already in progress: creating tablet
W20260318 02:51:28.006907 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 785f6728f94d41f3997961e3d1ebee34 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 785f6728f94d41f3997961e3d1ebee34 already in progress: creating tablet
I20260318 02:51:28.008543 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_79fa337db6b541168cfa36f0d089c71e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.009223 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79fa337db6b541168cfa36f0d089c71e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.010231 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aebb91ff6b0416fac2ef2d056ca897a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:27.967665 906 tablet_service.cc:1511] Processing CreateTablet for tablet e993481bf55747b0a6a1c996c6917408 (DEFAULT_TABLE table=default.Table_9051f0735dad4cef8cbce07f27319d58 [id=c868efae5833440b90596b5de5d7b800]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.011471 889 tablet_service.cc:1511] Processing CreateTablet for tablet 8b715c5a31ba4515996595de89f1d62c (DEFAULT_TABLE table=default.Table_efdf3191da2441f598cdd7efdbd49a09 [id=e98f510836594d8ebb0da395137875ff]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:28.018111 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 42fc3a9965804b5eb0c9f96eabc38553 consensus state has no leader
I20260318 02:51:28.018688 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_edb797a4cd00413ca8adcf77fbd0164c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.019377 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_edb797a4cd00413ca8adcf77fbd0164c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:28.020732 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2fb9c8f339444bc8d7c6479e7d87f44 consensus state has no leader
I20260318 02:51:28.021204 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_25a5e0aa32c245ff957460a7a51caa4d" } new_table_name: "default.Table_551f61678d2f40bcb32bf1cd2e2c9f4e" modify_external_catalogs: true
I20260318 02:51:28.023659 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e4ceb961c2c249888bf307e9b4f8590c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.024262 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4ceb961c2c249888bf307e9b4f8590c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.024631 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_bab410a5ea4a4335a36f117fb75de6f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:28.026638 1031 tablet_service.cc:1511] Processing CreateTablet for tablet abfa81c3c78a498285e2961530272a39 (DEFAULT_TABLE table=default.Table_dc6c21598a584c8cb3d4a6de3f7f5567 [id=15bdf2c4b80447bfa3a92eb882c07396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.026723 1028 tablet_service.cc:1511] Processing CreateTablet for tablet a6d2dd53085848d6bd7237b07a5f81d0 (DEFAULT_TABLE table=default.Table_7c0b9a5bc04944f2864ad7f7289ad8f7 [id=74aaf5efafc14e5faae1d6a0d60d0bb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.027146 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abfa81c3c78a498285e2961530272a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.027379 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d2dd53085848d6bd7237b07a5f81d0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:28.039878 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bab410a5ea4a4335a36f117fb75de6f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.039903 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a61ad75d19d84c0abf5f3633bfe1dde3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.040560 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a61ad75d19d84c0abf5f3633bfe1dde3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.042080 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_fb278b4a85874854972d2d299d913aec" } new_table_name: "default.Table_c374a4de160944ef9e12b190b7947bcc" modify_external_catalogs: true
I20260318 02:51:28.042693 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26c7c573c40412f88b9c6cc71a3c648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.044354 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cda2afa253041449b3c5dcb0547160b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.044615 1173 raft_consensus.cc:359] T 7cfaf92570b34b2bb1f52aea06187c83 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.047287 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 495c8ace1cdb4741aa2ffa1f85dfb25e (DEFAULT_TABLE table=default.Table_c41a7b6dc05048439b0883d5077f5421 [id=d69787f3adce4eceaa6b4e2e882c4c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.047749 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 495c8ace1cdb4741aa2ffa1f85dfb25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.051895 1673 raft_consensus.cc:493] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:28.054912 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_54b4a3fab33448e1bb213ded14c746a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.055553 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54b4a3fab33448e1bb213ded14c746a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.056674 1184 ts_tablet_manager.cc:1929] T ec32c25ae14b406cb6ab4d913b575091 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.057210 1184 log.cc:1199] T ec32c25ae14b406cb6ab4d913b575091 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/ec32c25ae14b406cb6ab4d913b575091
I20260318 02:51:28.058779 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet fd1284c6e90d4beb8223fd807d7888ec
W20260318 02:51:28.059082 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fe82e581368c4d8a894f0283c1a710fe consensus state has no leader
I20260318 02:51:28.059648 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 3e38dec0d2e9417e8571e202036e7117
I20260318 02:51:28.062143 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 6f527a0ba0914924bc7f604ae8a48393
I20260318 02:51:28.062634 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 2adcc9f1ad69458c997475111bb787cf (table default.Table_8fdbd48eef374965b592274f14ea8ee1 [id=e7071ce844664614a646a3554c38ae41]) successfully deleted
W20260318 02:51:28.062891 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 785f6728f94d41f3997961e3d1ebee34 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 785f6728f94d41f3997961e3d1ebee34 already in progress: creating tablet
I20260318 02:51:28.067543 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet fd1284c6e90d4beb8223fd807d7888ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.067600 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e38dec0d2e9417e8571e202036e7117 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.069623 1176 tablet_replica.cc:333] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:28.071338 1673 raft_consensus.cc:515] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.076377 1176 raft_consensus.cc:2243] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:28.077342 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c8264f69f934d3ba2e41434ce350f3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.080121 1176 raft_consensus.cc:2272] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:28.080758 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed193d1b80be496298dae6fafef94577 consensus state has no leader
I20260318 02:51:28.059433 1175 tablet_replica.cc:333] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:28.059736 1173 raft_consensus.cc:385] T 7cfaf92570b34b2bb1f52aea06187c83 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.060117 892 tablet_service.cc:1511] Processing CreateTablet for tablet fa077243d5634d888f3a191b7f9d2d19 (DEFAULT_TABLE table=default.Table_ba651a71312242f98acb8a2229bfb548 [id=46bae779de56403ab810fc4dcde25233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.081432 1667 raft_consensus.cc:493] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:28.060286 897 tablet_service.cc:1511] Processing CreateTablet for tablet 3291ecec94e642e3a995a2d7006619e7 (DEFAULT_TABLE table=default.Table_08987cfd708d4bb2b783719d46212566 [id=93f86e39848a4bd598b3154930bcaafb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.081581 1667 raft_consensus.cc:515] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.063562 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e993481bf55747b0a6a1c996c6917408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.080456 899 tablet_service.cc:1511] Processing CreateTablet for tablet ed193d1b80be496298dae6fafef94577 (DEFAULT_TABLE table=default.Table_fb278b4a85874854972d2d299d913aec [id=19c97904f14f4e7883a746c65506eaf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.082069 1176 ts_tablet_manager.cc:1916] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.083011 1667 leader_election.cc:290] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:28.084121 763 tablet_service.cc:1511] Processing CreateTablet for tablet a6d2dd53085848d6bd7237b07a5f81d0 (DEFAULT_TABLE table=default.Table_7c0b9a5bc04944f2864ad7f7289ad8f7 [id=74aaf5efafc14e5faae1d6a0d60d0bb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.084470 1673 leader_election.cc:290] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:28.087471 753 tablet_service.cc:1558] Processing DeleteTablet for tablet fd1284c6e90d4beb8223fd807d7888ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.088553 766 tablet_service.cc:1511] Processing CreateTablet for tablet abfa81c3c78a498285e2961530272a39 (DEFAULT_TABLE table=default.Table_dc6c21598a584c8cb3d4a6de3f7f5567 [id=15bdf2c4b80447bfa3a92eb882c07396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.093696 752 tablet_service.cc:1511] Processing CreateTablet for tablet 495c8ace1cdb4741aa2ffa1f85dfb25e (DEFAULT_TABLE table=default.Table_c41a7b6dc05048439b0883d5077f5421 [id=d69787f3adce4eceaa6b4e2e882c4c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.098672 1174 tablet_bootstrap.cc:654] T f1ff303b23184d4b92994bde194229b4 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.099555 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e38dec0d2e9417e8571e202036e7117 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.099884 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abfa81c3c78a498285e2961530272a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.104077 762 tablet_service.cc:1511] Processing CreateTablet for tablet 868605c58c1d4744ab8930313e7dcaa9 (DEFAULT_TABLE table=default.Table_3fda21034cb44e32a46bd033d7e4aa55 [id=c3eb102920ff46d89bf713e574a91a5b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:28.105788 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2f80f29dfd814acd8b7e143a72231dfd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f80f29dfd814acd8b7e143a72231dfd already in progress: creating tablet
I20260318 02:51:28.109485 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f527a0ba0914924bc7f604ae8a48393 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.110363 1173 raft_consensus.cc:740] T 7cfaf92570b34b2bb1f52aea06187c83 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.112589 753 tablet_service.cc:1511] Processing CreateTablet for tablet 53b0d1315274460d848afcfd4f88ee6e (DEFAULT_TABLE table=default.Table_eb858b839de14ff58abebe876d3ff752 [id=6c1803680f9b4bb4940646e81346cff6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.112679 1173 consensus_queue.cc:260] T 7cfaf92570b34b2bb1f52aea06187c83 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.113842 890 tablet_service.cc:1511] Processing CreateTablet for tablet 5f63108c062348b1ba995ea16f40a695 (DEFAULT_TABLE table=default.Table_a6a2143355de4e07bdbabc02ba2f188a [id=bc2b86c84e194e1ca11aa9724a09dec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.114365 1173 ts_tablet_manager.cc:1434] T 7cfaf92570b34b2bb1f52aea06187c83 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.268s user 0.003s sys 0.000s
I20260318 02:51:28.115211 754 tablet_service.cc:1511] Processing CreateTablet for tablet 597a9271dedf4e789926e7e65fd79dfc (DEFAULT_TABLE table=default.Table_554a425f9acb4c92ab87a63ff39b8790 [id=f198d9d6f4844bda879e96c9d2ff92a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.118213 747 tablet_service.cc:1511] Processing CreateTablet for tablet d30e39476d93400c8c79dd529688e7e0 (DEFAULT_TABLE table=default.Table_dbb2de6255ae4293a1c724e0d9e9f947 [id=60cd1ef01f934058a27163dc8c93df78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.120452 758 tablet_service.cc:1511] Processing CreateTablet for tablet 258dc29e4e4245289b7e450837edcd24 (DEFAULT_TABLE table=default.Table_fe03be40cbc54d21927bda17030ed005 [id=3665ac075f964d4c8e2cdda80cbef8a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.122025 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55bbc320b0e4f9595bae9816e594b82" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:28.122712 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d2dd53085848d6bd7237b07a5f81d0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:28.122845 719 leader_election.cc:343] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:28.123648 1175 raft_consensus.cc:2243] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.124051 888 tablet_service.cc:1511] Processing CreateTablet for tablet f95ebc89fd2545b1835a1bc10414248d (DEFAULT_TABLE table=default.Table_7852bda585cb4d9b99d507f2a7ddaec6 [id=8695bce5538d4e1197fd227c3bd00d9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.124102 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c8264f69f934d3ba2e41434ce350f3e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:28.125301 1175 raft_consensus.cc:2272] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.125313 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_594a288e26f245c8a9c365f583bced74" } modify_external_catalogs: true
I20260318 02:51:28.125509 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_594a288e26f245c8a9c365f583bced74" } modify_external_catalogs: true
I20260318 02:51:28.123966 907 tablet_service.cc:1511] Processing CreateTablet for tablet 1ac9581312964ad6afcc96f798fa534a (DEFAULT_TABLE table=default.Table_0d5c3ad34b094deb9c076110a43cbe09 [id=cafdea84974648a2b072c366228502ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.126042 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3f656b3bee94423f80dd692ce3481733" } modify_external_catalogs: true
I20260318 02:51:28.126194 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3f656b3bee94423f80dd692ce3481733" } modify_external_catalogs: true
I20260318 02:51:28.127599 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 868605c58c1d4744ab8930313e7dcaa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.129355 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597a9271dedf4e789926e7e65fd79dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.131968 761 tablet_service.cc:1511] Processing CreateTablet for tablet 540498d9949349f39796087173099d69 (DEFAULT_TABLE table=default.Table_afbc46e2a03c4c97918c5827a59796e7 [id=aedbba494dfa4b4c825a6204a2bb1def]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:28.134133 719 leader_election.cc:343] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:28.134712 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 258dc29e4e4245289b7e450837edcd24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.136261 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d30e39476d93400c8c79dd529688e7e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.139220 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b0d1315274460d848afcfd4f88ee6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.140121 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 495c8ace1cdb4741aa2ffa1f85dfb25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.142066 901 tablet_service.cc:1511] Processing CreateTablet for tablet 59ce7583e7f545f18145b4e55e1fbb81 (DEFAULT_TABLE table=default.Table_ecc8c866d2154ffbbb606dba2a14c2c9 [id=38d754fc7768404493abfcd27874f157]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.145287 1173 tablet_bootstrap.cc:492] T d4a54d0daa9f48a89b3f114367750826 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:28.145247 900 tablet_service.cc:1511] Processing CreateTablet for tablet 42fc3a9965804b5eb0c9f96eabc38553 (DEFAULT_TABLE table=default.Table_20ad72acdab447458f7b870f7a55b9ee [id=34ae57119f9549aeb0123c5d46118cf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.145361 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540498d9949349f39796087173099d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.145661 1175 ts_tablet_manager.cc:1916] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.145757 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b715c5a31ba4515996595de89f1d62c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.145912 896 tablet_service.cc:1511] Processing CreateTablet for tablet ca4e1eec9a2148488295416cd68ca607 (DEFAULT_TABLE table=default.Table_496e7d616c09464a884078334d256839 [id=f6fae39c375b41e096459fe397b69b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.146256 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed193d1b80be496298dae6fafef94577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.146481 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f63108c062348b1ba995ea16f40a695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.146685 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42fc3a9965804b5eb0c9f96eabc38553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.146996 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa077243d5634d888f3a191b7f9d2d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.147212 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca4e1eec9a2148488295416cd68ca607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.147410 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f95ebc89fd2545b1835a1bc10414248d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.148168 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ce7583e7f545f18145b4e55e1fbb81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.149804 1687 raft_consensus.cc:493] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:28.150451 1687 raft_consensus.cc:515] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.151151 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55bbc320b0e4f9595bae9816e594b82" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:28.151813 1687 leader_election.cc:290] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:28.153345 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 53b0d1315274460d848afcfd4f88ee6e (DEFAULT_TABLE table=default.Table_eb858b839de14ff58abebe876d3ff752 [id=6c1803680f9b4bb4940646e81346cff6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.153723 1032 tablet_service.cc:1511] Processing CreateTablet for tablet d30e39476d93400c8c79dd529688e7e0 (DEFAULT_TABLE table=default.Table_dbb2de6255ae4293a1c724e0d9e9f947 [id=60cd1ef01f934058a27163dc8c93df78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.153353 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 258dc29e4e4245289b7e450837edcd24 (DEFAULT_TABLE table=default.Table_fe03be40cbc54d21927bda17030ed005 [id=3665ac075f964d4c8e2cdda80cbef8a4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:28.155288 719 leader_election.cc:343] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:28.155711 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c8264f69f934d3ba2e41434ce350f3e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:28.156360 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 540498d9949349f39796087173099d69 (DEFAULT_TABLE table=default.Table_afbc46e2a03c4c97918c5827a59796e7 [id=aedbba494dfa4b4c825a6204a2bb1def]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.156843 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b0d1315274460d848afcfd4f88ee6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.157195 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ac9581312964ad6afcc96f798fa534a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.157301 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d30e39476d93400c8c79dd529688e7e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.157331 719 leader_election.cc:304] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:28.157821 1673 raft_consensus.cc:2749] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:28.159222 905 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a3a36a7fd4742c9827b334ce31d4a7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.161033 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 258dc29e4e4245289b7e450837edcd24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.163051 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 597a9271dedf4e789926e7e65fd79dfc (DEFAULT_TABLE table=default.Table_554a425f9acb4c92ab87a63ff39b8790 [id=f198d9d6f4844bda879e96c9d2ff92a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.164052 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f527a0ba0914924bc7f604ae8a48393 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.164072 905 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ed4350e0fde4c8690970bc69830fcb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:28.164441 999 leader_election.cc:343] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 5aebb91ff6b0416fac2ef2d056ca897a
I20260318 02:51:28.165529 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 868605c58c1d4744ab8930313e7dcaa9 (DEFAULT_TABLE table=default.Table_3fda21034cb44e32a46bd033d7e4aa55 [id=c3eb102920ff46d89bf713e574a91a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.165866 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3291ecec94e642e3a995a2d7006619e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.166517 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540498d9949349f39796087173099d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.168751 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597a9271dedf4e789926e7e65fd79dfc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:28.168727 719 leader_election.cc:343] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:28.169219 719 leader_election.cc:304] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:28.170308 1673 raft_consensus.cc:2749] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:28.171083 1184 ts_tablet_manager.cc:1950] T ec32c25ae14b406cb6ab4d913b575091 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:28.172830 905 tablet_service.cc:1511] Processing CreateTablet for tablet abfa81c3c78a498285e2961530272a39 (DEFAULT_TABLE table=default.Table_dc6c21598a584c8cb3d4a6de3f7f5567 [id=15bdf2c4b80447bfa3a92eb882c07396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.173331 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abfa81c3c78a498285e2961530272a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.177085 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 868605c58c1d4744ab8930313e7dcaa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.180374 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet ec32c25ae14b406cb6ab4d913b575091 (table default.Table_7692f02c62f94771bc39331507161bb2 [id=60f0afdd0f9f4c5196ea491b90991241]) successfully deleted
I20260318 02:51:28.183799 1176 ts_tablet_manager.cc:1929] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
W20260318 02:51:28.184641 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 6bb381f10d87414f9c1a99942216adc7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6bb381f10d87414f9c1a99942216adc7 already in progress: creating tablet
I20260318 02:51:28.185703 894 tablet_service.cc:1558] Processing DeleteTablet for tablet fd1284c6e90d4beb8223fd807d7888ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:28.188086 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet c4051c8e4d3d49829f9eac8e36baab2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4051c8e4d3d49829f9eac8e36baab2f already in progress: creating tablet
W20260318 02:51:28.189858 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 9d20847fa6f9461cb6137f56ea680cb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d20847fa6f9461cb6137f56ea680cb6 already in progress: creating tablet
I20260318 02:51:28.190205 1184 tablet_replica.cc:333] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:28.192026 898 tablet_service.cc:1511] Processing CreateTablet for tablet a6d2dd53085848d6bd7237b07a5f81d0 (DEFAULT_TABLE table=default.Table_7c0b9a5bc04944f2864ad7f7289ad8f7 [id=74aaf5efafc14e5faae1d6a0d60d0bb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.198091 895 tablet_service.cc:1511] Processing CreateTablet for tablet 868605c58c1d4744ab8930313e7dcaa9 (DEFAULT_TABLE table=default.Table_3fda21034cb44e32a46bd033d7e4aa55 [id=c3eb102920ff46d89bf713e574a91a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.202814 906 tablet_service.cc:1511] Processing CreateTablet for tablet 495c8ace1cdb4741aa2ffa1f85dfb25e (DEFAULT_TABLE table=default.Table_c41a7b6dc05048439b0883d5077f5421 [id=d69787f3adce4eceaa6b4e2e882c4c95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.191193 1176 log.cc:1199] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/ee07c93213d44d9bb156d9ad7937facf
I20260318 02:51:28.209218 1176 ts_tablet_manager.cc:1950] T ee07c93213d44d9bb156d9ad7937facf P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:28.210734 1176 tablet_replica.cc:333] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:28.210980 1176 raft_consensus.cc:2243] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.211154 1176 raft_consensus.cc:2272] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.211135 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet ee07c93213d44d9bb156d9ad7937facf (table default.Table_ba651a71312242f98acb8a2229bfb548 [id=46bae779de56403ab810fc4dcde25233]) successfully deleted
W20260318 02:51:28.211520 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 9d20847fa6f9461cb6137f56ea680cb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d20847fa6f9461cb6137f56ea680cb6 already in progress: creating tablet
I20260318 02:51:28.211723 1176 ts_tablet_manager.cc:1916] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:28.211823 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 6bb381f10d87414f9c1a99942216adc7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6bb381f10d87414f9c1a99942216adc7 already in progress: creating tablet
W20260318 02:51:28.212072 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet c4051c8e4d3d49829f9eac8e36baab2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4051c8e4d3d49829f9eac8e36baab2f already in progress: creating tablet
I20260318 02:51:28.221899 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d2dd53085848d6bd7237b07a5f81d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.223003 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7c0b9a5bc04944f2864ad7f7289ad8f7" } new_table_name: "default.Table_1251c4e2807e4e858b0c190d50b7aab0" modify_external_catalogs: true
I20260318 02:51:28.225780 1174 tablet_bootstrap.cc:492] T f1ff303b23184d4b92994bde194229b4 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:28.226040 1174 ts_tablet_manager.cc:1403] T f1ff303b23184d4b92994bde194229b4 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.249s user 0.008s sys 0.020s
I20260318 02:51:28.226894 1174 raft_consensus.cc:359] T f1ff303b23184d4b92994bde194229b4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.227135 1174 raft_consensus.cc:385] T f1ff303b23184d4b92994bde194229b4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.227247 1174 raft_consensus.cc:740] T f1ff303b23184d4b92994bde194229b4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.227557 1174 consensus_queue.cc:260] T f1ff303b23184d4b92994bde194229b4 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.228096 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e38dec0d2e9417e8571e202036e7117 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:28.229311 444 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet fe82e581368c4d8a894f0283c1a710fe (table default.Table_551f61678d2f40bcb32bf1cd2e2c9f4e [id=831b3293b7eb44c6acb5de02d0769c1d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fe82e581368c4d8a894f0283c1a710fe consensus state has no leader
I20260318 02:51:28.228675 894 tablet_service.cc:1511] Processing CreateTablet for tablet 540498d9949349f39796087173099d69 (DEFAULT_TABLE table=default.Table_afbc46e2a03c4c97918c5827a59796e7 [id=aedbba494dfa4b4c825a6204a2bb1def]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.231083 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f527a0ba0914924bc7f604ae8a48393 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.231262 1174 ts_tablet_manager.cc:1434] T f1ff303b23184d4b92994bde194229b4 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260318 02:51:28.234557 1174 tablet_bootstrap.cc:492] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:28.235643 1184 raft_consensus.cc:2243] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.236092 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 868605c58c1d4744ab8930313e7dcaa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.236027 1184 raft_consensus.cc:2272] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.237617 1184 ts_tablet_manager.cc:1916] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.238178 1174 tablet_bootstrap.cc:654] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.242111 762 tablet_service.cc:1558] Processing DeleteTablet for tablet f1ff303b23184d4b92994bde194229b4 with delete_type TABLET_DATA_DELETED (replaced by tablet b5c19bc5e07949088c84cedbf944dfdb) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.242425 1173 tablet_bootstrap.cc:654] T d4a54d0daa9f48a89b3f114367750826 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.243666 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1bf6b42fe89741b19856a55be8811420" } new_table_name: "default.Table_ac2dafcc68eb412da14e17b420c2bf92" modify_external_catalogs: true
I20260318 02:51:28.245010 1176 ts_tablet_manager.cc:1929] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.245173 1176 log.cc:1199] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/0ed4350e0fde4c8690970bc69830fcb3
I20260318 02:51:28.245509 1176 ts_tablet_manager.cc:1950] T 0ed4350e0fde4c8690970bc69830fcb3 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:28.246497 1176 tablet_replica.cc:333] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:28.246706 1176 raft_consensus.cc:2243] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.246886 1176 raft_consensus.cc:2272] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.247427 1176 ts_tablet_manager.cc:1916] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.247849 1174 tablet_bootstrap.cc:492] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:28.248891 1174 ts_tablet_manager.cc:1403] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.003s
I20260318 02:51:28.249960 1174 raft_consensus.cc:359] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.251679 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 0ed4350e0fde4c8690970bc69830fcb3 (table default.Table_4ced5c1198ce406b85fbee4bbe6368c0 [id=a1f776ccb9f44dba98f77ad3fec5df41]) successfully deleted
W20260318 02:51:28.253418 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a6d2dd53085848d6bd7237b07a5f81d0 consensus state has no leader
I20260318 02:51:28.257516 1174 raft_consensus.cc:385] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.257946 1174 raft_consensus.cc:740] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.258558 1174 consensus_queue.cc:260] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.260949 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3852466c8ce14d2caee518fe948fbdfc" } new_table_name: "default.Table_f9effad0f719477fa069bbbe2b4ef857" modify_external_catalogs: true
I20260318 02:51:28.264619 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7053cfb9ed1245aaa504d240368eff1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.265297 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7053cfb9ed1245aaa504d240368eff1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.266692 1174 ts_tablet_manager.cc:1434] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s
I20260318 02:51:28.270598 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_46a2caeb0a8f424b85290dc1e56f8e15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:28.270658 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_cd6fa6816d194e7fb86251cce055a47f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:28.271034 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2bac6e37bc644cc1952a524104c54eda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.271240 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd6fa6816d194e7fb86251cce055a47f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:28.271421 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bac6e37bc644cc1952a524104c54eda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:28.271238 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46a2caeb0a8f424b85290dc1e56f8e15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.270744 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_50775e92a3544e0bb2d75969b9a6b57a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.272747 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50775e92a3544e0bb2d75969b9a6b57a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.273517 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e8949513489d44e0a36b239de4fbed56" } modify_external_catalogs: true
I20260318 02:51:28.273681 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e8949513489d44e0a36b239de4fbed56" } modify_external_catalogs: true
I20260318 02:51:28.276599 893 tablet_service.cc:1511] Processing CreateTablet for tablet 258dc29e4e4245289b7e450837edcd24 (DEFAULT_TABLE table=default.Table_fe03be40cbc54d21927bda17030ed005 [id=3665ac075f964d4c8e2cdda80cbef8a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.281343 762 tablet_service.cc:1558] Processing DeleteTablet for tablet af793623466249e695b262ab451d4dc9 with delete_type TABLET_DATA_DELETED (replaced by tablet e57dbb1276114cd6b7d26f7167b99f25) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.281486 1174 tablet_bootstrap.cc:492] T 95f15079d1df4314b6dd5c7afd896af5 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:28.283649 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9e89e17e334a44b79f81c72c38ae6e68" } new_table_name: "default.Table_23b963651b514aeaa69a42da8e6d2150" modify_external_catalogs: true
I20260318 02:51:28.284119 1174 tablet_bootstrap.cc:654] T 95f15079d1df4314b6dd5c7afd896af5 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.287420 1176 ts_tablet_manager.cc:1929] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.287575 1176 log.cc:1199] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/e55bbc320b0e4f9595bae9816e594b82
I20260318 02:51:28.292546 1673 raft_consensus.cc:493] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:28.292788 1673 raft_consensus.cc:515] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.293017 1175 ts_tablet_manager.cc:1929] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.293506 1673 leader_election.cc:290] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:28.294589 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af793623466249e695b262ab451d4dc9" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:28.295315 719 leader_election.cc:343] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:28.296371 1172 tablet_bootstrap.cc:492] T 71c518c87bdd4a63aa1016e8de6bafdc P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:28.296586 1172 ts_tablet_manager.cc:1403] T 71c518c87bdd4a63aa1016e8de6bafdc P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.318s user 0.025s sys 0.067s
I20260318 02:51:28.298197 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6b7d64f684ff4cc0992215f5962ab5eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:28.298544 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_dbd509def99c4f02a35097ecbd42c1f1" } modify_external_catalogs: true
W20260318 02:51:28.298807 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b7d64f684ff4cc0992215f5962ab5eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.299005 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9a44c965ec574cae8cced06f58d02bff" } modify_external_catalogs: true
I20260318 02:51:28.299168 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_31dc7662988b47369de3999555752620"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.299685 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31dc7662988b47369de3999555752620 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.300280 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_833f8bfd9c5f49bfbaefd932e597b22a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:28.300642 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_dbd509def99c4f02a35097ecbd42c1f1" } modify_external_catalogs: true
I20260318 02:51:28.299230 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9a44c965ec574cae8cced06f58d02bff" } modify_external_catalogs: true
W20260318 02:51:28.301395 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_833f8bfd9c5f49bfbaefd932e597b22a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.297477 1172 raft_consensus.cc:359] T 71c518c87bdd4a63aa1016e8de6bafdc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.301668 1176 ts_tablet_manager.cc:1950] T e55bbc320b0e4f9595bae9816e594b82 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:28.301712 1172 raft_consensus.cc:385] T 71c518c87bdd4a63aa1016e8de6bafdc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.301805 1172 raft_consensus.cc:740] T 71c518c87bdd4a63aa1016e8de6bafdc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.302075 1172 consensus_queue.cc:260] T 71c518c87bdd4a63aa1016e8de6bafdc P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.302784 1172 ts_tablet_manager.cc:1434] T 71c518c87bdd4a63aa1016e8de6bafdc P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260318 02:51:28.303970 1176 tablet_replica.cc:333] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:28.304196 1176 raft_consensus.cc:2243] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.304370 1176 raft_consensus.cc:2272] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.305465 1172 tablet_bootstrap.cc:492] T 00d953e1ae2f47fc8016a2f9a791141d P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:28.305573 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e418df45882c435a8276e46a8abf6bdd consensus state has no leader
I20260318 02:51:28.305476 888 tablet_service.cc:1511] Processing CreateTablet for tablet 53b0d1315274460d848afcfd4f88ee6e (DEFAULT_TABLE table=default.Table_eb858b839de14ff58abebe876d3ff752 [id=6c1803680f9b4bb4940646e81346cff6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.306095 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e6582a7916c645beb3988d9627005b9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.306800 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6582a7916c645beb3988d9627005b9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.308266 1176 ts_tablet_manager.cc:1916] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.308588 1172 tablet_bootstrap.cc:654] T 00d953e1ae2f47fc8016a2f9a791141d P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.310802 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet e55bbc320b0e4f9595bae9816e594b82 (table default.Table_31d713ee51bc47c1a98874825f31a240 [id=f64d22ad510d4dd587445837c79a53c9]) successfully deleted
W20260318 02:51:28.312247 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2a3a36a7fd4742c9827b334ce31d4a7c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a3a36a7fd4742c9827b334ce31d4a7c already in progress: creating tablet
W20260318 02:51:28.318781 997 leader_election.cc:343] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: 7480b1fa026242d7bb6ddbf8df563116
I20260318 02:51:28.319089 997 leader_election.cc:304] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:28.319415 997 raft_consensus.cc:2686] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260318 02:51:28.322661 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af793623466249e695b262ab451d4dc9" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:28.323314 719 leader_election.cc:343] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:28.323465 719 leader_election.cc:304] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:28.323696 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 495c8ace1cdb4741aa2ffa1f85dfb25e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:28.323756 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a7ddc0807d742cea258f889390e2142 consensus state has no leader
I20260318 02:51:28.323943 1673 raft_consensus.cc:2749] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:28.325258 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6c3be173e88b405ba8a9872aff3b8da7" } new_table_name: "default.Table_036cfacba4504adc8db1ed111b34e126" modify_external_catalogs: true
I20260318 02:51:28.327148 1172 tablet_bootstrap.cc:492] T 00d953e1ae2f47fc8016a2f9a791141d P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:28.327453 1172 ts_tablet_manager.cc:1403] T 00d953e1ae2f47fc8016a2f9a791141d P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.004s
I20260318 02:51:28.328382 1172 raft_consensus.cc:359] T 00d953e1ae2f47fc8016a2f9a791141d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.332448 1172 raft_consensus.cc:385] T 00d953e1ae2f47fc8016a2f9a791141d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.332602 1172 raft_consensus.cc:740] T 00d953e1ae2f47fc8016a2f9a791141d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.332950 1172 consensus_queue.cc:260] T 00d953e1ae2f47fc8016a2f9a791141d P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.333662 1172 ts_tablet_manager.cc:1434] T 00d953e1ae2f47fc8016a2f9a791141d P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260318 02:51:28.335922 1172 tablet_bootstrap.cc:492] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:28.337726 1172 tablet_bootstrap.cc:654] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.338879 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_dc3bf04a6859483e999dc1bcb8462e7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.339622 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc3bf04a6859483e999dc1bcb8462e7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:28.345340 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5b55cf85d7842e59f0ed92aecdcd5d0 consensus state has no leader
I20260318 02:51:28.347240 457 master_service.cc:954] ReplaceTablet: received request to replace tablet b894f0772a754196a3e651b38c46f001 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:28.347642 1174 tablet_bootstrap.cc:492] T 95f15079d1df4314b6dd5c7afd896af5 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:28.347855 1174 ts_tablet_manager.cc:1403] T 95f15079d1df4314b6dd5c7afd896af5 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.066s user 0.004s sys 0.004s
I20260318 02:51:28.348034 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 00d953e1ae2f47fc8016a2f9a791141d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.348156 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 71c518c87bdd4a63aa1016e8de6bafdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.348766 1174 raft_consensus.cc:359] T 95f15079d1df4314b6dd5c7afd896af5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.348997 1174 raft_consensus.cc:385] T 95f15079d1df4314b6dd5c7afd896af5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.349076 1174 raft_consensus.cc:740] T 95f15079d1df4314b6dd5c7afd896af5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.349331 1174 consensus_queue.cc:260] T 95f15079d1df4314b6dd5c7afd896af5 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.361164 1175 log.cc:1199] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/677f33f9e4ad4859ab85692f7b7aad2a
I20260318 02:51:28.361624 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 305cc777ed0c46e497c80f15b8e6ead1
I20260318 02:51:28.361969 1175 ts_tablet_manager.cc:1950] T 677f33f9e4ad4859ab85692f7b7aad2a P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:28.362529 907 tablet_service.cc:1511] Processing CreateTablet for tablet 597a9271dedf4e789926e7e65fd79dfc (DEFAULT_TABLE table=default.Table_554a425f9acb4c92ab87a63ff39b8790 [id=f198d9d6f4844bda879e96c9d2ff92a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.362624 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 503386365f6a49f6b84c64b59b764c10
I20260318 02:51:28.363116 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cfaf92570b34b2bb1f52aea06187c83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.363370 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540498d9949349f39796087173099d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.367307 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 503386365f6a49f6b84c64b59b764c10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.368368 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet a384923c86ee42d6a47ed3f68e6811df
I20260318 02:51:28.369222 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 7cdd554113bf4a7092da876365a89456
I20260318 02:51:28.370867 747 tablet_service.cc:1558] Processing DeleteTablet for tablet a384923c86ee42d6a47ed3f68e6811df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.371414 1176 ts_tablet_manager.cc:1929] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.374604 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cdd554113bf4a7092da876365a89456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.381973 1174 ts_tablet_manager.cc:1434] T 95f15079d1df4314b6dd5c7afd896af5 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20260318 02:51:28.383371 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 305cc777ed0c46e497c80f15b8e6ead1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.384426 1176 log.cc:1199] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/0c8264f69f934d3ba2e41434ce350f3e
I20260318 02:51:28.385340 1176 ts_tablet_manager.cc:1950] T 0c8264f69f934d3ba2e41434ce350f3e P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:28.387290 1176 tablet_replica.cc:333] T f1ff303b23184d4b92994bde194229b4 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:28.387609 1174 tablet_bootstrap.cc:492] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:28.387691 1176 raft_consensus.cc:2243] T f1ff303b23184d4b92994bde194229b4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.388074 1176 raft_consensus.cc:2272] T f1ff303b23184d4b92994bde194229b4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.389385 1176 ts_tablet_manager.cc:1916] T f1ff303b23184d4b92994bde194229b4 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.392355 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 305cc777ed0c46e497c80f15b8e6ead1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.392787 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 503386365f6a49f6b84c64b59b764c10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.394477 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet a384923c86ee42d6a47ed3f68e6811df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.395071 1174 tablet_bootstrap.cc:654] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.395236 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cdd554113bf4a7092da876365a89456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.396179 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba2b7cd82df4c19b2b434a6ba045e3b (DEFAULT_TABLE table=default.Table_bab410a5ea4a4335a36f117fb75de6f8 [id=6f0a60b535c642b1abf777bc19e5d9a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.396764 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba2b7cd82df4c19b2b434a6ba045e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.405244 1174 tablet_bootstrap.cc:492] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:28.405323 1184 ts_tablet_manager.cc:1929] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.405517 1174 ts_tablet_manager.cc:1403] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.007s
I20260318 02:51:28.405542 1184 log.cc:1199] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/7480b1fa026242d7bb6ddbf8df563116
I20260318 02:51:28.405942 1184 ts_tablet_manager.cc:1950] T 7480b1fa026242d7bb6ddbf8df563116 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:28.406512 1174 raft_consensus.cc:359] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.406785 1174 raft_consensus.cc:385] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.406920 1174 raft_consensus.cc:740] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.407236 1174 consensus_queue.cc:260] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.407570 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 95f15079d1df4314b6dd5c7afd896af5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.408077 762 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba2b7cd82df4c19b2b434a6ba045e3b (DEFAULT_TABLE table=default.Table_bab410a5ea4a4335a36f117fb75de6f8 [id=6f0a60b535c642b1abf777bc19e5d9a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.408317 747 tablet_service.cc:1511] Processing CreateTablet for tablet 60a4e38c14f84e6ba9d0402b62f7432c (DEFAULT_TABLE table=default.Table_e4ceb961c2c249888bf307e9b4f8590c [id=ea67bccacea1494cbe1deef3a21488c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.408505 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba2b7cd82df4c19b2b434a6ba045e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.408771 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a4e38c14f84e6ba9d0402b62f7432c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.413030 1174 ts_tablet_manager.cc:1434] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260318 02:51:28.419687 1174 tablet_bootstrap.cc:492] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:28.420934 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 0c8264f69f934d3ba2e41434ce350f3e (table default.Table_50e2d197579e426787bc46d7494e2f74 [id=83452e9434ad488c9cda6c178ec3b182]) successfully deleted
W20260318 02:51:28.421372 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet fd1284c6e90d4beb8223fd807d7888ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd1284c6e90d4beb8223fd807d7888ec already in progress: creating tablet
I20260318 02:51:28.421339 762 tablet_service.cc:1511] Processing CreateTablet for tablet 572553569bbe4731b2580f1d22ee4fdd (DEFAULT_TABLE table=default.Table_edb797a4cd00413ca8adcf77fbd0164c [id=4beac30de13140a5a38f5ab127a6857e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:28.421731 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 3e38dec0d2e9417e8571e202036e7117 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e38dec0d2e9417e8571e202036e7117 already in progress: creating tablet
W20260318 02:51:28.421922 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 6f527a0ba0914924bc7f604ae8a48393 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f527a0ba0914924bc7f604ae8a48393 already in progress: creating tablet
I20260318 02:51:28.422358 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572553569bbe4731b2580f1d22ee4fdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.423007 1172 tablet_bootstrap.cc:492] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:28.423223 1172 ts_tablet_manager.cc:1403] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.087s user 0.000s sys 0.007s
I20260318 02:51:28.423611 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 572553569bbe4731b2580f1d22ee4fdd (DEFAULT_TABLE table=default.Table_edb797a4cd00413ca8adcf77fbd0164c [id=4beac30de13140a5a38f5ab127a6857e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.424114 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572553569bbe4731b2580f1d22ee4fdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.424216 1172 raft_consensus.cc:359] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.424485 1172 raft_consensus.cc:385] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.424624 1172 raft_consensus.cc:740] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.424980 1172 consensus_queue.cc:260] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.425822 1172 ts_tablet_manager.cc:1434] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260318 02:51:28.426391 1172 tablet_bootstrap.cc:492] T 62af8b953213412bb0c3bd1c68042ec9 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:28.427354 1174 tablet_bootstrap.cc:654] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.427901 418 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu pid 494
I20260318 02:51:28.429533 558 generic_service.cc:196] Checking for leaks (request via RPC)
I20260318 02:51:28.433995 1667 raft_consensus.cc:493] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:28.434219 1667 raft_consensus.cc:515] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.434903 1667 leader_election.cc:290] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:28.438350 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b894f0772a754196a3e651b38c46f001
I20260318 02:51:28.438572 454 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 24c66e2cc96f458fb3279827cea4ca9e (table default.Table_ac2dafcc68eb412da14e17b420c2bf92 [id=ade423581b18488699c64d3b107d0b07]). Expected version 1 got 0
I20260318 02:51:28.438953 457 catalog_manager.cc:6741] ReplaceTablet: tablet b894f0772a754196a3e651b38c46f001 deleted and replaced by tablet 977a25a368734b11a8b2cefef88be651
W20260318 02:51:28.440026 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 785f6728f94d41f3997961e3d1ebee34 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 785f6728f94d41f3997961e3d1ebee34 already in progress: creating tablet
I20260318 02:51:28.443471 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 7480b1fa026242d7bb6ddbf8df563116 (table default.Table_3e4d4a8323da4e20a12b2b6a9f7fd54c [id=71930ef490a446019e86d9159e1f67d3]) successfully deleted
I20260318 02:51:28.444813 454 master_service.cc:954] ReplaceTablet: received request to replace tablet 46ce65cca47f48db94e70226494cfbae from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:28.445278 752 tablet_service.cc:1558] Processing DeleteTablet for tablet b894f0772a754196a3e651b38c46f001 with delete_type TABLET_DATA_DELETED (replaced by tablet 977a25a368734b11a8b2cefef88be651) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.446987 896 tablet_service.cc:1511] Processing CreateTablet for tablet d30e39476d93400c8c79dd529688e7e0 (DEFAULT_TABLE table=default.Table_dbb2de6255ae4293a1c724e0d9e9f947 [id=60cd1ef01f934058a27163dc8c93df78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.447166 1176 ts_tablet_manager.cc:1929] T f1ff303b23184d4b92994bde194229b4 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.447296 1176 log.cc:1199] T f1ff303b23184d4b92994bde194229b4 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/f1ff303b23184d4b92994bde194229b4
I20260318 02:51:28.447675 1176 ts_tablet_manager.cc:1950] T f1ff303b23184d4b92994bde194229b4 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:28.448597 1176 tablet_replica.cc:333] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:28.448822 1176 raft_consensus.cc:2243] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.448997 1176 raft_consensus.cc:2272] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.449756 1176 ts_tablet_manager.cc:1916] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.449762 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 666c2992fa4f479ab4ffd7ac0c3a9c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.454591 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 597a9271dedf4e789926e7e65fd79dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.455739 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet b894f0772a754196a3e651b38c46f001 with delete_type TABLET_DATA_DELETED (replaced by tablet 977a25a368734b11a8b2cefef88be651) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.456651 1184 tablet_replica.cc:333] T 7cfaf92570b34b2bb1f52aea06187c83 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:28.456980 1184 raft_consensus.cc:2243] T 7cfaf92570b34b2bb1f52aea06187c83 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.458268 752 tablet_service.cc:1511] Processing CreateTablet for tablet d7c40c4cda934922ba7df2775ce892fe (DEFAULT_TABLE table=default.Table_bf9631ddcae948d899f328bac240c567 [id=262f3187f30e45208a08fc060c867ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.458863 758 tablet_service.cc:1511] Processing CreateTablet for tablet 15f79ab1c38141adaed4bd381df26d9b (DEFAULT_TABLE table=default.Table_636584fd33494a7d9fd584d2b6384496 [id=8cc9d412a9a24546a478989a5b5cdc1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.459054 761 tablet_service.cc:1511] Processing CreateTablet for tablet 9f274ae7a6834ca98f01575fcf8b161e (DEFAULT_TABLE table=default.Table_a61ad75d19d84c0abf5f3633bfe1dde3 [id=e174c5b05ed94868a62e672f78f9ee36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.460059 763 tablet_service.cc:1511] Processing CreateTablet for tablet 33f93d766c44461cb0f5f4bfba09a744 (DEFAULT_TABLE table=default.Table_79fa337db6b541168cfa36f0d089c71e [id=08b2b61f0ecd40e18b45ab3e1b2dbf08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.460500 766 tablet_service.cc:1511] Processing CreateTablet for tablet b07006bc31584865a0a5eb407e7ccc16 (DEFAULT_TABLE table=default.Table_e7940bdd0aa248b9bb9049e759f5d72e [id=45dc1528ffbe4ff09fc344b4a33bf924]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.460536 753 tablet_service.cc:1511] Processing CreateTablet for tablet 71c53e67f27a4047a370d00d223961e6 (DEFAULT_TABLE table=default.Table_54b4a3fab33448e1bb213ded14c746a1 [id=1628b8bd04ff4a2bba7298ae4497a222]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.461103 747 tablet_service.cc:1511] Processing CreateTablet for tablet 0f499c464eb14164a2df3abc2d4a47c7 (DEFAULT_TABLE table=default.Table_0215eed4500f4b01b0c52104e28e94f8 [id=ab2b933c89924a2599507f0b0242017c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.462028 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666c2992fa4f479ab4ffd7ac0c3a9c92" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:28.463027 719 leader_election.cc:343] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:28.464381 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b0d1315274460d848afcfd4f88ee6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.466235 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666c2992fa4f479ab4ffd7ac0c3a9c92" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:28.466742 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f274ae7a6834ca98f01575fcf8b161e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.466852 1175 tablet_replica.cc:333] T 7cfaf92570b34b2bb1f52aea06187c83 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:28.466912 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d30e39476d93400c8c79dd529688e7e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.467065 1175 raft_consensus.cc:2243] T 7cfaf92570b34b2bb1f52aea06187c83 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.467271 1175 raft_consensus.cc:2272] T 7cfaf92570b34b2bb1f52aea06187c83 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.467379 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c53e67f27a4047a370d00d223961e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.467840 1175 ts_tablet_manager.cc:1916] T 7cfaf92570b34b2bb1f52aea06187c83 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.467906 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07006bc31584865a0a5eb407e7ccc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.468120 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f79ab1c38141adaed4bd381df26d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.468546 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 258dc29e4e4245289b7e450837edcd24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.468578 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c40c4cda934922ba7df2775ce892fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.468994 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f93d766c44461cb0f5f4bfba09a744. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:28.469679 719 leader_election.cc:343] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:28.469830 719 leader_election.cc:304] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:28.470106 1667 raft_consensus.cc:2749] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:28.470822 1172 tablet_bootstrap.cc:654] T 62af8b953213412bb0c3bd1c68042ec9 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.470928 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f499c464eb14164a2df3abc2d4a47c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.471195 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 60a4e38c14f84e6ba9d0402b62f7432c (DEFAULT_TABLE table=default.Table_e4ceb961c2c249888bf307e9b4f8590c [id=ea67bccacea1494cbe1deef3a21488c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.472294 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a4e38c14f84e6ba9d0402b62f7432c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.486466 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet f1ff303b23184d4b92994bde194229b4 (table default.Table_440979f48f6a443285065bb1dd666d0a [id=873432f002e14a4fa7065dcfe5caebd5]) successfully deleted
I20260318 02:51:28.488627 1184 raft_consensus.cc:2272] T 7cfaf92570b34b2bb1f52aea06187c83 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.495522 1173 tablet_bootstrap.cc:492] T d4a54d0daa9f48a89b3f114367750826 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:28.495699 1173 ts_tablet_manager.cc:1403] T d4a54d0daa9f48a89b3f114367750826 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.381s user 0.002s sys 0.006s
I20260318 02:51:28.500903 1176 ts_tablet_manager.cc:1929] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.501144 1176 log.cc:1199] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/af793623466249e695b262ab451d4dc9
I20260318 02:51:28.501567 1176 ts_tablet_manager.cc:1950] T af793623466249e695b262ab451d4dc9 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:28.503237 1176 tablet_replica.cc:333] T 95f15079d1df4314b6dd5c7afd896af5 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:28.504436 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 0f499c464eb14164a2df3abc2d4a47c7 (DEFAULT_TABLE table=default.Table_0215eed4500f4b01b0c52104e28e94f8 [id=ab2b933c89924a2599507f0b0242017c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.508821 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet cf27c8d69f41431e9fab12e605e15b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.509115 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f499c464eb14164a2df3abc2d4a47c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.512687 1032 tablet_service.cc:1511] Processing CreateTablet for tablet d7c40c4cda934922ba7df2775ce892fe (DEFAULT_TABLE table=default.Table_bf9631ddcae948d899f328bac240c567 [id=262f3187f30e45208a08fc060c867ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.513254 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c40c4cda934922ba7df2775ce892fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.525074 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 503386365f6a49f6b84c64b59b764c10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.525763 1184 ts_tablet_manager.cc:1916] T 7cfaf92570b34b2bb1f52aea06187c83 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.526115 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 305cc777ed0c46e497c80f15b8e6ead1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:28.526096 997 leader_election.cc:343] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: 5aebb91ff6b0416fac2ef2d056ca897a
I20260318 02:51:28.526326 889 tablet_service.cc:1558] Processing DeleteTablet for tablet a384923c86ee42d6a47ed3f68e6811df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.526367 997 leader_election.cc:304] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:28.526517 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cdd554113bf4a7092da876365a89456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.526774 1687 raft_consensus.cc:2749] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:28.527014 899 tablet_service.cc:1511] Processing CreateTablet for tablet 5ba2b7cd82df4c19b2b434a6ba045e3b (DEFAULT_TABLE table=default.Table_bab410a5ea4a4335a36f117fb75de6f8 [id=6f0a60b535c642b1abf777bc19e5d9a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.527452 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ba2b7cd82df4c19b2b434a6ba045e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.527496 902 tablet_service.cc:1511] Processing CreateTablet for tablet 60a4e38c14f84e6ba9d0402b62f7432c (DEFAULT_TABLE table=default.Table_e4ceb961c2c249888bf307e9b4f8590c [id=ea67bccacea1494cbe1deef3a21488c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.527896 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a4e38c14f84e6ba9d0402b62f7432c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.528396 891 tablet_service.cc:1511] Processing CreateTablet for tablet 572553569bbe4731b2580f1d22ee4fdd (DEFAULT_TABLE table=default.Table_edb797a4cd00413ca8adcf77fbd0164c [id=4beac30de13140a5a38f5ab127a6857e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.528776 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572553569bbe4731b2580f1d22ee4fdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.529538 892 tablet_service.cc:1558] Processing DeleteTablet for tablet b894f0772a754196a3e651b38c46f001 with delete_type TABLET_DATA_DELETED (replaced by tablet 977a25a368734b11a8b2cefef88be651) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.529973 900 tablet_service.cc:1511] Processing CreateTablet for tablet 0f499c464eb14164a2df3abc2d4a47c7 (DEFAULT_TABLE table=default.Table_0215eed4500f4b01b0c52104e28e94f8 [id=ab2b933c89924a2599507f0b0242017c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.530318 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f499c464eb14164a2df3abc2d4a47c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.531095 905 tablet_service.cc:1511] Processing CreateTablet for tablet d7c40c4cda934922ba7df2775ce892fe (DEFAULT_TABLE table=default.Table_bf9631ddcae948d899f328bac240c567 [id=262f3187f30e45208a08fc060c867ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.531448 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c40c4cda934922ba7df2775ce892fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.532254 897 tablet_service.cc:1511] Processing CreateTablet for tablet 15f79ab1c38141adaed4bd381df26d9b (DEFAULT_TABLE table=default.Table_636584fd33494a7d9fd584d2b6384496 [id=8cc9d412a9a24546a478989a5b5cdc1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.532572 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f79ab1c38141adaed4bd381df26d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.535805 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 33f93d766c44461cb0f5f4bfba09a744 (DEFAULT_TABLE table=default.Table_79fa337db6b541168cfa36f0d089c71e [id=08b2b61f0ecd40e18b45ab3e1b2dbf08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.536378 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f93d766c44461cb0f5f4bfba09a744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.538147 1176 raft_consensus.cc:2243] T 95f15079d1df4314b6dd5c7afd896af5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.538404 1176 raft_consensus.cc:2272] T 95f15079d1df4314b6dd5c7afd896af5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.542263 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 9f274ae7a6834ca98f01575fcf8b161e (DEFAULT_TABLE table=default.Table_a61ad75d19d84c0abf5f3633bfe1dde3 [id=e174c5b05ed94868a62e672f78f9ee36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.542817 895 tablet_service.cc:1511] Processing CreateTablet for tablet 9f274ae7a6834ca98f01575fcf8b161e (DEFAULT_TABLE table=default.Table_a61ad75d19d84c0abf5f3633bfe1dde3 [id=e174c5b05ed94868a62e672f78f9ee36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.543201 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f274ae7a6834ca98f01575fcf8b161e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.543301 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f274ae7a6834ca98f01575fcf8b161e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.538297 1173 raft_consensus.cc:359] T d4a54d0daa9f48a89b3f114367750826 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.548955 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 15f79ab1c38141adaed4bd381df26d9b (DEFAULT_TABLE table=default.Table_636584fd33494a7d9fd584d2b6384496 [id=8cc9d412a9a24546a478989a5b5cdc1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.550325 1173 raft_consensus.cc:385] T d4a54d0daa9f48a89b3f114367750826 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.550853 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 71c53e67f27a4047a370d00d223961e6 (DEFAULT_TABLE table=default.Table_54b4a3fab33448e1bb213ded14c746a1 [id=1628b8bd04ff4a2bba7298ae4497a222]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.552050 1042 tablet_service.cc:1511] Processing CreateTablet for tablet b07006bc31584865a0a5eb407e7ccc16 (DEFAULT_TABLE table=default.Table_e7940bdd0aa248b9bb9049e759f5d72e [id=45dc1528ffbe4ff09fc344b4a33bf924]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.553323 1176 ts_tablet_manager.cc:1916] T 95f15079d1df4314b6dd5c7afd896af5 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.560204 888 tablet_service.cc:1511] Processing CreateTablet for tablet 71c53e67f27a4047a370d00d223961e6 (DEFAULT_TABLE table=default.Table_54b4a3fab33448e1bb213ded14c746a1 [id=1628b8bd04ff4a2bba7298ae4497a222]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.560971 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c53e67f27a4047a370d00d223961e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.562614 1174 tablet_bootstrap.cc:492] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:28.563073 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c53e67f27a4047a370d00d223961e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.563011 892 tablet_service.cc:1511] Processing CreateTablet for tablet b07006bc31584865a0a5eb407e7ccc16 (DEFAULT_TABLE table=default.Table_e7940bdd0aa248b9bb9049e759f5d72e [id=45dc1528ffbe4ff09fc344b4a33bf924]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.563388 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07006bc31584865a0a5eb407e7ccc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.564004 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07006bc31584865a0a5eb407e7ccc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.564039 1174 ts_tablet_manager.cc:1403] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.145s user 0.005s sys 0.001s
I20260318 02:51:28.565150 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f79ab1c38141adaed4bd381df26d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.565080 1174 raft_consensus.cc:359] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.565693 1173 raft_consensus.cc:740] T d4a54d0daa9f48a89b3f114367750826 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.566108 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_497d117a371b43f3a21e5c39793ab2c0" } new_table_name: "default.Table_9867792729394010ba769354562198f3" modify_external_catalogs: true
I20260318 02:51:28.568157 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet af793623466249e695b262ab451d4dc9 (table default.Table_9c0322ee5c694253958b5d9583c3708e [id=34553220f38c4ffd99cf61e1679bdb81]) successfully deleted
I20260318 02:51:28.569921 1172 tablet_bootstrap.cc:492] T 62af8b953213412bb0c3bd1c68042ec9 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
W20260318 02:51:28.568603 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 503386365f6a49f6b84c64b59b764c10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 503386365f6a49f6b84c64b59b764c10 already in progress: creating tablet
W20260318 02:51:28.570529 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet a384923c86ee42d6a47ed3f68e6811df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a384923c86ee42d6a47ed3f68e6811df already in progress: creating tablet
W20260318 02:51:28.571491 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 7cdd554113bf4a7092da876365a89456 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cdd554113bf4a7092da876365a89456 already in progress: creating tablet
W20260318 02:51:28.571730 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 305cc777ed0c46e497c80f15b8e6ead1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 305cc777ed0c46e497c80f15b8e6ead1 already in progress: creating tablet
I20260318 02:51:28.572180 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b1f7648e9f33494297265d436ecd65b0" } new_table_name: "default.Table_a1f1780a70204cb983ce946bf6c26eb7" modify_external_catalogs: true
I20260318 02:51:28.575284 454 master_service.cc:954] ReplaceTablet: received request to replace tablet 900c6ef2dc634a788239dd5b77c4bde0 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:28.575770 1174 raft_consensus.cc:385] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.576062 1174 raft_consensus.cc:740] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.576655 1174 consensus_queue.cc:260] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.580569 1174 ts_tablet_manager.cc:1434] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260318 02:51:28.575789 1173 consensus_queue.cc:260] T d4a54d0daa9f48a89b3f114367750826 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.581980 1174 tablet_bootstrap.cc:492] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:28.583155 1172 ts_tablet_manager.cc:1403] T 62af8b953213412bb0c3bd1c68042ec9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.157s user 0.004s sys 0.005s
I20260318 02:51:28.588770 896 tablet_service.cc:1511] Processing CreateTablet for tablet 33f93d766c44461cb0f5f4bfba09a744 (DEFAULT_TABLE table=default.Table_79fa337db6b541168cfa36f0d089c71e [id=08b2b61f0ecd40e18b45ab3e1b2dbf08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.591439 1173 ts_tablet_manager.cc:1434] T d4a54d0daa9f48a89b3f114367750826 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.093s user 0.002s sys 0.002s
I20260318 02:51:28.591799 1173 tablet_bootstrap.cc:492] T 62af8b953213412bb0c3bd1c68042ec9 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:28.592981 1174 tablet_bootstrap.cc:654] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.597169 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d61882f9637443aea484b9928b8a27c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.597898 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d61882f9637443aea484b9928b8a27c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.598516 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f386fceff4eb4f528da50b63a3703bec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:28.599010 1174 tablet_bootstrap.cc:492] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
W20260318 02:51:28.599061 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f386fceff4eb4f528da50b63a3703bec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.599172 1174 ts_tablet_manager.cc:1403] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.003s
I20260318 02:51:28.599912 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b66901f5baad43c5b75f20aa84cb9872"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:28.600039 1174 raft_consensus.cc:359] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.600225 1174 raft_consensus.cc:385] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.600317 1174 raft_consensus.cc:740] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
W20260318 02:51:28.600457 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b66901f5baad43c5b75f20aa84cb9872 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.600625 1174 consensus_queue.cc:260] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.601373 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_65363a41f18f4b13b6e74847567c753b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:28.601516 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_440979f48f6a443285065bb1dd666d0a" } new_table_name: "default.Table_cec1585fa5824e7682f05533101d20eb" modify_external_catalogs: true
W20260318 02:51:28.601953 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65363a41f18f4b13b6e74847567c753b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.606263 1174 ts_tablet_manager.cc:1434] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
W20260318 02:51:28.606504 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2a3a36a7fd4742c9827b334ce31d4a7c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a3a36a7fd4742c9827b334ce31d4a7c already in progress: creating tablet
I20260318 02:51:28.611770 1174 tablet_bootstrap.cc:492] T 9d20847fa6f9461cb6137f56ea680cb6 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:28.613123 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f93d766c44461cb0f5f4bfba09a744. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:28.615808 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 0ed4350e0fde4c8690970bc69830fcb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ed4350e0fde4c8690970bc69830fcb3 already in progress: creating tablet
I20260318 02:51:28.620069 1174 tablet_bootstrap.cc:654] T 9d20847fa6f9461cb6137f56ea680cb6 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.625236 1172 raft_consensus.cc:359] T 62af8b953213412bb0c3bd1c68042ec9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.629971 1172 raft_consensus.cc:385] T 62af8b953213412bb0c3bd1c68042ec9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.633527 1172 raft_consensus.cc:740] T 62af8b953213412bb0c3bd1c68042ec9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.640069 1173 tablet_bootstrap.cc:654] T 62af8b953213412bb0c3bd1c68042ec9 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.640579 1172 consensus_queue.cc:260] T 62af8b953213412bb0c3bd1c68042ec9 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.648016 1172 ts_tablet_manager.cc:1434] T 62af8b953213412bb0c3bd1c68042ec9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.058s user 0.003s sys 0.000s
I20260318 02:51:28.574304 1176 ts_tablet_manager.cc:1929] T 95f15079d1df4314b6dd5c7afd896af5 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.654987 1172 tablet_bootstrap.cc:492] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:28.655037 1176 log.cc:1199] T 95f15079d1df4314b6dd5c7afd896af5 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/95f15079d1df4314b6dd5c7afd896af5
I20260318 02:51:28.660758 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet ed697b98352c4f65931c154b1f160991
I20260318 02:51:28.664059 452 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet bc47f35f9c2c4e5085ab482285effc91 (table default.Table_497d117a371b43f3a21e5c39793ab2c0 [id=1515573be85644d7a4f046947aa1537b]). Expected version 2 got 0
I20260318 02:51:28.665517 1175 ts_tablet_manager.cc:1929] T 7cfaf92570b34b2bb1f52aea06187c83 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.665705 1175 log.cc:1199] T 7cfaf92570b34b2bb1f52aea06187c83 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/7cfaf92570b34b2bb1f52aea06187c83
I20260318 02:51:28.665705 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet ed697b98352c4f65931c154b1f160991 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.666087 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_fd865bede2d9484994861c767da3ffb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.666568 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd865bede2d9484994861c767da3ffb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.667091 1175 ts_tablet_manager.cc:1950] T 7cfaf92570b34b2bb1f52aea06187c83 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:28.677121 1173 tablet_bootstrap.cc:492] T 62af8b953213412bb0c3bd1c68042ec9 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:28.677434 1173 ts_tablet_manager.cc:1403] T 62af8b953213412bb0c3bd1c68042ec9 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.086s user 0.004s sys 0.004s
I20260318 02:51:28.678332 1173 raft_consensus.cc:359] T 62af8b953213412bb0c3bd1c68042ec9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.678656 1173 raft_consensus.cc:385] T 62af8b953213412bb0c3bd1c68042ec9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.678779 1173 raft_consensus.cc:740] T 62af8b953213412bb0c3bd1c68042ec9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.679067 1173 consensus_queue.cc:260] T 62af8b953213412bb0c3bd1c68042ec9 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.679702 891 tablet_service.cc:1558] Processing DeleteTablet for tablet ed697b98352c4f65931c154b1f160991 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.682204 1184 ts_tablet_manager.cc:1929] T 7cfaf92570b34b2bb1f52aea06187c83 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.682462 1173 ts_tablet_manager.cc:1434] T 62af8b953213412bb0c3bd1c68042ec9 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:28.682943 1173 tablet_bootstrap.cc:492] T 00d953e1ae2f47fc8016a2f9a791141d P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:28.684769 1173 tablet_bootstrap.cc:654] T 00d953e1ae2f47fc8016a2f9a791141d P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.687247 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 677f33f9e4ad4859ab85692f7b7aad2a (table default.Table_a61fc584a9fb41fa9d17ab0aef58582d [id=a1611aa744774532bf8c16d8cc701c49]) successfully deleted
I20260318 02:51:28.687793 1184 log.cc:1199] T 7cfaf92570b34b2bb1f52aea06187c83 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/7cfaf92570b34b2bb1f52aea06187c83
I20260318 02:51:28.688076 1176 ts_tablet_manager.cc:1950] T 95f15079d1df4314b6dd5c7afd896af5 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:28.688442 1184 ts_tablet_manager.cc:1950] T 7cfaf92570b34b2bb1f52aea06187c83 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:28.689002 1687 raft_consensus.cc:493] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:28.689785 1687 raft_consensus.cc:515] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.690542 1687 leader_election.cc:290] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:28.691531 999 leader_election.cc:343] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: cf27c8d69f41431e9fab12e605e15b9c
I20260318 02:51:28.686060 1172 tablet_bootstrap.cc:654] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:28.694206 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 9d20847fa6f9461cb6137f56ea680cb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d20847fa6f9461cb6137f56ea680cb6 already in progress: creating tablet
W20260318 02:51:28.696942 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 6bb381f10d87414f9c1a99942216adc7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6bb381f10d87414f9c1a99942216adc7 already in progress: creating tablet
I20260318 02:51:28.697526 1722 tablet.cc:1723] T 24c66e2cc96f458fb3279827cea4ca9e P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:28.700887 1176 tablet_replica.cc:333] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:28.689481 1720 tablet.cc:1723] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:28.692128 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf27c8d69f41431e9fab12e605e15b9c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:28.703025 1176 raft_consensus.cc:2243] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.703282 1176 raft_consensus.cc:2272] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.701372 1719 tablet.cc:1723] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:28.705895 888 tablet_service.cc:1558] Processing DeleteTablet for tablet d4a54d0daa9f48a89b3f114367750826 with delete_type TABLET_DATA_DELETED (replaced by tablet 061ebb62f4c54a2a8c24b90ec15402d3) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.706241 1175 tablet_replica.cc:333] T d4a54d0daa9f48a89b3f114367750826 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:28.706483 1175 raft_consensus.cc:2243] T d4a54d0daa9f48a89b3f114367750826 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.706724 1175 raft_consensus.cc:2272] T d4a54d0daa9f48a89b3f114367750826 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.707479 1176 ts_tablet_manager.cc:1916] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.713866 747 tablet_service.cc:1558] Processing DeleteTablet for tablet ed697b98352c4f65931c154b1f160991 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.714727 1175 ts_tablet_manager.cc:1916] T d4a54d0daa9f48a89b3f114367750826 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.698866 1184 tablet_replica.cc:333] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
W20260318 02:51:28.703855 997 leader_election.cc:343] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:28.717133 997 leader_election.cc:304] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:28.717535 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet c4051c8e4d3d49829f9eac8e36baab2f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4051c8e4d3d49829f9eac8e36baab2f already in progress: creating tablet
I20260318 02:51:28.717733 1687 raft_consensus.cc:2749] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:28.717793 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2a3a36a7fd4742c9827b334ce31d4a7c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a3a36a7fd4742c9827b334ce31d4a7c already in progress: creating tablet
W20260318 02:51:28.717993 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 0ed4350e0fde4c8690970bc69830fcb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ed4350e0fde4c8690970bc69830fcb3 already in progress: creating tablet
W20260318 02:51:28.718171 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet fd1284c6e90d4beb8223fd807d7888ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd1284c6e90d4beb8223fd807d7888ec already in progress: creating tablet
W20260318 02:51:28.718357 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 3e38dec0d2e9417e8571e202036e7117 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e38dec0d2e9417e8571e202036e7117 already in progress: creating tablet
I20260318 02:51:28.718407 1184 raft_consensus.cc:2243] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:28.718557 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 6f527a0ba0914924bc7f604ae8a48393 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f527a0ba0914924bc7f604ae8a48393 already in progress: creating tablet
I20260318 02:51:28.719786 1184 raft_consensus.cc:2272] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.720494 1184 ts_tablet_manager.cc:1916] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.707283 456 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet bc47f35f9c2c4e5085ab482285effc91 (table default.Table_497d117a371b43f3a21e5c39793ab2c0 [id=1515573be85644d7a4f046947aa1537b]). Expected version 2 got 0
I20260318 02:51:28.727191 1176 ts_tablet_manager.cc:1929] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.727358 1176 log.cc:1199] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/666c2992fa4f479ab4ffd7ac0c3a9c92
I20260318 02:51:28.713215 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 95f15079d1df4314b6dd5c7afd896af5 (table default.Table_74486e0a87264fb8ae22f015c8eb3fbe [id=5d87c85c334642829cb97e4b4cc4d95f]) successfully deleted
W20260318 02:51:28.727859 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet b894f0772a754196a3e651b38c46f001 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b894f0772a754196a3e651b38c46f001 already in progress: creating tablet
I20260318 02:51:28.734079 1176 ts_tablet_manager.cc:1950] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:28.735605 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6e856430587e41c0ab30702ffe6dd939"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.736217 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e856430587e41c0ab30702ffe6dd939 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.719682 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 7cfaf92570b34b2bb1f52aea06187c83 (table default.Table_2d7043580f83421ca8d7039923dc441e [id=aca08645de7c4fec8ffc5dbda004973b]) successfully deleted
W20260318 02:51:28.737923 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 503386365f6a49f6b84c64b59b764c10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 503386365f6a49f6b84c64b59b764c10 already in progress: creating tablet
W20260318 02:51:28.738159 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 305cc777ed0c46e497c80f15b8e6ead1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 305cc777ed0c46e497c80f15b8e6ead1 already in progress: creating tablet
I20260318 02:51:28.739506 1175 ts_tablet_manager.cc:1929] T d4a54d0daa9f48a89b3f114367750826 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.739677 1175 log.cc:1199] T d4a54d0daa9f48a89b3f114367750826 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/d4a54d0daa9f48a89b3f114367750826
I20260318 02:51:28.740023 1175 ts_tablet_manager.cc:1950] T d4a54d0daa9f48a89b3f114367750826 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:28.740588 1174 tablet_bootstrap.cc:492] T 9d20847fa6f9461cb6137f56ea680cb6 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:28.740864 1174 ts_tablet_manager.cc:1403] T 9d20847fa6f9461cb6137f56ea680cb6 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.130s user 0.006s sys 0.019s
W20260318 02:51:28.741672 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet a384923c86ee42d6a47ed3f68e6811df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a384923c86ee42d6a47ed3f68e6811df already in progress: creating tablet
W20260318 02:51:28.741983 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 7cdd554113bf4a7092da876365a89456 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cdd554113bf4a7092da876365a89456 already in progress: creating tablet
I20260318 02:51:28.742980 1174 raft_consensus.cc:359] T 9d20847fa6f9461cb6137f56ea680cb6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.743285 1174 raft_consensus.cc:385] T 9d20847fa6f9461cb6137f56ea680cb6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.743407 1174 raft_consensus.cc:740] T 9d20847fa6f9461cb6137f56ea680cb6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.743736 1174 consensus_queue.cc:260] T 9d20847fa6f9461cb6137f56ea680cb6 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:28.746192 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet b894f0772a754196a3e651b38c46f001 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b894f0772a754196a3e651b38c46f001 already in progress: creating tablet
W20260318 02:51:28.746661 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet ed697b98352c4f65931c154b1f160991 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed697b98352c4f65931c154b1f160991 already in progress: creating tablet
I20260318 02:51:28.748397 1173 tablet_bootstrap.cc:492] T 00d953e1ae2f47fc8016a2f9a791141d P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:28.748693 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet d4a54d0daa9f48a89b3f114367750826 (table default.Table_88caf570ec6a4dfea94952fb5718c9c6 [id=5a3571f0765948588578d8e5185807a8]) successfully deleted
I20260318 02:51:28.749039 1173 ts_tablet_manager.cc:1403] T 00d953e1ae2f47fc8016a2f9a791141d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.066s user 0.001s sys 0.004s
I20260318 02:51:28.749954 1173 raft_consensus.cc:359] T 00d953e1ae2f47fc8016a2f9a791141d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.750216 1173 raft_consensus.cc:385] T 00d953e1ae2f47fc8016a2f9a791141d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.750339 1173 raft_consensus.cc:740] T 00d953e1ae2f47fc8016a2f9a791141d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.750626 1173 consensus_queue.cc:260] T 00d953e1ae2f47fc8016a2f9a791141d P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.751667 1174 ts_tablet_manager.cc:1434] T 9d20847fa6f9461cb6137f56ea680cb6 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260318 02:51:28.753125 1174 tablet_bootstrap.cc:492] T 08307bc69291479eb8ee0d7aec124829 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:28.753283 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 666c2992fa4f479ab4ffd7ac0c3a9c92 (table default.Table_113ffa1cc0ef491cbc6786967482632f [id=504539970798458680abc4a9307656fa]) successfully deleted
W20260318 02:51:28.753609 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet ed697b98352c4f65931c154b1f160991 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed697b98352c4f65931c154b1f160991 already in progress: creating tablet
I20260318 02:51:28.754853 1174 tablet_bootstrap.cc:654] T 08307bc69291479eb8ee0d7aec124829 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.756321 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 62af8b953213412bb0c3bd1c68042ec9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.760660 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 7cfaf92570b34b2bb1f52aea06187c83 (table default.Table_2d7043580f83421ca8d7039923dc441e [id=aca08645de7c4fec8ffc5dbda004973b]) successfully deleted
W20260318 02:51:28.762595 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5c19bc5e07949088c84cedbf944dfdb consensus state has no leader
W20260318 02:51:28.764071 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3868406102b748a5b13420b24bf16485 consensus state has no leader
I20260318 02:51:28.764453 1172 tablet_bootstrap.cc:492] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:28.764457 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_752481de469d4cb5851520fd5052faf8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:28.764601 1172 ts_tablet_manager.cc:1403] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.112s user 0.005s sys 0.000s
W20260318 02:51:28.765054 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_752481de469d4cb5851520fd5052faf8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.766512 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_962a2e57d3cd414da0cebbd805a7c937"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.767019 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_962a2e57d3cd414da0cebbd805a7c937 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:28.768210 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc47f35f9c2c4e5085ab482285effc91 consensus state has no leader
I20260318 02:51:28.768276 1184 ts_tablet_manager.cc:1929] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.768409 1184 log.cc:1199] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/5aebb91ff6b0416fac2ef2d056ca897a
I20260318 02:51:28.768551 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_408acaf34cab438d92ffb9d939624018" } new_table_name: "default.Table_a168ed2816204e05aa65aaed95173a8f" modify_external_catalogs: true
I20260318 02:51:28.768821 1184 ts_tablet_manager.cc:1950] T 5aebb91ff6b0416fac2ef2d056ca897a P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:28.769940 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 900c6ef2dc634a788239dd5b77c4bde0
I20260318 02:51:28.770380 454 catalog_manager.cc:6741] ReplaceTablet: tablet 900c6ef2dc634a788239dd5b77c4bde0 deleted and replaced by tablet 20ecb11db30e409b9090ebfc4a4f0785
I20260318 02:51:28.770737 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8a3ee564e57c44ceafe096c878900896"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.771234 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a3ee564e57c44ceafe096c878900896 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.772660 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7726804d85124e99b24f46fd5169aed5" } new_table_name: "default.Table_a8076e315fa94c08aea13ffb29815bd1" modify_external_catalogs: true
I20260318 02:51:28.774191 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_fddbe89a9a524d028fba5877d8b23387" } modify_external_catalogs: true
I20260318 02:51:28.774369 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_fddbe89a9a524d028fba5877d8b23387" } modify_external_catalogs: true
I20260318 02:51:28.775655 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 900c6ef2dc634a788239dd5b77c4bde0 with delete_type TABLET_DATA_DELETED (replaced by tablet 20ecb11db30e409b9090ebfc4a4f0785) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.776603 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 900c6ef2dc634a788239dd5b77c4bde0 with delete_type TABLET_DATA_DELETED (replaced by tablet 20ecb11db30e409b9090ebfc4a4f0785) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.776950 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 5aebb91ff6b0416fac2ef2d056ca897a (table default.Table_764057148a0945d0a7a4f9e497808d92 [id=e91dc919c98843a7b31ed85f73ab5774]) successfully deleted
W20260318 02:51:28.777364 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 900c6ef2dc634a788239dd5b77c4bde0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 900c6ef2dc634a788239dd5b77c4bde0 already in progress: creating tablet
W20260318 02:51:28.777571 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 900c6ef2dc634a788239dd5b77c4bde0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 900c6ef2dc634a788239dd5b77c4bde0 already in progress: creating tablet
I20260318 02:51:28.779263 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6b19fea4f7ad44fb900d8bf1f165d331"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.779745 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b19fea4f7ad44fb900d8bf1f165d331 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.781363 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 900c6ef2dc634a788239dd5b77c4bde0 with delete_type TABLET_DATA_DELETED (replaced by tablet 20ecb11db30e409b9090ebfc4a4f0785) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.782217 1172 raft_consensus.cc:359] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.782379 1172 raft_consensus.cc:385] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.782454 1172 raft_consensus.cc:740] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
W20260318 02:51:28.786054 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet fd1284c6e90d4beb8223fd807d7888ec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd1284c6e90d4beb8223fd807d7888ec already in progress: creating tablet
I20260318 02:51:28.782655 1172 consensus_queue.cc:260] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:28.786360 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 3e38dec0d2e9417e8571e202036e7117 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e38dec0d2e9417e8571e202036e7117 already in progress: creating tablet
W20260318 02:51:28.786839 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 6f527a0ba0914924bc7f604ae8a48393 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f527a0ba0914924bc7f604ae8a48393 already in progress: creating tablet
I20260318 02:51:28.787591 1173 ts_tablet_manager.cc:1434] T 00d953e1ae2f47fc8016a2f9a791141d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.038s user 0.001s sys 0.001s
I20260318 02:51:28.790971 1173 tablet_bootstrap.cc:492] T cf27c8d69f41431e9fab12e605e15b9c P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:28.792835 1173 tablet_bootstrap.cc:654] T cf27c8d69f41431e9fab12e605e15b9c P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.795286 1687 raft_consensus.cc:493] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:28.795480 1687 raft_consensus.cc:515] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.796126 1687 leader_election.cc:290] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:28.797851 999 leader_election.cc:343] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: a8b44b68094344f7a694ae4d985f56a6
I20260318 02:51:28.798161 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b44b68094344f7a694ae4d985f56a6" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:28.798677 997 leader_election.cc:343] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:28.798810 997 leader_election.cc:304] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:28.799285 1687 raft_consensus.cc:2749] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:28.803498 1172 ts_tablet_manager.cc:1434] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.039s user 0.000s sys 0.002s
I20260318 02:51:28.803871 1184 tablet_replica.cc:333] T 00d953e1ae2f47fc8016a2f9a791141d P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:28.804207 1184 raft_consensus.cc:2243] T 00d953e1ae2f47fc8016a2f9a791141d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.807507 1184 raft_consensus.cc:2272] T 00d953e1ae2f47fc8016a2f9a791141d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.807333 1172 tablet_bootstrap.cc:492] T d4a54d0daa9f48a89b3f114367750826 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:28.808490 1184 ts_tablet_manager.cc:1916] T 00d953e1ae2f47fc8016a2f9a791141d P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.810608 455 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_ac2dafcc68eb412da14e17b420c2bf92 [id=ade423581b18488699c64d3b107d0b07] alter complete (version 1)
I20260318 02:51:28.811242 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_67969be821524f06922e86b98527c45b" } modify_external_catalogs: true
I20260318 02:51:28.811393 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 62af8b953213412bb0c3bd1c68042ec9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.811419 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_67969be821524f06922e86b98527c45b" } modify_external_catalogs: true
I20260318 02:51:28.811677 1175 tablet_replica.cc:333] T 62af8b953213412bb0c3bd1c68042ec9 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:28.811836 1175 raft_consensus.cc:2243] T 62af8b953213412bb0c3bd1c68042ec9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.812006 1175 raft_consensus.cc:2272] T 62af8b953213412bb0c3bd1c68042ec9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.812175 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7053cfb9ed1245aaa504d240368eff1a" } modify_external_catalogs: true
I20260318 02:51:28.812358 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7053cfb9ed1245aaa504d240368eff1a" } modify_external_catalogs: true
I20260318 02:51:28.813125 1175 ts_tablet_manager.cc:1916] T 62af8b953213412bb0c3bd1c68042ec9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.813200 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8a612850d1784dda9f09b14b7e12b28c" } modify_external_catalogs: true
I20260318 02:51:28.813341 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8a612850d1784dda9f09b14b7e12b28c" } modify_external_catalogs: true
W20260318 02:51:28.813866 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 918c542a51864e54871efc5e7f62ef61 consensus state has no leader
I20260318 02:51:28.814117 457 master_service.cc:954] ReplaceTablet: received request to replace tablet 503386365f6a49f6b84c64b59b764c10 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:28.814617 457 master_service.cc:954] ReplaceTablet: received request to replace tablet 258dc29e4e4245289b7e450837edcd24 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:28.814653 1174 tablet_bootstrap.cc:492] T 08307bc69291479eb8ee0d7aec124829 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:28.814813 1174 ts_tablet_manager.cc:1403] T 08307bc69291479eb8ee0d7aec124829 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.062s user 0.001s sys 0.002s
I20260318 02:51:28.815665 1174 raft_consensus.cc:359] T 08307bc69291479eb8ee0d7aec124829 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.815840 1174 raft_consensus.cc:385] T 08307bc69291479eb8ee0d7aec124829 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.815933 1174 raft_consensus.cc:740] T 08307bc69291479eb8ee0d7aec124829 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.816095 454 master_service.cc:954] ReplaceTablet: received request to replace tablet 785f6728f94d41f3997961e3d1ebee34 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:28.816182 1174 consensus_queue.cc:260] T 08307bc69291479eb8ee0d7aec124829 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.816504 454 master_service.cc:954] ReplaceTablet: received request to replace tablet b10fd13bf3ea48b0896b34fce478e25a from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:28.816470 1028 tablet_service.cc:1511] Processing CreateTablet for tablet f7f8240ed325401da6344c8ee033ad43 (DEFAULT_TABLE table=default.Table_833f8bfd9c5f49bfbaefd932e597b22a [id=c6d32a3c49154543a33b445f5a85aabb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.816756 1174 ts_tablet_manager.cc:1434] T 08307bc69291479eb8ee0d7aec124829 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:28.816949 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7f8240ed325401da6344c8ee033ad43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.817111 1174 tablet_bootstrap.cc:492] T 93479517a1d34d2d99633018a6a57127 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:28.817191 896 tablet_service.cc:1511] Processing CreateTablet for tablet f7f8240ed325401da6344c8ee033ad43 (DEFAULT_TABLE table=default.Table_833f8bfd9c5f49bfbaefd932e597b22a [id=c6d32a3c49154543a33b445f5a85aabb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.817565 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7f8240ed325401da6344c8ee033ad43. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:28.817821 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7f21df58fac437da5747becfa3f28b4 consensus state has no leader
I20260318 02:51:28.818758 1174 tablet_bootstrap.cc:654] T 93479517a1d34d2d99633018a6a57127 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.824311 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 00d953e1ae2f47fc8016a2f9a791141d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.809504 1172 tablet_bootstrap.cc:654] T d4a54d0daa9f48a89b3f114367750826 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.830248 1175 ts_tablet_manager.cc:1929] T 62af8b953213412bb0c3bd1c68042ec9 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.831252 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 2a6f56dafead404eb1720276b07ea733 (DEFAULT_TABLE table=default.Table_2bac6e37bc644cc1952a524104c54eda [id=67f2d4eef0ff423ab56e7c9ba8a01b51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.831465 1175 log.cc:1199] T 62af8b953213412bb0c3bd1c68042ec9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/62af8b953213412bb0c3bd1c68042ec9
I20260318 02:51:28.831676 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6f56dafead404eb1720276b07ea733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.831864 1175 ts_tablet_manager.cc:1950] T 62af8b953213412bb0c3bd1c68042ec9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:28.832867 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 62af8b953213412bb0c3bd1c68042ec9 (table default.Table_64fa6aaaa46242f3a737f4da65eb1947 [id=de39610433af488e9fc732cbb5dd7523]) successfully deleted
I20260318 02:51:28.831103 896 tablet_service.cc:1511] Processing CreateTablet for tablet 2a6f56dafead404eb1720276b07ea733 (DEFAULT_TABLE table=default.Table_2bac6e37bc644cc1952a524104c54eda [id=67f2d4eef0ff423ab56e7c9ba8a01b51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.833323 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6f56dafead404eb1720276b07ea733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.835443 1174 tablet_bootstrap.cc:492] T 93479517a1d34d2d99633018a6a57127 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:28.835580 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet e2304246c244407b9d4eb301ac5d7ba9
I20260318 02:51:28.835628 1174 ts_tablet_manager.cc:1403] T 93479517a1d34d2d99633018a6a57127 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.005s
I20260318 02:51:28.835636 1175 tablet_replica.cc:333] T 00d953e1ae2f47fc8016a2f9a791141d P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:28.836314 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet e2304246c244407b9d4eb301ac5d7ba9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.836434 1174 raft_consensus.cc:359] T 93479517a1d34d2d99633018a6a57127 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.836659 1174 raft_consensus.cc:385] T 93479517a1d34d2d99633018a6a57127 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.836794 1174 raft_consensus.cc:740] T 93479517a1d34d2d99633018a6a57127 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.837046 1174 consensus_queue.cc:260] T 93479517a1d34d2d99633018a6a57127 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.837707 1174 ts_tablet_manager.cc:1434] T 93479517a1d34d2d99633018a6a57127 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:28.838021 1174 tablet_bootstrap.cc:492] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:28.841082 888 tablet_service.cc:1558] Processing DeleteTablet for tablet e2304246c244407b9d4eb301ac5d7ba9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.841269 1175 raft_consensus.cc:2243] T 00d953e1ae2f47fc8016a2f9a791141d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.841449 1175 raft_consensus.cc:2272] T 00d953e1ae2f47fc8016a2f9a791141d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.843286 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d20847fa6f9461cb6137f56ea680cb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.843806 761 tablet_service.cc:1511] Processing CreateTablet for tablet f7f8240ed325401da6344c8ee033ad43 (DEFAULT_TABLE table=default.Table_833f8bfd9c5f49bfbaefd932e597b22a [id=c6d32a3c49154543a33b445f5a85aabb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.844211 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7f8240ed325401da6344c8ee033ad43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.844303 1175 ts_tablet_manager.cc:1916] T 00d953e1ae2f47fc8016a2f9a791141d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.844851 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 08307bc69291479eb8ee0d7aec124829 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.845089 758 tablet_service.cc:1558] Processing DeleteTablet for tablet e2304246c244407b9d4eb301ac5d7ba9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.845283 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 93479517a1d34d2d99633018a6a57127 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fec974d146f44aeb72df483fa85b287) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.845494 1176 tablet_replica.cc:333] T 9d20847fa6f9461cb6137f56ea680cb6 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:28.845676 1174 tablet_bootstrap.cc:654] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.845686 1176 raft_consensus.cc:2243] T 9d20847fa6f9461cb6137f56ea680cb6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.846205 1176 raft_consensus.cc:2272] T 9d20847fa6f9461cb6137f56ea680cb6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.848390 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet a8b44b68094344f7a694ae4d985f56a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.849151 1176 ts_tablet_manager.cc:1916] T 9d20847fa6f9461cb6137f56ea680cb6 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.849263 1184 ts_tablet_manager.cc:1929] T 00d953e1ae2f47fc8016a2f9a791141d P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.849417 1184 log.cc:1199] T 00d953e1ae2f47fc8016a2f9a791141d P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/00d953e1ae2f47fc8016a2f9a791141d
I20260318 02:51:28.849757 1184 ts_tablet_manager.cc:1950] T 00d953e1ae2f47fc8016a2f9a791141d P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:28.850888 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 00d953e1ae2f47fc8016a2f9a791141d (table default.Table_87b1b608a1414098af9c5136bf508ab7 [id=b3f661ab32bc4941805f8c4018d47435]) successfully deleted
I20260318 02:51:28.856992 1184 tablet_replica.cc:333] T 71c518c87bdd4a63aa1016e8de6bafdc P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:28.857376 1184 raft_consensus.cc:2243] T 71c518c87bdd4a63aa1016e8de6bafdc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.860879 1667 raft_consensus.cc:493] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:28.860987 1184 raft_consensus.cc:2272] T 71c518c87bdd4a63aa1016e8de6bafdc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.861061 1667 raft_consensus.cc:515] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.861721 1667 leader_election.cc:290] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:28.861874 1184 ts_tablet_manager.cc:1916] T 71c518c87bdd4a63aa1016e8de6bafdc P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.862905 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916b5b77fb2f4003b78a71025319ed15" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:28.863282 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916b5b77fb2f4003b78a71025319ed15" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:28.863997 719 leader_election.cc:343] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:28.864204 719 leader_election.cc:343] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:28.864270 719 leader_election.cc:304] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:28.865360 1667 raft_consensus.cc:2749] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:28.865628 1174 tablet_bootstrap.cc:492] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:28.865839 1174 ts_tablet_manager.cc:1403] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.001s
I20260318 02:51:28.867053 1174 raft_consensus.cc:359] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.867316 1174 raft_consensus.cc:385] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.867439 1174 raft_consensus.cc:740] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.867743 1174 consensus_queue.cc:260] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.867869 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 258dc29e4e4245289b7e450837edcd24
I20260318 02:51:28.868399 457 catalog_manager.cc:6741] ReplaceTablet: tablet 258dc29e4e4245289b7e450837edcd24 deleted and replaced by tablet dc0bb9b5580d43429828e67f53871982
I20260318 02:51:28.868815 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b10fd13bf3ea48b0896b34fce478e25a
I20260318 02:51:28.868937 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 258dc29e4e4245289b7e450837edcd24 with delete_type TABLET_DATA_DELETED (replaced by tablet dc0bb9b5580d43429828e67f53871982) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.869117 1174 ts_tablet_manager.cc:1434] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:28.869223 454 catalog_manager.cc:6741] ReplaceTablet: tablet b10fd13bf3ea48b0896b34fce478e25a deleted and replaced by tablet 053efeef673f4535993b29d102884408
I20260318 02:51:28.869225 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 258dc29e4e4245289b7e450837edcd24 with delete_type TABLET_DATA_DELETED (replaced by tablet dc0bb9b5580d43429828e67f53871982) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.869478 1174 tablet_bootstrap.cc:492] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:28.869769 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 41646d513e834600a209761392ac7fb1
I20260318 02:51:28.869891 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet b10fd13bf3ea48b0896b34fce478e25a with delete_type TABLET_DATA_DELETED (replaced by tablet 053efeef673f4535993b29d102884408) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.870206 888 tablet_service.cc:1558] Processing DeleteTablet for tablet b10fd13bf3ea48b0896b34fce478e25a with delete_type TABLET_DATA_DELETED (replaced by tablet 053efeef673f4535993b29d102884408) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.870749 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet bf344c2361b7412c87a7c7f9a72a15b6
I20260318 02:51:28.870738 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 41646d513e834600a209761392ac7fb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.871038 888 tablet_service.cc:1558] Processing DeleteTablet for tablet 41646d513e834600a209761392ac7fb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.871618 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet bf344c2361b7412c87a7c7f9a72a15b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.872644 1174 tablet_bootstrap.cc:654] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.872642 455 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet b51a15e4303742a999fe9a96d450c827 (table default.Table_c9fa61fd1bdb405f89a32f500da8f182 [id=9aa1a9e376e8459987f5ef2231598bd0]). Expected version 1 got 0
I20260318 02:51:28.873420 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 258dc29e4e4245289b7e450837edcd24 with delete_type TABLET_DATA_DELETED (replaced by tablet dc0bb9b5580d43429828e67f53871982) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.873656 758 tablet_service.cc:1558] Processing DeleteTablet for tablet b10fd13bf3ea48b0896b34fce478e25a with delete_type TABLET_DATA_DELETED (replaced by tablet 053efeef673f4535993b29d102884408) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.873878 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 41646d513e834600a209761392ac7fb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.873870 888 tablet_service.cc:1558] Processing DeleteTablet for tablet bf344c2361b7412c87a7c7f9a72a15b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.874598 747 tablet_service.cc:1558] Processing DeleteTablet for tablet bf344c2361b7412c87a7c7f9a72a15b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.875077 1173 tablet_bootstrap.cc:492] T cf27c8d69f41431e9fab12e605e15b9c P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:28.875749 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet dfb3e7fe7a834636a16ee8a772b73ee2
I20260318 02:51:28.876048 1173 ts_tablet_manager.cc:1403] T cf27c8d69f41431e9fab12e605e15b9c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.085s user 0.003s sys 0.015s
I20260318 02:51:28.876487 888 tablet_service.cc:1558] Processing DeleteTablet for tablet dfb3e7fe7a834636a16ee8a772b73ee2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.876506 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet dfb3e7fe7a834636a16ee8a772b73ee2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.876962 747 tablet_service.cc:1558] Processing DeleteTablet for tablet dfb3e7fe7a834636a16ee8a772b73ee2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.876943 1173 raft_consensus.cc:359] T cf27c8d69f41431e9fab12e605e15b9c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.877127 1173 raft_consensus.cc:385] T cf27c8d69f41431e9fab12e605e15b9c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.879295 1173 raft_consensus.cc:740] T cf27c8d69f41431e9fab12e605e15b9c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.879637 1173 consensus_queue.cc:260] T cf27c8d69f41431e9fab12e605e15b9c P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.883919 896 tablet_service.cc:1558] Processing DeleteTablet for tablet cf27c8d69f41431e9fab12e605e15b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.884477 1173 ts_tablet_manager.cc:1434] T cf27c8d69f41431e9fab12e605e15b9c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260318 02:51:28.887993 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5ed5970032fe44119b015cb6bbcd91d0" } modify_external_catalogs: true
I20260318 02:51:28.888137 1176 ts_tablet_manager.cc:1929] T 9d20847fa6f9461cb6137f56ea680cb6 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.888198 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5ed5970032fe44119b015cb6bbcd91d0" } modify_external_catalogs: true
I20260318 02:51:28.888266 1176 log.cc:1199] T 9d20847fa6f9461cb6137f56ea680cb6 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/9d20847fa6f9461cb6137f56ea680cb6
I20260318 02:51:28.888592 1176 ts_tablet_manager.cc:1950] T 9d20847fa6f9461cb6137f56ea680cb6 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:28.889603 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 9d20847fa6f9461cb6137f56ea680cb6 (table default.Table_30dc528b33264c9faed7f9f325d93738 [id=ed55cf5473c34c8b95532da9cfa81fad]) successfully deleted
I20260318 02:51:28.894623 1184 ts_tablet_manager.cc:1929] T 71c518c87bdd4a63aa1016e8de6bafdc P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.895087 1184 log.cc:1199] T 71c518c87bdd4a63aa1016e8de6bafdc P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/71c518c87bdd4a63aa1016e8de6bafdc
I20260318 02:51:28.895785 1184 ts_tablet_manager.cc:1950] T 71c518c87bdd4a63aa1016e8de6bafdc P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:28.896381 1173 tablet_bootstrap.cc:492] T a8b44b68094344f7a694ae4d985f56a6 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:28.879195 1175 ts_tablet_manager.cc:1929] T 00d953e1ae2f47fc8016a2f9a791141d P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.896941 1175 log.cc:1199] T 00d953e1ae2f47fc8016a2f9a791141d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/00d953e1ae2f47fc8016a2f9a791141d
I20260318 02:51:28.897918 1175 ts_tablet_manager.cc:1950] T 00d953e1ae2f47fc8016a2f9a791141d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:28.898130 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 4df7d75e696a4aec981de3963c282b0d
I20260318 02:51:28.898910 1175 tablet_replica.cc:333] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:28.899004 1174 tablet_bootstrap.cc:492] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:28.899241 1174 ts_tablet_manager.cc:1403] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.001s
I20260318 02:51:28.899236 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 00d953e1ae2f47fc8016a2f9a791141d (table default.Table_87b1b608a1414098af9c5136bf508ab7 [id=b3f661ab32bc4941805f8c4018d47435]) successfully deleted
I20260318 02:51:28.899580 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet 4df7d75e696a4aec981de3963c282b0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:28.899941 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 4df7d75e696a4aec981de3963c282b0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.900152 1174 raft_consensus.cc:359] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.900437 1174 raft_consensus.cc:385] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.900557 1174 raft_consensus.cc:740] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.899864 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 4df7d75e696a4aec981de3963c282b0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.900986 1175 raft_consensus.cc:2243] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:28.901000 1174 consensus_queue.cc:260] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.900277 1176 tablet_replica.cc:333] T 08307bc69291479eb8ee0d7aec124829 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:28.901363 1176 raft_consensus.cc:2243] T 08307bc69291479eb8ee0d7aec124829 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.900580 1173 tablet_bootstrap.cc:654] T a8b44b68094344f7a694ae4d985f56a6 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.901677 1176 raft_consensus.cc:2272] T 08307bc69291479eb8ee0d7aec124829 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.902186 1174 ts_tablet_manager.cc:1434] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:28.902515 1174 tablet_bootstrap.cc:492] T 2c5038e9e1074f46976a1a5bb4282944 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:28.902819 1667 raft_consensus.cc:493] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:28.902974 1667 raft_consensus.cc:515] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.903559 1667 leader_election.cc:290] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:28.904314 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc47f35f9c2c4e5085ab482285effc91" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:28.904805 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc47f35f9c2c4e5085ab482285effc91" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:28.905400 719 leader_election.cc:343] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:28.906100 719 leader_election.cc:343] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:28.906276 719 leader_election.cc:304] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:28.906769 1667 raft_consensus.cc:2749] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:28.907174 1174 tablet_bootstrap.cc:654] T 2c5038e9e1074f46976a1a5bb4282944 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.910585 1175 raft_consensus.cc:2272] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.911376 1175 ts_tablet_manager.cc:1916] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.911450 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d343e53f2354a3386b19d71ef00d5a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.912386 1176 ts_tablet_manager.cc:1916] T 08307bc69291479eb8ee0d7aec124829 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.913015 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 71c518c87bdd4a63aa1016e8de6bafdc (table default.Table_346cff4fabb54f2ebef24b9eb0cf3be6 [id=dc28d96d1b5741de820129003145794b]) successfully deleted
W20260318 02:51:28.913416 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 305cc777ed0c46e497c80f15b8e6ead1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 305cc777ed0c46e497c80f15b8e6ead1 already in progress: creating tablet
W20260318 02:51:28.913663 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 503386365f6a49f6b84c64b59b764c10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 503386365f6a49f6b84c64b59b764c10 already in progress: creating tablet
W20260318 02:51:28.913887 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet a384923c86ee42d6a47ed3f68e6811df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a384923c86ee42d6a47ed3f68e6811df already in progress: creating tablet
W20260318 02:51:28.914112 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 7cdd554113bf4a7092da876365a89456 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cdd554113bf4a7092da876365a89456 already in progress: creating tablet
W20260318 02:51:28.914332 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet b894f0772a754196a3e651b38c46f001 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b894f0772a754196a3e651b38c46f001 already in progress: creating tablet
I20260318 02:51:28.914353 1184 tablet_replica.cc:333] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:28.914570 1184 raft_consensus.cc:2243] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.914853 1184 raft_consensus.cc:2272] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.920040 1175 ts_tablet_manager.cc:1929] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260318 02:51:28.920231 761 tablet_service.cc:1511] Processing CreateTablet for tablet 2a6f56dafead404eb1720276b07ea733 (DEFAULT_TABLE table=default.Table_2bac6e37bc644cc1952a524104c54eda [id=67f2d4eef0ff423ab56e7c9ba8a01b51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.920832 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6f56dafead404eb1720276b07ea733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.921658 1184 ts_tablet_manager.cc:1916] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.922363 1175 log.cc:1199] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/e2304246c244407b9d4eb301ac5d7ba9
I20260318 02:51:28.922787 1175 ts_tablet_manager.cc:1950] T e2304246c244407b9d4eb301ac5d7ba9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:28.924029 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet e2304246c244407b9d4eb301ac5d7ba9 (table default.Table_fddbe89a9a524d028fba5877d8b23387 [id=20ed812002544f6f8caef448f7514f7c]) successfully deleted
W20260318 02:51:28.924639 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 258dc29e4e4245289b7e450837edcd24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 258dc29e4e4245289b7e450837edcd24 already in progress: creating tablet
W20260318 02:51:28.924925 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet b10fd13bf3ea48b0896b34fce478e25a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b10fd13bf3ea48b0896b34fce478e25a already in progress: creating tablet
I20260318 02:51:28.925654 1028 tablet_service.cc:1511] Processing CreateTablet for tablet dfb3e7fe7a834636a16ee8a772b73ee2 (DEFAULT_TABLE table=default.Table_7053cfb9ed1245aaa504d240368eff1a [id=ffdcbe72708741c483aa2461a6816f83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.925668 896 tablet_service.cc:1511] Processing CreateTablet for tablet dfb3e7fe7a834636a16ee8a772b73ee2 (DEFAULT_TABLE table=default.Table_7053cfb9ed1245aaa504d240368eff1a [id=ffdcbe72708741c483aa2461a6816f83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.925675 747 tablet_service.cc:1511] Processing CreateTablet for tablet dfb3e7fe7a834636a16ee8a772b73ee2 (DEFAULT_TABLE table=default.Table_7053cfb9ed1245aaa504d240368eff1a [id=ffdcbe72708741c483aa2461a6816f83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.926081 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfb3e7fe7a834636a16ee8a772b73ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.926127 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfb3e7fe7a834636a16ee8a772b73ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.926234 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfb3e7fe7a834636a16ee8a772b73ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.933377 1175 tablet_replica.cc:333] T cf27c8d69f41431e9fab12e605e15b9c P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
W20260318 02:51:28.933487 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 41646d513e834600a209761392ac7fb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41646d513e834600a209761392ac7fb1 already in progress: creating tablet
I20260318 02:51:28.933729 1175 raft_consensus.cc:2243] T cf27c8d69f41431e9fab12e605e15b9c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:28.933777 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet bf344c2361b7412c87a7c7f9a72a15b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf344c2361b7412c87a7c7f9a72a15b6 already in progress: creating tablet
I20260318 02:51:28.934015 1175 raft_consensus.cc:2272] T cf27c8d69f41431e9fab12e605e15b9c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:28.934027 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet dfb3e7fe7a834636a16ee8a772b73ee2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfb3e7fe7a834636a16ee8a772b73ee2 already in progress: creating tablet
I20260318 02:51:28.934768 1175 ts_tablet_manager.cc:1916] T cf27c8d69f41431e9fab12e605e15b9c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.935173 1173 tablet_bootstrap.cc:492] T a8b44b68094344f7a694ae4d985f56a6 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:28.935323 1173 ts_tablet_manager.cc:1403] T a8b44b68094344f7a694ae4d985f56a6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.039s user 0.005s sys 0.003s
I20260318 02:51:28.935886 896 tablet_service.cc:1511] Processing CreateTablet for tablet ccff619ef27f48a59d5dd683fe5d09db (DEFAULT_TABLE table=default.Table_46a2caeb0a8f424b85290dc1e56f8e15 [id=ec8783e475dd4f05a3d822517ce924f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.936586 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccff619ef27f48a59d5dd683fe5d09db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.936967 1173 raft_consensus.cc:359] T a8b44b68094344f7a694ae4d985f56a6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.937139 1173 raft_consensus.cc:385] T a8b44b68094344f7a694ae4d985f56a6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.937211 1173 raft_consensus.cc:740] T a8b44b68094344f7a694ae4d985f56a6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.937474 1173 consensus_queue.cc:260] T a8b44b68094344f7a694ae4d985f56a6 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.938932 1173 ts_tablet_manager.cc:1434] T a8b44b68094344f7a694ae4d985f56a6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260318 02:51:28.938948 1174 tablet_bootstrap.cc:492] T 2c5038e9e1074f46976a1a5bb4282944 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:28.939097 1174 ts_tablet_manager.cc:1403] T 2c5038e9e1074f46976a1a5bb4282944 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.001s
I20260318 02:51:28.939218 1173 tablet_bootstrap.cc:492] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:28.939865 1174 raft_consensus.cc:359] T 2c5038e9e1074f46976a1a5bb4282944 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:28.940028 1174 raft_consensus.cc:385] T 2c5038e9e1074f46976a1a5bb4282944 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.940119 1174 raft_consensus.cc:740] T 2c5038e9e1074f46976a1a5bb4282944 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.940326 1174 consensus_queue.cc:260] T 2c5038e9e1074f46976a1a5bb4282944 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:28.940976 1173 tablet_bootstrap.cc:654] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.940965 1174 ts_tablet_manager.cc:1434] T 2c5038e9e1074f46976a1a5bb4282944 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:28.941253 1174 tablet_bootstrap.cc:492] T 3e38dec0d2e9417e8571e202036e7117 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:28.941604 888 tablet_service.cc:1558] Processing DeleteTablet for tablet a8b44b68094344f7a694ae4d985f56a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:28.942849 1174 tablet_bootstrap.cc:654] T 3e38dec0d2e9417e8571e202036e7117 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.949896 1044 tablet_service.cc:1511] Processing CreateTablet for tablet ccff619ef27f48a59d5dd683fe5d09db (DEFAULT_TABLE table=default.Table_46a2caeb0a8f424b85290dc1e56f8e15 [id=ec8783e475dd4f05a3d822517ce924f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.950232 1172 tablet_bootstrap.cc:492] T d4a54d0daa9f48a89b3f114367750826 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:28.950479 1172 ts_tablet_manager.cc:1403] T d4a54d0daa9f48a89b3f114367750826 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.143s user 0.003s sys 0.001s
I20260318 02:51:28.951407 1172 raft_consensus.cc:359] T d4a54d0daa9f48a89b3f114367750826 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.951588 753 tablet_service.cc:1511] Processing CreateTablet for tablet ccff619ef27f48a59d5dd683fe5d09db (DEFAULT_TABLE table=default.Table_46a2caeb0a8f424b85290dc1e56f8e15 [id=ec8783e475dd4f05a3d822517ce924f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.951697 1172 raft_consensus.cc:385] T d4a54d0daa9f48a89b3f114367750826 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.951768 1172 raft_consensus.cc:740] T d4a54d0daa9f48a89b3f114367750826 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.952028 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccff619ef27f48a59d5dd683fe5d09db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.952016 1172 consensus_queue.cc:260] T d4a54d0daa9f48a89b3f114367750826 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:28.952510 1172 ts_tablet_manager.cc:1434] T d4a54d0daa9f48a89b3f114367750826 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260318 02:51:28.952862 1172 tablet_bootstrap.cc:492] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:28.954298 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c5038e9e1074f46976a1a5bb4282944 with delete_type TABLET_DATA_DELETED (replaced by tablet 27fc03c90b584becb250546100af736c) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:28.954782 1172 tablet_bootstrap.cc:654] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.957011 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccff619ef27f48a59d5dd683fe5d09db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.963410 1184 ts_tablet_manager.cc:1929] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.963631 1184 log.cc:1199] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/cf27c8d69f41431e9fab12e605e15b9c
I20260318 02:51:28.964010 1184 ts_tablet_manager.cc:1950] T cf27c8d69f41431e9fab12e605e15b9c P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:28.963932 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_acd2793d6aea4258be0afe46caa5d732"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:28.964852 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2a220571935c4f34a14be87348a10cf8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.964999 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_acd2793d6aea4258be0afe46caa5d732 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.965538 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet cf27c8d69f41431e9fab12e605e15b9c (table default.Table_1d2a493334714a809ca348d380f97577 [id=313b847f9c15442198f034c266da8078]) successfully deleted
I20260318 02:51:28.965657 1173 tablet_bootstrap.cc:492] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
W20260318 02:51:28.965808 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet ed697b98352c4f65931c154b1f160991 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed697b98352c4f65931c154b1f160991 already in progress: creating tablet
I20260318 02:51:28.965871 1184 tablet_replica.cc:333] T 62af8b953213412bb0c3bd1c68042ec9 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:28.965956 1173 ts_tablet_manager.cc:1403] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.004s
I20260318 02:51:28.966642 1184 raft_consensus.cc:2243] T 62af8b953213412bb0c3bd1c68042ec9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.966820 1173 raft_consensus.cc:359] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:28.966976 1184 raft_consensus.cc:2272] T 62af8b953213412bb0c3bd1c68042ec9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.967423 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ed19d9231be44ca5acea8b9a1cad67de" } new_table_name: "default.Table_c6d53ff287654d37b638cd812b89127f" modify_external_catalogs: true
I20260318 02:51:28.968091 1173 raft_consensus.cc:385] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:28.968189 1173 raft_consensus.cc:740] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.968474 1173 consensus_queue.cc:260] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:28.970180 1173 ts_tablet_manager.cc:1434] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260318 02:51:28.970525 1173 tablet_bootstrap.cc:492] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:28.970722 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_209fa5c75dbf4c9d8fa3755b25c0502d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:28.971273 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_209fa5c75dbf4c9d8fa3755b25c0502d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.974354 1173 tablet_bootstrap.cc:654] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:28.974817 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_54b4a3fab33448e1bb213ded14c746a1" } new_table_name: "default.Table_3364639236c34063b210c13a3d726f6f" modify_external_catalogs: true
I20260318 02:51:28.978017 896 tablet_service.cc:1511] Processing CreateTablet for tablet 793a87e8bcb442c1b6fb0ecfcbc71480 (DEFAULT_TABLE table=default.Table_dc3bf04a6859483e999dc1bcb8462e7e [id=5341e8b88b3a455985bff5a1ec3c364e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.978603 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793a87e8bcb442c1b6fb0ecfcbc71480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.980348 1172 tablet_bootstrap.cc:492] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:28.980623 1172 ts_tablet_manager.cc:1403] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.001s
I20260318 02:51:28.981374 1176 ts_tablet_manager.cc:1929] T 08307bc69291479eb8ee0d7aec124829 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:28.981600 1176 log.cc:1199] T 08307bc69291479eb8ee0d7aec124829 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/08307bc69291479eb8ee0d7aec124829
I20260318 02:51:28.982133 1176 ts_tablet_manager.cc:1950] T 08307bc69291479eb8ee0d7aec124829 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:28.983868 1176 tablet_replica.cc:333] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:28.984114 1176 raft_consensus.cc:2243] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:28.984365 1176 raft_consensus.cc:2272] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:28.984784 1172 raft_consensus.cc:359] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:28.985069 1172 raft_consensus.cc:385] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260318 02:51:28.985253 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a220571935c4f34a14be87348a10cf8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.985809 1172 raft_consensus.cc:740] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:28.987318 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 08307bc69291479eb8ee0d7aec124829 (table default.Table_80f976f24d184e2cbaf4f63b8495c8ab [id=2597ecaa93914543870472f2af156dc2]) successfully deleted
I20260318 02:51:28.991004 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 793a87e8bcb442c1b6fb0ecfcbc71480 (DEFAULT_TABLE table=default.Table_dc3bf04a6859483e999dc1bcb8462e7e [id=5341e8b88b3a455985bff5a1ec3c364e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.991223 1172 consensus_queue.cc:260] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:28.992645 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_dbb2de6255ae4293a1c724e0d9e9f947" } new_table_name: "default.Table_65e155035fa4491e9d71e09c78082822" modify_external_catalogs: true
I20260318 02:51:28.992913 761 tablet_service.cc:1511] Processing CreateTablet for tablet 793a87e8bcb442c1b6fb0ecfcbc71480 (DEFAULT_TABLE table=default.Table_dc3bf04a6859483e999dc1bcb8462e7e [id=5341e8b88b3a455985bff5a1ec3c364e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.993306 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793a87e8bcb442c1b6fb0ecfcbc71480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.994895 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e2ff8e79aa4148bfa15f985c2cf1b1b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:28.994989 888 tablet_service.cc:1511] Processing CreateTablet for tablet 70dca1ffc22c4c029840635f1b312dff (DEFAULT_TABLE table=default.Table_6b7d64f684ff4cc0992215f5962ab5eb [id=6ec5e0e160f64ea58a57775ba6978d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.995407 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70dca1ffc22c4c029840635f1b312dff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:28.995481 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2ff8e79aa4148bfa15f985c2cf1b1b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:28.996109 753 tablet_service.cc:1511] Processing CreateTablet for tablet 70dca1ffc22c4c029840635f1b312dff (DEFAULT_TABLE table=default.Table_6b7d64f684ff4cc0992215f5962ab5eb [id=6ec5e0e160f64ea58a57775ba6978d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.996487 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70dca1ffc22c4c029840635f1b312dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.998148 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793a87e8bcb442c1b6fb0ecfcbc71480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.998281 902 tablet_service.cc:1511] Processing CreateTablet for tablet c0349def0e4045f2b1e9a02dd654a174 (DEFAULT_TABLE table=default.Table_cd6fa6816d194e7fb86251cce055a47f [id=76d5bb45e6b3427591b09343d5fc206a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:28.998631 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0349def0e4045f2b1e9a02dd654a174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:28.999006 1184 ts_tablet_manager.cc:1916] T 62af8b953213412bb0c3bd1c68042ec9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:28.999261 449 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet bd077319b3c443849de087eb61da6a77 (table default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]). Expected version 1 got 0
I20260318 02:51:29.000085 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a45c93f14c58497cb5a6e81c8bef604c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:29.000844 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 70dca1ffc22c4c029840635f1b312dff (DEFAULT_TABLE table=default.Table_6b7d64f684ff4cc0992215f5962ab5eb [id=6ec5e0e160f64ea58a57775ba6978d9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.001245 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70dca1ffc22c4c029840635f1b312dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.003008 1176 ts_tablet_manager.cc:1916] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:29.004395 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a45c93f14c58497cb5a6e81c8bef604c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.005466 747 tablet_service.cc:1511] Processing CreateTablet for tablet c0349def0e4045f2b1e9a02dd654a174 (DEFAULT_TABLE table=default.Table_cd6fa6816d194e7fb86251cce055a47f [id=76d5bb45e6b3427591b09343d5fc206a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.005570 1032 tablet_service.cc:1511] Processing CreateTablet for tablet c0349def0e4045f2b1e9a02dd654a174 (DEFAULT_TABLE table=default.Table_cd6fa6816d194e7fb86251cce055a47f [id=76d5bb45e6b3427591b09343d5fc206a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.005882 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0349def0e4045f2b1e9a02dd654a174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.005939 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0349def0e4045f2b1e9a02dd654a174. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:29.006450 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2dab268da5e843cab5c28a521217df97 consensus state has no leader
I20260318 02:51:29.007928 449 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet bd077319b3c443849de087eb61da6a77 (table default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]). Expected version 1 got 0
I20260318 02:51:29.008121 892 tablet_service.cc:1511] Processing CreateTablet for tablet a628b6d2523344edbf78695a041113cf (DEFAULT_TABLE table=default.Table_31dc7662988b47369de3999555752620 [id=0ec8928ac9814a7ea706c73ab7fdd336]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.008210 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet d4a54d0daa9f48a89b3f114367750826 with delete_type TABLET_DATA_DELETED (replaced by tablet 061ebb62f4c54a2a8c24b90ec15402d3) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:29.010128 758 tablet_service.cc:1511] Processing CreateTablet for tablet a628b6d2523344edbf78695a041113cf (DEFAULT_TABLE table=default.Table_31dc7662988b47369de3999555752620 [id=0ec8928ac9814a7ea706c73ab7fdd336]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.010514 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a628b6d2523344edbf78695a041113cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.013592 766 tablet_service.cc:1511] Processing CreateTablet for tablet 62af4992cca84830ab8317f734338365 (DEFAULT_TABLE table=default.Table_50775e92a3544e0bb2d75969b9a6b57a [id=8fbdbd98b35a4307b1daea8094b3e79c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.014132 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62af4992cca84830ab8317f734338365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.017278 763 tablet_service.cc:1511] Processing CreateTablet for tablet c0d9f28881ca49a6af360aa9c9b9aa29 (DEFAULT_TABLE table=default.Table_e6582a7916c645beb3988d9627005b9f [id=0a8629843d18472fb8171c1773f61efe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.017706 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0d9f28881ca49a6af360aa9c9b9aa29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.018754 752 tablet_service.cc:1511] Processing CreateTablet for tablet 977a25a368734b11a8b2cefef88be651 (DEFAULT_TABLE table=default.Table_b3839730b36c41868e3760527839bafb [id=c5fda294c63f4731b2890404b92def44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.019246 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 977a25a368734b11a8b2cefef88be651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.019761 897 tablet_service.cc:1511] Processing CreateTablet for tablet 62af4992cca84830ab8317f734338365 (DEFAULT_TABLE table=default.Table_50775e92a3544e0bb2d75969b9a6b57a [id=8fbdbd98b35a4307b1daea8094b3e79c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.020882 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a628b6d2523344edbf78695a041113cf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:29.021222 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d30e39476d93400c8c79dd529688e7e0 consensus state has no leader
I20260318 02:51:29.024528 1042 tablet_service.cc:1511] Processing CreateTablet for tablet a628b6d2523344edbf78695a041113cf (DEFAULT_TABLE table=default.Table_31dc7662988b47369de3999555752620 [id=0ec8928ac9814a7ea706c73ab7fdd336]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.025661 1033 tablet_service.cc:1511] Processing CreateTablet for tablet c0d9f28881ca49a6af360aa9c9b9aa29 (DEFAULT_TABLE table=default.Table_e6582a7916c645beb3988d9627005b9f [id=0a8629843d18472fb8171c1773f61efe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.026386 895 tablet_service.cc:1511] Processing CreateTablet for tablet c0d9f28881ca49a6af360aa9c9b9aa29 (DEFAULT_TABLE table=default.Table_e6582a7916c645beb3988d9627005b9f [id=0a8629843d18472fb8171c1773f61efe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.027603 891 tablet_service.cc:1511] Processing CreateTablet for tablet 977a25a368734b11a8b2cefef88be651 (DEFAULT_TABLE table=default.Table_b3839730b36c41868e3760527839bafb [id=c5fda294c63f4731b2890404b92def44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.027985 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62af4992cca84830ab8317f734338365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.029604 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_12335c7599cd41278d16568ac55906c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.030261 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12335c7599cd41278d16568ac55906c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.031219 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a628b6d2523344edbf78695a041113cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.031636 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_aebead9c64604ea689e8c748f2b54d18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:29.031795 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 62af4992cca84830ab8317f734338365 (DEFAULT_TABLE table=default.Table_50775e92a3544e0bb2d75969b9a6b57a [id=8fbdbd98b35a4307b1daea8094b3e79c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:29.032205 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aebead9c64604ea689e8c748f2b54d18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.032262 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62af4992cca84830ab8317f734338365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.032639 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 977a25a368734b11a8b2cefef88be651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.032562 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_53a7c49bab9b4d0c8b44a2456b7e392f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:29.032860 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 977a25a368734b11a8b2cefef88be651 (DEFAULT_TABLE table=default.Table_b3839730b36c41868e3760527839bafb [id=c5fda294c63f4731b2890404b92def44]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:29.033070 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53a7c49bab9b4d0c8b44a2456b7e392f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.033183 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 977a25a368734b11a8b2cefef88be651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.033386 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_bb068517bfdb437c8f40639ce70b9ad0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:29.033733 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0d9f28881ca49a6af360aa9c9b9aa29. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:29.033856 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb068517bfdb437c8f40639ce70b9ad0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.034261 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3fda21034cb44e32a46bd033d7e4aa55" } new_table_name: "default.Table_997790cbbac74789b5c64a54d0c44ff3" modify_external_catalogs: true
I20260318 02:51:29.035116 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9d7d16cb2c6a4cadae49658f8b3b44fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.035645 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d7d16cb2c6a4cadae49658f8b3b44fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.039463 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0d9f28881ca49a6af360aa9c9b9aa29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.064476 1173 tablet_bootstrap.cc:492] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:29.064657 1173 ts_tablet_manager.cc:1403] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.094s user 0.000s sys 0.003s
W20260318 02:51:29.069456 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 71c53e67f27a4047a370d00d223961e6 consensus state has no leader
I20260318 02:51:29.069988 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_998db7d1aec14ebb8599ab941d9e29f0" } new_table_name: "default.Table_ed6ebe71dc614470a951f2e484f28d88" modify_external_catalogs: true
I20260318 02:51:29.071748 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_554a425f9acb4c92ab87a63ff39b8790" } modify_external_catalogs: true
I20260318 02:51:29.071913 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_554a425f9acb4c92ab87a63ff39b8790" } modify_external_catalogs: true
I20260318 02:51:29.073944 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_036cfacba4504adc8db1ed111b34e126" } modify_external_catalogs: true
I20260318 02:51:29.074234 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_036cfacba4504adc8db1ed111b34e126" } modify_external_catalogs: true
I20260318 02:51:29.074807 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_fe03be40cbc54d21927bda17030ed005" } modify_external_catalogs: true
I20260318 02:51:29.074972 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_fe03be40cbc54d21927bda17030ed005" } modify_external_catalogs: true
I20260318 02:51:29.075443 1172 ts_tablet_manager.cc:1434] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260318 02:51:29.075968 1687 raft_consensus.cc:493] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:29.076844 1687 raft_consensus.cc:515] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:29.079391 1172 tablet_bootstrap.cc:492] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:29.085510 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd077319b3c443849de087eb61da6a77" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:29.085748 784 raft_consensus.cc:2468] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:29.088614 999 leader_election.cc:304] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:29.090754 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8d6d4b35c7754174adfe3a4d4889cdae" } modify_external_catalogs: true
I20260318 02:51:29.090950 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8d6d4b35c7754174adfe3a4d4889cdae" } modify_external_catalogs: true
I20260318 02:51:29.092995 1687 leader_election.cc:290] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:29.093467 1687 raft_consensus.cc:2804] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:29.093559 1687 raft_consensus.cc:493] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:29.093843 1687 raft_consensus.cc:3060] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:29.101749 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_51d490345e9f497ca6b3076edf95c90f" } modify_external_catalogs: true
I20260318 02:51:29.101959 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_51d490345e9f497ca6b3076edf95c90f" } modify_external_catalogs: true
I20260318 02:51:29.102505 1175 ts_tablet_manager.cc:1929] T cf27c8d69f41431e9fab12e605e15b9c P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:29.110924 1174 tablet_bootstrap.cc:492] T 3e38dec0d2e9417e8571e202036e7117 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:29.111147 1174 ts_tablet_manager.cc:1403] T 3e38dec0d2e9417e8571e202036e7117 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.170s user 0.030s sys 0.022s
I20260318 02:51:29.111999 1174 raft_consensus.cc:359] T 3e38dec0d2e9417e8571e202036e7117 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.112222 1174 raft_consensus.cc:385] T 3e38dec0d2e9417e8571e202036e7117 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.112306 1174 raft_consensus.cc:740] T 3e38dec0d2e9417e8571e202036e7117 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.112578 1174 consensus_queue.cc:260] T 3e38dec0d2e9417e8571e202036e7117 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.113526 1174 ts_tablet_manager.cc:1434] T 3e38dec0d2e9417e8571e202036e7117 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260318 02:51:29.113597 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 868605c58c1d4744ab8930313e7dcaa9 consensus state has no leader
I20260318 02:51:29.113878 1174 tablet_bootstrap.cc:492] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:29.118103 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e38dec0d2e9417e8571e202036e7117 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.122773 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet bd077319b3c443849de087eb61da6a77 (table default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]). Expected version 1 got 0
I20260318 02:51:29.127205 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 8b99d05da31c4b77a78a94baf55b28fa (DEFAULT_TABLE table=default.Table_6e856430587e41c0ab30702ffe6dd939 [id=fb5b9a4246ba4f3bba85f06848e4c011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.128315 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b99d05da31c4b77a78a94baf55b28fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.128417 753 tablet_service.cc:1511] Processing CreateTablet for tablet 89a225cb00d04582b2bf0f569ddab07f (DEFAULT_TABLE table=default.Table_2a220571935c4f34a14be87348a10cf8 [id=8a5e348325eb47eb9a8925a0ac4e0cd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.128518 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 88c0962c84624c3ea5f03c898f5ff348 (DEFAULT_TABLE table=default.Table_b66901f5baad43c5b75f20aa84cb9872 [id=e152cce48208465c9f69ebf0e134c508]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.128888 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a225cb00d04582b2bf0f569ddab07f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.129240 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88c0962c84624c3ea5f03c898f5ff348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.130520 761 tablet_service.cc:1511] Processing CreateTablet for tablet e867dcd3ff3e4eb7b923305a037c5a79 (DEFAULT_TABLE table=default.Table_6b19fea4f7ad44fb900d8bf1f165d331 [id=f4c32ff0197c4cc2bcd6543b2084c8c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.130926 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e867dcd3ff3e4eb7b923305a037c5a79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.131187 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 20009aa96bf44ae88acfeef8e38bc204 (DEFAULT_TABLE table=default.Table_962a2e57d3cd414da0cebbd805a7c937 [id=8d46a458cb9842e5866adbb6a1219ca5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.131276 1184 ts_tablet_manager.cc:1929] T 62af8b953213412bb0c3bd1c68042ec9 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:29.131381 1184 log.cc:1199] T 62af8b953213412bb0c3bd1c68042ec9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/62af8b953213412bb0c3bd1c68042ec9
I20260318 02:51:29.131614 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20009aa96bf44ae88acfeef8e38bc204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.131783 1184 ts_tablet_manager.cc:1950] T 62af8b953213412bb0c3bd1c68042ec9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:29.132256 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 89a225cb00d04582b2bf0f569ddab07f (DEFAULT_TABLE table=default.Table_2a220571935c4f34a14be87348a10cf8 [id=8a5e348325eb47eb9a8925a0ac4e0cd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.132377 1174 tablet_bootstrap.cc:654] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:29.132607 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a225cb00d04582b2bf0f569ddab07f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.133773 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a (DEFAULT_TABLE table=default.Table_65363a41f18f4b13b6e74847567c753b [id=246241251d334f89b244b25aae6935ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.133878 754 tablet_service.cc:1511] Processing CreateTablet for tablet 8b99d05da31c4b77a78a94baf55b28fa (DEFAULT_TABLE table=default.Table_6e856430587e41c0ab30702ffe6dd939 [id=fb5b9a4246ba4f3bba85f06848e4c011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.133931 1033 tablet_service.cc:1511] Processing CreateTablet for tablet e867dcd3ff3e4eb7b923305a037c5a79 (DEFAULT_TABLE table=default.Table_6b19fea4f7ad44fb900d8bf1f165d331 [id=f4c32ff0197c4cc2bcd6543b2084c8c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.134743 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.138005 762 tablet_service.cc:1511] Processing CreateTablet for tablet 20009aa96bf44ae88acfeef8e38bc204 (DEFAULT_TABLE table=default.Table_962a2e57d3cd414da0cebbd805a7c937 [id=8d46a458cb9842e5866adbb6a1219ca5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.138921 760 tablet_service.cc:1511] Processing CreateTablet for tablet 88c0962c84624c3ea5f03c898f5ff348 (DEFAULT_TABLE table=default.Table_b66901f5baad43c5b75f20aa84cb9872 [id=e152cce48208465c9f69ebf0e134c508]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.139142 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e867dcd3ff3e4eb7b923305a037c5a79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.140650 756 tablet_service.cc:1511] Processing CreateTablet for tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a (DEFAULT_TABLE table=default.Table_65363a41f18f4b13b6e74847567c753b [id=246241251d334f89b244b25aae6935ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.140764 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 62af8b953213412bb0c3bd1c68042ec9 (table default.Table_64fa6aaaa46242f3a737f4da65eb1947 [id=de39610433af488e9fc732cbb5dd7523]) successfully deleted
I20260318 02:51:29.140928 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 9a0fe429edde49fe8702ffb13b034a6c (DEFAULT_TABLE table=default.Table_fd865bede2d9484994861c767da3ffb2 [id=3a1a1a5d12014a24a1a077f4c0b30976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.141044 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b99d05da31c4b77a78a94baf55b28fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.141309 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a0fe429edde49fe8702ffb13b034a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.142436 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.142917 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20009aa96bf44ae88acfeef8e38bc204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.143313 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88c0962c84624c3ea5f03c898f5ff348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.145591 1038 tablet_service.cc:1511] Processing CreateTablet for tablet dc0bb9b5580d43429828e67f53871982 (DEFAULT_TABLE table=default.Table_fe03be40cbc54d21927bda17030ed005 [id=3665ac075f964d4c8e2cdda80cbef8a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.145852 755 tablet_service.cc:1511] Processing CreateTablet for tablet 053efeef673f4535993b29d102884408 (DEFAULT_TABLE table=default.Table_b361769933b047a094f2220b0eb496c3 [id=a06743180c9e418590b66e4476eba4d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.145951 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc0bb9b5580d43429828e67f53871982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.146903 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 053efeef673f4535993b29d102884408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.148169 750 tablet_service.cc:1511] Processing CreateTablet for tablet a4918d7f2f2645e88b7f3e1d52926fb1 (DEFAULT_TABLE table=default.Table_acd2793d6aea4258be0afe46caa5d732 [id=111287d6b2a440969fcd43ac61f20cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.148603 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4918d7f2f2645e88b7f3e1d52926fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.149714 888 tablet_service.cc:1511] Processing CreateTablet for tablet e867dcd3ff3e4eb7b923305a037c5a79 (DEFAULT_TABLE table=default.Table_6b19fea4f7ad44fb900d8bf1f165d331 [id=f4c32ff0197c4cc2bcd6543b2084c8c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.150017 891 tablet_service.cc:1511] Processing CreateTablet for tablet 8b99d05da31c4b77a78a94baf55b28fa (DEFAULT_TABLE table=default.Table_6e856430587e41c0ab30702ffe6dd939 [id=fb5b9a4246ba4f3bba85f06848e4c011]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.150859 906 tablet_service.cc:1511] Processing CreateTablet for tablet 053efeef673f4535993b29d102884408 (DEFAULT_TABLE table=default.Table_b361769933b047a094f2220b0eb496c3 [id=a06743180c9e418590b66e4476eba4d5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:29.160043 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a75f367cde75433d86a4ee9384e57761 consensus state has no leader
I20260318 02:51:29.160497 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 597a9271dedf4e789926e7e65fd79dfc
W20260318 02:51:29.161767 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 900c6ef2dc634a788239dd5b77c4bde0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 900c6ef2dc634a788239dd5b77c4bde0 already in progress: creating tablet
I20260318 02:51:29.163798 766 tablet_service.cc:1511] Processing CreateTablet for tablet 89b8448f18cb4d7c8c14edd76fd86c60 (DEFAULT_TABLE table=default.Table_8a3ee564e57c44ceafe096c878900896 [id=ef2a4589a0524d62984684fcbaa03c91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.164227 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b8448f18cb4d7c8c14edd76fd86c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.165750 747 tablet_service.cc:1511] Processing CreateTablet for tablet 9a0fe429edde49fe8702ffb13b034a6c (DEFAULT_TABLE table=default.Table_fd865bede2d9484994861c767da3ffb2 [id=3a1a1a5d12014a24a1a077f4c0b30976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.168516 1174 tablet_bootstrap.cc:492] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:29.168665 1174 ts_tablet_manager.cc:1403] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.055s user 0.008s sys 0.000s
I20260318 02:51:29.169798 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet dc0bb9b5580d43429828e67f53871982
I20260318 02:51:29.172922 1173 raft_consensus.cc:359] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.173166 1173 raft_consensus.cc:385] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.172924 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd077319b3c443849de087eb61da6a77" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:29.173348 1173 raft_consensus.cc:740] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.173569 925 raft_consensus.cc:2468] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:29.173636 896 tablet_service.cc:1558] Processing DeleteTablet for tablet dc0bb9b5580d43429828e67f53871982 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:29.173962 1040 tablet_service.cc:1511] Processing CreateTablet for tablet a4918d7f2f2645e88b7f3e1d52926fb1 (DEFAULT_TABLE table=default.Table_acd2793d6aea4258be0afe46caa5d732 [id=111287d6b2a440969fcd43ac61f20cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.174248 1173 consensus_queue.cc:260] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.174561 900 tablet_service.cc:1511] Processing CreateTablet for tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a (DEFAULT_TABLE table=default.Table_65363a41f18f4b13b6e74847567c753b [id=246241251d334f89b244b25aae6935ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.175002 902 tablet_service.cc:1511] Processing CreateTablet for tablet 20009aa96bf44ae88acfeef8e38bc204 (DEFAULT_TABLE table=default.Table_962a2e57d3cd414da0cebbd805a7c937 [id=8d46a458cb9842e5866adbb6a1219ca5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.175908 758 tablet_service.cc:1511] Processing CreateTablet for tablet dc0bb9b5580d43429828e67f53871982 (DEFAULT_TABLE table=default.Table_fe03be40cbc54d21927bda17030ed005 [id=3665ac075f964d4c8e2cdda80cbef8a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.176007 905 tablet_service.cc:1511] Processing CreateTablet for tablet 9a0fe429edde49fe8702ffb13b034a6c (DEFAULT_TABLE table=default.Table_fd865bede2d9484994861c767da3ffb2 [id=3a1a1a5d12014a24a1a077f4c0b30976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.176071 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 053efeef673f4535993b29d102884408 (DEFAULT_TABLE table=default.Table_b361769933b047a094f2220b0eb496c3 [id=a06743180c9e418590b66e4476eba4d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.176296 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e867dcd3ff3e4eb7b923305a037c5a79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.177560 892 tablet_service.cc:1511] Processing CreateTablet for tablet 89a225cb00d04582b2bf0f569ddab07f (DEFAULT_TABLE table=default.Table_2a220571935c4f34a14be87348a10cf8 [id=8a5e348325eb47eb9a8925a0ac4e0cd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.177994 899 tablet_service.cc:1511] Processing CreateTablet for tablet dc0bb9b5580d43429828e67f53871982 (DEFAULT_TABLE table=default.Table_fe03be40cbc54d21927bda17030ed005 [id=3665ac075f964d4c8e2cdda80cbef8a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.178062 898 tablet_service.cc:1511] Processing CreateTablet for tablet a4918d7f2f2645e88b7f3e1d52926fb1 (DEFAULT_TABLE table=default.Table_acd2793d6aea4258be0afe46caa5d732 [id=111287d6b2a440969fcd43ac61f20cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.178304 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b99d05da31c4b77a78a94baf55b28fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.178258 893 tablet_service.cc:1511] Processing CreateTablet for tablet 89b8448f18cb4d7c8c14edd76fd86c60 (DEFAULT_TABLE table=default.Table_8a3ee564e57c44ceafe096c878900896 [id=ef2a4589a0524d62984684fcbaa03c91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.178514 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4918d7f2f2645e88b7f3e1d52926fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.178601 907 tablet_service.cc:1511] Processing CreateTablet for tablet ef03f9716ae04df4826fb9f54a0ef765 (DEFAULT_TABLE table=default.Table_f386fceff4eb4f528da50b63a3703bec [id=23faba74cf1f41959acf24685ce7a6c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.178900 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef03f9716ae04df4826fb9f54a0ef765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.180930 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 053efeef673f4535993b29d102884408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.181126 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a0fe429edde49fe8702ffb13b034a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.184854 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc0bb9b5580d43429828e67f53871982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.185114 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b8448f18cb4d7c8c14edd76fd86c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.187765 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20009aa96bf44ae88acfeef8e38bc204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.189987 1174 raft_consensus.cc:359] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.190222 1174 raft_consensus.cc:385] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.189363 757 tablet_service.cc:1511] Processing CreateTablet for tablet ef03f9716ae04df4826fb9f54a0ef765 (DEFAULT_TABLE table=default.Table_f386fceff4eb4f528da50b63a3703bec [id=23faba74cf1f41959acf24685ce7a6c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.192598 1174 raft_consensus.cc:740] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.192972 1174 consensus_queue.cc:260] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.192972 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0dc4fd883c61478cb1c3cad66d5ec9a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.193588 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0dc4fd883c61478cb1c3cad66d5ec9a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.194931 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 597a9271dedf4e789926e7e65fd79dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.196942 1174 ts_tablet_manager.cc:1434] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20260318 02:51:29.197162 895 tablet_service.cc:1511] Processing CreateTablet for tablet 88c0962c84624c3ea5f03c898f5ff348 (DEFAULT_TABLE table=default.Table_b66901f5baad43c5b75f20aa84cb9872 [id=e152cce48208465c9f69ebf0e134c508]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.199134 763 tablet_service.cc:1511] Processing CreateTablet for tablet 2e98aefae22c48d2b4d69bc9d59f4ff6 (DEFAULT_TABLE table=default.Table_752481de469d4cb5851520fd5052faf8 [id=bca341c3a99a4be2b1f04d7a19feb2d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.200531 759 tablet_service.cc:1558] Processing DeleteTablet for tablet dc0bb9b5580d43429828e67f53871982 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.200889 1175 log.cc:1199] T cf27c8d69f41431e9fab12e605e15b9c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/cf27c8d69f41431e9fab12e605e15b9c
I20260318 02:51:29.204893 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.205109 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet 597a9271dedf4e789926e7e65fd79dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:29.205763 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f5b55cf85d7842e59f0ed92aecdcd5d0
I20260318 02:51:29.205992 1175 ts_tablet_manager.cc:1950] T cf27c8d69f41431e9fab12e605e15b9c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:29.207826 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet cf27c8d69f41431e9fab12e605e15b9c (table default.Table_1d2a493334714a809ca348d380f97577 [id=313b847f9c15442198f034c266da8078]) successfully deleted
W20260318 02:51:29.208175 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 4df7d75e696a4aec981de3963c282b0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4df7d75e696a4aec981de3963c282b0d already in progress: creating tablet
I20260318 02:51:29.210918 1174 tablet_bootstrap.cc:492] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:29.211686 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a6a2143355de4e07bdbabc02ba2f188a" } new_table_name: "default.Table_25f1927eaff447d8ab2f529f4cee83f6" modify_external_catalogs: true
I20260318 02:51:29.213153 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88c0962c84624c3ea5f03c898f5ff348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.214190 456 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 99e807c8ff5e457fb6c97c6d1b277eab (table default.Table_fd8edd9c8882403f8541f00d0728e3b7 [id=568e88222ca648ce88ee962e91a84588]). Expected version 1 got 0
I20260318 02:51:29.215204 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4918d7f2f2645e88b7f3e1d52926fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.217510 896 tablet_service.cc:1511] Processing CreateTablet for tablet 2e98aefae22c48d2b4d69bc9d59f4ff6 (DEFAULT_TABLE table=default.Table_752481de469d4cb5851520fd5052faf8 [id=bca341c3a99a4be2b1f04d7a19feb2d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.220882 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_62c15aab881b46dba0f3fb97b039ec08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.221786 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62c15aab881b46dba0f3fb97b039ec08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.222133 1173 ts_tablet_manager.cc:1434] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.139s user 0.002s sys 0.001s
I20260318 02:51:29.223264 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 597a9271dedf4e789926e7e65fd79dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:29.225600 759 tablet_service.cc:1558] Processing DeleteTablet for tablet f5b55cf85d7842e59f0ed92aecdcd5d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.226104 1176 ts_tablet_manager.cc:1929] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260318 02:51:29.227381 1176 log.cc:1199] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/e2304246c244407b9d4eb301ac5d7ba9
I20260318 02:51:29.230162 1176 ts_tablet_manager.cc:1950] T e2304246c244407b9d4eb301ac5d7ba9 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:29.230260 759 tablet_service.cc:1511] Processing CreateTablet for tablet 20ecb11db30e409b9090ebfc4a4f0785 (DEFAULT_TABLE table=default.Table_c2d16f88924544cbaf4ed64b9c5bc7a6 [id=8749d9c9086f43a99348c9bfe995e6e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.230974 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b572b82f174a48ad969343a2df8b9bfe" } new_table_name: "default.Table_9c1f15738a1a4bec83ebfdc1f93a9131" modify_external_catalogs: true
I20260318 02:51:29.231408 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7d354ce302b6453b980bc1324e6cd3d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.231984 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d354ce302b6453b980bc1324e6cd3d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.235162 1667 raft_consensus.cc:493] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:29.235961 754 tablet_service.cc:1511] Processing CreateTablet for tablet bdbcdd36a02d417786e2baec77cbb232 (DEFAULT_TABLE table=default.Table_209fa5c75dbf4c9d8fa3755b25c0502d [id=2613ffe0a67840e790095c07d08ccb2c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:29.239920 444 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet d2fb9c8f339444bc8d7c6479e7d87f44 (table default.Table_a1a0cf6e73df4034be50c53e585878c0 [id=895bbd90cf47462ab116ee3f37e94982], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet d2fb9c8f339444bc8d7c6479e7d87f44 consensus state has no leader
I20260318 02:51:29.240440 1667 raft_consensus.cc:515] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.241695 1667 leader_election.cc:290] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:29.244804 449 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 99e807c8ff5e457fb6c97c6d1b277eab (table default.Table_fd8edd9c8882403f8541f00d0728e3b7 [id=568e88222ca648ce88ee962e91a84588]). Expected version 1 got 0
I20260318 02:51:29.245505 761 tablet_service.cc:1511] Processing CreateTablet for tablet f047e256dea04affa752abf1452d970f (DEFAULT_TABLE table=default.Table_d61882f9637443aea484b9928b8a27c9 [id=1dc3880d714a42d6b4f12988b3139a2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.223207 1041 tablet_service.cc:1511] Processing CreateTablet for tablet ef03f9716ae04df4826fb9f54a0ef765 (DEFAULT_TABLE table=default.Table_f386fceff4eb4f528da50b63a3703bec [id=23faba74cf1f41959acf24685ce7a6c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.224275 1172 tablet_bootstrap.cc:654] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:29.233168 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 89b8448f18cb4d7c8c14edd76fd86c60 (DEFAULT_TABLE table=default.Table_8a3ee564e57c44ceafe096c878900896 [id=ef2a4589a0524d62984684fcbaa03c91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.233224 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 053efeef673f4535993b29d102884408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.249487 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a
I20260318 02:51:29.233285 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 2e98aefae22c48d2b4d69bc9d59f4ff6 (DEFAULT_TABLE table=default.Table_752481de469d4cb5851520fd5052faf8 [id=bca341c3a99a4be2b1f04d7a19feb2d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.233443 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet f5b55cf85d7842e59f0ed92aecdcd5d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:29.235545 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet dc0bb9b5580d43429828e67f53871982 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:29.233271 999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.129:46711, user_credentials={real_user=slave}} blocked reactor thread for 102481us
I20260318 02:51:29.222784 1184 tablet_replica.cc:333] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:29.252676 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a0fe429edde49fe8702ffb13b034a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.253753 1176 tablet_replica.cc:333] T 93479517a1d34d2d99633018a6a57127 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:29.255538 1176 raft_consensus.cc:2243] T 93479517a1d34d2d99633018a6a57127 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:29.255187 903 tablet_service.cc:1558] Processing DeleteTablet for tablet f5b55cf85d7842e59f0ed92aecdcd5d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:29.254756 1173 tablet_bootstrap.cc:492] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:29.256326 1176 raft_consensus.cc:2272] T 93479517a1d34d2d99633018a6a57127 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:29.257133 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 71c518c87bdd4a63aa1016e8de6bafdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:29.256371 897 tablet_service.cc:1511] Processing CreateTablet for tablet 20ecb11db30e409b9090ebfc4a4f0785 (DEFAULT_TABLE table=default.Table_c2d16f88924544cbaf4ed64b9c5bc7a6 [id=8749d9c9086f43a99348c9bfe995e6e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.236073 1025 tablet_service.cc:1511] Processing CreateTablet for tablet bdbcdd36a02d417786e2baec77cbb232 (DEFAULT_TABLE table=default.Table_209fa5c75dbf4c9d8fa3755b25c0502d [id=2613ffe0a67840e790095c07d08ccb2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.258613 1175 tablet_replica.cc:333] T a8b44b68094344f7a694ae4d985f56a6 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:29.237234 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 20ecb11db30e409b9090ebfc4a4f0785 (DEFAULT_TABLE table=default.Table_c2d16f88924544cbaf4ed64b9c5bc7a6 [id=8749d9c9086f43a99348c9bfe995e6e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.258955 903 tablet_service.cc:1558] Processing DeleteTablet for tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:29.259120 1176 ts_tablet_manager.cc:1916] T 93479517a1d34d2d99633018a6a57127 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:29.259476 889 tablet_service.cc:1511] Processing CreateTablet for tablet f047e256dea04affa752abf1452d970f (DEFAULT_TABLE table=default.Table_d61882f9637443aea484b9928b8a27c9 [id=1dc3880d714a42d6b4f12988b3139a2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.259835 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdbcdd36a02d417786e2baec77cbb232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.259944 902 tablet_service.cc:1511] Processing CreateTablet for tablet bdbcdd36a02d417786e2baec77cbb232 (DEFAULT_TABLE table=default.Table_209fa5c75dbf4c9d8fa3755b25c0502d [id=2613ffe0a67840e790095c07d08ccb2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.260032 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc0bb9b5580d43429828e67f53871982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.260941 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e98aefae22c48d2b4d69bc9d59f4ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.260921 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e807c8ff5e457fb6c97c6d1b277eab" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:29.261616 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet e2304246c244407b9d4eb301ac5d7ba9 (table default.Table_fddbe89a9a524d028fba5877d8b23387 [id=20ed812002544f6f8caef448f7514f7c]) successfully deleted
I20260318 02:51:29.262431 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e98aefae22c48d2b4d69bc9d59f4ff6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:29.262544 719 leader_election.cc:343] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:29.263080 1175 raft_consensus.cc:2243] T a8b44b68094344f7a694ae4d985f56a6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:29.264781 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef03f9716ae04df4826fb9f54a0ef765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.265684 1667 raft_consensus.cc:493] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:29.265829 755 tablet_service.cc:1558] Processing DeleteTablet for tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.266177 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20ecb11db30e409b9090ebfc4a4f0785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.266834 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f047e256dea04affa752abf1452d970f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.265846 1667 raft_consensus.cc:515] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.267974 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b8448f18cb4d7c8c14edd76fd86c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.268326 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e98aefae22c48d2b4d69bc9d59f4ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.268450 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a225cb00d04582b2bf0f569ddab07f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.269157 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20ecb11db30e409b9090ebfc4a4f0785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.271566 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdbcdd36a02d417786e2baec77cbb232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.272004 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f047e256dea04affa752abf1452d970f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.272544 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d343e53f2354a3386b19d71ef00d5a4" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:29.272923 1667 leader_election.cc:290] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:29.272958 1175 raft_consensus.cc:2272] T a8b44b68094344f7a694ae4d985f56a6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:29.273290 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20ecb11db30e409b9090ebfc4a4f0785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.275988 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:29.277025 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_12335c7599cd41278d16568ac55906c5" } new_table_name: "default.Table_f5f60ceb0c0c4e50993d4d9d5ff3d0f4" modify_external_catalogs: true
I20260318 02:51:29.277141 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_923e145b0497406aa12727b8a4e5d5e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.277694 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_923e145b0497406aa12727b8a4e5d5e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.278848 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e8896d6ba495415ea6b0bfbe2479e0f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.279368 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8896d6ba495415ea6b0bfbe2479e0f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:29.284247 719 leader_election.cc:343] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:29.286623 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdbcdd36a02d417786e2baec77cbb232. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.286927 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_4ecce75b6c624f5889db31ad1ced6e00"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.287617 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ecce75b6c624f5889db31ad1ced6e00 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.294646 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef03f9716ae04df4826fb9f54a0ef765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.295228 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet ba3e7e9a85c94d7380b96a9373c1f503
I20260318 02:51:29.299336 1176 ts_tablet_manager.cc:1929] T 93479517a1d34d2d99633018a6a57127 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:29.299518 1176 log.cc:1199] T 93479517a1d34d2d99633018a6a57127 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/93479517a1d34d2d99633018a6a57127
I20260318 02:51:29.299909 1176 ts_tablet_manager.cc:1950] T 93479517a1d34d2d99633018a6a57127 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:29.301219 759 tablet_service.cc:1558] Processing DeleteTablet for tablet ba3e7e9a85c94d7380b96a9373c1f503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.301679 1176 tablet_replica.cc:333] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:29.301862 1176 raft_consensus.cc:2243] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:29.302053 1176 raft_consensus.cc:2272] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:29.303023 1687 raft_consensus.cc:515] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:29.305529 1174 tablet_bootstrap.cc:654] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:29.310645 1667 raft_consensus.cc:493] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:29.310825 1667 raft_consensus.cc:515] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.311462 1667 leader_election.cc:290] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:29.311434 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a0d84da969fb47a6b9a9f0d817fc478a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.312100 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0d84da969fb47a6b9a9f0d817fc478a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.313094 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 93479517a1d34d2d99633018a6a57127 (table default.Table_167a79354e7844aabe2ae725df4f536c [id=095e4b55b1544007a032a984ba934743]) successfully deleted
W20260318 02:51:29.313426 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet b10fd13bf3ea48b0896b34fce478e25a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b10fd13bf3ea48b0896b34fce478e25a already in progress: creating tablet
W20260318 02:51:29.313634 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 41646d513e834600a209761392ac7fb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41646d513e834600a209761392ac7fb1 already in progress: creating tablet
W20260318 02:51:29.313803 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet bf344c2361b7412c87a7c7f9a72a15b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf344c2361b7412c87a7c7f9a72a15b6 already in progress: creating tablet
W20260318 02:51:29.314345 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet dfb3e7fe7a834636a16ee8a772b73ee2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfb3e7fe7a834636a16ee8a772b73ee2 already in progress: creating tablet
W20260318 02:51:29.314564 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 4df7d75e696a4aec981de3963c282b0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4df7d75e696a4aec981de3963c282b0d already in progress: creating tablet
W20260318 02:51:29.325645 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5f63108c062348b1ba995ea16f40a695 consensus state has no leader
I20260318 02:51:29.326141 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7286c0505cce4fdbb3d3ff1021f7ae40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.326771 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7286c0505cce4fdbb3d3ff1021f7ae40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.326136 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_fe91f66877bf46138d65eaa4c8a0778c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.328438 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe91f66877bf46138d65eaa4c8a0778c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:29.340873 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 68b0f0cd89234e72a052f3f9f964aa35 consensus state has no leader
I20260318 02:51:29.342964 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_fd865bede2d9484994861c767da3ffb2" } new_table_name: "default.Table_c163a32a9f1541b892b0883ae968defc" modify_external_catalogs: true
I20260318 02:51:29.351790 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_793e04a202214a95b056303786d5f5bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.352421 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_793e04a202214a95b056303786d5f5bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:29.358819 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08f12b593f2540b9956a38b8e8500824 has no consensus state
I20260318 02:51:29.360242 1175 ts_tablet_manager.cc:1916] T a8b44b68094344f7a694ae4d985f56a6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:29.363651 1174 tablet_bootstrap.cc:492] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:29.363843 1174 ts_tablet_manager.cc:1403] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.163s user 0.008s sys 0.005s
I20260318 02:51:29.364113 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a15e4303742a999fe9a96d450c827" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:29.365079 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet ba3e7e9a85c94d7380b96a9373c1f503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:29.365371 1687 leader_election.cc:290] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:29.365269 1174 raft_consensus.cc:359] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:29.365484 1174 raft_consensus.cc:385] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.365566 1174 raft_consensus.cc:740] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.365815 1174 consensus_queue.cc:260] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:29.366375 1174 ts_tablet_manager.cc:1434] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:29.366686 1184 raft_consensus.cc:2243] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:29.366653 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1f0867f6b8cd42bc9fb963f5349feed4" } new_table_name: "default.Table_838c707d24944e01a2673fd7c893bdd0" modify_external_catalogs: true
W20260318 02:51:29.366603 719 leader_election.cc:343] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:29.368882 1174 tablet_bootstrap.cc:492] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:29.368960 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd077319b3c443849de087eb61da6a77" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:29.369201 927 raft_consensus.cc:3060] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:29.370887 1174 tablet_bootstrap.cc:654] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:29.376307 1184 raft_consensus.cc:2272] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:29.377350 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd077319b3c443849de087eb61da6a77" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:29.377580 784 raft_consensus.cc:3060] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:29.380271 784 raft_consensus.cc:2468] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:29.375612 1030 tablet_service.cc:1511] Processing CreateTablet for tablet f047e256dea04affa752abf1452d970f (DEFAULT_TABLE table=default.Table_d61882f9637443aea484b9928b8a27c9 [id=1dc3880d714a42d6b4f12988b3139a2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.382462 1176 ts_tablet_manager.cc:1916] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:29.388468 1176 ts_tablet_manager.cc:1929] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:29.388609 1176 log.cc:1199] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/0d343e53f2354a3386b19d71ef00d5a4
I20260318 02:51:29.376020 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e807c8ff5e457fb6c97c6d1b277eab" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:29.395406 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f047e256dea04affa752abf1452d970f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.395749 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f41e180b423949a7a0f65976f1b993ed" } modify_external_catalogs: true
I20260318 02:51:29.395975 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f41e180b423949a7a0f65976f1b993ed" } modify_external_catalogs: true
I20260318 02:51:29.397954 898 tablet_service.cc:1558] Processing DeleteTablet for tablet ba3e7e9a85c94d7380b96a9373c1f503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:29.398669 1709 raft_consensus.cc:493] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:29.398808 1709 raft_consensus.cc:515] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:29.400822 860 leader_election.cc:343] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 71c518c87bdd4a63aa1016e8de6bafdc
I20260318 02:51:29.400933 1709 leader_election.cc:290] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:29.403837 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4174268bc53e4124b60df6ac9ee39eae" } modify_external_catalogs: true
I20260318 02:51:29.404052 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4174268bc53e4124b60df6ac9ee39eae" } modify_external_catalogs: true
I20260318 02:51:29.410178 452 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 105326aea9f744779ca76e0cbb2448cd (table default.Table_ea08fcfa1efe4bc2a486fc1423ce06ce [id=58354360683d422dbdcc43826b39dbc8]). Expected version 3 got 0
I20260318 02:51:29.411233 453 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet bd077319b3c443849de087eb61da6a77 (table default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]). Expected version 1 got 0
I20260318 02:51:29.416118 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d20052125a004fa088aea68c2ec6d98f" } modify_external_catalogs: true
I20260318 02:51:29.416337 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d20052125a004fa088aea68c2ec6d98f" } modify_external_catalogs: true
I20260318 02:51:29.417572 899 tablet_service.cc:1511] Processing CreateTablet for tablet 0b5d1e9e7b5d4e36a2ffdf2fc01bd902 (DEFAULT_TABLE table=default.Table_9d7d16cb2c6a4cadae49658f8b3b44fe [id=d6b7ab733266469cbf629ca96f163e06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.419804 905 tablet_service.cc:1511] Processing CreateTablet for tablet 44cc50429d4f4c109629a9ad08b06bb3 (DEFAULT_TABLE table=default.Table_aebead9c64604ea689e8c748f2b54d18 [id=fe8fd84e0d4748c8ba46f09978cfdb87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.420367 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b5d1e9e7b5d4e36a2ffdf2fc01bd902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.420607 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44cc50429d4f4c109629a9ad08b06bb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.426378 891 tablet_service.cc:1511] Processing CreateTablet for tablet ef021185bb774cf3aa3e08d88eaa1923 (DEFAULT_TABLE table=default.Table_bb068517bfdb437c8f40639ce70b9ad0 [id=d541e2f9479348409697c040d56bffe4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.428148 888 tablet_service.cc:1511] Processing CreateTablet for tablet f5ce7b986536414099b53f61033a960d (DEFAULT_TABLE table=default.Table_a45c93f14c58497cb5a6e81c8bef604c [id=af6b5041317a402d99adb729a5c44af9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.427685 897 tablet_service.cc:1511] Processing CreateTablet for tablet 69753d29db104bbda5a604ebb2db816e (DEFAULT_TABLE table=default.Table_e2ff8e79aa4148bfa15f985c2cf1b1b4 [id=cb81faed1a294ded80769eacd111cfc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.429697 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef021185bb774cf3aa3e08d88eaa1923. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:29.430091 418 external_mini_cluster.cc:1715] Unable to check leaks on /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu pid 494: Timed out: CheckLeaks RPC to 127.0.104.189:45933 timed out after 1.000s (SENT)
I20260318 02:51:29.430303 418 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu with pid 494
I20260318 02:51:29.432919 1176 ts_tablet_manager.cc:1950] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:29.433645 1176 tablet_replica.cc:333] T 2c5038e9e1074f46976a1a5bb4282944 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:29.433873 1176 raft_consensus.cc:2243] T 2c5038e9e1074f46976a1a5bb4282944 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:29.434059 1176 raft_consensus.cc:2272] T 2c5038e9e1074f46976a1a5bb4282944 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:29.435226 927 raft_consensus.cc:2468] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
W20260318 02:51:29.436239 862 leader_election.cc:343] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 71c518c87bdd4a63aa1016e8de6bafdc
I20260318 02:51:29.436405 862 leader_election.cc:304] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:29.436506 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 0d343e53f2354a3386b19d71ef00d5a4 (table default.Table_7710260d7bd54a859b6fc9023ce450e2 [id=301be4fd1a6b44c6962f9386d1e7f91e]) successfully deleted
I20260318 02:51:29.436736 757 tablet_service.cc:1511] Processing CreateTablet for tablet ef021185bb774cf3aa3e08d88eaa1923 (DEFAULT_TABLE table=default.Table_bb068517bfdb437c8f40639ce70b9ad0 [id=d541e2f9479348409697c040d56bffe4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.437265 1176 ts_tablet_manager.cc:1916] T 2c5038e9e1074f46976a1a5bb4282944 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:29.437312 758 tablet_service.cc:1511] Processing CreateTablet for tablet 44cc50429d4f4c109629a9ad08b06bb3 (DEFAULT_TABLE table=default.Table_aebead9c64604ea689e8c748f2b54d18 [id=fe8fd84e0d4748c8ba46f09978cfdb87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.437366 1709 raft_consensus.cc:2749] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:29.437441 747 tablet_service.cc:1511] Processing CreateTablet for tablet 08f12b593f2540b9956a38b8e8500824 (DEFAULT_TABLE table=default.Table_f5f60ceb0c0c4e50993d4d9d5ff3d0f4 [id=fd180116fb824961b2c98967718ea4bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.437687 763 tablet_service.cc:1511] Processing CreateTablet for tablet f5ce7b986536414099b53f61033a960d (DEFAULT_TABLE table=default.Table_a45c93f14c58497cb5a6e81c8bef604c [id=af6b5041317a402d99adb729a5c44af9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.437726 761 tablet_service.cc:1511] Processing CreateTablet for tablet 0b5d1e9e7b5d4e36a2ffdf2fc01bd902 (DEFAULT_TABLE table=default.Table_9d7d16cb2c6a4cadae49658f8b3b44fe [id=d6b7ab733266469cbf629ca96f163e06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.438100 754 tablet_service.cc:1511] Processing CreateTablet for tablet 69753d29db104bbda5a604ebb2db816e (DEFAULT_TABLE table=default.Table_e2ff8e79aa4148bfa15f985c2cf1b1b4 [id=cb81faed1a294ded80769eacd111cfc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.438184 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef021185bb774cf3aa3e08d88eaa1923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.438432 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69753d29db104bbda5a604ebb2db816e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.438623 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f12b593f2540b9956a38b8e8500824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.438783 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b5d1e9e7b5d4e36a2ffdf2fc01bd902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.445068 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ce7b986536414099b53f61033a960d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:29.451983 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a0fe429edde49fe8702ffb13b034a6c consensus state has no leader
W20260318 02:51:29.452632 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf73a9f8f67b42d9baf1396d70a1a3a9 consensus state has no leader
I20260318 02:51:29.452684 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ce7b986536414099b53f61033a960d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.453013 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 8e578c7498b6404cb87f493127005500
I20260318 02:51:29.453725 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 42fc3a9965804b5eb0c9f96eabc38553
I20260318 02:51:29.454355 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44cc50429d4f4c109629a9ad08b06bb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.454375 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 824b9dc6982f425c9518c0ea3560bf84
I20260318 02:51:29.454912 893 tablet_service.cc:1511] Processing CreateTablet for tablet eaf1477c32ce45329a9a0ac19158d54e (DEFAULT_TABLE table=default.Table_53a7c49bab9b4d0c8b44a2456b7e392f [id=11dfd0029ed94904ab88d4d412343f22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.455729 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c374a4de160944ef9e12b190b7947bcc" } modify_external_catalogs: true
I20260318 02:51:29.455893 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c374a4de160944ef9e12b190b7947bcc" } modify_external_catalogs: true
I20260318 02:51:29.455955 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e578c7498b6404cb87f493127005500 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:29.458469 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e578c7498b6404cb87f493127005500 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.458748 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 42fc3a9965804b5eb0c9f96eabc38553 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.458941 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 824b9dc6982f425c9518c0ea3560bf84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.462637 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69753d29db104bbda5a604ebb2db816e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.463531 1174 tablet_bootstrap.cc:492] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:29.463896 1174 ts_tablet_manager.cc:1403] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.095s user 0.007s sys 0.000s
I20260318 02:51:29.465142 1174 raft_consensus.cc:359] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:29.466395 1174 raft_consensus.cc:385] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.467078 1174 raft_consensus.cc:740] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.467705 1174 consensus_queue.cc:260] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:29.445592 898 tablet_service.cc:1511] Processing CreateTablet for tablet 08f12b593f2540b9956a38b8e8500824 (DEFAULT_TABLE table=default.Table_f5f60ceb0c0c4e50993d4d9d5ff3d0f4 [id=fd180116fb824961b2c98967718ea4bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.468657 1174 ts_tablet_manager.cc:1434] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260318 02:51:29.469383 719 leader_election.cc:343] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:29.469549 719 leader_election.cc:304] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:29.469925 1667 raft_consensus.cc:2749] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:29.469558 1174 tablet_bootstrap.cc:492] T d1a884fde2c145518a2cb14b7780b6dd P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:29.396322 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d343e53f2354a3386b19d71ef00d5a4" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:29.415190 1027 tablet_service.cc:1511] Processing CreateTablet for tablet f5ce7b986536414099b53f61033a960d (DEFAULT_TABLE table=default.Table_a45c93f14c58497cb5a6e81c8bef604c [id=af6b5041317a402d99adb729a5c44af9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.420015 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 69753d29db104bbda5a604ebb2db816e (DEFAULT_TABLE table=default.Table_e2ff8e79aa4148bfa15f985c2cf1b1b4 [id=cb81faed1a294ded80769eacd111cfc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.472815 759 tablet_service.cc:1511] Processing CreateTablet for tablet eaf1477c32ce45329a9a0ac19158d54e (DEFAULT_TABLE table=default.Table_53a7c49bab9b4d0c8b44a2456b7e392f [id=11dfd0029ed94904ab88d4d412343f22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.422763 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 0b5d1e9e7b5d4e36a2ffdf2fc01bd902 (DEFAULT_TABLE table=default.Table_9d7d16cb2c6a4cadae49658f8b3b44fe [id=d6b7ab733266469cbf629ca96f163e06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.424322 1029 tablet_service.cc:1511] Processing CreateTablet for tablet eaf1477c32ce45329a9a0ac19158d54e (DEFAULT_TABLE table=default.Table_53a7c49bab9b4d0c8b44a2456b7e392f [id=11dfd0029ed94904ab88d4d412343f22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.424659 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 08f12b593f2540b9956a38b8e8500824 (DEFAULT_TABLE table=default.Table_f5f60ceb0c0c4e50993d4d9d5ff3d0f4 [id=fd180116fb824961b2c98967718ea4bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.473299 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf1477c32ce45329a9a0ac19158d54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.424989 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 44cc50429d4f4c109629a9ad08b06bb3 (DEFAULT_TABLE table=default.Table_aebead9c64604ea689e8c748f2b54d18 [id=fe8fd84e0d4748c8ba46f09978cfdb87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.437026 997 leader_election.cc:304] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:29.474783 1687 raft_consensus.cc:2804] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:29.475664 1687 raft_consensus.cc:697] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:29.476368 1687 consensus_queue.cc:237] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:29.478716 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 824b9dc6982f425c9518c0ea3560bf84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:29.467816 1026 tablet_service.cc:1511] Processing CreateTablet for tablet ef021185bb774cf3aa3e08d88eaa1923 (DEFAULT_TABLE table=default.Table_bb068517bfdb437c8f40639ce70b9ad0 [id=d541e2f9479348409697c040d56bffe4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.468778 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a15e4303742a999fe9a96d450c827" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:29.481739 1174 tablet_bootstrap.cc:654] T d1a884fde2c145518a2cb14b7780b6dd P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:29.485641 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf1477c32ce45329a9a0ac19158d54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.489347 452 catalog_manager.cc:5671] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:29.489838 452 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet bd077319b3c443849de087eb61da6a77 (table default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]). Expected version 1 got 0
I20260318 02:51:29.492159 1174 tablet_bootstrap.cc:492] T d1a884fde2c145518a2cb14b7780b6dd P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:29.493939 1174 ts_tablet_manager.cc:1403] T d1a884fde2c145518a2cb14b7780b6dd P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.000s
I20260318 02:51:29.496833 1176 ts_tablet_manager.cc:1929] T 2c5038e9e1074f46976a1a5bb4282944 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:29.496997 1176 log.cc:1199] T 2c5038e9e1074f46976a1a5bb4282944 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/2c5038e9e1074f46976a1a5bb4282944
I20260318 02:51:29.497320 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 42fc3a9965804b5eb0c9f96eabc38553 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:29.497473 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d7033fee66fc4e33b922723a18a78236" } modify_external_catalogs: true
I20260318 02:51:29.497670 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d7033fee66fc4e33b922723a18a78236" } modify_external_catalogs: true
I20260318 02:51:29.499729 1174 raft_consensus.cc:359] T d1a884fde2c145518a2cb14b7780b6dd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.500058 1174 raft_consensus.cc:385] T d1a884fde2c145518a2cb14b7780b6dd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.504298 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet ed193d1b80be496298dae6fafef94577
I20260318 02:51:29.508225 1174 raft_consensus.cc:740] T d1a884fde2c145518a2cb14b7780b6dd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.507432 759 tablet_service.cc:1558] Processing DeleteTablet for tablet ed193d1b80be496298dae6fafef94577 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.508836 1174 consensus_queue.cc:260] T d1a884fde2c145518a2cb14b7780b6dd P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.509624 1174 ts_tablet_manager.cc:1434] T d1a884fde2c145518a2cb14b7780b6dd P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260318 02:51:29.509966 1176 ts_tablet_manager.cc:1950] T 2c5038e9e1074f46976a1a5bb4282944 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:29.471863 1184 ts_tablet_manager.cc:1916] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:29.510329 1174 tablet_bootstrap.cc:492] T 547762347d7843e989e55e0449ad9fcb P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:29.516425 452 master_service.cc:954] ReplaceTablet: received request to replace tablet 783c886a99994d6c8d9add724277819a from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:29.516430 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 824b9dc6982f425c9518c0ea3560bf84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:29.516721 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet ed193d1b80be496298dae6fafef94577 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:29.516845 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet d1a67e637d934c0f99c00d04fb26df0d
I20260318 02:51:29.516942 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ce7b986536414099b53f61033a960d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.517244 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf1477c32ce45329a9a0ac19158d54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.517305 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e578c7498b6404cb87f493127005500 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:29.519419 759 tablet_service.cc:1558] Processing DeleteTablet for tablet d1a67e637d934c0f99c00d04fb26df0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.520295 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_4247fd2723c44dfd9773172a8052e0e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.521108 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4247fd2723c44dfd9773172a8052e0e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.526517 1174 tablet_bootstrap.cc:654] T 547762347d7843e989e55e0449ad9fcb P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:29.527282 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 2c5038e9e1074f46976a1a5bb4282944 (table default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]) successfully deleted
I20260318 02:51:29.527909 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_434959925cdf4e2c86cf3aa4424d017f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:29.528053 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b3374f675c6b416e8a0c9f0450bb66c2" } new_table_name: "default.Table_c88cc2fd710a4910992ba3010b134825" modify_external_catalogs: true
W20260318 02:51:29.528522 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_434959925cdf4e2c86cf3aa4424d017f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.519470 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f12b593f2540b9956a38b8e8500824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.521700 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet d1a67e637d934c0f99c00d04fb26df0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:29.532425 719 connection.cc:537] client connection to 127.0.104.189:45933 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260318 02:51:29.533106 441 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.104.189:45933 (error 108) [suppressed 4 similar messages]
I20260318 02:51:29.532532 1176 tablet_replica.cc:333] T 3e38dec0d2e9417e8571e202036e7117 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:29.538460 1176 raft_consensus.cc:2243] T 3e38dec0d2e9417e8571e202036e7117 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:29.538844 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b715c5a31ba4515996595de89f1d62c consensus state has no leader
I20260318 02:51:29.540120 1176 raft_consensus.cc:2272] T 3e38dec0d2e9417e8571e202036e7117 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:29.541311 1176 ts_tablet_manager.cc:1916] T 3e38dec0d2e9417e8571e202036e7117 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:29.553050 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_be8f0eb1bb5b4ec8964d987ede6b0947" } new_table_name: "default.Table_d8f270f8efef44899f943d0160c9579b" modify_external_catalogs: true
I20260318 02:51:29.554397 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c880704226ff4e89bf538efec8f0b892"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.554939 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c880704226ff4e89bf538efec8f0b892 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:29.557202 1749 negotiation.cc:337] Failed RPC negotiation. Trace:
0318 02:51:29.533604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.104.189:45933 (local address 127.0.104.129:53265)
0318 02:51:29.556747 (+ 23143us) negotiation.cc:107] Waiting for socket to connect
0318 02:51:29.556903 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.104.189:45933: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":22973,"threads_started":1}
W20260318 02:51:29.557631 441 consensus_peers.cc:597] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a -> Peer 8b701993861d4c11b3394a2d6588b3b7 (127.0.104.189:45933): Couldn't send request to peer 8b701993861d4c11b3394a2d6588b3b7. Status: Network error: Client connection negotiation failed: client connection to 127.0.104.189:45933: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:29.557803 450 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 105326aea9f744779ca76e0cbb2448cd (table default.Table_ea08fcfa1efe4bc2a486fc1423ce06ce [id=58354360683d422dbdcc43826b39dbc8]). Expected version 3 got 0
I20260318 02:51:29.560856 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2697bc78fa724b77aca8e7b6b4c7b938" } new_table_name: "default.Table_c0a9aae588ef49148c04338c906dab4a" modify_external_catalogs: true
I20260318 02:51:29.563422 449 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 1516525b471540288c6cb5d61120d430 (table default.Table_4e770bc308894d9094b88315d9093ba5 [id=433e7aa77412424ebb38784bb073d1fb]). Expected version 6 got 0
I20260318 02:51:29.531600 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44cc50429d4f4c109629a9ad08b06bb3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:29.567507 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 consensus state has no leader
I20260318 02:51:29.567857 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef021185bb774cf3aa3e08d88eaa1923. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:29.532183 997 connection.cc:537] client connection to 127.0.104.189:45933 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260318 02:51:29.565092 759 tablet_service.cc:1558] Processing DeleteTablet for tablet d1a884fde2c145518a2cb14b7780b6dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.567273 1174 tablet_bootstrap.cc:492] T 547762347d7843e989e55e0449ad9fcb P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:29.539414 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 42fc3a9965804b5eb0c9f96eabc38553 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:29.556185 1172 tablet_bootstrap.cc:492] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:29.568807 1172 ts_tablet_manager.cc:1403] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.493s user 0.001s sys 0.006s
I20260318 02:51:29.569765 1172 raft_consensus.cc:359] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.570016 1172 raft_consensus.cc:385] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.570103 1172 raft_consensus.cc:740] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.570334 1172 consensus_queue.cc:260] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.572206 759 tablet_service.cc:1511] Processing CreateTablet for tablet eff9aafa0d9f4ff7a057c87c381589a3 (DEFAULT_TABLE table=default.Table_923e145b0497406aa12727b8a4e5d5e3 [id=b2dae404d4e54d098c010def0c4e6b3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.572690 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eff9aafa0d9f4ff7a057c87c381589a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.572588 1040 tablet_service.cc:1511] Processing CreateTablet for tablet eff9aafa0d9f4ff7a057c87c381589a3 (DEFAULT_TABLE table=default.Table_923e145b0497406aa12727b8a4e5d5e3 [id=b2dae404d4e54d098c010def0c4e6b3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.573203 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eff9aafa0d9f4ff7a057c87c381589a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.574967 1176 ts_tablet_manager.cc:1929] T 3e38dec0d2e9417e8571e202036e7117 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:29.575083 1176 log.cc:1199] T 3e38dec0d2e9417e8571e202036e7117 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/3e38dec0d2e9417e8571e202036e7117
I20260318 02:51:29.575428 1176 ts_tablet_manager.cc:1950] T 3e38dec0d2e9417e8571e202036e7117 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:29.576443 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 3e38dec0d2e9417e8571e202036e7117 (table default.Table_f6484117e54a4f2298a8d7365770c153 [id=c06168b4ee024f728f2f11a4cc39fc4e]) successfully deleted
I20260318 02:51:29.570871 1172 ts_tablet_manager.cc:1434] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:29.577245 758 tablet_service.cc:1511] Processing CreateTablet for tablet d279b1b52366488f80097eaf52dfb2db (DEFAULT_TABLE table=default.Table_7d354ce302b6453b980bc1324e6cd3d7 [id=7c4f0a4d2884462e9f892904da548fe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.577339 1172 tablet_bootstrap.cc:492] T f447cab3445c451d8ef8746966cfcd42 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:29.577610 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d279b1b52366488f80097eaf52dfb2db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.579818 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69753d29db104bbda5a604ebb2db816e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.580487 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b5d1e9e7b5d4e36a2ffdf2fc01bd902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.580871 1172 tablet_bootstrap.cc:654] T f447cab3445c451d8ef8746966cfcd42 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:29.530180 999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.129:46711, user_credentials={real_user=slave}} blocked reactor thread for 58001.9us
I20260318 02:51:29.565831 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f12b593f2540b9956a38b8e8500824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.565933 896 tablet_service.cc:1558] Processing DeleteTablet for tablet ed193d1b80be496298dae6fafef94577 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:29.583707 892 tablet_service.cc:1558] Processing DeleteTablet for tablet d1a67e637d934c0f99c00d04fb26df0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:29.584488 757 tablet_service.cc:1511] Processing CreateTablet for tablet 54260f32672147f6bbd30f3981e9f61c (DEFAULT_TABLE table=default.Table_e8896d6ba495415ea6b0bfbe2479e0f8 [id=9e670e72d39242a8b529524695f0f6cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.584896 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54260f32672147f6bbd30f3981e9f61c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:29.586666 719 leader_election.cc:343] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:29.586786 719 leader_election.cc:304] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:29.586946 719 raft_consensus.cc:2686] T 0d343e53f2354a3386b19d71ef00d5a4 P 6a903d876086423b8016d705b98895ad: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260318 02:51:29.587641 763 tablet_service.cc:1511] Processing CreateTablet for tablet 51462898f3664b50a3b4ca1403b20c20 (DEFAULT_TABLE table=default.Table_4ecce75b6c624f5889db31ad1ced6e00 [id=4e754fae4f5f4ea5b633a77c9d763e3d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:29.587906 719 leader_election.cc:343] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:29.587998 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51462898f3664b50a3b4ca1403b20c20. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:29.589027 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 597a9271dedf4e789926e7e65fd79dfc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 597a9271dedf4e789926e7e65fd79dfc already in progress: creating tablet
W20260318 02:51:29.590015 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet dc0bb9b5580d43429828e67f53871982 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc0bb9b5580d43429828e67f53871982 already in progress: creating tablet
I20260318 02:51:29.590951 754 tablet_service.cc:1511] Processing CreateTablet for tablet c7a128649e834d0a85f3833f2152e040 (DEFAULT_TABLE table=default.Table_0dc4fd883c61478cb1c3cad66d5ec9a1 [id=7e6d8058b2714d87b00a970b52ee2e74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.591262 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a128649e834d0a85f3833f2152e040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.592976 747 tablet_service.cc:1511] Processing CreateTablet for tablet 0e99c2956a764e6cb07cbc41e4a6f2f8 (DEFAULT_TABLE table=default.Table_62c15aab881b46dba0f3fb97b039ec08 [id=9a0951ffecfc404292f3af69337bde0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.593350 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e99c2956a764e6cb07cbc41e4a6f2f8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:29.598004 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f5b55cf85d7842e59f0ed92aecdcd5d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5b55cf85d7842e59f0ed92aecdcd5d0 already in progress: creating tablet
W20260318 02:51:29.598856 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a already in progress: creating tablet
W20260318 02:51:29.599404 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet ba3e7e9a85c94d7380b96a9373c1f503 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba3e7e9a85c94d7380b96a9373c1f503 already in progress: creating tablet
W20260318 02:51:29.599992 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 8e578c7498b6404cb87f493127005500 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e578c7498b6404cb87f493127005500 already in progress: creating tablet
W20260318 02:51:29.600508 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 42fc3a9965804b5eb0c9f96eabc38553 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42fc3a9965804b5eb0c9f96eabc38553 already in progress: creating tablet
W20260318 02:51:29.601051 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 824b9dc6982f425c9518c0ea3560bf84 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 824b9dc6982f425c9518c0ea3560bf84 already in progress: creating tablet
I20260318 02:51:29.588007 719 leader_election.cc:304] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:29.601624 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet ed193d1b80be496298dae6fafef94577 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed193d1b80be496298dae6fafef94577 already in progress: creating tablet
I20260318 02:51:29.601840 1667 raft_consensus.cc:2749] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:29.602303 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet d1a67e637d934c0f99c00d04fb26df0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1a67e637d934c0f99c00d04fb26df0d already in progress: creating tablet
I20260318 02:51:29.602555 1176 tablet_replica.cc:333] T d1a884fde2c145518a2cb14b7780b6dd P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:29.602761 1176 raft_consensus.cc:2243] T d1a884fde2c145518a2cb14b7780b6dd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:29.602949 1176 raft_consensus.cc:2272] T d1a884fde2c145518a2cb14b7780b6dd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:29.604552 1176 ts_tablet_manager.cc:1916] T d1a884fde2c145518a2cb14b7780b6dd P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:29.597179 860 connection.cc:537] client connection to 127.0.104.189:45933 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260318 02:51:29.609539 1175 ts_tablet_manager.cc:1929] T a8b44b68094344f7a694ae4d985f56a6 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:29.609691 1175 log.cc:1199] T a8b44b68094344f7a694ae4d985f56a6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/a8b44b68094344f7a694ae4d985f56a6
I20260318 02:51:29.611450 891 tablet_service.cc:1511] Processing CreateTablet for tablet eff9aafa0d9f4ff7a057c87c381589a3 (DEFAULT_TABLE table=default.Table_923e145b0497406aa12727b8a4e5d5e3 [id=b2dae404d4e54d098c010def0c4e6b3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.611905 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eff9aafa0d9f4ff7a057c87c381589a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.618724 1176 ts_tablet_manager.cc:1929] T d1a884fde2c145518a2cb14b7780b6dd P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:29.618896 1176 log.cc:1199] T d1a884fde2c145518a2cb14b7780b6dd P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/d1a884fde2c145518a2cb14b7780b6dd
I20260318 02:51:29.619974 1668 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:29.620196 1668 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: This master's current role is: LEADER
I20260318 02:51:29.620630 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1136fb5f74264862b0dee0926825df6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.621683 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1136fb5f74264862b0dee0926825df6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.622185 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1f0223a1a57a4f84850ba99f63de7e9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.622637 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f0223a1a57a4f84850ba99f63de7e9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.622979 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3122f85862b74242a50f9d08dc75e6cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.623409 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3122f85862b74242a50f9d08dc75e6cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.633101 455 master_service.cc:954] ReplaceTablet: received request to replace tablet b07006bc31584865a0a5eb407e7ccc16 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:29.636003 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ac071828b4034d5a9bf1ffbdf5e40849"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:29.636101 1034 tablet_service.cc:1511] Processing CreateTablet for tablet d279b1b52366488f80097eaf52dfb2db (DEFAULT_TABLE table=default.Table_7d354ce302b6453b980bc1324e6cd3d7 [id=7c4f0a4d2884462e9f892904da548fe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.636513 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d279b1b52366488f80097eaf52dfb2db. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:29.636662 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac071828b4034d5a9bf1ffbdf5e40849 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.639508 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 0e99c2956a764e6cb07cbc41e4a6f2f8 (DEFAULT_TABLE table=default.Table_62c15aab881b46dba0f3fb97b039ec08 [id=9a0951ffecfc404292f3af69337bde0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.639956 899 tablet_service.cc:1511] Processing CreateTablet for tablet 54260f32672147f6bbd30f3981e9f61c (DEFAULT_TABLE table=default.Table_e8896d6ba495415ea6b0bfbe2479e0f8 [id=9e670e72d39242a8b529524695f0f6cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.641849 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 51462898f3664b50a3b4ca1403b20c20 (DEFAULT_TABLE table=default.Table_4ecce75b6c624f5889db31ad1ced6e00 [id=4e754fae4f5f4ea5b633a77c9d763e3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.642679 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e99c2956a764e6cb07cbc41e4a6f2f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.643002 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54260f32672147f6bbd30f3981e9f61c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.643293 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51462898f3664b50a3b4ca1403b20c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.647584 1175 ts_tablet_manager.cc:1950] T a8b44b68094344f7a694ae4d985f56a6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:29.647740 1040 tablet_service.cc:1511] Processing CreateTablet for tablet c7a128649e834d0a85f3833f2152e040 (DEFAULT_TABLE table=default.Table_0dc4fd883c61478cb1c3cad66d5ec9a1 [id=7e6d8058b2714d87b00a970b52ee2e74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.648092 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 54260f32672147f6bbd30f3981e9f61c (DEFAULT_TABLE table=default.Table_e8896d6ba495415ea6b0bfbe2479e0f8 [id=9e670e72d39242a8b529524695f0f6cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.648622 1175 tablet_replica.cc:333] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:29.629957 1174 ts_tablet_manager.cc:1403] T 547762347d7843e989e55e0449ad9fcb P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.120s user 0.020s sys 0.000s
I20260318 02:51:29.648890 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a128649e834d0a85f3833f2152e040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.649390 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54260f32672147f6bbd30f3981e9f61c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.649717 1175 raft_consensus.cc:2243] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:29.649641 1174 raft_consensus.cc:359] T 547762347d7843e989e55e0449ad9fcb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.649817 1174 raft_consensus.cc:385] T 547762347d7843e989e55e0449ad9fcb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.649909 1175 raft_consensus.cc:2272] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:29.650969 896 tablet_service.cc:1511] Processing CreateTablet for tablet 0e99c2956a764e6cb07cbc41e4a6f2f8 (DEFAULT_TABLE table=default.Table_62c15aab881b46dba0f3fb97b039ec08 [id=9a0951ffecfc404292f3af69337bde0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.655719 1174 raft_consensus.cc:740] T 547762347d7843e989e55e0449ad9fcb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.650139 1176 ts_tablet_manager.cc:1950] T d1a884fde2c145518a2cb14b7780b6dd P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
W20260318 02:51:29.656093 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bac04b3e4ad448b09a1a25a754b44aad consensus state has no leader
I20260318 02:51:29.656234 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet a8b44b68094344f7a694ae4d985f56a6 (table default.Table_7f6deccea357456489e67b7be47c0c18 [id=eda94e850ac246cc878d8ef48a7f506e]) successfully deleted
W20260318 02:51:29.656478 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet dc0bb9b5580d43429828e67f53871982 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc0bb9b5580d43429828e67f53871982 already in progress: creating tablet
I20260318 02:51:29.656473 1667 raft_consensus.cc:493] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:29.656615 1667 raft_consensus.cc:515] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:29.656754 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 597a9271dedf4e789926e7e65fd79dfc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 597a9271dedf4e789926e7e65fd79dfc already in progress: creating tablet
W20260318 02:51:29.656980 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f5b55cf85d7842e59f0ed92aecdcd5d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5b55cf85d7842e59f0ed92aecdcd5d0 already in progress: creating tablet
I20260318 02:51:29.657182 1174 consensus_queue.cc:260] T 547762347d7843e989e55e0449ad9fcb P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.657308 1667 leader_election.cc:290] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:29.656997 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet d1a884fde2c145518a2cb14b7780b6dd (table default.Table_6372798c3d47435ea80a21ca734ce78f [id=b5127c54241a49309f32bfa4e5f6f2cd]) successfully deleted
I20260318 02:51:29.658833 892 tablet_service.cc:1511] Processing CreateTablet for tablet 51462898f3664b50a3b4ca1403b20c20 (DEFAULT_TABLE table=default.Table_4ecce75b6c624f5889db31ad1ced6e00 [id=4e754fae4f5f4ea5b633a77c9d763e3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.659495 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1516525b471540288c6cb5d61120d430" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:29.660465 719 leader_election.cc:343] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:29.662240 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1516525b471540288c6cb5d61120d430" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:29.663288 905 tablet_service.cc:1511] Processing CreateTablet for tablet d279b1b52366488f80097eaf52dfb2db (DEFAULT_TABLE table=default.Table_7d354ce302b6453b980bc1324e6cd3d7 [id=7c4f0a4d2884462e9f892904da548fe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.663666 889 tablet_service.cc:1511] Processing CreateTablet for tablet c7a128649e834d0a85f3833f2152e040 (DEFAULT_TABLE table=default.Table_0dc4fd883c61478cb1c3cad66d5ec9a1 [id=7e6d8058b2714d87b00a970b52ee2e74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.663972 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51462898f3664b50a3b4ca1403b20c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.667261 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e99c2956a764e6cb07cbc41e4a6f2f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.667626 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d279b1b52366488f80097eaf52dfb2db. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:29.668273 719 leader_election.cc:343] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:29.668394 719 leader_election.cc:304] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:29.669553 1667 raft_consensus.cc:2749] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:29.676692 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a128649e834d0a85f3833f2152e040. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.678807 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b19e155d16bd4725a2d4200eda764366"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.679483 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b19e155d16bd4725a2d4200eda764366 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.680851 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f9effad0f719477fa069bbbe2b4ef857" } new_table_name: "default.Table_d41ae6aee5434ad5b137a8e293b24cef" modify_external_catalogs: true
I20260318 02:51:29.682662 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0bc143d5f9bf42be85f911249422e04d" } modify_external_catalogs: true
I20260318 02:51:29.682848 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0bc143d5f9bf42be85f911249422e04d" } modify_external_catalogs: true
I20260318 02:51:29.683362 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_559e7d5c5ca844c3985182f0fa1e14f8" } new_table_name: "default.Table_c978284529db4de7883f9f0664c4a158" modify_external_catalogs: true
I20260318 02:51:29.684618 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 547762347d7843e989e55e0449ad9fcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.685061 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c89f8c40260f47be9787ac38ce5dcd46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:29.685403 1172 tablet_bootstrap.cc:492] T f447cab3445c451d8ef8746966cfcd42 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:29.685559 1172 ts_tablet_manager.cc:1403] T f447cab3445c451d8ef8746966cfcd42 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.108s user 0.001s sys 0.007s
W20260318 02:51:29.685593 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c89f8c40260f47be9787ac38ce5dcd46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.686349 1172 raft_consensus.cc:359] T f447cab3445c451d8ef8746966cfcd42 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.686522 1172 raft_consensus.cc:385] T f447cab3445c451d8ef8746966cfcd42 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.686594 1172 raft_consensus.cc:740] T f447cab3445c451d8ef8746966cfcd42 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.687620 1175 ts_tablet_manager.cc:1916] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:29.687825 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 547762347d7843e989e55e0449ad9fcb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 547762347d7843e989e55e0449ad9fcb already in progress: creating tablet
I20260318 02:51:29.689095 1173 tablet_bootstrap.cc:654] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:29.691744 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d2f73355578d4f4391b25e72718cfa1e" } modify_external_catalogs: true
I20260318 02:51:29.691933 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d2f73355578d4f4391b25e72718cfa1e" } modify_external_catalogs: true
I20260318 02:51:29.694155 1184 ts_tablet_manager.cc:1929] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260318 02:51:29.694325 1184 log.cc:1199] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/e2304246c244407b9d4eb301ac5d7ba9
I20260318 02:51:29.694765 1184 ts_tablet_manager.cc:1950] T e2304246c244407b9d4eb301ac5d7ba9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:29.695657 1184 tablet_replica.cc:333] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:29.696012 1172 consensus_queue.cc:260] T f447cab3445c451d8ef8746966cfcd42 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.697990 1172 ts_tablet_manager.cc:1434] T f447cab3445c451d8ef8746966cfcd42 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260318 02:51:29.698266 1172 tablet_bootstrap.cc:492] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:29.707638 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f5f60ceb0c0c4e50993d4d9d5ff3d0f4" } modify_external_catalogs: true
I20260318 02:51:29.707841 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f5f60ceb0c0c4e50993d4d9d5ff3d0f4" } modify_external_catalogs: true
I20260318 02:51:29.708585 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_4600a261d8844254ba70e12cd1dc1676"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.709192 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4600a261d8844254ba70e12cd1dc1676 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.715746 1687 raft_consensus.cc:493] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:29.715917 1687 raft_consensus.cc:515] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.716490 1687 leader_election.cc:290] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:29.717101 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a08d8bbe3a4234b97203536db32078" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:29.717310 784 raft_consensus.cc:2468] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:29.717790 999 leader_election.cc:304] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:29.718487 1687 raft_consensus.cc:2804] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:29.718631 1687 raft_consensus.cc:493] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:29.718721 1687 raft_consensus.cc:3060] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:29.721585 1687 raft_consensus.cc:515] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.722868 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a08d8bbe3a4234b97203536db32078" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:29.723052 784 raft_consensus.cc:3060] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:29.726199 784 raft_consensus.cc:2468] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:29.726784 999 leader_election.cc:304] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:29.727125 1740 raft_consensus.cc:2804] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:29.729240 1687 leader_election.cc:290] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:29.730851 759 tablet_service.cc:1511] Processing CreateTablet for tablet 25db0bd3082f42c68aa88ae561ffb8a6 (DEFAULT_TABLE table=default.Table_434959925cdf4e2c86cf3aa4424d017f [id=c073517f1c8e424281ba2101a6a41868]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.731292 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25db0bd3082f42c68aa88ae561ffb8a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.732803 899 tablet_service.cc:1511] Processing CreateTablet for tablet c6e16e3e8feb42568c8f6d4a470877d0 (DEFAULT_TABLE table=default.Table_793e04a202214a95b056303786d5f5bd [id=63db8e7eefba49829e5d3f6e385ea9dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.733006 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet e2304246c244407b9d4eb301ac5d7ba9 (table default.Table_fddbe89a9a524d028fba5877d8b23387 [id=20ed812002544f6f8caef448f7514f7c]) successfully deleted
I20260318 02:51:29.733807 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6e16e3e8feb42568c8f6d4a470877d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.733968 897 tablet_service.cc:1511] Processing CreateTablet for tablet 25db0bd3082f42c68aa88ae561ffb8a6 (DEFAULT_TABLE table=default.Table_434959925cdf4e2c86cf3aa4424d017f [id=c073517f1c8e424281ba2101a6a41868]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.734382 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25db0bd3082f42c68aa88ae561ffb8a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.734490 754 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7d7767fa514821981f7086ef152091 (DEFAULT_TABLE table=default.Table_4247fd2723c44dfd9773172a8052e0e7 [id=e6d16612eda640b394c947b0b1607aa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.734828 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7d7767fa514821981f7086ef152091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.736950 747 tablet_service.cc:1511] Processing CreateTablet for tablet c6e16e3e8feb42568c8f6d4a470877d0 (DEFAULT_TABLE table=default.Table_793e04a202214a95b056303786d5f5bd [id=63db8e7eefba49829e5d3f6e385ea9dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.737278 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6e16e3e8feb42568c8f6d4a470877d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.738433 902 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7d7767fa514821981f7086ef152091 (DEFAULT_TABLE table=default.Table_4247fd2723c44dfd9773172a8052e0e7 [id=e6d16612eda640b394c947b0b1607aa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.738756 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7d7767fa514821981f7086ef152091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.740969 757 tablet_service.cc:1511] Processing CreateTablet for tablet 9eb15de8387248f1b2359c08230ff034 (DEFAULT_TABLE table=default.Table_7286c0505cce4fdbb3d3ff1021f7ae40 [id=78b9f9c06bd44938a359dacc47696211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.741089 1174 ts_tablet_manager.cc:1434] T 547762347d7843e989e55e0449ad9fcb P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.092s user 0.014s sys 0.010s
I20260318 02:51:29.741297 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eb15de8387248f1b2359c08230ff034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.741403 1174 tablet_bootstrap.cc:492] T 65f63eb5e114464988b3b89e3af61b61 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:29.742749 1174 tablet_bootstrap.cc:654] T 65f63eb5e114464988b3b89e3af61b61 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:29.745286 893 tablet_service.cc:1511] Processing CreateTablet for tablet b0fce0e19eeb4c658eedcd7f4283dd04 (DEFAULT_TABLE table=default.Table_a0d84da969fb47a6b9a9f0d817fc478a [id=9335c52391f4478996c4ea6dbeb8f63e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.745666 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0fce0e19eeb4c658eedcd7f4283dd04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.745889 1740 raft_consensus.cc:697] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:29.746246 1740 consensus_queue.cc:237] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.731226 763 tablet_service.cc:1511] Processing CreateTablet for tablet b0fce0e19eeb4c658eedcd7f4283dd04 (DEFAULT_TABLE table=default.Table_a0d84da969fb47a6b9a9f0d817fc478a [id=9335c52391f4478996c4ea6dbeb8f63e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.748986 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a08d8bbe3a4234b97203536db32078" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:29.749167 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0fce0e19eeb4c658eedcd7f4283dd04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.749373 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a08d8bbe3a4234b97203536db32078" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:29.749604 888 tablet_service.cc:1511] Processing CreateTablet for tablet 9eb15de8387248f1b2359c08230ff034 (DEFAULT_TABLE table=default.Table_7286c0505cce4fdbb3d3ff1021f7ae40 [id=78b9f9c06bd44938a359dacc47696211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.749956 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eb15de8387248f1b2359c08230ff034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.750344 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 25db0bd3082f42c68aa88ae561ffb8a6 (DEFAULT_TABLE table=default.Table_434959925cdf4e2c86cf3aa4424d017f [id=c073517f1c8e424281ba2101a6a41868]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.750718 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25db0bd3082f42c68aa88ae561ffb8a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.730851 758 tablet_service.cc:1511] Processing CreateTablet for tablet 664f3dc10eee4dba9543fea7d0fc467e (DEFAULT_TABLE table=default.Table_fe91f66877bf46138d65eaa4c8a0778c [id=ca23a67ab2b04beba2ed1d36470e87c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.752995 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 664f3dc10eee4dba9543fea7d0fc467e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.757995 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet f447cab3445c451d8ef8746966cfcd42 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c5038e9e1074f46976a1a5bb4282944) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:29.758652 1034 tablet_service.cc:1511] Processing CreateTablet for tablet b0fce0e19eeb4c658eedcd7f4283dd04 (DEFAULT_TABLE table=default.Table_a0d84da969fb47a6b9a9f0d817fc478a [id=9335c52391f4478996c4ea6dbeb8f63e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.759123 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0fce0e19eeb4c658eedcd7f4283dd04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.761055 891 tablet_service.cc:1511] Processing CreateTablet for tablet 664f3dc10eee4dba9543fea7d0fc467e (DEFAULT_TABLE table=default.Table_fe91f66877bf46138d65eaa4c8a0778c [id=ca23a67ab2b04beba2ed1d36470e87c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.761564 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 664f3dc10eee4dba9543fea7d0fc467e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.774576 1172 tablet_bootstrap.cc:654] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:29.775554 1184 raft_consensus.cc:2243] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:29.775851 1184 raft_consensus.cc:2272] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:29.776460 1184 ts_tablet_manager.cc:1916] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:29.779302 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_eb858b839de14ff58abebe876d3ff752" } modify_external_catalogs: true
I20260318 02:51:29.779534 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_eb858b839de14ff58abebe876d3ff752" } modify_external_catalogs: true
I20260318 02:51:29.790410 1172 tablet_bootstrap.cc:492] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:29.790668 1172 ts_tablet_manager.cc:1403] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.092s user 0.001s sys 0.006s
I20260318 02:51:29.791522 1172 raft_consensus.cc:359] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.791805 1172 raft_consensus.cc:385] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.791922 1172 raft_consensus.cc:740] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.792207 1172 consensus_queue.cc:260] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.792768 1172 ts_tablet_manager.cc:1434] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260318 02:51:29.793110 1172 tablet_bootstrap.cc:492] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:29.794894 1172 tablet_bootstrap.cc:654] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:29.795965 1184 ts_tablet_manager.cc:1929] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:29.797207 1184 log.cc:1199] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/a8b44b68094344f7a694ae4d985f56a6
I20260318 02:51:29.797614 1184 ts_tablet_manager.cc:1950] T a8b44b68094344f7a694ae4d985f56a6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:29.799232 1184 tablet_replica.cc:333] T d4a54d0daa9f48a89b3f114367750826 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:29.799577 1184 raft_consensus.cc:2243] T d4a54d0daa9f48a89b3f114367750826 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:29.799858 1184 raft_consensus.cc:2272] T d4a54d0daa9f48a89b3f114367750826 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:29.800403 1184 ts_tablet_manager.cc:1916] T d4a54d0daa9f48a89b3f114367750826 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:29.802428 1175 ts_tablet_manager.cc:1929] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:29.802590 1175 log.cc:1199] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/71c518c87bdd4a63aa1016e8de6bafdc
I20260318 02:51:29.803004 1175 ts_tablet_manager.cc:1950] T 71c518c87bdd4a63aa1016e8de6bafdc P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:29.806164 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 71c518c87bdd4a63aa1016e8de6bafdc (table default.Table_346cff4fabb54f2ebef24b9eb0cf3be6 [id=dc28d96d1b5741de820129003145794b]) successfully deleted
W20260318 02:51:29.806521 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a already in progress: creating tablet
W20260318 02:51:29.806826 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet ba3e7e9a85c94d7380b96a9373c1f503 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba3e7e9a85c94d7380b96a9373c1f503 already in progress: creating tablet
W20260318 02:51:29.807077 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 8e578c7498b6404cb87f493127005500 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e578c7498b6404cb87f493127005500 already in progress: creating tablet
W20260318 02:51:29.807345 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 824b9dc6982f425c9518c0ea3560bf84 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 824b9dc6982f425c9518c0ea3560bf84 already in progress: creating tablet
I20260318 02:51:29.808254 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d6ad068d690949058bd4fdeea68e31a3" } modify_external_catalogs: true
I20260318 02:51:29.808423 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d6ad068d690949058bd4fdeea68e31a3" } modify_external_catalogs: true
I20260318 02:51:29.809540 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5e2b468b791348fe97d627711ff12f94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.810099 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e2b468b791348fe97d627711ff12f94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.810310 1184 ts_tablet_manager.cc:1929] T d4a54d0daa9f48a89b3f114367750826 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:29.810472 1184 log.cc:1199] T d4a54d0daa9f48a89b3f114367750826 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/d4a54d0daa9f48a89b3f114367750826
I20260318 02:51:29.810832 1184 ts_tablet_manager.cc:1950] T d4a54d0daa9f48a89b3f114367750826 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
W20260318 02:51:29.811291 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e418df45882c435a8276e46a8abf6bdd consensus state has no leader
I20260318 02:51:29.811671 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3188dcbe312043c3a4d363f0efa90709" } new_table_name: "default.Table_21b4c184cd9f4bf4adc9c8ffa1d00c6c" modify_external_catalogs: true
W20260318 02:51:29.812948 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 104cd36774df4bc0adf1d449224304d5 consensus state has no leader
I20260318 02:51:29.813045 1184 tablet_replica.cc:333] T f447cab3445c451d8ef8746966cfcd42 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:29.813248 1184 raft_consensus.cc:2243] T f447cab3445c451d8ef8746966cfcd42 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:29.813421 1184 raft_consensus.cc:2272] T f447cab3445c451d8ef8746966cfcd42 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:29.813315 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_4b6a70e405584e358aae8e56074d30da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:29.813793 1172 tablet_bootstrap.cc:492] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
W20260318 02:51:29.813868 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b6a70e405584e358aae8e56074d30da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.813946 1172 ts_tablet_manager.cc:1403] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.004s
I20260318 02:51:29.814195 1184 ts_tablet_manager.cc:1916] T f447cab3445c451d8ef8746966cfcd42 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:29.814785 1172 raft_consensus.cc:359] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.814967 1172 raft_consensus.cc:385] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.815048 1172 raft_consensus.cc:740] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.815300 1172 consensus_queue.cc:260] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.815730 1172 ts_tablet_manager.cc:1434] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:29.816039 1172 tablet_bootstrap.cc:492] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:29.817560 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 547762347d7843e989e55e0449ad9fcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.817921 1176 tablet_replica.cc:333] T 547762347d7843e989e55e0449ad9fcb P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:29.818096 1176 raft_consensus.cc:2243] T 547762347d7843e989e55e0449ad9fcb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:29.818254 1176 raft_consensus.cc:2272] T 547762347d7843e989e55e0449ad9fcb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:29.818984 1176 ts_tablet_manager.cc:1916] T 547762347d7843e989e55e0449ad9fcb P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:29.820431 1760 raft_consensus.cc:493] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:29.820605 1760 raft_consensus.cc:515] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.821414 1760 leader_election.cc:290] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:29.822643 999 leader_election.cc:343] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: a4f891043b7d468da3e808980690354d
I20260318 02:51:29.823505 1184 ts_tablet_manager.cc:1929] T f447cab3445c451d8ef8746966cfcd42 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:29.823843 1184 log.cc:1199] T f447cab3445c451d8ef8746966cfcd42 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/f447cab3445c451d8ef8746966cfcd42
I20260318 02:51:29.824306 1184 ts_tablet_manager.cc:1950] T f447cab3445c451d8ef8746966cfcd42 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:29.824659 1176 ts_tablet_manager.cc:1929] T 547762347d7843e989e55e0449ad9fcb P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:29.824806 1176 log.cc:1199] T 547762347d7843e989e55e0449ad9fcb P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/547762347d7843e989e55e0449ad9fcb
I20260318 02:51:29.825088 1176 ts_tablet_manager.cc:1950] T 547762347d7843e989e55e0449ad9fcb P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:29.825582 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_08987cfd708d4bb2b783719d46212566" } new_table_name: "default.Table_faeb6cafbd43447591559ebb7ede6da3" modify_external_catalogs: true
I20260318 02:51:29.827322 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 547762347d7843e989e55e0449ad9fcb (table default.Table_6d3695295b794364b4cdc7849155a559 [id=71965e8878d84c45a022d4438ea04e0e]) successfully deleted
I20260318 02:51:29.826067 1172 tablet_bootstrap.cc:654] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:29.826861 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 2f7d7767fa514821981f7086ef152091 (DEFAULT_TABLE table=default.Table_4247fd2723c44dfd9773172a8052e0e7 [id=e6d16612eda640b394c947b0b1607aa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.828564 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f7d7767fa514821981f7086ef152091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.830140 1174 tablet_bootstrap.cc:492] T 65f63eb5e114464988b3b89e3af61b61 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:29.830335 1174 ts_tablet_manager.cc:1403] T 65f63eb5e114464988b3b89e3af61b61 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.089s user 0.020s sys 0.015s
I20260318 02:51:29.831099 1174 raft_consensus.cc:359] T 65f63eb5e114464988b3b89e3af61b61 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.831332 1174 raft_consensus.cc:385] T 65f63eb5e114464988b3b89e3af61b61 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.831431 1174 raft_consensus.cc:740] T 65f63eb5e114464988b3b89e3af61b61 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.831707 1174 consensus_queue.cc:260] T 65f63eb5e114464988b3b89e3af61b61 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.832242 1174 ts_tablet_manager.cc:1434] T 65f63eb5e114464988b3b89e3af61b61 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:29.832854 1174 tablet_bootstrap.cc:492] T abfdba1f21e44652b2bce62cd3e6681f P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:29.833351 1037 tablet_service.cc:1511] Processing CreateTablet for tablet c6e16e3e8feb42568c8f6d4a470877d0 (DEFAULT_TABLE table=default.Table_793e04a202214a95b056303786d5f5bd [id=63db8e7eefba49829e5d3f6e385ea9dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.833794 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6e16e3e8feb42568c8f6d4a470877d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.834636 1174 tablet_bootstrap.cc:654] T abfdba1f21e44652b2bce62cd3e6681f P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:29.834654 1172 tablet_bootstrap.cc:492] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:29.834815 1172 ts_tablet_manager.cc:1403] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.006s
I20260318 02:51:29.835626 1172 raft_consensus.cc:359] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:29.835843 1172 raft_consensus.cc:385] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.835919 1172 raft_consensus.cc:740] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.836179 1172 consensus_queue.cc:260] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:29.836730 1172 ts_tablet_manager.cc:1434] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:29.837157 1172 tablet_bootstrap.cc:492] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:29.839237 1172 tablet_bootstrap.cc:654] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:29.840839 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 664f3dc10eee4dba9543fea7d0fc467e (DEFAULT_TABLE table=default.Table_fe91f66877bf46138d65eaa4c8a0778c [id=ca23a67ab2b04beba2ed1d36470e87c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.841329 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 664f3dc10eee4dba9543fea7d0fc467e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.845053 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 20a492fdea6c44ba8439614b0dcc2ba6
W20260318 02:51:29.845417 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 42fc3a9965804b5eb0c9f96eabc38553 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42fc3a9965804b5eb0c9f96eabc38553 already in progress: creating tablet
I20260318 02:51:29.845818 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 9eb15de8387248f1b2359c08230ff034 (DEFAULT_TABLE table=default.Table_7286c0505cce4fdbb3d3ff1021f7ae40 [id=78b9f9c06bd44938a359dacc47696211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:29.846302 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eb15de8387248f1b2359c08230ff034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:29.846292 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 20a492fdea6c44ba8439614b0dcc2ba6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:29.846844 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 20a492fdea6c44ba8439614b0dcc2ba6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:29.847065 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet ed193d1b80be496298dae6fafef94577 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed193d1b80be496298dae6fafef94577 already in progress: creating tablet
W20260318 02:51:29.847414 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet d1a67e637d934c0f99c00d04fb26df0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1a67e637d934c0f99c00d04fb26df0d already in progress: creating tablet
W20260318 02:51:29.847477 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 20a492fdea6c44ba8439614b0dcc2ba6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20a492fdea6c44ba8439614b0dcc2ba6 already in progress: creating tablet
W20260318 02:51:29.847658 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 20a492fdea6c44ba8439614b0dcc2ba6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20a492fdea6c44ba8439614b0dcc2ba6 already in progress: creating tablet
I20260318 02:51:29.849639 448 catalog_manager.cc:5671] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:29.850553 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet a8b44b68094344f7a694ae4d985f56a6 (table default.Table_7f6deccea357456489e67b7be47c0c18 [id=eda94e850ac246cc878d8ef48a7f506e]) successfully deleted
W20260318 02:51:29.850935 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet b10fd13bf3ea48b0896b34fce478e25a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b10fd13bf3ea48b0896b34fce478e25a already in progress: creating tablet
W20260318 02:51:29.851227 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 41646d513e834600a209761392ac7fb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41646d513e834600a209761392ac7fb1 already in progress: creating tablet
W20260318 02:51:29.851457 997 leader_election.cc:343] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:29.851743 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet bf344c2361b7412c87a7c7f9a72a15b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf344c2361b7412c87a7c7f9a72a15b6 already in progress: creating tablet
I20260318 02:51:29.851778 1174 tablet_bootstrap.cc:492] T abfdba1f21e44652b2bce62cd3e6681f P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:29.851742 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f891043b7d468da3e808980690354d" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:29.851900 1174 ts_tablet_manager.cc:1403] T abfdba1f21e44652b2bce62cd3e6681f P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.003s
W20260318 02:51:29.851922 997 leader_election.cc:343] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:29.851994 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet dfb3e7fe7a834636a16ee8a772b73ee2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfb3e7fe7a834636a16ee8a772b73ee2 already in progress: creating tablet
W20260318 02:51:29.852360 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 4df7d75e696a4aec981de3963c282b0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4df7d75e696a4aec981de3963c282b0d already in progress: creating tablet
I20260318 02:51:29.852569 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet d4a54d0daa9f48a89b3f114367750826 (table default.Table_88caf570ec6a4dfea94952fb5718c9c6 [id=5a3571f0765948588578d8e5185807a8]) successfully deleted
I20260318 02:51:29.852578 1174 raft_consensus.cc:359] T abfdba1f21e44652b2bce62cd3e6681f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.852754 1174 raft_consensus.cc:385] T abfdba1f21e44652b2bce62cd3e6681f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260318 02:51:29.852783 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 597a9271dedf4e789926e7e65fd79dfc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 597a9271dedf4e789926e7e65fd79dfc already in progress: creating tablet
I20260318 02:51:29.852826 1174 raft_consensus.cc:740] T abfdba1f21e44652b2bce62cd3e6681f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
W20260318 02:51:29.852986 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet dc0bb9b5580d43429828e67f53871982 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc0bb9b5580d43429828e67f53871982 already in progress: creating tablet
I20260318 02:51:29.853025 1174 consensus_queue.cc:260] T abfdba1f21e44652b2bce62cd3e6681f P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:29.853256 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f5b55cf85d7842e59f0ed92aecdcd5d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5b55cf85d7842e59f0ed92aecdcd5d0 already in progress: creating tablet
W20260318 02:51:29.853577 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a already in progress: creating tablet
W20260318 02:51:29.853819 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet ba3e7e9a85c94d7380b96a9373c1f503 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba3e7e9a85c94d7380b96a9373c1f503 already in progress: creating tablet
I20260318 02:51:29.853982 1174 ts_tablet_manager.cc:1434] T abfdba1f21e44652b2bce62cd3e6681f P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:29.854281 1174 tablet_bootstrap.cc:492] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:29.854679 1172 tablet_bootstrap.cc:492] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:29.854859 1172 ts_tablet_manager.cc:1403] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.009s
I20260318 02:51:29.855657 1172 raft_consensus.cc:359] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.856042 1172 raft_consensus.cc:385] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.856154 1174 tablet_bootstrap.cc:654] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:29.856189 1172 raft_consensus.cc:740] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.856467 1172 consensus_queue.cc:260] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.857040 1172 ts_tablet_manager.cc:1434] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:29.857385 1172 tablet_bootstrap.cc:492] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:29.859141 1172 tablet_bootstrap.cc:654] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:29.859521 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 824b9dc6982f425c9518c0ea3560bf84 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 824b9dc6982f425c9518c0ea3560bf84 already in progress: creating tablet
W20260318 02:51:29.859789 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet ed193d1b80be496298dae6fafef94577 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed193d1b80be496298dae6fafef94577 already in progress: creating tablet
W20260318 02:51:29.860044 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet d1a67e637d934c0f99c00d04fb26df0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1a67e637d934c0f99c00d04fb26df0d already in progress: creating tablet
W20260318 02:51:29.860306 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 8e578c7498b6404cb87f493127005500 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8e578c7498b6404cb87f493127005500 already in progress: creating tablet
W20260318 02:51:29.860569 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 42fc3a9965804b5eb0c9f96eabc38553 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42fc3a9965804b5eb0c9f96eabc38553 already in progress: creating tablet
I20260318 02:51:29.860810 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet f447cab3445c451d8ef8746966cfcd42 (table default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]) successfully deleted
W20260318 02:51:29.860821 423 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 47738.7us
I20260318 02:51:29.861505 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b07006bc31584865a0a5eb407e7ccc16
I20260318 02:51:29.863263 455 catalog_manager.cc:6741] ReplaceTablet: tablet b07006bc31584865a0a5eb407e7ccc16 deleted and replaced by tablet 8aac627aab0d41bda3053c57029a26fd
I20260318 02:51:29.863502 893 tablet_service.cc:1558] Processing DeleteTablet for tablet b07006bc31584865a0a5eb407e7ccc16 with delete_type TABLET_DATA_DELETED (replaced by tablet 8aac627aab0d41bda3053c57029a26fd) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:29.863652 763 tablet_service.cc:1558] Processing DeleteTablet for tablet b07006bc31584865a0a5eb407e7ccc16 with delete_type TABLET_DATA_DELETED (replaced by tablet 8aac627aab0d41bda3053c57029a26fd) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:29.864243 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet b07006bc31584865a0a5eb407e7ccc16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b07006bc31584865a0a5eb407e7ccc16 already in progress: creating tablet
W20260318 02:51:29.864354 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet b07006bc31584865a0a5eb407e7ccc16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b07006bc31584865a0a5eb407e7ccc16 already in progress: creating tablet
I20260318 02:51:29.868469 1174 tablet_bootstrap.cc:492] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:29.868670 1174 ts_tablet_manager.cc:1403] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.000s
I20260318 02:51:29.869513 1174 raft_consensus.cc:359] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.869745 1174 raft_consensus.cc:385] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.869849 1174 raft_consensus.cc:740] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.870151 1174 consensus_queue.cc:260] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.870396 455 master_service.cc:954] ReplaceTablet: received request to replace tablet ed193d1b80be496298dae6fafef94577 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:29.870961 1174 ts_tablet_manager.cc:1434] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:29.871014 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_bdf933d3dd024516a917b03a05f291a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:29.871236 1174 tablet_bootstrap.cc:492] T f5a829abed0444b79c48ab080d024824 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:29.871608 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bdf933d3dd024516a917b03a05f291a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.873031 1174 tablet_bootstrap.cc:654] T f5a829abed0444b79c48ab080d024824 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:29.875564 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 65f63eb5e114464988b3b89e3af61b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.875792 1176 tablet_replica.cc:333] T 65f63eb5e114464988b3b89e3af61b61 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:29.875962 1176 raft_consensus.cc:2243] T 65f63eb5e114464988b3b89e3af61b61 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:29.876112 1176 raft_consensus.cc:2272] T 65f63eb5e114464988b3b89e3af61b61 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:29.876299 997 leader_election.cc:343] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:29.876475 997 leader_election.cc:304] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:29.877094 1176 ts_tablet_manager.cc:1916] T 65f63eb5e114464988b3b89e3af61b61 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:29.879460 1173 tablet_bootstrap.cc:492] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:29.879642 1173 ts_tablet_manager.cc:1403] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.657s user 0.004s sys 0.012s
I20260318 02:51:29.880595 1173 raft_consensus.cc:359] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.880848 1173 raft_consensus.cc:385] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.880918 1173 raft_consensus.cc:740] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.881156 1173 consensus_queue.cc:260] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.883885 1173 ts_tablet_manager.cc:1434] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:29.884193 1176 ts_tablet_manager.cc:1929] T 65f63eb5e114464988b3b89e3af61b61 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:29.884313 1176 log.cc:1199] T 65f63eb5e114464988b3b89e3af61b61 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/65f63eb5e114464988b3b89e3af61b61
I20260318 02:51:29.884464 1173 tablet_bootstrap.cc:492] T 5db76f996b094bf99b6c6fe33f02b9f3 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:29.884596 1176 ts_tablet_manager.cc:1950] T 65f63eb5e114464988b3b89e3af61b61 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:29.885138 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 08f12b593f2540b9956a38b8e8500824
I20260318 02:51:29.886169 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 08f12b593f2540b9956a38b8e8500824 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:29.886899 1173 tablet_bootstrap.cc:654] T 5db76f996b094bf99b6c6fe33f02b9f3 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:29.886904 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 08f12b593f2540b9956a38b8e8500824 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08f12b593f2540b9956a38b8e8500824 already in progress: creating tablet
I20260318 02:51:29.887177 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 65f63eb5e114464988b3b89e3af61b61 (table default.Table_e285c48a68a04ddca6c3da148d0f43f1 [id=d7a2b53e58414b9b878a51724594ceda]) successfully deleted
I20260318 02:51:29.887666 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 08f12b593f2540b9956a38b8e8500824 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:29.888285 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 08f12b593f2540b9956a38b8e8500824 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08f12b593f2540b9956a38b8e8500824 already in progress: creating tablet
I20260318 02:51:29.892223 1174 tablet_bootstrap.cc:492] T f5a829abed0444b79c48ab080d024824 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:29.892429 1174 ts_tablet_manager.cc:1403] T f5a829abed0444b79c48ab080d024824 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.001s
I20260318 02:51:29.893232 1174 raft_consensus.cc:359] T f5a829abed0444b79c48ab080d024824 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.893447 1174 raft_consensus.cc:385] T f5a829abed0444b79c48ab080d024824 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.893535 1174 raft_consensus.cc:740] T f5a829abed0444b79c48ab080d024824 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.893786 1174 consensus_queue.cc:260] T f5a829abed0444b79c48ab080d024824 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.894618 1174 ts_tablet_manager.cc:1434] T f5a829abed0444b79c48ab080d024824 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:29.894943 1174 tablet_bootstrap.cc:492] T f9bc73d3f85745ecb62d861b6375a987 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:29.895197 449 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet bfb352bce9cc4e8aa899d691954d28d2 (table default.Table_992b9f90aa8c4e51959ca139974f10fe [id=e0b93f047d414aa5bc01df1a1dcb8878]). Expected version 1 got 0
I20260318 02:51:29.896445 763 tablet_service.cc:1558] Processing DeleteTablet for tablet abfdba1f21e44652b2bce62cd3e6681f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.896664 1176 tablet_replica.cc:333] T abfdba1f21e44652b2bce62cd3e6681f P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:29.896903 1176 raft_consensus.cc:2243] T abfdba1f21e44652b2bce62cd3e6681f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:29.897037 1176 raft_consensus.cc:2272] T abfdba1f21e44652b2bce62cd3e6681f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:29.897703 1176 ts_tablet_manager.cc:1916] T abfdba1f21e44652b2bce62cd3e6681f P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:29.903165 1756 raft_consensus.cc:493] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:29.903291 1756 raft_consensus.cc:515] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:29.903818 1756 leader_election.cc:290] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:29.904937 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105326aea9f744779ca76e0cbb2448cd" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:29.905469 719 leader_election.cc:343] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:29.905683 1176 ts_tablet_manager.cc:1929] T abfdba1f21e44652b2bce62cd3e6681f P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:29.905817 1176 log.cc:1199] T abfdba1f21e44652b2bce62cd3e6681f P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/abfdba1f21e44652b2bce62cd3e6681f
I20260318 02:51:29.906152 1176 ts_tablet_manager.cc:1950] T abfdba1f21e44652b2bce62cd3e6681f P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:29.896549 1174 tablet_bootstrap.cc:654] T f9bc73d3f85745ecb62d861b6375a987 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:29.907207 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet abfdba1f21e44652b2bce62cd3e6681f (table default.Table_fc98457cd89d4e7386e8668c917c0db5 [id=832c20ba6970431893816d86c1ee374b]) successfully deleted
I20260318 02:51:29.908535 763 tablet_service.cc:1558] Processing DeleteTablet for tablet f5a829abed0444b79c48ab080d024824 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.908631 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a8076e315fa94c08aea13ffb29815bd1" } new_table_name: "default.Table_56f2e832d57c4171b2e0606f8a9f78e4" modify_external_catalogs: true
I20260318 02:51:29.908857 1176 tablet_replica.cc:333] T f5a829abed0444b79c48ab080d024824 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:29.909031 1176 raft_consensus.cc:2243] T f5a829abed0444b79c48ab080d024824 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:29.909173 1176 raft_consensus.cc:2272] T f5a829abed0444b79c48ab080d024824 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:29.909857 1176 ts_tablet_manager.cc:1916] T f5a829abed0444b79c48ab080d024824 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:29.913026 1740 raft_consensus.cc:2749] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:29.878425 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 20a492fdea6c44ba8439614b0dcc2ba6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:29.904649 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105326aea9f744779ca76e0cbb2448cd" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:29.913772 719 leader_election.cc:343] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:29.913889 719 leader_election.cc:304] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:29.914232 1756 raft_consensus.cc:2749] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:29.915478 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 083493ab9d26493a924025fbd96ab1d7
I20260318 02:51:29.916407 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 083493ab9d26493a924025fbd96ab1d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:29.917277 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 083493ab9d26493a924025fbd96ab1d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 083493ab9d26493a924025fbd96ab1d7 already in progress: creating tablet
I20260318 02:51:29.917999 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 083493ab9d26493a924025fbd96ab1d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.919366 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6d1032d49d3244f0b80bf144e88b3d12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.920039 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d1032d49d3244f0b80bf144e88b3d12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.921348 1176 ts_tablet_manager.cc:1929] T f5a829abed0444b79c48ab080d024824 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:29.921988 1176 log.cc:1199] T f5a829abed0444b79c48ab080d024824 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/f5a829abed0444b79c48ab080d024824
I20260318 02:51:29.922468 1176 ts_tablet_manager.cc:1950] T f5a829abed0444b79c48ab080d024824 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:29.923805 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet f5a829abed0444b79c48ab080d024824 (table default.Table_b81f87a10bfa4885ba1ad5ed5fdf1828 [id=bdcf510793fa400cb6b8ddd13fd3fe0b]) successfully deleted
W20260318 02:51:29.924974 997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 48694us
W20260318 02:51:29.925314 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 083493ab9d26493a924025fbd96ab1d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 083493ab9d26493a924025fbd96ab1d7 already in progress: creating tablet
W20260318 02:51:29.926353 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 20a492fdea6c44ba8439614b0dcc2ba6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20a492fdea6c44ba8439614b0dcc2ba6 already in progress: creating tablet
I20260318 02:51:29.926884 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 53b0d1315274460d848afcfd4f88ee6e
I20260318 02:51:29.927207 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 08f12b593f2540b9956a38b8e8500824 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:29.927822 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 53b0d1315274460d848afcfd4f88ee6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:29.927836 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 53b0d1315274460d848afcfd4f88ee6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:29.928351 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 53b0d1315274460d848afcfd4f88ee6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53b0d1315274460d848afcfd4f88ee6e already in progress: creating tablet
W20260318 02:51:29.928611 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 53b0d1315274460d848afcfd4f88ee6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53b0d1315274460d848afcfd4f88ee6e already in progress: creating tablet
W20260318 02:51:29.928973 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 08f12b593f2540b9956a38b8e8500824 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08f12b593f2540b9956a38b8e8500824 already in progress: creating tablet
I20260318 02:51:29.929450 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 53b0d1315274460d848afcfd4f88ee6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:29.930040 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 53b0d1315274460d848afcfd4f88ee6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53b0d1315274460d848afcfd4f88ee6e already in progress: creating tablet
I20260318 02:51:29.933723 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_762224444e604c1fa386410335af4f48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:29.934367 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet b07006bc31584865a0a5eb407e7ccc16 with delete_type TABLET_DATA_DELETED (replaced by tablet 8aac627aab0d41bda3053c57029a26fd) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:29.934464 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_762224444e604c1fa386410335af4f48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:29.935094 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet b07006bc31584865a0a5eb407e7ccc16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b07006bc31584865a0a5eb407e7ccc16 already in progress: creating tablet
I20260318 02:51:29.940896 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_659b60f9843f48f698d176f54ae06d07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.941674 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_659b60f9843f48f698d176f54ae06d07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:29.948366 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cb29fd9d6fc845b2aaffe34c290fd5ca consensus state has no leader
I20260318 02:51:29.949204 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 083493ab9d26493a924025fbd96ab1d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:29.950181 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 083493ab9d26493a924025fbd96ab1d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 083493ab9d26493a924025fbd96ab1d7 already in progress: creating tablet
I20260318 02:51:29.951553 1173 tablet_bootstrap.cc:492] T 5db76f996b094bf99b6c6fe33f02b9f3 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:29.951786 1173 ts_tablet_manager.cc:1403] T 5db76f996b094bf99b6c6fe33f02b9f3 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.068s user 0.000s sys 0.003s
I20260318 02:51:29.951756 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7e830a261b9b4dadae5dc42d69c292ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:29.952670 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e830a261b9b4dadae5dc42d69c292ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:29.953091 1173 raft_consensus.cc:359] T 5db76f996b094bf99b6c6fe33f02b9f3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.953363 1173 raft_consensus.cc:385] T 5db76f996b094bf99b6c6fe33f02b9f3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.953490 1173 raft_consensus.cc:740] T 5db76f996b094bf99b6c6fe33f02b9f3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.953996 1173 consensus_queue.cc:260] T 5db76f996b094bf99b6c6fe33f02b9f3 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.957460 1173 ts_tablet_manager.cc:1434] T 5db76f996b094bf99b6c6fe33f02b9f3 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:29.957897 1173 tablet_bootstrap.cc:492] T 0ed4350e0fde4c8690970bc69830fcb3 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:29.969413 451 master_service.cc:954] ReplaceTablet: received request to replace tablet b8a46b4db30a48c99addf763f7edfb16 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:29.975647 1172 tablet_bootstrap.cc:492] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:29.975946 1172 ts_tablet_manager.cc:1403] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.119s user 0.051s sys 0.042s
I20260318 02:51:29.976943 1172 raft_consensus.cc:359] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.977250 1172 raft_consensus.cc:385] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.977360 1172 raft_consensus.cc:740] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.977682 1172 consensus_queue.cc:260] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.980439 1172 ts_tablet_manager.cc:1434] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:29.981681 1172 tablet_bootstrap.cc:492] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:29.983379 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 4fa7c1d6879c40ebb8d989ebae205e9e
I20260318 02:51:29.984524 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fa7c1d6879c40ebb8d989ebae205e9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:29.985237 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 4fa7c1d6879c40ebb8d989ebae205e9e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4fa7c1d6879c40ebb8d989ebae205e9e already in progress: creating tablet
I20260318 02:51:29.985927 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fa7c1d6879c40ebb8d989ebae205e9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:29.986452 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 5db76f996b094bf99b6c6fe33f02b9f3 with delete_type TABLET_DATA_DELETED (replaced by tablet 89a76fc237fc4bb8a891e3151efb3106) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:29.986678 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 4fa7c1d6879c40ebb8d989ebae205e9e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4fa7c1d6879c40ebb8d989ebae205e9e already in progress: creating tablet
I20260318 02:51:29.986747 1175 tablet_replica.cc:333] T 5db76f996b094bf99b6c6fe33f02b9f3 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:29.986928 1175 raft_consensus.cc:2243] T 5db76f996b094bf99b6c6fe33f02b9f3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:29.987116 1175 raft_consensus.cc:2272] T 5db76f996b094bf99b6c6fe33f02b9f3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:29.987105 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fa7c1d6879c40ebb8d989ebae205e9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:29.987198 1172 tablet_bootstrap.cc:654] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:29.988127 452 master_service.cc:954] ReplaceTablet: received request to replace tablet 9451d57fad72413c81443623c7995d4e from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:29.988159 1175 ts_tablet_manager.cc:1916] T 5db76f996b094bf99b6c6fe33f02b9f3 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:29.990409 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 4fa7c1d6879c40ebb8d989ebae205e9e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4fa7c1d6879c40ebb8d989ebae205e9e already in progress: creating tablet
I20260318 02:51:29.993054 1173 tablet_bootstrap.cc:654] T 0ed4350e0fde4c8690970bc69830fcb3 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:29.994563 1174 tablet_bootstrap.cc:492] T f9bc73d3f85745ecb62d861b6375a987 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:29.994712 1174 ts_tablet_manager.cc:1403] T f9bc73d3f85745ecb62d861b6375a987 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.100s user 0.019s sys 0.047s
I20260318 02:51:29.995491 1174 raft_consensus.cc:359] T f9bc73d3f85745ecb62d861b6375a987 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.995676 1174 raft_consensus.cc:385] T f9bc73d3f85745ecb62d861b6375a987 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.995744 1174 raft_consensus.cc:740] T f9bc73d3f85745ecb62d861b6375a987 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.995950 1174 consensus_queue.cc:260] T f9bc73d3f85745ecb62d861b6375a987 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.996486 1172 tablet_bootstrap.cc:492] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:29.996687 1172 ts_tablet_manager.cc:1403] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.006s
I20260318 02:51:29.997490 1174 ts_tablet_manager.cc:1434] T f9bc73d3f85745ecb62d861b6375a987 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:29.997536 1172 raft_consensus.cc:359] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.997766 1172 raft_consensus.cc:385] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:29.997876 1172 raft_consensus.cc:740] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:29.998139 1172 consensus_queue.cc:260] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:29.998404 1175 ts_tablet_manager.cc:1929] T 5db76f996b094bf99b6c6fe33f02b9f3 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:29.998548 1174 tablet_bootstrap.cc:492] T 29541950221544e396ada303fbbb5002 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:29.998574 1175 log.cc:1199] T 5db76f996b094bf99b6c6fe33f02b9f3 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/5db76f996b094bf99b6c6fe33f02b9f3
I20260318 02:51:29.999042 1175 ts_tablet_manager.cc:1950] T 5db76f996b094bf99b6c6fe33f02b9f3 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:29.999869 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 5db76f996b094bf99b6c6fe33f02b9f3 (table default.Table_1e9e471c1715493487baf6ce6eab167a [id=a6f1506993614ec5904423ac309abf1a]) successfully deleted
I20260318 02:51:30.000121 1174 tablet_bootstrap.cc:654] T 29541950221544e396ada303fbbb5002 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.000654 1172 ts_tablet_manager.cc:1434] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260318 02:51:30.001147 1172 tablet_bootstrap.cc:492] T 918c542a51864e54871efc5e7f62ef61 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:30.003525 1172 tablet_bootstrap.cc:654] T 918c542a51864e54871efc5e7f62ef61 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.005373 1172 tablet_bootstrap.cc:492] T 918c542a51864e54871efc5e7f62ef61 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:30.005544 1172 ts_tablet_manager.cc:1403] T 918c542a51864e54871efc5e7f62ef61 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260318 02:51:30.006332 1172 raft_consensus.cc:359] T 918c542a51864e54871efc5e7f62ef61 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.006495 1172 raft_consensus.cc:385] T 918c542a51864e54871efc5e7f62ef61 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.006574 1172 raft_consensus.cc:740] T 918c542a51864e54871efc5e7f62ef61 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.006799 1172 consensus_queue.cc:260] T 918c542a51864e54871efc5e7f62ef61 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:30.007134 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3291ecec94e642e3a995a2d7006619e7 consensus state has no leader
I20260318 02:51:30.007727 1172 ts_tablet_manager.cc:1434] T 918c542a51864e54871efc5e7f62ef61 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260318 02:51:30.008041 1172 tablet_bootstrap.cc:492] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:30.009948 1172 tablet_bootstrap.cc:654] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.012094 763 tablet_service.cc:1558] Processing DeleteTablet for tablet f9bc73d3f85745ecb62d861b6375a987 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.012346 1176 tablet_replica.cc:333] T f9bc73d3f85745ecb62d861b6375a987 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:30.012526 1176 raft_consensus.cc:2243] T f9bc73d3f85745ecb62d861b6375a987 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:30.012681 1176 raft_consensus.cc:2272] T f9bc73d3f85745ecb62d861b6375a987 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:30.013311 1176 ts_tablet_manager.cc:1916] T f9bc73d3f85745ecb62d861b6375a987 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:30.013617 1173 tablet_bootstrap.cc:492] T 0ed4350e0fde4c8690970bc69830fcb3 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:30.013800 1173 ts_tablet_manager.cc:1403] T 0ed4350e0fde4c8690970bc69830fcb3 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.000s
I20260318 02:51:30.014998 1173 raft_consensus.cc:359] T 0ed4350e0fde4c8690970bc69830fcb3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.015218 1173 raft_consensus.cc:385] T 0ed4350e0fde4c8690970bc69830fcb3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.015182 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9fdb7241643a4fb38c07adf178cdc452"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:30.015813 1173 raft_consensus.cc:740] T 0ed4350e0fde4c8690970bc69830fcb3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
W20260318 02:51:30.015920 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9fdb7241643a4fb38c07adf178cdc452 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:30.016199 1173 consensus_queue.cc:260] T 0ed4350e0fde4c8690970bc69830fcb3 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.019090 1176 ts_tablet_manager.cc:1929] T f9bc73d3f85745ecb62d861b6375a987 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:30.019210 1176 log.cc:1199] T f9bc73d3f85745ecb62d861b6375a987 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/f9bc73d3f85745ecb62d861b6375a987
I20260318 02:51:30.019474 1176 ts_tablet_manager.cc:1950] T f9bc73d3f85745ecb62d861b6375a987 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:30.019683 1173 ts_tablet_manager.cc:1434] T 0ed4350e0fde4c8690970bc69830fcb3 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260318 02:51:30.020081 1173 tablet_bootstrap.cc:492] T f447cab3445c451d8ef8746966cfcd42 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:30.020673 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet f9bc73d3f85745ecb62d861b6375a987 (table default.Table_5e18692d41ef4f6b9ac36936944042f7 [id=dfd0c35772ae4d71a6679f3bdaec5068]) successfully deleted
I20260318 02:51:30.022543 1173 tablet_bootstrap.cc:654] T f447cab3445c451d8ef8746966cfcd42 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.023679 1740 raft_consensus.cc:493] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.023862 1740 raft_consensus.cc:515] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.024554 1740 leader_election.cc:290] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:30.026778 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5765355efaa4ef4ab3b68ea33f51536" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:30.027009 784 raft_consensus.cc:2468] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:30.027998 999 leader_election.cc:304] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:30.028465 1740 raft_consensus.cc:2804] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:30.028581 1740 raft_consensus.cc:493] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:30.028664 1740 raft_consensus.cc:3060] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.031953 1740 raft_consensus.cc:515] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.033061 1740 leader_election.cc:290] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:30.033468 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5765355efaa4ef4ab3b68ea33f51536" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:30.033669 784 raft_consensus.cc:3060] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.034284 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ed4350e0fde4c8690970bc69830fcb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:30.034545 1175 tablet_replica.cc:333] T 0ed4350e0fde4c8690970bc69830fcb3 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:30.034731 1175 raft_consensus.cc:2243] T 0ed4350e0fde4c8690970bc69830fcb3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:30.034897 1175 raft_consensus.cc:2272] T 0ed4350e0fde4c8690970bc69830fcb3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:30.035169 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5765355efaa4ef4ab3b68ea33f51536" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:30.035681 1175 ts_tablet_manager.cc:1916] T 0ed4350e0fde4c8690970bc69830fcb3 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:30.035935 763 tablet_service.cc:1558] Processing DeleteTablet for tablet f9bc73d3f85745ecb62d861b6375a987 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.036316 784 raft_consensus.cc:2468] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
W20260318 02:51:30.036631 443 catalog_manager.cc:4969] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f9bc73d3f85745ecb62d861b6375a987 because the tablet was not found. No further retry: Not found: Tablet not found: f9bc73d3f85745ecb62d861b6375a987
I20260318 02:51:30.036690 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5765355efaa4ef4ab3b68ea33f51536" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:30.039621 999 leader_election.cc:304] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
W20260318 02:51:30.040177 997 leader_election.cc:343] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.040257 1740 raft_consensus.cc:2804] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
W20260318 02:51:30.040572 997 leader_election.cc:343] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.040650 1740 raft_consensus.cc:697] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:30.040967 1740 consensus_queue.cc:237] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.045245 1175 ts_tablet_manager.cc:1929] T 0ed4350e0fde4c8690970bc69830fcb3 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:30.045452 1175 log.cc:1199] T 0ed4350e0fde4c8690970bc69830fcb3 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/0ed4350e0fde4c8690970bc69830fcb3
I20260318 02:51:30.045843 1175 ts_tablet_manager.cc:1950] T 0ed4350e0fde4c8690970bc69830fcb3 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:30.046175 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_bfe33a0aadc84b8e83a5de13322a445a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:30.046854 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfe33a0aadc84b8e83a5de13322a445a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:30.046921 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 0ed4350e0fde4c8690970bc69830fcb3 (table default.Table_4ced5c1198ce406b85fbee4bbe6368c0 [id=a1f776ccb9f44dba98f77ad3fec5df41]) successfully deleted
I20260318 02:51:30.048285 1709 raft_consensus.cc:493] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.048446 1709 raft_consensus.cc:515] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.049108 1709 leader_election.cc:290] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.050230 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e0c54b3f1b44e4bea7253473714e94" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:30.050312 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e0c54b3f1b44e4bea7253473714e94" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:30.050472 1064 raft_consensus.cc:2468] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:30.050515 784 raft_consensus.cc:2468] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:30.051045 862 leader_election.cc:304] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:30.051885 1709 raft_consensus.cc:2804] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:30.052000 1709 raft_consensus.cc:493] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:30.052081 1709 raft_consensus.cc:3060] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:30.052821 423 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 76571.9us
I20260318 02:51:30.054934 1709 raft_consensus.cc:515] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.056105 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e0c54b3f1b44e4bea7253473714e94" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:30.056324 1064 raft_consensus.cc:3060] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.057133 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e0c54b3f1b44e4bea7253473714e94" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:30.057318 784 raft_consensus.cc:3060] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.058988 1064 raft_consensus.cc:2468] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:30.060133 784 raft_consensus.cc:2468] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:30.060770 862 leader_election.cc:304] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:30.062356 1709 leader_election.cc:290] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.062801 1709 raft_consensus.cc:2804] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:30.063165 1709 raft_consensus.cc:697] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:30.063628 1709 consensus_queue.cc:237] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:30.064375 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7f21df58fac437da5747becfa3f28b4 consensus state has no leader
I20260318 02:51:30.066794 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6e856430587e41c0ab30702ffe6dd939" } new_table_name: "default.Table_705682c0d1ba4277b50c02540d92b99e" modify_external_catalogs: true
I20260318 02:51:30.078972 1174 tablet_bootstrap.cc:492] T 29541950221544e396ada303fbbb5002 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:30.079253 1174 ts_tablet_manager.cc:1403] T 29541950221544e396ada303fbbb5002 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.081s user 0.010s sys 0.006s
I20260318 02:51:30.079823 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_07df9bd10c594e0ea40840e6f7e5d1c1" } new_table_name: "default.Table_3096d9a574d24640a9efe555f7b58d4f" modify_external_catalogs: true
I20260318 02:51:30.080052 1173 tablet_bootstrap.cc:492] T f447cab3445c451d8ef8746966cfcd42 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:30.080222 1173 ts_tablet_manager.cc:1403] T f447cab3445c451d8ef8746966cfcd42 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.000s
I20260318 02:51:30.080374 1174 raft_consensus.cc:359] T 29541950221544e396ada303fbbb5002 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.080600 1174 raft_consensus.cc:385] T 29541950221544e396ada303fbbb5002 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.080698 1174 raft_consensus.cc:740] T 29541950221544e396ada303fbbb5002 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.080996 1174 consensus_queue.cc:260] T 29541950221544e396ada303fbbb5002 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.081048 1173 raft_consensus.cc:359] T f447cab3445c451d8ef8746966cfcd42 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.081243 1173 raft_consensus.cc:385] T f447cab3445c451d8ef8746966cfcd42 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.081333 1173 raft_consensus.cc:740] T f447cab3445c451d8ef8746966cfcd42 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.081555 1173 consensus_queue.cc:260] T f447cab3445c451d8ef8746966cfcd42 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.082767 1174 ts_tablet_manager.cc:1434] T 29541950221544e396ada303fbbb5002 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260318 02:51:30.083894 1174 tablet_bootstrap.cc:492] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:30.085563 1174 tablet_bootstrap.cc:654] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.091604 1173 ts_tablet_manager.cc:1434] T f447cab3445c451d8ef8746966cfcd42 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.011s user 0.007s sys 0.002s
I20260318 02:51:30.091984 1173 tablet_bootstrap.cc:492] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:30.093991 1173 tablet_bootstrap.cc:654] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.094201 1174 tablet_bootstrap.cc:492] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:30.094395 1174 ts_tablet_manager.cc:1403] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260318 02:51:30.095182 1174 raft_consensus.cc:359] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.095417 1174 raft_consensus.cc:385] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.095513 1174 raft_consensus.cc:740] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.095758 1174 consensus_queue.cc:260] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.097137 1172 tablet_bootstrap.cc:492] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:30.097328 1172 ts_tablet_manager.cc:1403] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.089s user 0.005s sys 0.018s
I20260318 02:51:30.097323 1174 ts_tablet_manager.cc:1434] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260318 02:51:30.098140 1172 raft_consensus.cc:359] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.098325 1174 tablet_bootstrap.cc:492] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:30.098403 1172 raft_consensus.cc:385] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.098511 1172 raft_consensus.cc:740] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.098747 1172 consensus_queue.cc:260] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.100126 1174 tablet_bootstrap.cc:654] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.100592 1172 ts_tablet_manager.cc:1434] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260318 02:51:30.101137 1172 tablet_bootstrap.cc:492] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:30.105163 1172 tablet_bootstrap.cc:654] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.109175 1173 tablet_bootstrap.cc:492] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:30.109432 1173 ts_tablet_manager.cc:1403] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.005s
I20260318 02:51:30.110109 1174 tablet_bootstrap.cc:492] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:30.110319 1174 ts_tablet_manager.cc:1403] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.005s
I20260318 02:51:30.110226 1173 raft_consensus.cc:359] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.110626 1173 raft_consensus.cc:385] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.110714 1173 raft_consensus.cc:740] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.110970 1173 consensus_queue.cc:260] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.111337 1174 raft_consensus.cc:359] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.111542 1174 raft_consensus.cc:385] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.111574 1173 ts_tablet_manager.cc:1434] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:30.111675 1174 raft_consensus.cc:740] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.111901 1173 tablet_bootstrap.cc:492] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:30.111999 1174 consensus_queue.cc:260] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.113533 1174 ts_tablet_manager.cc:1434] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:30.113561 1173 tablet_bootstrap.cc:654] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.114961 1174 tablet_bootstrap.cc:492] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:30.115705 1172 tablet_bootstrap.cc:492] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:30.115891 1172 ts_tablet_manager.cc:1403] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260318 02:51:30.116636 1172 raft_consensus.cc:359] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.116899 1172 raft_consensus.cc:385] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.116969 1172 raft_consensus.cc:740] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.117195 1172 consensus_queue.cc:260] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.118453 1174 tablet_bootstrap.cc:654] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.120671 1172 ts_tablet_manager.cc:1434] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:30.122435 1172 tablet_bootstrap.cc:492] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:30.123970 457 catalog_manager.cc:5671] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 reported cstate change: term changed from 0 to 1, leader changed from <none> to b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130). New cstate: current_term: 1 leader_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:30.124330 1172 tablet_bootstrap.cc:654] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.127933 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 29541950221544e396ada303fbbb5002 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.128242 1176 tablet_replica.cc:333] T 29541950221544e396ada303fbbb5002 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:30.128423 1176 raft_consensus.cc:2243] T 29541950221544e396ada303fbbb5002 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:30.128575 1176 raft_consensus.cc:2272] T 29541950221544e396ada303fbbb5002 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:30.129594 1176 ts_tablet_manager.cc:1916] T 29541950221544e396ada303fbbb5002 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:30.133148 1172 tablet_bootstrap.cc:492] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:30.133667 1172 ts_tablet_manager.cc:1403] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260318 02:51:30.134665 1172 raft_consensus.cc:359] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.135663 1176 ts_tablet_manager.cc:1929] T 29541950221544e396ada303fbbb5002 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:30.135792 1176 log.cc:1199] T 29541950221544e396ada303fbbb5002 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/29541950221544e396ada303fbbb5002
I20260318 02:51:30.136142 1176 ts_tablet_manager.cc:1950] T 29541950221544e396ada303fbbb5002 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:30.136663 1172 raft_consensus.cc:385] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.136970 1172 raft_consensus.cc:740] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.137487 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 29541950221544e396ada303fbbb5002 (table default.Table_f6489e5e0d7f47cb889864d493a7b77c [id=85cf06ab49054e56859af17f79130d0a]) successfully deleted
I20260318 02:51:30.137544 1172 consensus_queue.cc:260] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.140771 1172 ts_tablet_manager.cc:1434] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260318 02:51:30.141633 1174 tablet_bootstrap.cc:492] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:30.141849 1174 ts_tablet_manager.cc:1403] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.000s
I20260318 02:51:30.142769 1172 tablet_bootstrap.cc:492] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:30.142686 1174 raft_consensus.cc:359] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.143003 1174 raft_consensus.cc:385] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.143107 1174 raft_consensus.cc:740] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.143389 1174 consensus_queue.cc:260] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.144873 1172 tablet_bootstrap.cc:654] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.145382 1174 ts_tablet_manager.cc:1434] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:30.146780 1174 tablet_bootstrap.cc:492] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:30.150154 1174 tablet_bootstrap.cc:654] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.155300 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_099c48c03d18476fb701684f3ca05655"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:30.156515 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_099c48c03d18476fb701684f3ca05655 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:30.158056 1756 raft_consensus.cc:493] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.158227 1756 raft_consensus.cc:515] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.158866 1756 leader_election.cc:290] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:30.159672 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb352bce9cc4e8aa899d691954d28d2" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:30.160468 719 leader_election.cc:343] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.161208 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb352bce9cc4e8aa899d691954d28d2" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:30.161978 719 leader_election.cc:343] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.162104 719 leader_election.cc:304] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:30.162328 1756 raft_consensus.cc:2749] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:30.166132 1174 tablet_bootstrap.cc:492] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:30.166371 1174 ts_tablet_manager.cc:1403] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.003s
I20260318 02:51:30.167177 1174 raft_consensus.cc:359] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.167420 1174 raft_consensus.cc:385] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.167518 1174 raft_consensus.cc:740] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.167549 1172 tablet_bootstrap.cc:492] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:30.167639 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b8a46b4db30a48c99addf763f7edfb16
I20260318 02:51:30.167917 1174 consensus_queue.cc:260] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.168170 451 catalog_manager.cc:6741] ReplaceTablet: tablet b8a46b4db30a48c99addf763f7edfb16 deleted and replaced by tablet 6e9a5b965cb141e1a5dd1c96f590ad5a
I20260318 02:51:30.168439 893 tablet_service.cc:1558] Processing DeleteTablet for tablet b8a46b4db30a48c99addf763f7edfb16 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e9a5b965cb141e1a5dd1c96f590ad5a) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:30.168500 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet b8a46b4db30a48c99addf763f7edfb16 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e9a5b965cb141e1a5dd1c96f590ad5a) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:30.168877 1174 ts_tablet_manager.cc:1434] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:30.169145 1174 tablet_bootstrap.cc:492] T 4fa6bf38381740a1bab1088ede6ede1c P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:30.169116 763 tablet_service.cc:1558] Processing DeleteTablet for tablet b8a46b4db30a48c99addf763f7edfb16 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e9a5b965cb141e1a5dd1c96f590ad5a) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.169150 1172 ts_tablet_manager.cc:1403] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.026s user 0.011s sys 0.000s
W20260318 02:51:30.169697 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet b8a46b4db30a48c99addf763f7edfb16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8a46b4db30a48c99addf763f7edfb16 already in progress: creating tablet
W20260318 02:51:30.170056 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet b8a46b4db30a48c99addf763f7edfb16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8a46b4db30a48c99addf763f7edfb16 already in progress: creating tablet
I20260318 02:51:30.170012 1172 raft_consensus.cc:359] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.170197 1172 raft_consensus.cc:385] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.170266 1172 raft_consensus.cc:740] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
W20260318 02:51:30.170336 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet b8a46b4db30a48c99addf763f7edfb16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8a46b4db30a48c99addf763f7edfb16 already in progress: creating tablet
I20260318 02:51:30.170523 1172 consensus_queue.cc:260] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.171535 1174 tablet_bootstrap.cc:654] T 4fa6bf38381740a1bab1088ede6ede1c P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.172847 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_deecd27166cf4d969acab284d9e382e0" } modify_external_catalogs: true
I20260318 02:51:30.173027 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_deecd27166cf4d969acab284d9e382e0" } modify_external_catalogs: true
I20260318 02:51:30.177416 1173 tablet_bootstrap.cc:492] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:30.177654 1173 ts_tablet_manager.cc:1403] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.066s user 0.003s sys 0.019s
I20260318 02:51:30.178419 1173 raft_consensus.cc:359] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.178609 1173 raft_consensus.cc:385] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.178696 1173 raft_consensus.cc:740] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.178937 1173 consensus_queue.cc:260] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.182138 1173 ts_tablet_manager.cc:1434] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260318 02:51:30.183446 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_79fa337db6b541168cfa36f0d089c71e" } modify_external_catalogs: true
I20260318 02:51:30.183646 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_79fa337db6b541168cfa36f0d089c71e" } modify_external_catalogs: true
I20260318 02:51:30.184840 1173 tablet_bootstrap.cc:492] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:30.186571 1173 tablet_bootstrap.cc:654] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.187646 1172 ts_tablet_manager.cc:1434] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260318 02:51:30.188325 1174 tablet_bootstrap.cc:492] T 4fa6bf38381740a1bab1088ede6ede1c P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:30.191015 1174 ts_tablet_manager.cc:1403] T 4fa6bf38381740a1bab1088ede6ede1c P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.001s
I20260318 02:51:30.195561 1174 raft_consensus.cc:359] T 4fa6bf38381740a1bab1088ede6ede1c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.195976 1174 raft_consensus.cc:385] T 4fa6bf38381740a1bab1088ede6ede1c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.199811 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_607d1941968145a6a336b9a5bb85b43e" } modify_external_catalogs: true
I20260318 02:51:30.200102 1174 raft_consensus.cc:740] T 4fa6bf38381740a1bab1088ede6ede1c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.200107 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_607d1941968145a6a336b9a5bb85b43e" } modify_external_catalogs: true
I20260318 02:51:30.200187 1172 tablet_bootstrap.cc:492] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:30.200495 1174 consensus_queue.cc:260] T 4fa6bf38381740a1bab1088ede6ede1c P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.201874 1174 ts_tablet_manager.cc:1434] T 4fa6bf38381740a1bab1088ede6ede1c P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260318 02:51:30.202039 1172 tablet_bootstrap.cc:654] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.202756 1174 tablet_bootstrap.cc:492] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:30.204803 1174 tablet_bootstrap.cc:654] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:30.208806 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8b99d05da31c4b77a78a94baf55b28fa consensus state has no leader
I20260318 02:51:30.211774 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b3839730b36c41868e3760527839bafb" } modify_external_catalogs: true
I20260318 02:51:30.211987 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b3839730b36c41868e3760527839bafb" } modify_external_catalogs: true
I20260318 02:51:30.213557 1173 tablet_bootstrap.cc:492] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:30.213732 1173 ts_tablet_manager.cc:1403] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.001s
I20260318 02:51:30.214035 1756 raft_consensus.cc:493] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.214170 1756 raft_consensus.cc:515] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.214587 1173 raft_consensus.cc:359] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.214727 1756 leader_election.cc:290] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:30.214782 1173 raft_consensus.cc:385] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.215224 1173 raft_consensus.cc:740] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.215487 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6794f8a443f41b195fb326d49f56756" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:30.215466 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6794f8a443f41b195fb326d49f56756" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:30.215512 1173 consensus_queue.cc:260] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:30.216042 719 leader_election.cc:343] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:30.216253 719 leader_election.cc:343] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.216317 719 leader_election.cc:304] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:30.217948 1756 raft_consensus.cc:2749] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:30.218135 1173 ts_tablet_manager.cc:1434] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260318 02:51:30.218474 1173 tablet_bootstrap.cc:492] T c5765355efaa4ef4ab3b68ea33f51536 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:30.220225 1173 tablet_bootstrap.cc:654] T c5765355efaa4ef4ab3b68ea33f51536 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:30.222361 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9c05f7a75527410e9c5cde0dbc6bc10e consensus state has no leader
I20260318 02:51:30.222613 1172 tablet_bootstrap.cc:492] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:30.222766 1172 ts_tablet_manager.cc:1403] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.000s
I20260318 02:51:30.223628 1172 raft_consensus.cc:359] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.223878 1174 tablet_bootstrap.cc:492] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:30.223902 1172 raft_consensus.cc:385] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.224021 1174 ts_tablet_manager.cc:1403] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.003s
I20260318 02:51:30.224123 1172 raft_consensus.cc:740] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.224427 1172 consensus_queue.cc:260] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.224789 1174 raft_consensus.cc:359] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.224956 1174 raft_consensus.cc:385] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.225289 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_db8a1a6484c54822ad31ad887f108929"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:30.225006 1174 raft_consensus.cc:740] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
W20260318 02:51:30.225893 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db8a1a6484c54822ad31ad887f108929 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:30.225844 1174 consensus_queue.cc:260] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.226930 1174 ts_tablet_manager.cc:1434] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:30.227401 1174 tablet_bootstrap.cc:492] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:30.228564 1172 ts_tablet_manager.cc:1434] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260318 02:51:30.229483 1174 tablet_bootstrap.cc:654] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.232321 1172 tablet_bootstrap.cc:492] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:30.235210 1172 tablet_bootstrap.cc:654] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.237250 893 tablet_service.cc:1558] Processing DeleteTablet for tablet f447cab3445c451d8ef8746966cfcd42 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c5038e9e1074f46976a1a5bb4282944) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:30.237583 1175 tablet_replica.cc:333] T f447cab3445c451d8ef8746966cfcd42 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:30.237775 1175 raft_consensus.cc:2243] T f447cab3445c451d8ef8746966cfcd42 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:30.237960 1175 raft_consensus.cc:2272] T f447cab3445c451d8ef8746966cfcd42 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:30.238921 1175 ts_tablet_manager.cc:1916] T f447cab3445c451d8ef8746966cfcd42 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:30.240792 1709 raft_consensus.cc:493] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.240955 1709 raft_consensus.cc:515] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.241575 1709 leader_election.cc:290] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.242180 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c542a51864e54871efc5e7f62ef61" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:30.242390 1064 raft_consensus.cc:2468] T 918c542a51864e54871efc5e7f62ef61 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:30.242831 860 leader_election.cc:304] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:30.243824 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c542a51864e54871efc5e7f62ef61" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:30.244004 784 raft_consensus.cc:2468] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
W20260318 02:51:30.244601 444 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 9c05f7a75527410e9c5cde0dbc6bc10e (table default.Table_3096d9a574d24640a9efe555f7b58d4f [id=113b6b3abc1a4dcc91c49be4704a159c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9c05f7a75527410e9c5cde0dbc6bc10e consensus state has no leader
I20260318 02:51:30.245203 1709 raft_consensus.cc:2804] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:30.245304 1709 raft_consensus.cc:493] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:30.245417 1709 raft_consensus.cc:3060] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.248401 1709 raft_consensus.cc:515] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.250105 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c542a51864e54871efc5e7f62ef61" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:30.250337 1064 raft_consensus.cc:3060] T 918c542a51864e54871efc5e7f62ef61 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.250516 1175 ts_tablet_manager.cc:1929] T f447cab3445c451d8ef8746966cfcd42 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:30.250664 1175 log.cc:1199] T f447cab3445c451d8ef8746966cfcd42 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/f447cab3445c451d8ef8746966cfcd42
I20260318 02:51:30.251199 1175 ts_tablet_manager.cc:1950] T f447cab3445c451d8ef8746966cfcd42 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:30.252558 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet f447cab3445c451d8ef8746966cfcd42 (table default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]) successfully deleted
I20260318 02:51:30.254179 1064 raft_consensus.cc:2468] T 918c542a51864e54871efc5e7f62ef61 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:30.254958 1174 tablet_bootstrap.cc:492] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:30.255110 1174 ts_tablet_manager.cc:1403] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.004s
I20260318 02:51:30.254973 860 leader_election.cc:304] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:30.255728 1780 raft_consensus.cc:2804] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:30.255896 1780 raft_consensus.cc:697] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:30.255898 1174 raft_consensus.cc:359] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.256078 1174 raft_consensus.cc:385] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.256129 1174 raft_consensus.cc:740] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.256354 1174 consensus_queue.cc:260] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.256253 1780 consensus_queue.cc:237] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.256868 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918c542a51864e54871efc5e7f62ef61" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:30.257100 784 raft_consensus.cc:3060] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.257521 1174 ts_tablet_manager.cc:1434] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:30.257999 1174 tablet_bootstrap.cc:492] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:30.259740 1174 tablet_bootstrap.cc:654] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.261965 1172 tablet_bootstrap.cc:492] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:30.262249 1172 ts_tablet_manager.cc:1403] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.008s
I20260318 02:51:30.263149 1172 raft_consensus.cc:359] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.263486 1172 raft_consensus.cc:385] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.263599 1172 raft_consensus.cc:740] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.263921 1172 consensus_queue.cc:260] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.264278 784 raft_consensus.cc:2468] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:30.264528 1174 tablet_bootstrap.cc:492] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:30.264652 1174 ts_tablet_manager.cc:1403] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.002s
I20260318 02:51:30.265173 1709 leader_election.cc:290] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.265436 1174 raft_consensus.cc:359] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.265590 1174 raft_consensus.cc:385] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.265642 1174 raft_consensus.cc:740] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.265828 1174 consensus_queue.cc:260] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.266098 1172 ts_tablet_manager.cc:1434] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:30.266535 1174 ts_tablet_manager.cc:1434] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:30.266827 1174 tablet_bootstrap.cc:492] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:30.267298 1172 tablet_bootstrap.cc:492] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:30.268918 1174 tablet_bootstrap.cc:654] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.270406 1172 tablet_bootstrap.cc:654] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.278980 1174 tablet_bootstrap.cc:492] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:30.279151 1174 ts_tablet_manager.cc:1403] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.003s
I20260318 02:51:30.279964 1173 tablet_bootstrap.cc:492] T c5765355efaa4ef4ab3b68ea33f51536 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:30.279973 1174 raft_consensus.cc:359] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.280148 1174 raft_consensus.cc:385] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.280210 1174 raft_consensus.cc:740] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.280318 1173 ts_tablet_manager.cc:1403] T c5765355efaa4ef4ab3b68ea33f51536 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.062s user 0.011s sys 0.007s
I20260318 02:51:30.280421 1174 consensus_queue.cc:260] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.281208 1174 ts_tablet_manager.cc:1434] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:30.281242 1173 raft_consensus.cc:359] T c5765355efaa4ef4ab3b68ea33f51536 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.281488 1174 tablet_bootstrap.cc:492] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:30.281574 1173 raft_consensus.cc:385] T c5765355efaa4ef4ab3b68ea33f51536 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.281723 1173 raft_consensus.cc:740] T c5765355efaa4ef4ab3b68ea33f51536 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.281999 1173 consensus_queue.cc:260] T c5765355efaa4ef4ab3b68ea33f51536 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.282548 1173 ts_tablet_manager.cc:1434] T c5765355efaa4ef4ab3b68ea33f51536 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:30.282881 1173 tablet_bootstrap.cc:492] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:30.283228 1174 tablet_bootstrap.cc:654] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.284847 1173 tablet_bootstrap.cc:654] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.286657 1172 tablet_bootstrap.cc:492] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:30.286885 1172 ts_tablet_manager.cc:1403] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.002s
I20260318 02:51:30.287750 1172 raft_consensus.cc:359] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.288029 1172 raft_consensus.cc:385] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.288158 1172 raft_consensus.cc:740] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.288345 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2bac6e37bc644cc1952a524104c54eda" } new_table_name: "default.Table_be9d84a16e6f4af1a80125375ccfc8bb" modify_external_catalogs: true
I20260318 02:51:30.288450 1172 consensus_queue.cc:260] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.290583 1172 ts_tablet_manager.cc:1434] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260318 02:51:30.291229 1172 tablet_bootstrap.cc:492] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:30.292990 1174 tablet_bootstrap.cc:492] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:30.293125 1174 ts_tablet_manager.cc:1403] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.006s
I20260318 02:51:30.293884 1174 raft_consensus.cc:359] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.294062 1174 raft_consensus.cc:385] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.294124 1174 raft_consensus.cc:740] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.294323 1174 consensus_queue.cc:260] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.295106 1174 ts_tablet_manager.cc:1434] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:30.294919 1172 tablet_bootstrap.cc:654] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.295388 1174 tablet_bootstrap.cc:492] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:30.297425 1174 tablet_bootstrap.cc:654] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.298095 1173 tablet_bootstrap.cc:492] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:30.298363 1173 ts_tablet_manager.cc:1403] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.001s
I20260318 02:51:30.299189 1173 raft_consensus.cc:359] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.299448 1173 raft_consensus.cc:385] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.299556 1173 raft_consensus.cc:740] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.299849 1173 consensus_queue.cc:260] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.300912 1173 ts_tablet_manager.cc:1434] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:30.301299 1173 tablet_bootstrap.cc:492] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:30.303088 1740 consensus_queue.cc:1048] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:30.304195 1173 tablet_bootstrap.cc:654] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.304668 1756 raft_consensus.cc:493] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.304845 1756 raft_consensus.cc:515] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.305459 1756 leader_election.cc:290] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:30.306293 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104cd36774df4bc0adf1d449224304d5" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:30.306383 1172 tablet_bootstrap.cc:492] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:30.306679 1172 ts_tablet_manager.cc:1403] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.002s
W20260318 02:51:30.306805 719 leader_election.cc:343] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.307355 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104cd36774df4bc0adf1d449224304d5" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:30.307729 1172 raft_consensus.cc:359] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:30.307855 719 leader_election.cc:343] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.307969 719 leader_election.cc:304] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:30.308126 1172 raft_consensus.cc:385] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.308257 1172 raft_consensus.cc:740] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.308315 1756 raft_consensus.cc:2749] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:30.308614 1172 consensus_queue.cc:260] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.311432 1172 ts_tablet_manager.cc:1434] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:30.312665 1172 tablet_bootstrap.cc:492] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:30.314332 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_bd7b316d378c4633a0bb8139d43fbb62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:30.315088 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd7b316d378c4633a0bb8139d43fbb62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:30.316421 1172 tablet_bootstrap.cc:654] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.318681 418 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu
/tmp/dist-test-taskvjTIu6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.104.189:45933
--webserver_interface=127.0.104.189
--webserver_port=44181
--builtin_ntp_servers=127.0.104.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.104.190:39451,127.0.104.189:45933,127.0.104.188:41593
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260318 02:51:30.320045 1173 tablet_bootstrap.cc:492] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:30.320205 1173 ts_tablet_manager.cc:1403] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.001s
I20260318 02:51:30.321055 1173 raft_consensus.cc:359] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.321214 1173 raft_consensus.cc:385] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.321283 1173 raft_consensus.cc:740] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.321527 1173 consensus_queue.cc:260] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.322041 1173 ts_tablet_manager.cc:1434] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:30.322384 1173 tablet_bootstrap.cc:492] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:30.324117 1173 tablet_bootstrap.cc:654] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.330492 893 tablet_service.cc:1511] Processing CreateTablet for tablet f5ff3ee3ae21470a9bb636f03399d223 (DEFAULT_TABLE table=default.Table_ac071828b4034d5a9bf1ffbdf5e40849 [id=98f5da1bafe4477e8bc12311c233c376]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.331027 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ff3ee3ae21470a9bb636f03399d223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.331190 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 918c542a51864e54871efc5e7f62ef61 (table default.Table_a168ed2816204e05aa65aaed95173a8f [id=ee10bea676fa4d1a837737c939f3306b]). Expected version 5 got 0
I20260318 02:51:30.333684 456 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet b5c19bc5e07949088c84cedbf944dfdb (table default.Table_cec1585fa5824e7682f05533101d20eb [id=873432f002e14a4fa7065dcfe5caebd5]). Expected version 5 got 0
I20260318 02:51:30.334895 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 29541950221544e396ada303fbbb5002 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.335484 453 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 918c542a51864e54871efc5e7f62ef61 (table default.Table_a168ed2816204e05aa65aaed95173a8f [id=ee10bea676fa4d1a837737c939f3306b]). Expected version 5 got 0
W20260318 02:51:30.335564 443 catalog_manager.cc:4969] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 29541950221544e396ada303fbbb5002 because the tablet was not found. No further retry: Not found: Tablet not found: 29541950221544e396ada303fbbb5002
I20260318 02:51:30.336418 763 tablet_service.cc:1511] Processing CreateTablet for tablet f5ff3ee3ae21470a9bb636f03399d223 (DEFAULT_TABLE table=default.Table_ac071828b4034d5a9bf1ffbdf5e40849 [id=98f5da1bafe4477e8bc12311c233c376]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.336855 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ff3ee3ae21470a9bb636f03399d223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.337636 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 916f7a2a31f843e39f8703ba72b78287 (DEFAULT_TABLE table=default.Table_1f0223a1a57a4f84850ba99f63de7e9f [id=f524b48a30e94d348ce07ae2fcf12131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.337882 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9a32a6a0fa46938cdc85b656f4e562 (DEFAULT_TABLE table=default.Table_1136fb5f74264862b0dee0926825df6a [id=65d1f791063046758931d2771b76e4f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.338084 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916f7a2a31f843e39f8703ba72b78287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.338363 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 0652fc250fa04565b069bb767530d747 (DEFAULT_TABLE table=default.Table_3122f85862b74242a50f9d08dc75e6cf [id=f309f832e6a54c10a1c6979ef40b0c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.338665 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0652fc250fa04565b069bb767530d747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.341049 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 4e54f71cd47a4738b0f640382edee907 (DEFAULT_TABLE table=default.Table_c880704226ff4e89bf538efec8f0b892 [id=4579cade035a47cb863c71a9b33352b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.341064 759 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9a32a6a0fa46938cdc85b656f4e562 (DEFAULT_TABLE table=default.Table_1136fb5f74264862b0dee0926825df6a [id=65d1f791063046758931d2771b76e4f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.341393 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e54f71cd47a4738b0f640382edee907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.341423 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9a32a6a0fa46938cdc85b656f4e562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.337641 1028 tablet_service.cc:1511] Processing CreateTablet for tablet f5ff3ee3ae21470a9bb636f03399d223 (DEFAULT_TABLE table=default.Table_ac071828b4034d5a9bf1ffbdf5e40849 [id=98f5da1bafe4477e8bc12311c233c376]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.345023 758 tablet_service.cc:1511] Processing CreateTablet for tablet 0652fc250fa04565b069bb767530d747 (DEFAULT_TABLE table=default.Table_3122f85862b74242a50f9d08dc75e6cf [id=f309f832e6a54c10a1c6979ef40b0c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.345291 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ff3ee3ae21470a9bb636f03399d223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.345372 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0652fc250fa04565b069bb767530d747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.349084 747 tablet_service.cc:1511] Processing CreateTablet for tablet 916f7a2a31f843e39f8703ba72b78287 (DEFAULT_TABLE table=default.Table_1f0223a1a57a4f84850ba99f63de7e9f [id=f524b48a30e94d348ce07ae2fcf12131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.349457 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916f7a2a31f843e39f8703ba72b78287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.353011 757 tablet_service.cc:1511] Processing CreateTablet for tablet 4e54f71cd47a4738b0f640382edee907 (DEFAULT_TABLE table=default.Table_c880704226ff4e89bf538efec8f0b892 [id=4579cade035a47cb863c71a9b33352b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.353392 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e54f71cd47a4738b0f640382edee907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.356985 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9a32a6a0fa46938cdc85b656f4e562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.357091 1740 raft_consensus.cc:493] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.357244 1740 raft_consensus.cc:515] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.357911 1740 leader_election.cc:290] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:30.359261 1174 tablet_bootstrap.cc:492] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:30.359390 1174 ts_tablet_manager.cc:1403] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.064s user 0.007s sys 0.013s
I20260318 02:51:30.361054 1174 raft_consensus.cc:359] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.361238 1174 raft_consensus.cc:385] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.361208 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab158343adb14eab85c595fa5405145d" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:30.361294 1174 raft_consensus.cc:740] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.361357 785 raft_consensus.cc:2468] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:30.361840 999 leader_election.cc:304] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:30.362313 1740 raft_consensus.cc:2804] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:30.362443 1740 raft_consensus.cc:493] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:30.362533 1740 raft_consensus.cc:3060] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.362497 1174 consensus_queue.cc:260] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.365513 1174 ts_tablet_manager.cc:1434] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260318 02:51:30.370544 1174 tablet_bootstrap.cc:492] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:30.372926 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_33930f6668f341159c318db9160c142a" } modify_external_catalogs: true
I20260318 02:51:30.373154 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_33930f6668f341159c318db9160c142a" } modify_external_catalogs: true
I20260318 02:51:30.374619 1760 raft_consensus.cc:493] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.374838 1760 raft_consensus.cc:515] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.375512 1760 leader_election.cc:290] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:30.375664 1813 consensus_queue.cc:1048] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:30.380882 1740 raft_consensus.cc:515] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.381649 1740 leader_election.cc:290] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
W20260318 02:51:30.384861 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a6f56dafead404eb1720276b07ea733 consensus state has no leader
I20260318 02:51:30.385629 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab158343adb14eab85c595fa5405145d" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:30.385835 785 raft_consensus.cc:3060] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.387316 889 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9a32a6a0fa46938cdc85b656f4e562 (DEFAULT_TABLE table=default.Table_1136fb5f74264862b0dee0926825df6a [id=65d1f791063046758931d2771b76e4f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.388612 785 raft_consensus.cc:2468] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:30.392176 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab158343adb14eab85c595fa5405145d" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:30.392517 925 raft_consensus.cc:2468] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:30.393190 899 tablet_service.cc:1511] Processing CreateTablet for tablet 916f7a2a31f843e39f8703ba72b78287 (DEFAULT_TABLE table=default.Table_1f0223a1a57a4f84850ba99f63de7e9f [id=f524b48a30e94d348ce07ae2fcf12131]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.393603 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916f7a2a31f843e39f8703ba72b78287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.394788 892 tablet_service.cc:1511] Processing CreateTablet for tablet 0652fc250fa04565b069bb767530d747 (DEFAULT_TABLE table=default.Table_3122f85862b74242a50f9d08dc75e6cf [id=f309f832e6a54c10a1c6979ef40b0c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.395259 999 leader_election.cc:304] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:30.389043 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c20810ad3354126bf49bbeeb6edb098" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:30.395834 784 raft_consensus.cc:2468] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:30.395963 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9a32a6a0fa46938cdc85b656f4e562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.395921 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab158343adb14eab85c595fa5405145d" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:30.395932 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c20810ad3354126bf49bbeeb6edb098" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:30.395944 891 tablet_service.cc:1511] Processing CreateTablet for tablet 4e54f71cd47a4738b0f640382edee907 (DEFAULT_TABLE table=default.Table_c880704226ff4e89bf538efec8f0b892 [id=4579cade035a47cb863c71a9b33352b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.396512 999 leader_election.cc:304] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:30.396860 1760 raft_consensus.cc:2804] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
W20260318 02:51:30.398175 997 leader_election.cc:343] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.398519 926 raft_consensus.cc:3060] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.399340 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e54f71cd47a4738b0f640382edee907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.399626 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 33f93d766c44461cb0f5f4bfba09a744
I20260318 02:51:30.400249 454 master_service.cc:954] ReplaceTablet: received request to replace tablet c6e16e3e8feb42568c8f6d4a470877d0 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:30.400488 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 33f93d766c44461cb0f5f4bfba09a744 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.401985 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0652fc250fa04565b069bb767530d747. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:30.401971 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 33f93d766c44461cb0f5f4bfba09a744 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33f93d766c44461cb0f5f4bfba09a744 already in progress: creating tablet
I20260318 02:51:30.402068 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 33f93d766c44461cb0f5f4bfba09a744 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:30.402693 905 tablet_service.cc:1558] Processing DeleteTablet for tablet 33f93d766c44461cb0f5f4bfba09a744 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:30.402971 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 33f93d766c44461cb0f5f4bfba09a744 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33f93d766c44461cb0f5f4bfba09a744 already in progress: creating tablet
W20260318 02:51:30.403393 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 33f93d766c44461cb0f5f4bfba09a744 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33f93d766c44461cb0f5f4bfba09a744 already in progress: creating tablet
I20260318 02:51:30.403698 1740 raft_consensus.cc:2804] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:30.404191 1740 raft_consensus.cc:493] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:30.407016 1740 raft_consensus.cc:3060] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.408758 926 raft_consensus.cc:2468] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:30.411130 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5e2b468b791348fe97d627711ff12f94" } new_table_name: "default.Table_c9bc81a187a443318d1f42d64fd9330a" modify_external_catalogs: true
I20260318 02:51:30.419142 1740 raft_consensus.cc:515] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.420861 1174 tablet_bootstrap.cc:654] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.426550 1173 tablet_bootstrap.cc:492] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:30.426776 1173 ts_tablet_manager.cc:1403] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.104s user 0.002s sys 0.010s
I20260318 02:51:30.427846 1173 raft_consensus.cc:359] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.428114 1173 raft_consensus.cc:385] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.428220 1173 raft_consensus.cc:740] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.428509 1173 consensus_queue.cc:260] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.429170 1173 ts_tablet_manager.cc:1434] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260318 02:51:30.429536 1173 tablet_bootstrap.cc:492] T d6a08d8bbe3a4234b97203536db32078 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:30.431612 1173 tablet_bootstrap.cc:654] T d6a08d8bbe3a4234b97203536db32078 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.435894 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c20810ad3354126bf49bbeeb6edb098" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:30.436297 785 raft_consensus.cc:3060] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.437426 1173 tablet_bootstrap.cc:492] T d6a08d8bbe3a4234b97203536db32078 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:30.437608 1173 ts_tablet_manager.cc:1403] T d6a08d8bbe3a4234b97203536db32078 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260318 02:51:30.438447 1173 raft_consensus.cc:359] T d6a08d8bbe3a4234b97203536db32078 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.438683 1173 raft_consensus.cc:385] T d6a08d8bbe3a4234b97203536db32078 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.438787 1173 raft_consensus.cc:740] T d6a08d8bbe3a4234b97203536db32078 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.439076 1173 consensus_queue.cc:260] T d6a08d8bbe3a4234b97203536db32078 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.439657 785 raft_consensus.cc:2468] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:30.439692 1173 ts_tablet_manager.cc:1434] T d6a08d8bbe3a4234b97203536db32078 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:30.440060 1173 tablet_bootstrap.cc:492] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:30.440275 999 leader_election.cc:304] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:30.440840 1813 raft_consensus.cc:2804] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:30.441043 1813 raft_consensus.cc:697] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:30.441359 1813 consensus_queue.cc:237] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.442714 1740 leader_election.cc:290] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:30.443710 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c20810ad3354126bf49bbeeb6edb098" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:30.444171 997 leader_election.cc:343] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.444841 1172 tablet_bootstrap.cc:492] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:30.445026 1172 ts_tablet_manager.cc:1403] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.132s user 0.015s sys 0.016s
I20260318 02:51:30.446015 1172 raft_consensus.cc:359] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.446228 1172 raft_consensus.cc:385] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.446321 1172 raft_consensus.cc:740] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.446573 1172 consensus_queue.cc:260] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.447194 1172 ts_tablet_manager.cc:1434] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:30.447528 1172 tablet_bootstrap.cc:492] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:30.449635 1172 tablet_bootstrap.cc:654] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.452680 1173 tablet_bootstrap.cc:654] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.459182 1173 tablet_bootstrap.cc:492] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:30.459477 1173 ts_tablet_manager.cc:1403] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.004s
I20260318 02:51:30.460319 1760 raft_consensus.cc:697] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:30.460826 1760 consensus_queue.cc:237] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.461697 1172 tablet_bootstrap.cc:492] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:30.461894 1172 ts_tablet_manager.cc:1403] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.003s
I20260318 02:51:30.462826 1172 raft_consensus.cc:359] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.463042 1172 raft_consensus.cc:385] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.463128 1172 raft_consensus.cc:740] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.463376 1172 consensus_queue.cc:260] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.463902 1172 ts_tablet_manager.cc:1434] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:30.466328 1172 tablet_bootstrap.cc:492] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:30.468019 1172 tablet_bootstrap.cc:654] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.460583 1173 raft_consensus.cc:359] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.468919 1173 raft_consensus.cc:385] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.469036 1173 raft_consensus.cc:740] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.469260 1173 consensus_queue.cc:260] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.469731 1173 ts_tablet_manager.cc:1434] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260318 02:51:30.470077 1173 tablet_bootstrap.cc:492] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:30.471774 1173 tablet_bootstrap.cc:654] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.477470 1172 tablet_bootstrap.cc:492] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:30.477648 1172 ts_tablet_manager.cc:1403] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.001s
I20260318 02:51:30.478433 1172 raft_consensus.cc:359] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.478515 1174 tablet_bootstrap.cc:492] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:30.478587 1172 raft_consensus.cc:385] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.478650 1172 raft_consensus.cc:740] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.478691 1174 ts_tablet_manager.cc:1403] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.108s user 0.012s sys 0.028s
I20260318 02:51:30.478803 1172 consensus_queue.cc:260] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.479439 1174 raft_consensus.cc:359] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.479637 1174 raft_consensus.cc:385] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.479712 1174 raft_consensus.cc:740] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.479945 1174 consensus_queue.cc:260] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.482610 1780 raft_consensus.cc:493] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.482802 1780 raft_consensus.cc:515] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.483333 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 977a25a368734b11a8b2cefef88be651
I20260318 02:51:30.483404 1780 leader_election.cc:290] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.484252 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 99b4933dda1e465bb1d14d20433f3772
I20260318 02:51:30.484516 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 977a25a368734b11a8b2cefef88be651 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:30.485340 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 9451d57fad72413c81443623c7995d4e
I20260318 02:51:30.485405 1172 ts_tablet_manager.cc:1434] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260318 02:51:30.485704 452 catalog_manager.cc:6741] ReplaceTablet: tablet 9451d57fad72413c81443623c7995d4e deleted and replaced by tablet 535ff4839c9646a594db820dd5308d70
I20260318 02:51:30.485917 1172 tablet_bootstrap.cc:492] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:30.485949 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 977a25a368734b11a8b2cefef88be651 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 977a25a368734b11a8b2cefef88be651 already in progress: creating tablet
I20260318 02:51:30.487250 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 9451d57fad72413c81443623c7995d4e with delete_type TABLET_DATA_DELETED (replaced by tablet 535ff4839c9646a594db820dd5308d70) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:30.487614 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e16272bcf9c435a80b32ba9cba9c738" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:30.487907 1064 raft_consensus.cc:2468] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:30.487253 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 99b4933dda1e465bb1d14d20433f3772 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:30.488292 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 977a25a368734b11a8b2cefef88be651 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:30.488581 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 99b4933dda1e465bb1d14d20433f3772 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:30.488911 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 9451d57fad72413c81443623c7995d4e with delete_type TABLET_DATA_DELETED (replaced by tablet 535ff4839c9646a594db820dd5308d70) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:30.489107 1172 tablet_bootstrap.cc:654] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.489213 860 leader_election.cc:304] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:30.490075 1780 raft_consensus.cc:2804] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260318 02:51:30.490144 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 9451d57fad72413c81443623c7995d4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9451d57fad72413c81443623c7995d4e already in progress: creating tablet
I20260318 02:51:30.490173 1780 raft_consensus.cc:493] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:30.490273 1780 raft_consensus.cc:3060] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:30.490423 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 99b4933dda1e465bb1d14d20433f3772 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99b4933dda1e465bb1d14d20433f3772 already in progress: creating tablet
I20260318 02:51:30.491441 1173 tablet_bootstrap.cc:492] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:30.491603 1173 ts_tablet_manager.cc:1403] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.003s
W20260318 02:51:30.491652 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 977a25a368734b11a8b2cefef88be651 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 977a25a368734b11a8b2cefef88be651 already in progress: creating tablet
W20260318 02:51:30.491910 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 99b4933dda1e465bb1d14d20433f3772 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99b4933dda1e465bb1d14d20433f3772 already in progress: creating tablet
W20260318 02:51:30.492118 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 9451d57fad72413c81443623c7995d4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9451d57fad72413c81443623c7995d4e already in progress: creating tablet
I20260318 02:51:30.492466 1173 raft_consensus.cc:359] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.492645 1173 raft_consensus.cc:385] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.492751 1173 raft_consensus.cc:740] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.493019 1173 consensus_queue.cc:260] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.495220 1174 ts_tablet_manager.cc:1434] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.016s user 0.000s sys 0.005s
I20260318 02:51:30.497115 1172 tablet_bootstrap.cc:492] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:30.497295 1172 ts_tablet_manager.cc:1403] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.001s
I20260318 02:51:30.497700 1174 tablet_bootstrap.cc:492] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:30.498353 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 9451d57fad72413c81443623c7995d4e with delete_type TABLET_DATA_DELETED (replaced by tablet 535ff4839c9646a594db820dd5308d70) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.498988 1172 raft_consensus.cc:359] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.499189 1172 raft_consensus.cc:385] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.499285 1172 raft_consensus.cc:740] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.499334 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 99b4933dda1e465bb1d14d20433f3772 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.499549 1172 consensus_queue.cc:260] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.499670 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 977a25a368734b11a8b2cefef88be651 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:30.500424 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 9451d57fad72413c81443623c7995d4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9451d57fad72413c81443623c7995d4e already in progress: creating tablet
I20260318 02:51:30.500214 1172 ts_tablet_manager.cc:1434] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:30.500743 1780 raft_consensus.cc:515] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.500929 1172 tablet_bootstrap.cc:492] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:30.501565 1174 tablet_bootstrap.cc:654] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.501778 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e16272bcf9c435a80b32ba9cba9c738" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:30.501978 1064 raft_consensus.cc:3060] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:30.502601 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 99b4933dda1e465bb1d14d20433f3772 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99b4933dda1e465bb1d14d20433f3772 already in progress: creating tablet
I20260318 02:51:30.502866 1172 tablet_bootstrap.cc:654] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:30.502887 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 977a25a368734b11a8b2cefef88be651 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 977a25a368734b11a8b2cefef88be651 already in progress: creating tablet
I20260318 02:51:30.505033 1064 raft_consensus.cc:2468] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:30.499024 1173 ts_tablet_manager.cc:1434] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260318 02:51:30.505524 860 leader_election.cc:304] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:30.506904 1709 raft_consensus.cc:2804] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:30.507091 1709 raft_consensus.cc:697] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:30.511294 1780 leader_election.cc:290] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.513370 1830 raft_consensus.cc:493] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260318 02:51:30.513654 862 leader_election.cc:343] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2e16272bcf9c435a80b32ba9cba9c738
I20260318 02:51:30.513590 1830 raft_consensus.cc:515] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.514366 1830 leader_election.cc:290] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:30.515008 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ab476b9a54cc586a4c28e23382bfc" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:30.515187 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ab476b9a54cc586a4c28e23382bfc" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:30.515600 719 leader_election.cc:343] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:30.515834 719 leader_election.cc:343] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.515923 719 leader_election.cc:304] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:30.516388 1830 raft_consensus.cc:2749] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:30.516889 862 leader_election.cc:343] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2e16272bcf9c435a80b32ba9cba9c738
I20260318 02:51:30.524204 1173 tablet_bootstrap.cc:492] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:30.526536 1173 tablet_bootstrap.cc:654] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.532056 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet c6e16e3e8feb42568c8f6d4a470877d0
I20260318 02:51:30.532176 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 5ff188f25ff146fab121ebfab1af8467
I20260318 02:51:30.533402 891 tablet_service.cc:1558] Processing DeleteTablet for tablet c6e16e3e8feb42568c8f6d4a470877d0 with delete_type TABLET_DATA_DELETED (replaced by tablet 52b773c3412c4bc792471096802b3f1a) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:30.533622 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet c6e16e3e8feb42568c8f6d4a470877d0 with delete_type TABLET_DATA_DELETED (replaced by tablet 52b773c3412c4bc792471096802b3f1a) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:30.532935 454 catalog_manager.cc:6741] ReplaceTablet: tablet c6e16e3e8feb42568c8f6d4a470877d0 deleted and replaced by tablet 52b773c3412c4bc792471096802b3f1a
I20260318 02:51:30.534497 758 tablet_service.cc:1558] Processing DeleteTablet for tablet c6e16e3e8feb42568c8f6d4a470877d0 with delete_type TABLET_DATA_DELETED (replaced by tablet 52b773c3412c4bc792471096802b3f1a) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.534616 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ff188f25ff146fab121ebfab1af8467 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:30.534466 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ff188f25ff146fab121ebfab1af8467 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.534996 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ff188f25ff146fab121ebfab1af8467 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:30.535177 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet c6e16e3e8feb42568c8f6d4a470877d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6e16e3e8feb42568c8f6d4a470877d0 already in progress: creating tablet
W20260318 02:51:30.535807 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 5ff188f25ff146fab121ebfab1af8467 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ff188f25ff146fab121ebfab1af8467 already in progress: creating tablet
W20260318 02:51:30.536248 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet c6e16e3e8feb42568c8f6d4a470877d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6e16e3e8feb42568c8f6d4a470877d0 already in progress: creating tablet
W20260318 02:51:30.536500 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 5ff188f25ff146fab121ebfab1af8467 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ff188f25ff146fab121ebfab1af8467 already in progress: creating tablet
W20260318 02:51:30.536756 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet c6e16e3e8feb42568c8f6d4a470877d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c6e16e3e8feb42568c8f6d4a470877d0 already in progress: creating tablet
W20260318 02:51:30.536957 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 5ff188f25ff146fab121ebfab1af8467 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5ff188f25ff146fab121ebfab1af8467 already in progress: creating tablet
I20260318 02:51:30.537906 1172 tablet_bootstrap.cc:492] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
W20260318 02:51:30.538116 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 71ea229381d540fdae9b2d7bf3eac2b6 has no consensus state
I20260318 02:51:30.538159 1172 ts_tablet_manager.cc:1403] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.037s user 0.012s sys 0.015s
I20260318 02:51:30.539419 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_4628ee4bf3294e908b99ec30079b8cc9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:30.539638 1172 raft_consensus.cc:359] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.539825 1172 raft_consensus.cc:385] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.539909 1172 raft_consensus.cc:740] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.540024 1709 consensus_queue.cc:237] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.540141 1172 consensus_queue.cc:260] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.540481 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_42a80fd8d8eb4cffadcbe255e0c315b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:30.541047 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42a80fd8d8eb4cffadcbe255e0c315b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:30.541249 1172 ts_tablet_manager.cc:1434] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:30.541522 1172 tablet_bootstrap.cc:492] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:30.542603 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9cec0b03f7c349e796f0e677adc54d0c" } new_table_name: "default.Table_011412ca9e304055969a0ba44b82c555" modify_external_catalogs: true
I20260318 02:51:30.543426 1172 tablet_bootstrap.cc:654] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.544988 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_593af5f4ba59487a8dd335fdb4048253"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:30.545526 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_593af5f4ba59487a8dd335fdb4048253 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:30.546854 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ca9ce0c2522f46caaaf7d3081ec90c71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:30.547366 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca9ce0c2522f46caaaf7d3081ec90c71 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:30.548971 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_15ff9e631a4c46349b3addf65f585e69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:30.549540 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15ff9e631a4c46349b3addf65f585e69 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:30.551054 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4628ee4bf3294e908b99ec30079b8cc9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:30.556402 1173 tablet_bootstrap.cc:492] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:30.556587 1173 ts_tablet_manager.cc:1403] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.006s
I20260318 02:51:30.557411 1173 raft_consensus.cc:359] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.557583 1173 raft_consensus.cc:385] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.557634 1173 raft_consensus.cc:740] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.557832 1173 consensus_queue.cc:260] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.558281 1173 ts_tablet_manager.cc:1434] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:30.558557 1173 tablet_bootstrap.cc:492] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:30.560158 1173 tablet_bootstrap.cc:654] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:30.561518 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d0b01131720748688ca6c28985a3b3ff consensus state has no leader
I20260318 02:51:30.564056 449 master_service.cc:954] ReplaceTablet: received request to replace tablet a0a6f4b34ff14714892ed9e9b3604dc9 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:30.593693 1830 raft_consensus.cc:493] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.593906 1830 raft_consensus.cc:515] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.594583 1830 leader_election.cc:290] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:30.595570 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b716c3a80d4a44d190de38f926098efc" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:30.596299 719 leader_election.cc:343] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.596894 1760 consensus_queue.cc:1048] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:30.597193 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b716c3a80d4a44d190de38f926098efc" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:30.597743 1760 raft_consensus.cc:493] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.597926 1760 raft_consensus.cc:515] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.598536 1760 leader_election.cc:290] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:30.599685 719 leader_election.cc:343] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.599848 719 leader_election.cc:304] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:30.599928 997 leader_election.cc:343] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: 5db76f996b094bf99b6c6fe33f02b9f3
W20260318 02:51:30.600231 999 leader_election.cc:343] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 5db76f996b094bf99b6c6fe33f02b9f3
I20260318 02:51:30.600255 1830 raft_consensus.cc:2749] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:30.600344 999 leader_election.cc:304] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:30.600690 1760 raft_consensus.cc:2749] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:30.605777 927 raft_consensus.cc:3060] T d6a08d8bbe3a4234b97203536db32078 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.613062 1817 consensus_queue.cc:1048] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:30.624666 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_10187817db2d460889de2a6e1b646b2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:30.625478 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10187817db2d460889de2a6e1b646b2d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:30.627012 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a23a3971bb3546c6ad6966b77bf7a8ba" } new_table_name: "default.Table_cce439d1cd8d4d6db1ccc4b4b31dbbe0" modify_external_catalogs: true
I20260318 02:51:30.628455 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a614370b71c542db819ec98834a87cec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:30.628999 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a614370b71c542db819ec98834a87cec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:30.629190 1830 raft_consensus.cc:493] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.629387 1830 raft_consensus.cc:515] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.630115 1830 leader_election.cc:290] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:30.631254 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b230018a95a54ababfe5ecf2ca1e2e49" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:30.631803 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b230018a95a54ababfe5ecf2ca1e2e49" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:30.632071 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7852bda585cb4d9b99d507f2a7ddaec6" } new_table_name: "default.Table_2fab8241144b4ef39c7a088f8829bb80" modify_external_catalogs: true
W20260318 02:51:30.633319 719 leader_election.cc:343] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:30.633579 719 leader_election.cc:343] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.633678 719 leader_election.cc:304] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:30.634230 1830 raft_consensus.cc:2749] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:30.636790 456 master_service.cc:954] ReplaceTablet: received request to replace tablet 0e99c2956a764e6cb07cbc41e4a6f2f8 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:30.637140 1830 raft_consensus.cc:493] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.637306 1830 raft_consensus.cc:515] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.637959 1830 leader_election.cc:290] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:30.638936 457 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet ce0ab476b9a54cc586a4c28e23382bfc (table default.Table_51fd1fd451544782b3785014979adeba [id=94288205d88b4c6ca1f94de1b201a349]). Expected version 1 got 0
I20260318 02:51:30.638962 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa7c1d6879c40ebb8d989ebae205e9e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:30.639104 457 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 104cd36774df4bc0adf1d449224304d5 (table default.Table_c978284529db4de7883f9f0664c4a158 [id=8b5e3535d9e44b1a86dc59211a31deb6]). Expected version 1 got 0
W20260318 02:51:30.639672 719 leader_election.cc:343] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.639979 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa7c1d6879c40ebb8d989ebae205e9e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:30.640465 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 4fa6bf38381740a1bab1088ede6ede1c
W20260318 02:51:30.640486 719 leader_election.cc:343] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.640625 719 leader_election.cc:304] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:30.641019 455 master_service.cc:954] ReplaceTablet: received request to replace tablet c0349def0e4045f2b1e9a02dd654a174 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:30.641098 1830 raft_consensus.cc:2749] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:30.643652 763 tablet_service.cc:1511] Processing CreateTablet for tablet 7c029aa4cacd43fd8f2d5aa4fdf7bdc8 (DEFAULT_TABLE table=default.Table_099c48c03d18476fb701684f3ca05655 [id=8f2b44ea0af54c8da0e63c925c640d08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.644081 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c029aa4cacd43fd8f2d5aa4fdf7bdc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.644692 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fa6bf38381740a1bab1088ede6ede1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.644974 1176 tablet_replica.cc:333] T 4fa6bf38381740a1bab1088ede6ede1c P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:30.645164 1176 raft_consensus.cc:2243] T 4fa6bf38381740a1bab1088ede6ede1c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:30.645349 1176 raft_consensus.cc:2272] T 4fa6bf38381740a1bab1088ede6ede1c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:30.646507 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 421e5223d6af4da1a8e07534f942d016 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.646571 754 tablet_service.cc:1558] Processing DeleteTablet for tablet b716c3a80d4a44d190de38f926098efc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.646693 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fa7c1d6879c40ebb8d989ebae205e9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.646863 747 tablet_service.cc:1558] Processing DeleteTablet for tablet dea25aaad60a4b2483a8832f995d1316 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.647090 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 7883f526d06e442c81f1b66fd89d2cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.647192 1176 ts_tablet_manager.cc:1916] T 4fa6bf38381740a1bab1088ede6ede1c P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:30.655475 758 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca21ac13205419783d815c62d54e5d3 (DEFAULT_TABLE table=default.Table_bfe33a0aadc84b8e83a5de13322a445a [id=519cca339a4b44b4b6fc8e32283e5fd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.655961 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca21ac13205419783d815c62d54e5d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.658803 757 tablet_service.cc:1511] Processing CreateTablet for tablet 76109acb76424b1f96ede9ab1f018e5e (DEFAULT_TABLE table=default.Table_4600a261d8844254ba70e12cd1dc1676 [id=c64f2893d8024bf592ac46c8a655ca8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.659197 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76109acb76424b1f96ede9ab1f018e5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.659134 761 tablet_service.cc:1511] Processing CreateTablet for tablet ebbe05c64ae14c509584dd86e45b4aa1 (DEFAULT_TABLE table=default.Table_9fdb7241643a4fb38c07adf178cdc452 [id=fd0f5cae870c4ca4bd24b6f99eee384c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.659476 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebbe05c64ae14c509584dd86e45b4aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.659698 759 tablet_service.cc:1511] Processing CreateTablet for tablet 443e6018aed94077a38aa80bafee7264 (DEFAULT_TABLE table=default.Table_7e830a261b9b4dadae5dc42d69c292ca [id=8eb74cec077d406d867a9946198b7ae8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.660003 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443e6018aed94077a38aa80bafee7264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.663309 747 tablet_service.cc:1511] Processing CreateTablet for tablet d4e3346edd274750a5e27ec2393d08bc (DEFAULT_TABLE table=default.Table_659b60f9843f48f698d176f54ae06d07 [id=f912674193d84bbd88979e8d81dd9d3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.663635 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e3346edd274750a5e27ec2393d08bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.667946 754 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2c64dc7c0b479494ca474dad51a528 (DEFAULT_TABLE table=default.Table_bdf933d3dd024516a917b03a05f291a7 [id=34d00e5bb6f74dd480194ff5a9501eec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.668247 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2c64dc7c0b479494ca474dad51a528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.674461 757 tablet_service.cc:1511] Processing CreateTablet for tablet d4332d4afb164b35bee3b0146e26b4e1 (DEFAULT_TABLE table=default.Table_db8a1a6484c54822ad31ad887f108929 [id=e55712b310ea4b118a59b291a71d4291]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.674921 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4332d4afb164b35bee3b0146e26b4e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.674474 750 tablet_service.cc:1511] Processing CreateTablet for tablet 6858334d4c8b41b89c57b4b6f127a1c7 (DEFAULT_TABLE table=default.Table_762224444e604c1fa386410335af4f48 [id=ef9a2a8300044eb19f2b50dc13cbe776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.678114 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6858334d4c8b41b89c57b4b6f127a1c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.682293 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_429f0c1c10f44c3ba16cd3bbe5c0089b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:30.682973 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_429f0c1c10f44c3ba16cd3bbe5c0089b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:30.684998 1780 raft_consensus.cc:493] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.685148 1780 raft_consensus.cc:515] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.685842 1780 leader_election.cc:290] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.687299 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda9f1fe47e04688bde80ebe23494d08" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:30.687351 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 77a17ef7cfee4d65808b11e9cb51e7df consensus state has no leader
I20260318 02:51:30.687531 1064 raft_consensus.cc:2468] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:30.688089 860 leader_election.cc:304] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:30.690527 1780 raft_consensus.cc:2804] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:30.690625 1780 raft_consensus.cc:493] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:30.690689 1780 raft_consensus.cc:3060] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:30.690527 862 leader_election.cc:343] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: fda9f1fe47e04688bde80ebe23494d08
I20260318 02:51:30.696849 1174 tablet_bootstrap.cc:492] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:30.697096 1174 ts_tablet_manager.cc:1403] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.200s user 0.016s sys 0.024s
I20260318 02:51:30.698047 1174 raft_consensus.cc:359] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.699554 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_12fb0eb56f354fdc9acff9c77b5bf3fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:30.701889 1174 raft_consensus.cc:385] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.703213 1174 raft_consensus.cc:740] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.703770 1174 consensus_queue.cc:260] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.704808 1817 raft_consensus.cc:493] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.705018 1817 raft_consensus.cc:515] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.705372 760 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8bf09a136846eaababb5593e1833fc (DEFAULT_TABLE table=default.Table_b19e155d16bd4725a2d4200eda764366 [id=43a3c5574a7647f69a07ee7a5b646511]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.705790 1817 leader_election.cc:290] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.706039 755 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9a5b965cb141e1a5dd1c96f590ad5a (DEFAULT_TABLE table=default.Table_25494285095147fa885f1aa79e2f1722 [id=6f9a87f338414f20bb3969d3c3cdfa64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.706401 753 tablet_service.cc:1511] Processing CreateTablet for tablet f8e428b700044eaf9e360f74c751a206 (DEFAULT_TABLE table=default.Table_c89f8c40260f47be9787ac38ce5dcd46 [id=1dbb8f277403450086790ee9034c98da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.706818 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916b5b77fb2f4003b78a71025319ed15" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:30.707001 784 raft_consensus.cc:2468] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:30.707145 1174 ts_tablet_manager.cc:1434] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260318 02:51:30.707415 1174 tablet_bootstrap.cc:492] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:30.707422 999 leader_election.cc:304] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:30.708000 1817 raft_consensus.cc:2804] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:30.708086 1817 raft_consensus.cc:493] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:30.708180 1817 raft_consensus.cc:3060] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.713265 1817 raft_consensus.cc:515] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:30.715008 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f95ebc89fd2545b1835a1bc10414248d consensus state has no leader
I20260318 02:51:30.715482 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916b5b77fb2f4003b78a71025319ed15" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:30.715342 448 catalog_manager.cc:5671] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:30.715649 784 raft_consensus.cc:3060] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.715840 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 8c20810ad3354126bf49bbeeb6edb098 (table default.Table_4775eaa0e7e84642aa0a8f8b2885610e [id=463a6721eb0d43d09deeb283d1cc4233]). Expected version 1 got 0
I20260318 02:51:30.716171 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet bd077319b3c443849de087eb61da6a77 (table default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]). Expected version 1 got 0
I20260318 02:51:30.717084 1813 raft_consensus.cc:493] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.717238 1813 raft_consensus.cc:515] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:30.717532 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12fb0eb56f354fdc9acff9c77b5bf3fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:30.717926 1813 leader_election.cc:290] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.718441 784 raft_consensus.cc:2468] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:30.716451 448 catalog_manager.cc:5671] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:30.718864 757 tablet_service.cc:1511] Processing CreateTablet for tablet 8aac627aab0d41bda3053c57029a26fd (DEFAULT_TABLE table=default.Table_e7940bdd0aa248b9bb9049e759f5d72e [id=45dc1528ffbe4ff09fc344b4a33bf924]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.719058 999 leader_election.cc:304] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:30.719101 448 catalog_manager.cc:5671] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:30.719472 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet ab158343adb14eab85c595fa5405145d (table default.Table_b76c4b353fbe45c8a866d4cd2c4e264c [id=d20f8f1bd66d4dceab3b7bc72608da2a]). Expected version 2 got 0
I20260318 02:51:30.719780 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet bc47f35f9c2c4e5085ab482285effc91 (table default.Table_9867792729394010ba769354562198f3 [id=1515573be85644d7a4f046947aa1537b]). Expected version 3 got 0
I20260318 02:51:30.720080 1813 raft_consensus.cc:2804] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:30.720248 1813 raft_consensus.cc:697] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:30.720548 1813 consensus_queue.cc:237] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:30.722308 999 leader_election.cc:343] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 0c8264f69f934d3ba2e41434ce350f3e
I20260318 02:51:30.723189 1817 leader_election.cc:290] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.726931 1172 tablet_bootstrap.cc:492] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:30.727180 1172 ts_tablet_manager.cc:1403] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.186s user 0.026s sys 0.098s
I20260318 02:51:30.728238 1172 raft_consensus.cc:359] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.728493 1172 raft_consensus.cc:385] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.728626 1172 raft_consensus.cc:740] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.729986 1172 consensus_queue.cc:260] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.730593 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet c0349def0e4045f2b1e9a02dd654a174
I20260318 02:51:30.731094 455 catalog_manager.cc:6741] ReplaceTablet: tablet c0349def0e4045f2b1e9a02dd654a174 deleted and replaced by tablet 19748feaf1574824a3bf6ff8ae87f4a9
I20260318 02:51:30.731484 1172 ts_tablet_manager.cc:1434] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:30.731762 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 0e99c2956a764e6cb07cbc41e4a6f2f8
I20260318 02:51:30.731868 1172 tablet_bootstrap.cc:492] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:30.732157 456 catalog_manager.cc:6741] ReplaceTablet: tablet 0e99c2956a764e6cb07cbc41e4a6f2f8 deleted and replaced by tablet ebfb14850afa4043848814f01eabf394
I20260318 02:51:30.733141 1830 raft_consensus.cc:493] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.733270 1830 raft_consensus.cc:515] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.733876 1830 leader_election.cc:290] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:30.734509 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421e5223d6af4da1a8e07534f942d016" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:30.735240 719 leader_election.cc:343] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.735664 754 tablet_service.cc:1558] Processing DeleteTablet for tablet c0349def0e4045f2b1e9a02dd654a174 with delete_type TABLET_DATA_DELETED (replaced by tablet 19748feaf1574824a3bf6ff8ae87f4a9) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.735855 1172 tablet_bootstrap.cc:654] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.737507 759 tablet_service.cc:1511] Processing CreateTablet for tablet b907655687574f6bbd42755fb6505b15 (DEFAULT_TABLE table=default.Table_4b6a70e405584e358aae8e56074d30da [id=6835a01a95694bbfae98080bdfc3642d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.737974 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e99c2956a764e6cb07cbc41e4a6f2f8 with delete_type TABLET_DATA_DELETED (replaced by tablet ebfb14850afa4043848814f01eabf394) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.738507 1174 tablet_bootstrap.cc:654] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.739333 457 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet bd077319b3c443849de087eb61da6a77 (table default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]). Expected version 1 got 0
I20260318 02:51:30.739622 457 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet d0652735b8c24c23ade92913c1c7ad0f (table default.Table_20867faf86da4889b7995990926923a7 [id=5bc787aad96b4abd82ab3e033020ea9c]). Expected version 1 got 0
I20260318 02:51:30.746860 1172 tablet_bootstrap.cc:492] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:30.747043 1172 ts_tablet_manager.cc:1403] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.005s
I20260318 02:51:30.747884 754 tablet_service.cc:1558] Processing DeleteTablet for tablet b230018a95a54ababfe5ecf2ca1e2e49 with delete_type TABLET_DATA_DELETED (replaced by tablet 813702e53eee4a54a7d693fd6e03bbbb) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.747915 1172 raft_consensus.cc:359] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.748123 1172 raft_consensus.cc:385] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.748293 1172 raft_consensus.cc:740] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.748520 763 tablet_service.cc:1511] Processing CreateTablet for tablet c152446c906c4ed6b5eb0e3ee4d1917e (DEFAULT_TABLE table=default.Table_6d1032d49d3244f0b80bf144e88b3d12 [id=e91ed69dd8a54478bc6e8374ad0202b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.748548 1172 consensus_queue.cc:260] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.738417 758 tablet_service.cc:1511] Processing CreateTablet for tablet 71ea229381d540fdae9b2d7bf3eac2b6 (DEFAULT_TABLE table=default.Table_c9bc81a187a443318d1f42d64fd9330a [id=7e04ce6af13b48cd9f339f56eb4bbbb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.749361 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8bf09a136846eaababb5593e1833fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.749531 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9a5b965cb141e1a5dd1c96f590ad5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.749828 1176 ts_tablet_manager.cc:1929] T 4fa6bf38381740a1bab1088ede6ede1c P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:30.749873 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e428b700044eaf9e360f74c751a206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.749917 1176 log.cc:1199] T 4fa6bf38381740a1bab1088ede6ede1c P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/4fa6bf38381740a1bab1088ede6ede1c
I20260318 02:51:30.750197 1176 ts_tablet_manager.cc:1950] T 4fa6bf38381740a1bab1088ede6ede1c P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:30.750432 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b907655687574f6bbd42755fb6505b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.750638 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aac627aab0d41bda3053c57029a26fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.754283 1172 ts_tablet_manager.cc:1434] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260318 02:51:30.759558 1172 tablet_bootstrap.cc:492] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:30.761744 1172 tablet_bootstrap.cc:654] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.766741 1817 raft_consensus.cc:493] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.766959 1817 raft_consensus.cc:515] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.767668 1817 leader_election.cc:290] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:30.771166 999 leader_election.cc:343] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: af793623466249e695b262ab451d4dc9
I20260318 02:51:30.772781 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c152446c906c4ed6b5eb0e3ee4d1917e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.773115 1172 tablet_bootstrap.cc:492] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:30.773319 1172 ts_tablet_manager.cc:1403] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.006s
I20260318 02:51:30.774362 1830 raft_consensus.cc:493] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.774518 1830 raft_consensus.cc:515] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.774688 1817 raft_consensus.cc:493] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.774811 1817 raft_consensus.cc:515] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.775123 1830 leader_election.cc:290] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:30.775405 1817 leader_election.cc:290] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:30.776664 999 leader_election.cc:343] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2bd6ac47ba044099ad9bd211ef8d26a2
I20260318 02:51:30.777015 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea25aaad60a4b2483a8832f995d1316" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:30.777688 719 leader_election.cc:343] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.779124 1172 raft_consensus.cc:359] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.779420 1172 raft_consensus.cc:385] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.779808 1172 raft_consensus.cc:740] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.780164 1172 consensus_queue.cc:260] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.782425 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ea229381d540fdae9b2d7bf3eac2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.785161 1172 ts_tablet_manager.cc:1434] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
W20260318 02:51:30.787075 862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.129:46711, user_credentials={real_user=slave}} blocked reactor thread for 96564us
I20260318 02:51:30.788121 1782 raft_consensus.cc:493] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.788254 1782 raft_consensus.cc:515] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.788642 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 4fa6bf38381740a1bab1088ede6ede1c (table default.Table_607d1941968145a6a336b9a5bb85b43e [id=85784a23699343ee80e0adb9e5f82413]) successfully deleted
I20260318 02:51:30.789000 1176 tablet_replica.cc:333] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:30.789171 1176 raft_consensus.cc:2243] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:30.789649 1176 raft_consensus.cc:2272] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:30.790280 1176 ts_tablet_manager.cc:1916] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:30.791697 1172 tablet_bootstrap.cc:492] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:30.792599 1830 raft_consensus.cc:493] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.792771 1830 raft_consensus.cc:515] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.793378 1830 leader_election.cc:290] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:30.794262 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c19bc5e07949088c84cedbf944dfdb" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:30.795001 719 leader_election.cc:343] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.796221 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916b5b77fb2f4003b78a71025319ed15" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:30.796351 1172 tablet_bootstrap.cc:654] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.796921 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c19bc5e07949088c84cedbf944dfdb" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:30.788982 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421e5223d6af4da1a8e07534f942d016" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:30.797796 719 leader_election.cc:343] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.797907 719 leader_election.cc:304] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:30.798060 719 raft_consensus.cc:2686] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260318 02:51:30.798444 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916b5b77fb2f4003b78a71025319ed15" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:30.798497 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea25aaad60a4b2483a8832f995d1316" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:30.799562 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd6ac47ba044099ad9bd211ef8d26a2" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:30.799748 926 raft_consensus.cc:2468] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
W20260318 02:51:30.800390 997 leader_election.cc:343] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:30.800747 997 leader_election.cc:343] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.801245 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c8264f69f934d3ba2e41434ce350f3e" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:30.801577 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af793623466249e695b262ab451d4dc9" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:30.804353 1172 tablet_bootstrap.cc:492] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:30.804535 1782 leader_election.cc:290] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.804548 1172 ts_tablet_manager.cc:1403] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.002s
I20260318 02:51:30.804986 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f891043b7d468da3e808980690354d" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:30.805087 997 leader_election.cc:304] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:30.805198 1064 raft_consensus.cc:2468] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:30.805608 1172 raft_consensus.cc:359] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.805713 860 leader_election.cc:304] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:30.805857 1172 raft_consensus.cc:385] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.805950 1172 raft_consensus.cc:740] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.806167 1172 consensus_queue.cc:260] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:30.806201 719 leader_election.cc:343] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.806265 1782 raft_consensus.cc:2804] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:30.806330 1782 raft_consensus.cc:493] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:30.806320 719 leader_election.cc:304] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:30.806387 1782 raft_consensus.cc:3060] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:30.806675 719 leader_election.cc:343] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.806769 719 leader_election.cc:304] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:30.807088 1830 raft_consensus.cc:2749] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:30.806803 448 catalog_manager.cc:5671] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:30.807231 1830 raft_consensus.cc:2749] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:30.807807 997 leader_election.cc:343] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.807932 997 leader_election.cc:304] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:30.808236 1813 raft_consensus.cc:2804] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260318 02:51:30.808313 997 leader_election.cc:343] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.808430 997 leader_election.cc:304] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:30.808801 1760 raft_consensus.cc:2749] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:30.808974 1760 raft_consensus.cc:2749] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:30.810029 862 leader_election.cc:343] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: a4f891043b7d468da3e808980690354d
I20260318 02:51:30.808339 1813 raft_consensus.cc:493] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:30.810750 1813 raft_consensus.cc:3060] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.813560 1813 raft_consensus.cc:515] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.816222 1813 leader_election.cc:290] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:30.816684 999 leader_election.cc:343] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2bd6ac47ba044099ad9bd211ef8d26a2
I20260318 02:51:30.816943 1172 ts_tablet_manager.cc:1434] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260318 02:51:30.819711 1813 raft_consensus.cc:493] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.819975 1813 raft_consensus.cc:515] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:30.821717 999 leader_election.cc:343] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 95f15079d1df4314b6dd5c7afd896af5
I20260318 02:51:30.821950 1813 leader_election.cc:290] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.822144 1172 tablet_bootstrap.cc:492] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:30.822878 1176 ts_tablet_manager.cc:1929] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:30.824532 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f15079d1df4314b6dd5c7afd896af5" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:30.825302 997 leader_election.cc:343] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.825448 997 leader_election.cc:304] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:30.824846 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd6ac47ba044099ad9bd211ef8d26a2" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:30.826182 925 raft_consensus.cc:3060] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.826484 1813 raft_consensus.cc:2749] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:30.826901 1172 tablet_bootstrap.cc:654] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.828837 1782 raft_consensus.cc:515] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.829470 1782 leader_election.cc:290] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.830456 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f891043b7d468da3e808980690354d" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:30.830664 1064 raft_consensus.cc:3060] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.831374 1780 raft_consensus.cc:515] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.832032 1780 leader_election.cc:290] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.832248 1176 log.cc:1199] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/421e5223d6af4da1a8e07534f942d016
I20260318 02:51:30.832571 1176 ts_tablet_manager.cc:1950] T 421e5223d6af4da1a8e07534f942d016 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:30.834153 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda9f1fe47e04688bde80ebe23494d08" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:30.834358 1061 raft_consensus.cc:3060] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.836400 1176 tablet_replica.cc:333] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:30.836614 1176 raft_consensus.cc:2243] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:30.836658 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 421e5223d6af4da1a8e07534f942d016 (table default.Table_8dfcbdb7d773436fb70053d0d4a1d9e8 [id=7979bbf5d6744b6eb56acde8ec69ba5d]) successfully deleted
I20260318 02:51:30.838241 1813 raft_consensus.cc:493] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.838491 1813 raft_consensus.cc:515] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:30.838603 862 leader_election.cc:343] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: a4f891043b7d468da3e808980690354d
I20260318 02:51:30.839393 1813 leader_election.cc:290] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.839509 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2adcc9f1ad69458c997475111bb787cf" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:30.839689 924 raft_consensus.cc:2468] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:30.840116 997 leader_election.cc:304] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:30.840435 1813 raft_consensus.cc:2804] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:30.840544 1813 raft_consensus.cc:493] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:30.840654 1813 raft_consensus.cc:3060] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:30.841311 862 leader_election.cc:343] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: fda9f1fe47e04688bde80ebe23494d08
I20260318 02:51:30.841396 448 catalog_manager.cc:5671] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 reported cstate change: term changed from 0 to 1, leader changed from <none> to b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130). New cstate: current_term: 1 leader_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
W20260318 02:51:30.841856 999 leader_election.cc:343] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2adcc9f1ad69458c997475111bb787cf
I20260318 02:51:30.842226 448 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 918c542a51864e54871efc5e7f62ef61 (table default.Table_a168ed2816204e05aa65aaed95173a8f [id=ee10bea676fa4d1a837737c939f3306b]). Expected version 5 got 0
I20260318 02:51:30.842662 448 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet ab158343adb14eab85c595fa5405145d (table default.Table_b76c4b353fbe45c8a866d4cd2c4e264c [id=d20f8f1bd66d4dceab3b7bc72608da2a]). Expected version 2 got 0
I20260318 02:51:30.842983 448 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet bd077319b3c443849de087eb61da6a77 (table default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]). Expected version 1 got 0
I20260318 02:51:30.843370 1813 raft_consensus.cc:515] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.844363 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2adcc9f1ad69458c997475111bb787cf" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:30.844445 1813 leader_election.cc:290] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.844533 924 raft_consensus.cc:3060] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:30.845783 999 leader_election.cc:343] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2adcc9f1ad69458c997475111bb787cf
I20260318 02:51:30.845959 1064 raft_consensus.cc:2468] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:30.846339 860 leader_election.cc:304] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:30.846467 1061 raft_consensus.cc:2468] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:30.846645 1709 raft_consensus.cc:2804] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:30.846787 860 leader_election.cc:304] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:30.847086 1780 raft_consensus.cc:2804] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:30.847582 1780 raft_consensus.cc:697] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:30.847836 1780 consensus_queue.cc:237] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.848001 924 raft_consensus.cc:2468] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:30.848608 997 leader_election.cc:304] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:30.849073 1813 raft_consensus.cc:2804] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:30.850381 1813 raft_consensus.cc:697] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:30.851015 1813 consensus_queue.cc:237] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.846956 1709 raft_consensus.cc:697] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:30.851575 1176 raft_consensus.cc:2272] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:30.851907 1709 consensus_queue.cc:237] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.852193 1176 ts_tablet_manager.cc:1916] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:30.853601 925 raft_consensus.cc:2468] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:30.854240 997 leader_election.cc:304] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:30.854714 1817 raft_consensus.cc:2804] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:30.854867 1817 raft_consensus.cc:697] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:30.855145 1817 consensus_queue.cc:237] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.857532 1174 tablet_bootstrap.cc:492] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:30.857690 1174 ts_tablet_manager.cc:1403] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.150s user 0.006s sys 0.000s
I20260318 02:51:30.857920 1760 raft_consensus.cc:493] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.858093 1760 raft_consensus.cc:515] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.858456 1174 raft_consensus.cc:359] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.858633 1174 raft_consensus.cc:385] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.858677 1174 raft_consensus.cc:740] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.859014 1760 leader_election.cc:290] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.859530 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc47f35f9c2c4e5085ab482285effc91" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:30.859719 1173 tablet_bootstrap.cc:492] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:30.859731 784 raft_consensus.cc:2468] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:30.859855 1173 ts_tablet_manager.cc:1403] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.301s user 0.005s sys 0.030s
I20260318 02:51:30.859820 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc47f35f9c2c4e5085ab482285effc91" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:30.860292 997 leader_election.cc:343] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.860441 997 leader_election.cc:304] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:30.860559 1173 raft_consensus.cc:359] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.860759 1173 raft_consensus.cc:385] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:30.860817 1173 raft_consensus.cc:740] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:30.860863 1760 raft_consensus.cc:2804] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:30.860989 1760 raft_consensus.cc:493] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:30.861079 1760 raft_consensus.cc:3060] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.861016 1173 consensus_queue.cc:260] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.861577 1173 ts_tablet_manager.cc:1434] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260318 02:51:30.861917 1173 tablet_bootstrap.cc:492] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:30.863238 441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.189:45933, user_credentials={real_user=slave}} blocked reactor thread for 182292us
I20260318 02:51:30.865886 1760 raft_consensus.cc:515] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.866657 1760 leader_election.cc:290] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.867218 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc47f35f9c2c4e5085ab482285effc91" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:30.867403 784 raft_consensus.cc:3060] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.867726 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 5db76f996b094bf99b6c6fe33f02b9f3 with delete_type TABLET_DATA_DELETED (replaced by tablet 89a76fc237fc4bb8a891e3151efb3106) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:30.868115 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet a4f891043b7d468da3e808980690354d with delete_type TABLET_DATA_DELETED (replaced by tablet 4fa6bf38381740a1bab1088ede6ede1c) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:30.868633 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca21ac13205419783d815c62d54e5d3 (DEFAULT_TABLE table=default.Table_bfe33a0aadc84b8e83a5de13322a445a [id=519cca339a4b44b4b6fc8e32283e5fd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.869102 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca21ac13205419783d815c62d54e5d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.869983 784 raft_consensus.cc:2468] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:30.870239 1813 raft_consensus.cc:493] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.870393 1813 raft_consensus.cc:515] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.871217 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fa6bf38381740a1bab1088ede6ede1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:30.871248 1813 leader_election.cc:290] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:30.871474 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet fda9f1fe47e04688bde80ebe23494d08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:30.871657 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 2bd6ac47ba044099ad9bd211ef8d26a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 7c4eca5e16f84564b31933b8227fd980) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:30.872254 1042 tablet_service.cc:1511] Processing CreateTablet for tablet d4e3346edd274750a5e27ec2393d08bc (DEFAULT_TABLE table=default.Table_659b60f9843f48f698d176f54ae06d07 [id=f912674193d84bbd88979e8d81dd9d3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.874503 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e3346edd274750a5e27ec2393d08bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.877077 1184 tablet_replica.cc:333] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:30.876976 1174 consensus_queue.cc:260] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.877588 1184 raft_consensus.cc:2243] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:30.877903 1184 raft_consensus.cc:2272] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:30.880348 1174 ts_tablet_manager.cc:1434] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260318 02:51:30.881829 1174 tablet_bootstrap.cc:492] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:30.883726 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 2789a1195e7344c18dd226e196e2f302 with delete_type TABLET_DATA_DELETED (replaced by tablet f37ab96f13444fcbb5cfc3ad92d53c35) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.883795 1174 tablet_bootstrap.cc:654] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.885723 1184 ts_tablet_manager.cc:1916] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:30.886219 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7b0bea6538a9448aa9cb4132f0970647" } new_table_name: "default.Table_d5ddb641ef9245ca92ab35d8ac25b157" modify_external_catalogs: true
I20260318 02:51:30.886729 999 leader_election.cc:304] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:30.887398 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 7c029aa4cacd43fd8f2d5aa4fdf7bdc8 (DEFAULT_TABLE table=default.Table_099c48c03d18476fb701684f3ca05655 [id=8f2b44ea0af54c8da0e63c925c640d08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.891314 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 76109acb76424b1f96ede9ab1f018e5e (DEFAULT_TABLE table=default.Table_4600a261d8844254ba70e12cd1dc1676 [id=c64f2893d8024bf592ac46c8a655ca8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.891538 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2c64dc7c0b479494ca474dad51a528 (DEFAULT_TABLE table=default.Table_bdf933d3dd024516a917b03a05f291a7 [id=34d00e5bb6f74dd480194ff5a9501eec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.891568 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1852ce7593344cc790f3c957fb56cd32" } modify_external_catalogs: true
I20260318 02:51:30.891937 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1852ce7593344cc790f3c957fb56cd32" } modify_external_catalogs: true
I20260318 02:51:30.894028 1813 raft_consensus.cc:493] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:30.894035 1043 tablet_service.cc:1511] Processing CreateTablet for tablet b907655687574f6bbd42755fb6505b15 (DEFAULT_TABLE table=default.Table_4b6a70e405584e358aae8e56074d30da [id=6835a01a95694bbfae98080bdfc3642d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:30.894681 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9c60ef260d049bea4ce729316a0d09f consensus state has no leader
I20260318 02:51:30.898608 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_86fd2b4ab3b54217a92aca9959fc9238"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:30.899298 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86fd2b4ab3b54217a92aca9959fc9238 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:30.899230 1030 tablet_service.cc:1511] Processing CreateTablet for tablet ebbe05c64ae14c509584dd86e45b4aa1 (DEFAULT_TABLE table=default.Table_9fdb7241643a4fb38c07adf178cdc452 [id=fd0f5cae870c4ca4bd24b6f99eee384c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.901582 1760 raft_consensus.cc:2804] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
W20260318 02:51:30.901993 999 leader_election.cc:343] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2b6267d3f6e142579c62bbb4b14da4b0
I20260318 02:51:30.902297 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet a20b9dc70b5147ff8798946eda3131ca
I20260318 02:51:30.902405 1813 raft_consensus.cc:515] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:30.903337 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c9fa61fd1bdb405f89a32f500da8f182" } modify_external_catalogs: true
I20260318 02:51:30.903563 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c9fa61fd1bdb405f89a32f500da8f182" } modify_external_catalogs: true
I20260318 02:51:30.904320 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 443e6018aed94077a38aa80bafee7264 (DEFAULT_TABLE table=default.Table_7e830a261b9b4dadae5dc42d69c292ca [id=8eb74cec077d406d867a9946198b7ae8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.905239 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 6858334d4c8b41b89c57b4b6f127a1c7 (DEFAULT_TABLE table=default.Table_762224444e604c1fa386410335af4f48 [id=ef9a2a8300044eb19f2b50dc13cbe776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.906301 1760 raft_consensus.cc:697] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:30.906715 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c029aa4cacd43fd8f2d5aa4fdf7bdc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.907487 1027 tablet_service.cc:1511] Processing CreateTablet for tablet d4332d4afb164b35bee3b0146e26b4e1 (DEFAULT_TABLE table=default.Table_db8a1a6484c54822ad31ad887f108929 [id=e55712b310ea4b118a59b291a71d4291]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.910257 1760 consensus_queue.cc:237] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:30.911104 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_23b963651b514aeaa69a42da8e6d2150" } modify_external_catalogs: true
I20260318 02:51:30.911298 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_23b963651b514aeaa69a42da8e6d2150" } modify_external_catalogs: true
I20260318 02:51:30.911127 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6b7d64f684ff4cc0992215f5962ab5eb" } new_table_name: "default.Table_c48cbbec9ad84250bda73de5dbb9ccb8" modify_external_catalogs: true
I20260318 02:51:30.913472 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c6d53ff287654d37b638cd812b89127f" } modify_external_catalogs: true
I20260318 02:51:30.913640 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c6d53ff287654d37b638cd812b89127f" } modify_external_catalogs: true
I20260318 02:51:30.913967 1813 leader_election.cc:290] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:30.914011 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b51a15e4303742a999fe9a96d450c827
I20260318 02:51:30.914672 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4332d4afb164b35bee3b0146e26b4e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.916193 926 raft_consensus.cc:3060] T c5765355efaa4ef4ab3b68ea33f51536 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.916344 891 tablet_service.cc:1511] Processing CreateTablet for tablet 7c029aa4cacd43fd8f2d5aa4fdf7bdc8 (DEFAULT_TABLE table=default.Table_099c48c03d18476fb701684f3ca05655 [id=8f2b44ea0af54c8da0e63c925c640d08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.916821 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c029aa4cacd43fd8f2d5aa4fdf7bdc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.917152 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6267d3f6e142579c62bbb4b14da4b0" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:30.917514 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30205728339f4bcf8b7d94d6f373e01c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:30.917670 927 raft_consensus.cc:2468] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:30.917847 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc47f35f9c2c4e5085ab482285effc91" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:30.920295 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2c64dc7c0b479494ca474dad51a528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.921034 893 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca21ac13205419783d815c62d54e5d3 (DEFAULT_TABLE table=default.Table_bfe33a0aadc84b8e83a5de13322a445a [id=519cca339a4b44b4b6fc8e32283e5fd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.921392 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca21ac13205419783d815c62d54e5d3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:30.921818 999 leader_election.cc:343] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 30205728339f4bcf8b7d94d6f373e01c
I20260318 02:51:30.922209 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b907655687574f6bbd42755fb6505b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.922528 747 tablet_service.cc:1558] Processing DeleteTablet for tablet a20b9dc70b5147ff8798946eda3131ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.923206 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76109acb76424b1f96ede9ab1f018e5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.925791 758 tablet_service.cc:1558] Processing DeleteTablet for tablet b51a15e4303742a999fe9a96d450c827 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:30.927155 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6858334d4c8b41b89c57b4b6f127a1c7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:30.932046 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 70dca1ffc22c4c029840635f1b312dff consensus state has no leader
I20260318 02:51:30.933993 1173 tablet_bootstrap.cc:654] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:30.935563 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0215eed4500f4b01b0c52104e28e94f8" } new_table_name: "default.Table_8f6fc03338164c69badf6ecce1f3e2b1" modify_external_catalogs: true
I20260318 02:51:30.935696 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_09ea62fe8c224d87944f84b6ef7e4edc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:30.936751 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09ea62fe8c224d87944f84b6ef7e4edc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:30.941191 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fa6bf38381740a1bab1088ede6ede1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:30.941437 889 tablet_service.cc:1558] Processing DeleteTablet for tablet f447cab3445c451d8ef8746966cfcd42 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c5038e9e1074f46976a1a5bb4282944) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:30.941581 899 tablet_service.cc:1558] Processing DeleteTablet for tablet fda9f1fe47e04688bde80ebe23494d08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:30.941720 905 tablet_service.cc:1558] Processing DeleteTablet for tablet a4f891043b7d468da3e808980690354d with delete_type TABLET_DATA_DELETED (replaced by tablet 4fa6bf38381740a1bab1088ede6ede1c) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:30.941828 897 tablet_service.cc:1511] Processing CreateTablet for tablet d4e3346edd274750a5e27ec2393d08bc (DEFAULT_TABLE table=default.Table_659b60f9843f48f698d176f54ae06d07 [id=f912674193d84bbd88979e8d81dd9d3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.942243 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e3346edd274750a5e27ec2393d08bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.945034 898 tablet_service.cc:1511] Processing CreateTablet for tablet 76109acb76424b1f96ede9ab1f018e5e (DEFAULT_TABLE table=default.Table_4600a261d8844254ba70e12cd1dc1676 [id=c64f2893d8024bf592ac46c8a655ca8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.945431 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76109acb76424b1f96ede9ab1f018e5e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:30.945820 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0f499c464eb14164a2df3abc2d4a47c7 consensus state has no leader
I20260318 02:51:30.949036 896 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2c64dc7c0b479494ca474dad51a528 (DEFAULT_TABLE table=default.Table_bdf933d3dd024516a917b03a05f291a7 [id=34d00e5bb6f74dd480194ff5a9501eec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.949451 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2c64dc7c0b479494ca474dad51a528. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.951293 895 tablet_service.cc:1511] Processing CreateTablet for tablet b907655687574f6bbd42755fb6505b15 (DEFAULT_TABLE table=default.Table_4b6a70e405584e358aae8e56074d30da [id=6835a01a95694bbfae98080bdfc3642d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.956785 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b907655687574f6bbd42755fb6505b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.957613 1175 tablet_replica.cc:333] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:30.957957 906 tablet_service.cc:1511] Processing CreateTablet for tablet 6858334d4c8b41b89c57b4b6f127a1c7 (DEFAULT_TABLE table=default.Table_762224444e604c1fa386410335af4f48 [id=ef9a2a8300044eb19f2b50dc13cbe776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.958325 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6858334d4c8b41b89c57b4b6f127a1c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.956581 902 tablet_service.cc:1511] Processing CreateTablet for tablet ebbe05c64ae14c509584dd86e45b4aa1 (DEFAULT_TABLE table=default.Table_9fdb7241643a4fb38c07adf178cdc452 [id=fd0f5cae870c4ca4bd24b6f99eee384c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.960404 900 tablet_service.cc:1511] Processing CreateTablet for tablet d4332d4afb164b35bee3b0146e26b4e1 (DEFAULT_TABLE table=default.Table_db8a1a6484c54822ad31ad887f108929 [id=e55712b310ea4b118a59b291a71d4291]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.961190 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebbe05c64ae14c509584dd86e45b4aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.961452 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebbe05c64ae14c509584dd86e45b4aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.961985 1175 raft_consensus.cc:2243] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:30.962936 888 tablet_service.cc:1511] Processing CreateTablet for tablet 443e6018aed94077a38aa80bafee7264 (DEFAULT_TABLE table=default.Table_7e830a261b9b4dadae5dc42d69c292ca [id=8eb74cec077d406d867a9946198b7ae8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.964114 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4332d4afb164b35bee3b0146e26b4e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.964298 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443e6018aed94077a38aa80bafee7264. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.965422 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443e6018aed94077a38aa80bafee7264. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:30.967144 997 leader_election.cc:343] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.967707 997 leader_election.cc:304] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:30.967855 1175 pending_rounds.cc:70] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18: Trying to abort 1 pending ops.
I20260318 02:51:30.967924 1175 pending_rounds.cc:77] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494183315116032 op_type: NO_OP noop_request { }
I20260318 02:51:30.968026 1175 raft_consensus.cc:2889] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:30.968111 1175 raft_consensus.cc:2272] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:30.968261 997 leader_election.cc:304] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:30.969386 1813 raft_consensus.cc:2749] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:30.970685 1175 ts_tablet_manager.cc:1916] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:30.972780 1817 raft_consensus.cc:2804] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:30.972901 1817 raft_consensus.cc:493] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:30.973681 1817 raft_consensus.cc:3060] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:30.974568 893 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8bf09a136846eaababb5593e1833fc (DEFAULT_TABLE table=default.Table_b19e155d16bd4725a2d4200eda764366 [id=43a3c5574a7647f69a07ee7a5b646511]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.974912 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8bf09a136846eaababb5593e1833fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.975085 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_aced9bb925c04f9b90e57d4edf3ac2ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:30.975708 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aced9bb925c04f9b90e57d4edf3ac2ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:30.973575 997 leader_election.cc:343] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:30.976470 1175 ts_tablet_manager.cc:1929] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:30.976598 1175 log.cc:1199] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/fda9f1fe47e04688bde80ebe23494d08
I20260318 02:51:30.979002 454 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 8c20810ad3354126bf49bbeeb6edb098 (table default.Table_4775eaa0e7e84642aa0a8f8b2885610e [id=463a6721eb0d43d09deeb283d1cc4233]). Expected version 1 got 0
I20260318 02:51:30.979537 1175 ts_tablet_manager.cc:1950] T fda9f1fe47e04688bde80ebe23494d08 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:30.980281 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_320b02e7f0f648b98ffa56a638cc5283"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:30.980897 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_320b02e7f0f648b98ffa56a638cc5283 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:30.983702 898 tablet_service.cc:1511] Processing CreateTablet for tablet 8aac627aab0d41bda3053c57029a26fd (DEFAULT_TABLE table=default.Table_e7940bdd0aa248b9bb9049e759f5d72e [id=45dc1528ffbe4ff09fc344b4a33bf924]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:30.984117 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aac627aab0d41bda3053c57029a26fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:30.986199 1813 consensus_queue.cc:1048] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260318 02:51:30.993551 1175 tablet_replica.cc:333] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:30.993755 1175 raft_consensus.cc:2243] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:30.999751 1175 pending_rounds.cc:70] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18: Trying to abort 1 pending ops.
I20260318 02:51:30.999894 1175 pending_rounds.cc:77] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494183334957056 op_type: NO_OP noop_request { }
I20260318 02:51:31.000056 1175 raft_consensus.cc:2889] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:31.000187 1175 raft_consensus.cc:2272] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:30.998891 1817 raft_consensus.cc:515] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:31.000995 1175 ts_tablet_manager.cc:1916] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:31.002624 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 71ea229381d540fdae9b2d7bf3eac2b6 (DEFAULT_TABLE table=default.Table_c9bc81a187a443318d1f42d64fd9330a [id=7e04ce6af13b48cd9f339f56eb4bbbb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.003058 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ea229381d540fdae9b2d7bf3eac2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.002997 1027 tablet_service.cc:1511] Processing CreateTablet for tablet f8e428b700044eaf9e360f74c751a206 (DEFAULT_TABLE table=default.Table_c89f8c40260f47be9787ac38ce5dcd46 [id=1dbb8f277403450086790ee9034c98da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.006032 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e428b700044eaf9e360f74c751a206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.007829 905 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9a5b965cb141e1a5dd1c96f590ad5a (DEFAULT_TABLE table=default.Table_25494285095147fa885f1aa79e2f1722 [id=6f9a87f338414f20bb3969d3c3cdfa64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.008219 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9a5b965cb141e1a5dd1c96f590ad5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.009423 1176 ts_tablet_manager.cc:1929] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:31.009616 1176 log.cc:1199] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/b716c3a80d4a44d190de38f926098efc
I20260318 02:51:31.009994 1176 ts_tablet_manager.cc:1950] T b716c3a80d4a44d190de38f926098efc P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:31.011112 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet b716c3a80d4a44d190de38f926098efc (table default.Table_b173d9dd6cc74a9ea5044ae888a3bd14 [id=08016e8769bf4007bdb2eba7c11fe0f7]) successfully deleted
I20260318 02:51:31.013775 1176 tablet_replica.cc:333] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad: stopping tablet replica
W20260318 02:51:31.019057 999 leader_election.cc:343] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 30205728339f4bcf8b7d94d6f373e01c
I20260318 02:51:31.019485 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9a5b965cb141e1a5dd1c96f590ad5a (DEFAULT_TABLE table=default.Table_25494285095147fa885f1aa79e2f1722 [id=6f9a87f338414f20bb3969d3c3cdfa64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.020690 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9a5b965cb141e1a5dd1c96f590ad5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.021682 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8bf09a136846eaababb5593e1833fc (DEFAULT_TABLE table=default.Table_b19e155d16bd4725a2d4200eda764366 [id=43a3c5574a7647f69a07ee7a5b646511]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.022138 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8bf09a136846eaababb5593e1833fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.030895 1184 ts_tablet_manager.cc:1929] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:31.031149 1184 log.cc:1199] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/5db76f996b094bf99b6c6fe33f02b9f3
I20260318 02:51:31.031586 1184 ts_tablet_manager.cc:1950] T 5db76f996b094bf99b6c6fe33f02b9f3 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:31.034233 1176 raft_consensus.cc:2243] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:31.034425 1176 raft_consensus.cc:2272] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:31.034973 1176 ts_tablet_manager.cc:1916] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:31.043351 1756 raft_consensus.cc:493] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:31.043515 1756 raft_consensus.cc:515] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.044132 1756 leader_election.cc:290] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:31.044270 1817 leader_election.cc:290] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:31.044975 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6088f65949e24799973bd1f432b25dc7" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:31.045465 719 leader_election.cc:343] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:31.046712 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 8aac627aab0d41bda3053c57029a26fd (DEFAULT_TABLE table=default.Table_e7940bdd0aa248b9bb9049e759f5d72e [id=45dc1528ffbe4ff09fc344b4a33bf924]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.047392 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aac627aab0d41bda3053c57029a26fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.049732 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6088f65949e24799973bd1f432b25dc7" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:31.049870 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30205728339f4bcf8b7d94d6f373e01c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:31.050094 927 raft_consensus.cc:3060] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:31.050267 719 leader_election.cc:343] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:31.050395 719 leader_election.cc:304] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:31.050777 1756 raft_consensus.cc:2749] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:31.049902 899 tablet_service.cc:1511] Processing CreateTablet for tablet f8e428b700044eaf9e360f74c751a206 (DEFAULT_TABLE table=default.Table_c89f8c40260f47be9787ac38ce5dcd46 [id=1dbb8f277403450086790ee9034c98da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.051564 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 2adcc9f1ad69458c997475111bb787cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.052198 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c8264f69f934d3ba2e41434ce350f3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.052309 893 tablet_service.cc:1511] Processing CreateTablet for tablet 71ea229381d540fdae9b2d7bf3eac2b6 (DEFAULT_TABLE table=default.Table_c9bc81a187a443318d1f42d64fd9330a [id=7e04ce6af13b48cd9f339f56eb4bbbb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.052320 1034 tablet_service.cc:1511] Processing CreateTablet for tablet c152446c906c4ed6b5eb0e3ee4d1917e (DEFAULT_TABLE table=default.Table_6d1032d49d3244f0b80bf144e88b3d12 [id=e91ed69dd8a54478bc6e8374ad0202b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.052577 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b6267d3f6e142579c62bbb4b14da4b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.052863 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c152446c906c4ed6b5eb0e3ee4d1917e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.053026 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet e55bbc320b0e4f9595bae9816e594b82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.053313 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 30205728339f4bcf8b7d94d6f373e01c with delete_type TABLET_DATA_DELETED (replaced by tablet e3999f53c1cc4cb5a1d91eed23785cc6) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.053642 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e16272bcf9c435a80b32ba9cba9c738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.054032 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e428b700044eaf9e360f74c751a206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.054293 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet f1ff303b23184d4b92994bde194229b4 with delete_type TABLET_DATA_DELETED (replaced by tablet b5c19bc5e07949088c84cedbf944dfdb) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.055011 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet af793623466249e695b262ab451d4dc9 with delete_type TABLET_DATA_DELETED (replaced by tablet e57dbb1276114cd6b7d26f7167b99f25) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.055709 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ed4350e0fde4c8690970bc69830fcb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.056583 1043 tablet_service.cc:1558] Processing DeleteTablet for tablet c0349def0e4045f2b1e9a02dd654a174 with delete_type TABLET_DATA_DELETED (replaced by tablet 19748feaf1574824a3bf6ff8ae87f4a9) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.059314 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e99c2956a764e6cb07cbc41e4a6f2f8 with delete_type TABLET_DATA_DELETED (replaced by tablet ebfb14850afa4043848814f01eabf394) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.059625 897 tablet_service.cc:1558] Processing DeleteTablet for tablet c0349def0e4045f2b1e9a02dd654a174 with delete_type TABLET_DATA_DELETED (replaced by tablet 19748feaf1574824a3bf6ff8ae87f4a9) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.061420 1709 consensus_queue.cc:1048] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:31.067565 1813 raft_consensus.cc:493] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:31.067781 1813 raft_consensus.cc:515] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.068492 1813 leader_election.cc:290] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:31.074141 1176 ts_tablet_manager.cc:1929] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:31.074286 1176 log.cc:1199] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/4fa7c1d6879c40ebb8d989ebae205e9e
I20260318 02:51:31.074559 1176 ts_tablet_manager.cc:1950] T 4fa7c1d6879c40ebb8d989ebae205e9e P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:31.075466 1176 tablet_replica.cc:333] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:31.075670 1176 raft_consensus.cc:2243] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:31.075794 1176 raft_consensus.cc:2272] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:31.076329 1176 ts_tablet_manager.cc:1916] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:31.077821 999 leader_election.cc:343] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 0ed4350e0fde4c8690970bc69830fcb3
I20260318 02:51:31.081416 1172 tablet_bootstrap.cc:492] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:31.081594 1172 ts_tablet_manager.cc:1403] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.263s user 0.016s sys 0.035s
I20260318 02:51:31.082237 1817 raft_consensus.cc:493] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:31.082962 1817 raft_consensus.cc:515] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:31.084520 999 leader_election.cc:343] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: e55bbc320b0e4f9595bae9816e594b82
I20260318 02:51:31.084776 1817 leader_election.cc:290] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:31.085043 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 4fa7c1d6879c40ebb8d989ebae205e9e (table default.Table_d6ad068d690949058bd4fdeea68e31a3 [id=3557006319a041e69cf884ccd2ddd5dc]) successfully deleted
W20260318 02:51:31.086872 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 4fa6bf38381740a1bab1088ede6ede1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4fa6bf38381740a1bab1088ede6ede1c already in progress: creating tablet
I20260318 02:51:31.087342 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 666c2992fa4f479ab4ffd7ac0c3a9c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.088070 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 95f15079d1df4314b6dd5c7afd896af5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.078630 1184 tablet_replica.cc:333] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:31.087601 1861 tablet.cc:1723] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:31.087580 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 08307bc69291479eb8ee0d7aec124829 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.090562 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet b51a15e4303742a999fe9a96d450c827 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.090873 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d20847fa6f9461cb6137f56ea680cb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.091127 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet a20b9dc70b5147ff8798946eda3131ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.091449 1184 raft_consensus.cc:2243] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:31.091914 1184 raft_consensus.cc:2272] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:31.092851 1184 ts_tablet_manager.cc:1916] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:31.097880 892 tablet_service.cc:1511] Processing CreateTablet for tablet c152446c906c4ed6b5eb0e3ee4d1917e (DEFAULT_TABLE table=default.Table_6d1032d49d3244f0b80bf144e88b3d12 [id=e91ed69dd8a54478bc6e8374ad0202b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.100261 1709 consensus_queue.cc:1048] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260318 02:51:31.096174 441 catalog_manager.cc:4969] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f447cab3445c451d8ef8746966cfcd42 because the tablet was not found. No further retry: Not found: Tablet not found: f447cab3445c451d8ef8746966cfcd42
I20260318 02:51:31.102622 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet fda9f1fe47e04688bde80ebe23494d08 (table default.Table_3027337e0c384f2b868ff5550be99c07 [id=39b15a578c754e29b3e4f28015859a73]) successfully deleted
I20260318 02:51:31.108525 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a65f49199efd42e6a69e1765c4723285"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:31.109268 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a65f49199efd42e6a69e1765c4723285 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:31.118661 1740 raft_consensus.cc:493] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:31.118899 1740 raft_consensus.cc:515] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.119521 1740 leader_election.cc:290] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:31.121827 999 leader_election.cc:343] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 9d20847fa6f9461cb6137f56ea680cb6
I20260318 02:51:31.121959 1756 raft_consensus.cc:493] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:31.122097 1756 raft_consensus.cc:515] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.122661 1756 leader_election.cc:290] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:31.122715 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_039d1d42521f4f9f8be161d0b97004f7" } modify_external_catalogs: true
I20260318 02:51:31.122911 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_039d1d42521f4f9f8be161d0b97004f7" } modify_external_catalogs: true
I20260318 02:51:31.123240 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_821f8a94668d4ed19f00cb007a56b34d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:31.123876 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_821f8a94668d4ed19f00cb007a56b34d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:31.125562 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7883f526d06e442c81f1b66fd89d2cd0" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:31.126781 719 leader_election.cc:343] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:31.127395 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c152446c906c4ed6b5eb0e3ee4d1917e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.129599 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e99c2956a764e6cb07cbc41e4a6f2f8 with delete_type TABLET_DATA_DELETED (replaced by tablet ebfb14850afa4043848814f01eabf394) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.132628 1184 ts_tablet_manager.cc:1929] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:31.132786 1184 log.cc:1199] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/a4f891043b7d468da3e808980690354d
I20260318 02:51:31.133157 1184 ts_tablet_manager.cc:1950] T a4f891043b7d468da3e808980690354d P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:31.135394 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e16272bcf9c435a80b32ba9cba9c738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:21 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.135816 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 2bd6ac47ba044099ad9bd211ef8d26a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 7c4eca5e16f84564b31933b8227fd980) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.136130 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 30205728339f4bcf8b7d94d6f373e01c with delete_type TABLET_DATA_DELETED (replaced by tablet e3999f53c1cc4cb5a1d91eed23785cc6) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.137604 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 5db76f996b094bf99b6c6fe33f02b9f3 (table default.Table_1e9e471c1715493487baf6ce6eab167a [id=a6f1506993614ec5904423ac309abf1a]) successfully deleted
I20260318 02:51:31.141826 1174 tablet_bootstrap.cc:492] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:31.082450 1172 raft_consensus.cc:359] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.142181 1172 raft_consensus.cc:385] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:31.142309 1172 raft_consensus.cc:740] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:31.146273 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet a4f891043b7d468da3e808980690354d (table default.Table_607d1941968145a6a336b9a5bb85b43e [id=85784a23699343ee80e0adb9e5f82413]) successfully deleted
I20260318 02:51:31.146368 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7883f526d06e442c81f1b66fd89d2cd0" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:31.146592 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 4fa6bf38381740a1bab1088ede6ede1c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4fa6bf38381740a1bab1088ede6ede1c already in progress: creating tablet
I20260318 02:51:31.165382 927 raft_consensus.cc:2468] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:31.168010 448 master_service.cc:954] ReplaceTablet: received request to replace tablet 44cc50429d4f4c109629a9ad08b06bb3 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:31.174211 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2a7ddc0807d742cea258f889390e2142
I20260318 02:51:31.180122 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2dab268da5e843cab5c28a521217df97
I20260318 02:51:31.180649 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 44cc50429d4f4c109629a9ad08b06bb3
I20260318 02:51:31.181068 448 catalog_manager.cc:6741] ReplaceTablet: tablet 44cc50429d4f4c109629a9ad08b06bb3 deleted and replaced by tablet 8c1ba16db9d040708f8fd75c852bdbb1
I20260318 02:51:31.185693 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3c8778ad1e5149aeafe6d2c059b95881"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:31.186311 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c8778ad1e5149aeafe6d2c059b95881 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:31.189384 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a1f1780a70204cb983ce946bf6c26eb7" } new_table_name: "default.Table_ad02fb74a8e54e76ba7370a1d85c60b8" modify_external_catalogs: true
W20260318 02:51:31.200243 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3868406102b748a5b13420b24bf16485 consensus state has no leader
I20260318 02:51:31.201427 453 catalog_manager.cc:5671] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:31.201849 453 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet bc47f35f9c2c4e5085ab482285effc91 (table default.Table_9867792729394010ba769354562198f3 [id=1515573be85644d7a4f046947aa1537b]). Expected version 3 got 0
I20260318 02:51:31.202131 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 2adcc9f1ad69458c997475111bb787cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.200665 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 6deb99f7937144f39409929f99b135c5
I20260318 02:51:31.204098 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c9bc81a187a443318d1f42d64fd9330a" } new_table_name: "default.Table_926310d9a26348c189418c2df85654a9" modify_external_catalogs: true
I20260318 02:51:31.207039 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8a690b74a1804277b7f6584b8900ac0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:31.207211 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6aa6181c2ea647e9a91f1a0ec07fdfa3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:31.207348 1175 ts_tablet_manager.cc:1929] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:31.207453 1175 log.cc:1199] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/a4f891043b7d468da3e808980690354d
W20260318 02:51:31.207590 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a690b74a1804277b7f6584b8900ac0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:31.210915 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ea229381d540fdae9b2d7bf3eac2b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.211711 900 tablet_service.cc:1558] Processing DeleteTablet for tablet e55bbc320b0e4f9595bae9816e594b82 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.147325 1184 tablet_replica.cc:333] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:31.212499 1184 raft_consensus.cc:2243] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:31.212734 1184 raft_consensus.cc:2272] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:31.213289 1184 ts_tablet_manager.cc:1916] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:31.159760 1760 consensus_queue.cc:1048] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:31.161901 1740 raft_consensus.cc:493] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:31.183969 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 2dab268da5e843cab5c28a521217df97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.184757 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet 44cc50429d4f4c109629a9ad08b06bb3 with delete_type TABLET_DATA_DELETED (replaced by tablet 8c1ba16db9d040708f8fd75c852bdbb1) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.207635 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 6deb99f7937144f39409929f99b135c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.218559 1740 raft_consensus.cc:515] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.219233 1740 leader_election.cc:290] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:31.221249 999 leader_election.cc:343] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 08307bc69291479eb8ee0d7aec124829
W20260318 02:51:31.221954 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6aa6181c2ea647e9a91f1a0ec07fdfa3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:31.224581 1184 ts_tablet_manager.cc:1929] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:31.224824 1184 log.cc:1199] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/fda9f1fe47e04688bde80ebe23494d08
W20260318 02:51:31.225142 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 71ea229381d540fdae9b2d7bf3eac2b6 consensus state has no leader
I20260318 02:51:31.225338 1184 ts_tablet_manager.cc:1950] T fda9f1fe47e04688bde80ebe23494d08 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:31.226715 1184 tablet_replica.cc:333] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:31.226994 1184 raft_consensus.cc:2243] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:31.227303 1184 pending_rounds.cc:70] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d: Trying to abort 1 pending ops.
I20260318 02:51:31.227398 1184 pending_rounds.cc:77] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494183345098752 op_type: NO_OP noop_request { }
I20260318 02:51:31.227578 1184 raft_consensus.cc:2889] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:31.227735 1184 raft_consensus.cc:2272] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:31.227730 1033 tablet_service.cc:1511] Processing CreateTablet for tablet ac81de0ecdc24b87a4595bbb6f3e849b (DEFAULT_TABLE table=default.Table_12fb0eb56f354fdc9acff9c77b5bf3fa [id=4a49b623ebf74380b28692edf714478a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.228283 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac81de0ecdc24b87a4595bbb6f3e849b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.228406 1172 consensus_queue.cc:260] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.230497 1172 ts_tablet_manager.cc:1434] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.149s user 0.001s sys 0.001s
I20260318 02:51:31.230826 1172 tablet_bootstrap.cc:492] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:31.232429 1172 tablet_bootstrap.cc:654] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:31.233217 1175 ts_tablet_manager.cc:1950] T a4f891043b7d468da3e808980690354d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:31.233714 900 tablet_service.cc:1558] Processing DeleteTablet for tablet a20b9dc70b5147ff8798946eda3131ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.245421 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet fda9f1fe47e04688bde80ebe23494d08 (table default.Table_3027337e0c384f2b868ff5550be99c07 [id=39b15a578c754e29b3e4f28015859a73]) successfully deleted
I20260318 02:51:31.248257 1174 ts_tablet_manager.cc:1403] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.367s user 0.002s sys 0.002s
I20260318 02:51:31.144488 1176 ts_tablet_manager.cc:1929] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:31.248824 1176 log.cc:1199] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/dea25aaad60a4b2483a8832f995d1316
I20260318 02:51:31.249145 1176 ts_tablet_manager.cc:1950] T dea25aaad60a4b2483a8832f995d1316 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
W20260318 02:51:31.157186 719 leader_election.cc:343] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:31.249302 719 leader_election.cc:304] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:31.249601 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 92447.7us
I20260318 02:51:31.249841 1174 raft_consensus.cc:359] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.250025 1176 tablet_replica.cc:333] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:31.163235 1862 tablet.cc:1723] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:31.250195 1176 raft_consensus.cc:2243] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:31.250304 1176 raft_consensus.cc:2272] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:31.175527 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a7ddc0807d742cea258f889390e2142 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:31.181929 747 tablet_service.cc:1558] Processing DeleteTablet for tablet 2dab268da5e843cab5c28a521217df97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:31.182052 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 44cc50429d4f4c109629a9ad08b06bb3 with delete_type TABLET_DATA_DELETED (replaced by tablet 8c1ba16db9d040708f8fd75c852bdbb1) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:31.250861 1176 ts_tablet_manager.cc:1916] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:31.205096 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 6deb99f7937144f39409929f99b135c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:31.209370 753 tablet_service.cc:1511] Processing CreateTablet for tablet 27ef5968dd8440509104ab816f13ecea (DEFAULT_TABLE table=default.Table_429f0c1c10f44c3ba16cd3bbe5c0089b [id=b7fe420df8ed44f1ad125739e4924f9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.251921 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27ef5968dd8440509104ab816f13ecea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.212323 757 tablet_service.cc:1511] Processing CreateTablet for tablet c3d6574f9a4747b9ac417790fd978823 (DEFAULT_TABLE table=default.Table_a614370b71c542db819ec98834a87cec [id=edee3acec713434f825122a30e743bf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.204885 759 tablet_service.cc:1511] Processing CreateTablet for tablet ac81de0ecdc24b87a4595bbb6f3e849b (DEFAULT_TABLE table=default.Table_12fb0eb56f354fdc9acff9c77b5bf3fa [id=4a49b623ebf74380b28692edf714478a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.216740 755 tablet_service.cc:1511] Processing CreateTablet for tablet 91eba790375e4806a3f5766b6240d595 (DEFAULT_TABLE table=default.Table_10187817db2d460889de2a6e1b646b2d [id=cfa615e7b9c145149109149ab02165f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.253963 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac81de0ecdc24b87a4595bbb6f3e849b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.254155 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91eba790375e4806a3f5766b6240d595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.222092 754 tablet_service.cc:1511] Processing CreateTablet for tablet 90e188d8dc3d44c7a342aebd9aa0e299 (DEFAULT_TABLE table=default.Table_ca9ce0c2522f46caaaf7d3081ec90c71 [id=2cf4e2ed333a447f9289d25cc179510d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.254441 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90e188d8dc3d44c7a342aebd9aa0e299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.222436 761 tablet_service.cc:1511] Processing CreateTablet for tablet cdafabcad8a64c2094a3e55ea52178bd (DEFAULT_TABLE table=default.Table_42a80fd8d8eb4cffadcbe255e0c315b2 [id=83252b1e84af4b57866a242bfd9c4280]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.250010 1174 raft_consensus.cc:385] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:31.256832 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d6574f9a4747b9ac417790fd978823. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.226827 756 tablet_service.cc:1511] Processing CreateTablet for tablet 2a0f95a6757040c3afc682b3d33f5b07 (DEFAULT_TABLE table=default.Table_bd7b316d378c4633a0bb8139d43fbb62 [id=9cf08fdade2546c6ae6d5eba2854ff4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.257124 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a0f95a6757040c3afc682b3d33f5b07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.257402 1176 ts_tablet_manager.cc:1929] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:31.257534 1176 log.cc:1199] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/7883f526d06e442c81f1b66fd89d2cd0
I20260318 02:51:31.257799 1176 ts_tablet_manager.cc:1950] T 7883f526d06e442c81f1b66fd89d2cd0 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:31.258827 1176 tablet_replica.cc:333] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:31.259001 1176 raft_consensus.cc:2243] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:31.259145 1176 raft_consensus.cc:2272] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:31.259234 444 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 3868406102b748a5b13420b24bf16485 (table default.Table_ad02fb74a8e54e76ba7370a1d85c60b8 [id=a7ad61d6d9264ec4ac482798b1ea992e], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3868406102b748a5b13420b24bf16485 consensus state has no leader
I20260318 02:51:31.232782 762 tablet_service.cc:1511] Processing CreateTablet for tablet 52b773c3412c4bc792471096802b3f1a (DEFAULT_TABLE table=default.Table_793e04a202214a95b056303786d5f5bd [id=63db8e7eefba49829e5d3f6e385ea9dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.237318 752 tablet_service.cc:1511] Processing CreateTablet for tablet 19748feaf1574824a3bf6ff8ae87f4a9 (DEFAULT_TABLE table=default.Table_cd6fa6816d194e7fb86251cce055a47f [id=76d5bb45e6b3427591b09343d5fc206a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.259611 1176 ts_tablet_manager.cc:1916] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:31.217124 750 tablet_service.cc:1511] Processing CreateTablet for tablet 480f4438de13453fa84ce8c37388aeb1 (DEFAULT_TABLE table=default.Table_4628ee4bf3294e908b99ec30079b8cc9 [id=454158c183e24babbfb913541d927ccf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.243261 751 tablet_service.cc:1511] Processing CreateTablet for tablet 56957d38bee54080831abd44865c8dc4 (DEFAULT_TABLE table=default.Table_15ff9e631a4c46349b3addf65f585e69 [id=2e8ce4343c2e46d5babc6d712de07e5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.243722 764 tablet_service.cc:1511] Processing CreateTablet for tablet 82d1e4cc5af6416ea6db123cfa321a53 (DEFAULT_TABLE table=default.Table_593af5f4ba59487a8dd335fdb4048253 [id=ba8e159cd47e4d8f910a5af3f68a5024]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.259025 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdafabcad8a64c2094a3e55ea52178bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.260179 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d1e4cc5af6416ea6db123cfa321a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.231034 766 tablet_service.cc:1511] Processing CreateTablet for tablet 535ff4839c9646a594db820dd5308d70 (DEFAULT_TABLE table=default.Table_734eb14f943e4eab8ff7d14d00729858 [id=2d188e1de3394072a2327c0d08901bf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.260434 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535ff4839c9646a594db820dd5308d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.263531 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19748feaf1574824a3bf6ff8ae87f4a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.264856 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b773c3412c4bc792471096802b3f1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.267215 900 tablet_service.cc:1558] Processing DeleteTablet for tablet b51a15e4303742a999fe9a96d450c827 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.268838 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480f4438de13453fa84ce8c37388aeb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.271844 1175 tablet_replica.cc:333] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:31.272042 1175 raft_consensus.cc:2243] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:31.272397 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a7ddc0807d742cea258f889390e2142 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.272437 453 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e] alter complete (version 1)
I20260318 02:51:31.240190 748 tablet_service.cc:1511] Processing CreateTablet for tablet ebfb14850afa4043848814f01eabf394 (DEFAULT_TABLE table=default.Table_62c15aab881b46dba0f3fb97b039ec08 [id=9a0951ffecfc404292f3af69337bde0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.272996 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebfb14850afa4043848814f01eabf394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.273566 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet dea25aaad60a4b2483a8832f995d1316 (table default.Table_cfe05462158449cca7f529d5a37270be [id=feac1e97445140d9bfcb8eb2b9996498]) successfully deleted
I20260318 02:51:31.273775 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 7883f526d06e442c81f1b66fd89d2cd0 (table default.Table_bc4b73281db84d099008d5b137871ff9 [id=32f5b93025f84549a496e5827512aed5]) successfully deleted
W20260318 02:51:31.273978 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet c0349def0e4045f2b1e9a02dd654a174 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0349def0e4045f2b1e9a02dd654a174 already in progress: creating tablet
W20260318 02:51:31.275379 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 0e99c2956a764e6cb07cbc41e4a6f2f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e99c2956a764e6cb07cbc41e4a6f2f8 already in progress: creating tablet
I20260318 02:51:31.277803 1175 pending_rounds.cc:70] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18: Trying to abort 1 pending ops.
I20260318 02:51:31.277868 1175 pending_rounds.cc:77] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494182066102272 op_type: NO_OP noop_request { }
I20260318 02:51:31.277957 1175 raft_consensus.cc:2889] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:31.278036 1175 raft_consensus.cc:2272] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:31.278111 454 master_service.cc:954] ReplaceTablet: received request to replace tablet c0c33cfa1c194a65bfc64d0e1e9434ff from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:31.278282 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6a96af2ea8f04b2a8b13896020fb7bf0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:31.278846 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a96af2ea8f04b2a8b13896020fb7bf0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:31.279839 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 2dab268da5e843cab5c28a521217df97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.280537 1175 ts_tablet_manager.cc:1916] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:31.256814 1174 raft_consensus.cc:740] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:31.280850 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56957d38bee54080831abd44865c8dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.281124 1174 consensus_queue.cc:260] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.282284 1174 ts_tablet_manager.cc:1434] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.034s user 0.002s sys 0.000s
I20260318 02:51:31.282963 1174 tablet_bootstrap.cc:492] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:31.285128 1756 raft_consensus.cc:493] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:31.285243 1756 raft_consensus.cc:515] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.285770 1756 leader_election.cc:290] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:31.286243 1174 tablet_bootstrap.cc:654] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:31.289106 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_659b60f9843f48f698d176f54ae06d07" } modify_external_catalogs: true
I20260318 02:51:31.289499 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_992b9f90aa8c4e51959ca139974f10fe" } new_table_name: "default.Table_b1d3f1dcf5d3445a817d681110d65f37" modify_external_catalogs: true
I20260318 02:51:31.289814 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6d506ddf2c854df0a30d396a197e4032" } modify_external_catalogs: true
I20260318 02:51:31.290133 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_842d2c36399843b293a023c3043c631d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:31.290701 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_842d2c36399843b293a023c3043c631d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:31.291033 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_52514fef886048238fee929512ba027f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:31.291548 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52514fef886048238fee929512ba027f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:31.291823 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_edb797a4cd00413ca8adcf77fbd0164c" } new_table_name: "default.Table_be6fe6ada3fa4705b82768b6862b1de9" modify_external_catalogs: true
I20260318 02:51:31.293152 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 44cc50429d4f4c109629a9ad08b06bb3 with delete_type TABLET_DATA_DELETED (replaced by tablet 8c1ba16db9d040708f8fd75c852bdbb1) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.294219 892 tablet_service.cc:1511] Processing CreateTablet for tablet ac81de0ecdc24b87a4595bbb6f3e849b (DEFAULT_TABLE table=default.Table_12fb0eb56f354fdc9acff9c77b5bf3fa [id=4a49b623ebf74380b28692edf714478a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.294898 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bdf933d3dd024516a917b03a05f291a7" } new_table_name: "default.Table_9b00b191fd624f53bcbb0ad0f48c4de5" modify_external_catalogs: true
I20260318 02:51:31.295706 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac81de0ecdc24b87a4595bbb6f3e849b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.297989 895 tablet_service.cc:1511] Processing CreateTablet for tablet 27ef5968dd8440509104ab816f13ecea (DEFAULT_TABLE table=default.Table_429f0c1c10f44c3ba16cd3bbe5c0089b [id=b7fe420df8ed44f1ad125739e4924f9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.298408 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27ef5968dd8440509104ab816f13ecea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.301229 906 tablet_service.cc:1511] Processing CreateTablet for tablet 91eba790375e4806a3f5766b6240d595 (DEFAULT_TABLE table=default.Table_10187817db2d460889de2a6e1b646b2d [id=cfa615e7b9c145149109149ab02165f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.301621 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91eba790375e4806a3f5766b6240d595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.301563 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6d506ddf2c854df0a30d396a197e4032" } modify_external_catalogs: true
I20260318 02:51:31.304944 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_659b60f9843f48f698d176f54ae06d07" } modify_external_catalogs: true
I20260318 02:51:31.309016 905 tablet_service.cc:1511] Processing CreateTablet for tablet c3d6574f9a4747b9ac417790fd978823 (DEFAULT_TABLE table=default.Table_a614370b71c542db819ec98834a87cec [id=edee3acec713434f825122a30e743bf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.309443 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d6574f9a4747b9ac417790fd978823. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.314016 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet c0c33cfa1c194a65bfc64d0e1e9434ff
I20260318 02:51:31.314532 454 catalog_manager.cc:6741] ReplaceTablet: tablet c0c33cfa1c194a65bfc64d0e1e9434ff deleted and replaced by tablet e918bb008e0743a9bf7ada170812146e
I20260318 02:51:31.314838 766 tablet_service.cc:1558] Processing DeleteTablet for tablet c0c33cfa1c194a65bfc64d0e1e9434ff with delete_type TABLET_DATA_DELETED (replaced by tablet e918bb008e0743a9bf7ada170812146e) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:31.316972 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 6deb99f7937144f39409929f99b135c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.319128 1173 tablet_bootstrap.cc:492] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:31.319276 1173 ts_tablet_manager.cc:1403] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.457s user 0.012s sys 0.030s
I20260318 02:51:31.320016 1173 raft_consensus.cc:359] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.320188 1173 raft_consensus.cc:385] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:31.320236 1173 raft_consensus.cc:740] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:31.320431 1173 consensus_queue.cc:260] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.320930 1173 ts_tablet_manager.cc:1434] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:31.327136 899 tablet_service.cc:1511] Processing CreateTablet for tablet 90e188d8dc3d44c7a342aebd9aa0e299 (DEFAULT_TABLE table=default.Table_ca9ce0c2522f46caaaf7d3081ec90c71 [id=2cf4e2ed333a447f9289d25cc179510d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.327729 900 tablet_service.cc:1511] Processing CreateTablet for tablet 480f4438de13453fa84ce8c37388aeb1 (DEFAULT_TABLE table=default.Table_4628ee4bf3294e908b99ec30079b8cc9 [id=454158c183e24babbfb913541d927ccf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.328163 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480f4438de13453fa84ce8c37388aeb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.330554 888 tablet_service.cc:1511] Processing CreateTablet for tablet cdafabcad8a64c2094a3e55ea52178bd (DEFAULT_TABLE table=default.Table_42a80fd8d8eb4cffadcbe255e0c315b2 [id=83252b1e84af4b57866a242bfd9c4280]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.330914 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdafabcad8a64c2094a3e55ea52178bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.337134 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90e188d8dc3d44c7a342aebd9aa0e299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.344659 1173 tablet_bootstrap.cc:492] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:31.349020 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2789a1195e7344c18dd226e196e2f302" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:31.349090 902 tablet_service.cc:1511] Processing CreateTablet for tablet 2a0f95a6757040c3afc682b3d33f5b07 (DEFAULT_TABLE table=default.Table_bd7b316d378c4633a0bb8139d43fbb62 [id=9cf08fdade2546c6ae6d5eba2854ff4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.349526 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a0f95a6757040c3afc682b3d33f5b07. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:31.350586 719 leader_election.cc:343] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:31.355459 889 tablet_service.cc:1511] Processing CreateTablet for tablet 52b773c3412c4bc792471096802b3f1a (DEFAULT_TABLE table=default.Table_793e04a202214a95b056303786d5f5bd [id=63db8e7eefba49829e5d3f6e385ea9dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.355930 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b773c3412c4bc792471096802b3f1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.372576 1709 consensus_queue.cc:1048] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260318 02:51:31.389405 1173 tablet_bootstrap.cc:654] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:31.391664 906 tablet_service.cc:1511] Processing CreateTablet for tablet 535ff4839c9646a594db820dd5308d70 (DEFAULT_TABLE table=default.Table_734eb14f943e4eab8ff7d14d00729858 [id=2d188e1de3394072a2327c0d08901bf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.392099 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535ff4839c9646a594db820dd5308d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.393146 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_bf41e4bbbe2e4a3bbf8740b2ab558311"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:31.393153 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d22d1d6f0ce44b6fba47b797e8d6e18d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:31.393831 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf41e4bbbe2e4a3bbf8740b2ab558311 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:31.393831 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d22d1d6f0ce44b6fba47b797e8d6e18d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:31.396411 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d2c64dc7c0b479494ca474dad51a528 consensus state has no leader
I20260318 02:51:31.397329 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 916b5b77fb2f4003b78a71025319ed15
I20260318 02:51:31.401257 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 916b5b77fb2f4003b78a71025319ed15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:31.401321 902 tablet_service.cc:1511] Processing CreateTablet for tablet 19748feaf1574824a3bf6ff8ae87f4a9 (DEFAULT_TABLE table=default.Table_cd6fa6816d194e7fb86251cce055a47f [id=76d5bb45e6b3427591b09343d5fc206a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.401520 889 tablet_service.cc:1511] Processing CreateTablet for tablet 82d1e4cc5af6416ea6db123cfa321a53 (DEFAULT_TABLE table=default.Table_593af5f4ba59487a8dd335fdb4048253 [id=ba8e159cd47e4d8f910a5af3f68a5024]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.401696 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19748feaf1574824a3bf6ff8ae87f4a9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:31.403637 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 572553569bbe4731b2580f1d22ee4fdd consensus state has no leader
I20260318 02:51:31.404232 905 tablet_service.cc:1511] Processing CreateTablet for tablet ebfb14850afa4043848814f01eabf394 (DEFAULT_TABLE table=default.Table_62c15aab881b46dba0f3fb97b039ec08 [id=9a0951ffecfc404292f3af69337bde0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.405670 896 tablet_service.cc:1558] Processing DeleteTablet for tablet c0c33cfa1c194a65bfc64d0e1e9434ff with delete_type TABLET_DATA_DELETED (replaced by tablet e918bb008e0743a9bf7ada170812146e) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.409950 1184 ts_tablet_manager.cc:1916] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:31.410485 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2789a1195e7344c18dd226e196e2f302" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:31.413614 1174 tablet_bootstrap.cc:492] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:31.413828 1174 ts_tablet_manager.cc:1403] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.131s user 0.026s sys 0.007s
W20260318 02:51:31.414186 719 leader_election.cc:343] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:31.414295 719 leader_election.cc:304] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:31.414647 1174 raft_consensus.cc:359] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.414816 1174 raft_consensus.cc:385] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:31.414862 1174 raft_consensus.cc:740] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:31.415071 1174 consensus_queue.cc:260] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.415179 1756 raft_consensus.cc:2749] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:31.419840 1760 raft_consensus.cc:493] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:31.421702 1174 ts_tablet_manager.cc:1434] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260318 02:51:31.422238 1174 tablet_bootstrap.cc:492] T a20b9dc70b5147ff8798946eda3131ca P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:31.422492 1813 consensus_queue.cc:1048] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260318 02:51:31.424821 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 27ef5968dd8440509104ab816f13ecea (DEFAULT_TABLE table=default.Table_429f0c1c10f44c3ba16cd3bbe5c0089b [id=b7fe420df8ed44f1ad125739e4924f9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.426263 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27ef5968dd8440509104ab816f13ecea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.430477 1026 tablet_service.cc:1511] Processing CreateTablet for tablet c3d6574f9a4747b9ac417790fd978823 (DEFAULT_TABLE table=default.Table_a614370b71c542db819ec98834a87cec [id=edee3acec713434f825122a30e743bf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.431031 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d6574f9a4747b9ac417790fd978823. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.432099 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 480f4438de13453fa84ce8c37388aeb1 (DEFAULT_TABLE table=default.Table_4628ee4bf3294e908b99ec30079b8cc9 [id=454158c183e24babbfb913541d927ccf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.432459 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 91eba790375e4806a3f5766b6240d595 (DEFAULT_TABLE table=default.Table_10187817db2d460889de2a6e1b646b2d [id=cfa615e7b9c145149109149ab02165f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.433025 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a7ddc0807d742cea258f889390e2142 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.434489 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 2a0f95a6757040c3afc682b3d33f5b07 (DEFAULT_TABLE table=default.Table_bd7b316d378c4633a0bb8139d43fbb62 [id=9cf08fdade2546c6ae6d5eba2854ff4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.435166 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480f4438de13453fa84ce8c37388aeb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.436735 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91eba790375e4806a3f5766b6240d595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.437871 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a0f95a6757040c3afc682b3d33f5b07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.438512 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 90e188d8dc3d44c7a342aebd9aa0e299 (DEFAULT_TABLE table=default.Table_ca9ce0c2522f46caaaf7d3081ec90c71 [id=2cf4e2ed333a447f9289d25cc179510d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.438848 1034 tablet_service.cc:1511] Processing CreateTablet for tablet cdafabcad8a64c2094a3e55ea52178bd (DEFAULT_TABLE table=default.Table_42a80fd8d8eb4cffadcbe255e0c315b2 [id=83252b1e84af4b57866a242bfd9c4280]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.439241 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdafabcad8a64c2094a3e55ea52178bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.440124 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90e188d8dc3d44c7a342aebd9aa0e299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.443713 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d1e4cc5af6416ea6db123cfa321a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.457602 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebfb14850afa4043848814f01eabf394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.460382 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 916b5b77fb2f4003b78a71025319ed15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.461125 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 19748feaf1574824a3bf6ff8ae87f4a9 (DEFAULT_TABLE table=default.Table_cd6fa6816d194e7fb86251cce055a47f [id=76d5bb45e6b3427591b09343d5fc206a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.461611 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19748feaf1574824a3bf6ff8ae87f4a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.464993 1027 tablet_service.cc:1511] Processing CreateTablet for tablet ebfb14850afa4043848814f01eabf394 (DEFAULT_TABLE table=default.Table_62c15aab881b46dba0f3fb97b039ec08 [id=9a0951ffecfc404292f3af69337bde0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.467451 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebfb14850afa4043848814f01eabf394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.470610 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 916b5b77fb2f4003b78a71025319ed15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.472208 1044 tablet_service.cc:1558] Processing DeleteTablet for tablet c0c33cfa1c194a65bfc64d0e1e9434ff with delete_type TABLET_DATA_DELETED (replaced by tablet e918bb008e0743a9bf7ada170812146e) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.472800 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 56957d38bee54080831abd44865c8dc4 (DEFAULT_TABLE table=default.Table_15ff9e631a4c46349b3addf65f585e69 [id=2e8ce4343c2e46d5babc6d712de07e5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.473287 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56957d38bee54080831abd44865c8dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.474257 899 tablet_service.cc:1511] Processing CreateTablet for tablet 56957d38bee54080831abd44865c8dc4 (DEFAULT_TABLE table=default.Table_15ff9e631a4c46349b3addf65f585e69 [id=2e8ce4343c2e46d5babc6d712de07e5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.475581 1175 ts_tablet_manager.cc:1929] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:31.475689 1175 log.cc:1199] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/2e16272bcf9c435a80b32ba9cba9c738
I20260318 02:51:31.476465 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 82d1e4cc5af6416ea6db123cfa321a53 (DEFAULT_TABLE table=default.Table_593af5f4ba59487a8dd335fdb4048253 [id=ba8e159cd47e4d8f910a5af3f68a5024]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.476980 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d1e4cc5af6416ea6db123cfa321a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.491765 1782 raft_consensus.cc:493] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:31.491746 1813 raft_consensus.cc:493] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:31.491928 1782 raft_consensus.cc:515] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.491969 1813 raft_consensus.cc:515] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.492503 1782 leader_election.cc:290] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:31.492678 1813 leader_election.cc:290] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:31.493196 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55bbc320b0e4f9595bae9816e594b82" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:31.493386 1061 raft_consensus.cc:2468] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:31.495016 860 leader_election.cc:304] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
W20260318 02:51:31.495316 862 leader_election.cc:343] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: e55bbc320b0e4f9595bae9816e594b82
I20260318 02:51:31.496460 1782 raft_consensus.cc:2804] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:31.496560 1782 raft_consensus.cc:493] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:31.496618 1782 raft_consensus.cc:3060] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:31.499056 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 535ff4839c9646a594db820dd5308d70 (DEFAULT_TABLE table=default.Table_734eb14f943e4eab8ff7d14d00729858 [id=2d188e1de3394072a2327c0d08901bf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.499418 1782 raft_consensus.cc:515] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.499719 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 535ff4839c9646a594db820dd5308d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.500753 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55bbc320b0e4f9595bae9816e594b82" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:31.501006 1061 raft_consensus.cc:3060] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:31.501974 862 leader_election.cc:343] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: e55bbc320b0e4f9595bae9816e594b82
I20260318 02:51:31.502151 1782 leader_election.cc:290] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:31.504397 1061 raft_consensus.cc:2468] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:31.504627 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet a4f891043b7d468da3e808980690354d (table default.Table_607d1941968145a6a336b9a5bb85b43e [id=85784a23699343ee80e0adb9e5f82413]) successfully deleted
W20260318 02:51:31.505132 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet c0349def0e4045f2b1e9a02dd654a174 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0349def0e4045f2b1e9a02dd654a174 already in progress: creating tablet
I20260318 02:51:31.505195 860 leader_election.cc:304] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
W20260318 02:51:31.505429 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 0e99c2956a764e6cb07cbc41e4a6f2f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e99c2956a764e6cb07cbc41e4a6f2f8 already in progress: creating tablet
I20260318 02:51:31.506016 1780 raft_consensus.cc:2804] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:31.506141 1780 raft_consensus.cc:697] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:31.506431 1780 consensus_queue.cc:237] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.507733 1173 tablet_bootstrap.cc:492] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:31.507876 1173 ts_tablet_manager.cc:1403] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.163s user 0.010s sys 0.000s
I20260318 02:51:31.510159 1782 consensus_queue.cc:1048] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:31.510419 997 leader_election.cc:304] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:31.511511 1740 raft_consensus.cc:2804] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:31.511700 1740 raft_consensus.cc:697] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:31.512028 1740 consensus_queue.cc:237] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:31.513965 999 leader_election.cc:343] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 666c2992fa4f479ab4ffd7ac0c3a9c92
I20260318 02:51:31.527488 1861 tablet.cc:1723] T 918c542a51864e54871efc5e7f62ef61 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260318 02:51:31.534176 1175 ts_tablet_manager.cc:1950] T 2e16272bcf9c435a80b32ba9cba9c738 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:31.543200 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55bbc320b0e4f9595bae9816e594b82" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:31.543586 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d20847fa6f9461cb6137f56ea680cb6" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:31.543960 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08307bc69291479eb8ee0d7aec124829" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:31.544363 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56957d38bee54080831abd44865c8dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.547312 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 52b773c3412c4bc792471096802b3f1a (DEFAULT_TABLE table=default.Table_793e04a202214a95b056303786d5f5bd [id=63db8e7eefba49829e5d3f6e385ea9dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.548235 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52b773c3412c4bc792471096802b3f1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.548574 1175 tablet_replica.cc:333] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:31.548810 1175 raft_consensus.cc:2243] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:31.548969 1175 raft_consensus.cc:2272] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:31.549510 1175 ts_tablet_manager.cc:1916] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:31.564131 1874 raft_consensus.cc:493] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:31.564468 1874 raft_consensus.cc:515] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.565259 1874 leader_election.cc:290] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:31.570735 1756 raft_consensus.cc:493] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:31.570906 1756 raft_consensus.cc:515] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.571525 1756 leader_election.cc:290] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:31.572300 1862 tablet.cc:1723] T 918c542a51864e54871efc5e7f62ef61 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260318 02:51:31.574590 1176 ts_tablet_manager.cc:1929] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:31.574721 1176 log.cc:1199] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/b230018a95a54ababfe5ecf2ca1e2e49
I20260318 02:51:31.575088 1176 ts_tablet_manager.cc:1950] T b230018a95a54ababfe5ecf2ca1e2e49 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:31.576169 1176 tablet_replica.cc:333] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:31.576352 1176 raft_consensus.cc:2243] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:31.576478 1176 raft_consensus.cc:2272] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:31.576526 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet b230018a95a54ababfe5ecf2ca1e2e49 (table default.Table_1acdeb444a404cb0b89ac6450e835639 [id=9278db75ac0f4aa59c4af2f13a58e314]) successfully deleted
I20260318 02:51:31.590152 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0652735b8c24c23ade92913c1c7ad0f" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:31.591099 719 leader_election.cc:343] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:31.593988 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666c2992fa4f479ab4ffd7ac0c3a9c92" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:31.625278 1173 raft_consensus.cc:359] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.628824 1172 tablet_bootstrap.cc:492] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:31.628993 1172 ts_tablet_manager.cc:1403] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.398s user 0.000s sys 0.003s
I20260318 02:51:31.629139 1173 raft_consensus.cc:385] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:31.629426 1173 raft_consensus.cc:740] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:31.630373 1172 raft_consensus.cc:359] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.630558 1172 raft_consensus.cc:385] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:31.630607 1172 raft_consensus.cc:740] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:31.630813 1172 consensus_queue.cc:260] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.631273 1172 ts_tablet_manager.cc:1434] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:31.631181 1173 consensus_queue.cc:260] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.646746 1172 tablet_bootstrap.cc:492] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:31.655470 1173 ts_tablet_manager.cc:1434] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.148s user 0.002s sys 0.001s
I20260318 02:51:31.655941 1173 tablet_bootstrap.cc:492] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:31.656255 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet d4e3346edd274750a5e27ec2393d08bc
W20260318 02:51:31.657083 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bfb352bce9cc4e8aa899d691954d28d2 consensus state has no leader
I20260318 02:51:31.659307 751 tablet_service.cc:1558] Processing DeleteTablet for tablet d4e3346edd274750a5e27ec2393d08bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:31.664768 1174 tablet_bootstrap.cc:654] T a20b9dc70b5147ff8798946eda3131ca P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:31.675073 1176 ts_tablet_manager.cc:1916] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:31.676306 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8621d3fea96942a7845b8eb3f3781633"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:31.676985 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8621d3fea96942a7845b8eb3f3781633 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:31.679752 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0dc4fd883c61478cb1c3cad66d5ec9a1" } new_table_name: "default.Table_ac97b10d696748eabef55a19d976b4dd" modify_external_catalogs: true
I20260318 02:51:31.682423 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_af46ed3654604db1bc563c9ecd3e82df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:31.683022 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af46ed3654604db1bc563c9ecd3e82df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:31.683331 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_017276a514464042a76dbff62faa6f82" } modify_external_catalogs: true
I20260318 02:51:31.683491 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_017276a514464042a76dbff62faa6f82" } modify_external_catalogs: true
I20260318 02:51:31.684533 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_dc6c21598a584c8cb3d4a6de3f7f5567" } modify_external_catalogs: true
I20260318 02:51:31.684753 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_dc6c21598a584c8cb3d4a6de3f7f5567" } modify_external_catalogs: true
I20260318 02:51:31.685935 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_faeb6cafbd43447591559ebb7ede6da3" } modify_external_catalogs: true
I20260318 02:51:31.686105 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_faeb6cafbd43447591559ebb7ede6da3" } modify_external_catalogs: true
I20260318 02:51:31.690919 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_13562b9955cc4b1da96a7682ee85967a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:31.691583 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13562b9955cc4b1da96a7682ee85967a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:31.695431 1886 tablet.cc:1723] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:31.701718 751 tablet_service.cc:1511] Processing CreateTablet for tablet b3a12a4854914f9892e614697fe3a7b4 (DEFAULT_TABLE table=default.Table_3c8778ad1e5149aeafe6d2c059b95881 [id=190791c02bd64746995dc5f9be8786d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.701718 759 tablet_service.cc:1511] Processing CreateTablet for tablet 75ca99ca24f14cd48f29e49168ebca3f (DEFAULT_TABLE table=default.Table_aced9bb925c04f9b90e57d4edf3ac2ed [id=5ae56ba7b3a64296b3b96326e4b25e89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.704674 752 tablet_service.cc:1511] Processing CreateTablet for tablet ecb2289a6bcd4b8ca6c3810b7d615bce (DEFAULT_TABLE table=default.Table_09ea62fe8c224d87944f84b6ef7e4edc [id=2bcc38ee2a1e498497ab70123ae65c28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.705976 1173 tablet_bootstrap.cc:654] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:31.711453 756 tablet_service.cc:1511] Processing CreateTablet for tablet e1d897fa1eb9435e8a4b59f4a984336a (DEFAULT_TABLE table=default.Table_86fd2b4ab3b54217a92aca9959fc9238 [id=ec2cf4f52e874f878ca7474096094514]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.714816 1883 raft_consensus.cc:493] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:31.715106 1883 raft_consensus.cc:515] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:31.715308 750 tablet_service.cc:1511] Processing CreateTablet for tablet da178159cde84dda9546952d9b2bbb63 (DEFAULT_TABLE table=default.Table_821f8a94668d4ed19f00cb007a56b34d [id=3b2e6568e33c4563b1ac66fe86d06343]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.716406 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c20810ad3354126bf49bbeeb6edb098" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:31.717001 783 raft_consensus.cc:2393] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b25f4f05e0c94c8db825d5afa0b8bf18 in current term 1: Already voted for candidate 9422bb7011f342b08be0b073a88c4c4d in this term.
I20260318 02:51:31.717362 1892 tablet.cc:1723] T 918c542a51864e54871efc5e7f62ef61 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260318 02:51:31.717556 748 tablet_service.cc:1511] Processing CreateTablet for tablet 41b7d422014d4b2a85b0b97593677e3d (DEFAULT_TABLE table=default.Table_a65f49199efd42e6a69e1765c4723285 [id=45529e6b1ab34748b7c098b9599a5812]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.717824 1883 leader_election.cc:290] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:31.718438 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c20810ad3354126bf49bbeeb6edb098" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:31.719144 860 leader_election.cc:304] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:31.719767 1883 raft_consensus.cc:3060] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:31.724607 1173 tablet_bootstrap.cc:492] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:31.724587 761 tablet_service.cc:1511] Processing CreateTablet for tablet 15b052ebecbe4652b1a337d18712011f (DEFAULT_TABLE table=default.Table_320b02e7f0f648b98ffa56a638cc5283 [id=41a18b5945d249ca8971e875778177d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.725744 762 tablet_service.cc:1511] Processing CreateTablet for tablet 3f1a75b4559440c1bf38d4ae0c52d4e5 (DEFAULT_TABLE table=default.Table_8a690b74a1804277b7f6584b8900ac0a [id=121343e06cec4300b41705fc1dee9404]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.735235 1172 tablet_bootstrap.cc:654] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:31.740789 754 tablet_service.cc:1511] Processing CreateTablet for tablet 8c1ba16db9d040708f8fd75c852bdbb1 (DEFAULT_TABLE table=default.Table_aebead9c64604ea689e8c748f2b54d18 [id=fe8fd84e0d4748c8ba46f09978cfdb87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.748805 1172 tablet_bootstrap.cc:492] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:31.749171 1172 ts_tablet_manager.cc:1403] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.103s user 0.003s sys 0.007s
I20260318 02:51:31.750092 1172 raft_consensus.cc:359] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.750357 1172 raft_consensus.cc:385] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:31.750451 1172 raft_consensus.cc:740] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:31.750694 1172 consensus_queue.cc:260] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.751283 1172 ts_tablet_manager.cc:1434] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260318 02:51:31.752377 999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.129:46711, user_credentials={real_user=slave}} blocked reactor thread for 210027us
W20260318 02:51:31.752660 1812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260318 02:51:31.753218 1812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260318 02:51:31.753422 1812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260318 02:51:31.753716 1172 tablet_bootstrap.cc:492] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:31.755447 1172 tablet_bootstrap.cc:654] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:31.756438 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0652735b8c24c23ade92913c1c7ad0f" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:31.757395 999 leader_election.cc:343] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 93479517a1d34d2d99633018a6a57127
W20260318 02:51:31.757866 719 leader_election.cc:343] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:31.757995 719 leader_election.cc:304] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:31.758437 1756 raft_consensus.cc:2749] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:31.760543 1880 consensus_queue.cc:1048] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:31.762176 1172 tablet_bootstrap.cc:492] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:31.762384 1172 ts_tablet_manager.cc:1403] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.001s
I20260318 02:51:31.763314 1172 raft_consensus.cc:359] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.763556 1172 raft_consensus.cc:385] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:31.763754 1172 raft_consensus.cc:740] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
W20260318 02:51:31.764462 997 leader_election.cc:343] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: 0ed4350e0fde4c8690970bc69830fcb3
I20260318 02:51:31.764595 1172 consensus_queue.cc:260] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.764634 997 leader_election.cc:304] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:31.765110 1880 raft_consensus.cc:2749] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:31.765312 997 leader_election.cc:304] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:31.767732 1812 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260318 02:51:31.767908 1812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260318 02:51:31.768039 1812 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260318 02:51:31.768214 1812 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260318 02:51:31.776773 1174 tablet_bootstrap.cc:492] T a20b9dc70b5147ff8798946eda3131ca P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:31.766897 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93479517a1d34d2d99633018a6a57127" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:31.773517 893 tablet_service.cc:1511] Processing CreateTablet for tablet b3a12a4854914f9892e614697fe3a7b4 (DEFAULT_TABLE table=default.Table_3c8778ad1e5149aeafe6d2c059b95881 [id=190791c02bd64746995dc5f9be8786d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.777058 1174 ts_tablet_manager.cc:1403] T a20b9dc70b5147ff8798946eda3131ca P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.355s user 0.000s sys 0.005s
I20260318 02:51:31.774237 892 tablet_service.cc:1511] Processing CreateTablet for tablet 75ca99ca24f14cd48f29e49168ebca3f (DEFAULT_TABLE table=default.Table_aced9bb925c04f9b90e57d4edf3ac2ed [id=5ae56ba7b3a64296b3b96326e4b25e89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.776576 905 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b6267d3f6e142579c62bbb4b14da4b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.776758 899 tablet_service.cc:1558] Processing DeleteTablet for tablet d4e3346edd274750a5e27ec2393d08bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.777843 1174 raft_consensus.cc:359] T a20b9dc70b5147ff8798946eda3131ca P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.778031 1173 ts_tablet_manager.cc:1403] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.122s user 0.002s sys 0.003s
I20260318 02:51:31.778095 1174 raft_consensus.cc:385] T a20b9dc70b5147ff8798946eda3131ca P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:31.778191 1174 raft_consensus.cc:740] T a20b9dc70b5147ff8798946eda3131ca P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:31.778472 1174 consensus_queue.cc:260] T a20b9dc70b5147ff8798946eda3131ca P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.778954 1173 raft_consensus.cc:359] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.779273 1173 raft_consensus.cc:385] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:31.779366 1173 raft_consensus.cc:740] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:31.780084 1173 consensus_queue.cc:260] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.780761 1173 ts_tablet_manager.cc:1434] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:31.781193 1883 raft_consensus.cc:2749] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:31.784886 1174 ts_tablet_manager.cc:1434] T a20b9dc70b5147ff8798946eda3131ca P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260318 02:51:31.787144 1174 tablet_bootstrap.cc:492] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:31.789260 1174 tablet_bootstrap.cc:654] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:31.795120 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3a12a4854914f9892e614697fe3a7b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.795370 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75ca99ca24f14cd48f29e49168ebca3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.795540 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15b052ebecbe4652b1a337d18712011f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.795698 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41b7d422014d4b2a85b0b97593677e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.796000 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c1ba16db9d040708f8fd75c852bdbb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.796353 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da178159cde84dda9546952d9b2bbb63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.799865 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_88ba4f1da1534e4681a3d48f6ae0c52b" } new_table_name: "default.Table_36fe3a38bffa40f2b21e245f4fe2e57c" modify_external_catalogs: true
I20260318 02:51:31.800312 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7db492f7397146c69ce52c4e361c31d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:31.800850 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb2289a6bcd4b8ca6c3810b7d615bce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:31.801805 997 leader_election.cc:343] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:31.801949 997 leader_election.cc:304] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:31.801980 1812 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.104.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.104.190:39451,127.0.104.189:45933,127.0.104.188:41593
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.104.189:45933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.104.189
--webserver_port=44181
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type FASTDEBUG
built by None at 18 Mar 2026 02:43:20 UTC on bdcb31816ec0
build id 10982
ASAN enabled
W20260318 02:51:31.802320 997 leader_election.cc:343] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:31.802403 997 leader_election.cc:304] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:31.804100 1812 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260318 02:51:31.765594 1172 ts_tablet_manager.cc:1434] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260318 02:51:31.804818 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d897fa1eb9435e8a4b59f4a984336a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.805023 1172 tablet_bootstrap.cc:492] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:31.806542 1812 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260318 02:51:31.806667 1172 tablet_bootstrap.cc:654] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:31.808882 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1a75b4559440c1bf38d4ae0c52d4e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.809787 1874 raft_consensus.cc:2749] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:31.809988 1874 raft_consensus.cc:2749] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:31.810073 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7db492f7397146c69ce52c4e361c31d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:31.810192 1874 raft_consensus.cc:2749] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:31.813465 1173 tablet_bootstrap.cc:492] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:31.817106 449 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet ab158343adb14eab85c595fa5405145d (table default.Table_b76c4b353fbe45c8a866d4cd2c4e264c [id=d20f8f1bd66d4dceab3b7bc72608da2a]). Expected version 2 got 0
I20260318 02:51:31.765797 1184 ts_tablet_manager.cc:1929] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:31.820091 1184 log.cc:1199] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/2bd6ac47ba044099ad9bd211ef8d26a2
I20260318 02:51:31.820896 1184 ts_tablet_manager.cc:1950] T 2bd6ac47ba044099ad9bd211ef8d26a2 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:31.828276 1172 tablet_bootstrap.cc:492] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:31.828555 1172 ts_tablet_manager.cc:1403] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.006s
I20260318 02:51:31.829458 1172 raft_consensus.cc:359] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.829751 1172 raft_consensus.cc:385] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:31.829852 1172 raft_consensus.cc:740] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:31.830097 1172 consensus_queue.cc:260] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.830593 1172 ts_tablet_manager.cc:1434] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:31.830940 1172 tablet_bootstrap.cc:492] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:31.832777 1172 tablet_bootstrap.cc:654] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:31.799273 1740 consensus_queue.cc:1048] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260318 02:51:31.833954 997 leader_election.cc:343] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:31.839638 997 leader_election.cc:304] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:31.841926 1184 tablet_replica.cc:333] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:31.842840 1184 raft_consensus.cc:2243] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:31.843277 1184 pending_rounds.cc:70] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d: Trying to abort 1 pending ops.
I20260318 02:51:31.843395 1184 pending_rounds.cc:77] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494183329030144 op_type: NO_OP noop_request { }
I20260318 02:51:31.843564 1184 raft_consensus.cc:2889] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:31.843704 1184 raft_consensus.cc:2272] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:31.845223 1184 ts_tablet_manager.cc:1916] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:31.847468 1906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260318 02:51:31.854425 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c7a128649e834d0a85f3833f2152e040 consensus state has no leader
I20260318 02:51:31.861784 1740 raft_consensus.cc:2749] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:31.862470 1812 server_base.cc:1060] running on GCE node
I20260318 02:51:31.862957 1874 consensus_queue.cc:1048] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260318 02:51:31.864537 1908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260318 02:51:31.867514 997 leader_election.cc:343] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:31.867699 997 leader_election.cc:304] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:31.867962 1874 raft_consensus.cc:2749] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:31.873310 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f923305ec9784da8a5dc3521f65ccb12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:31.873994 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f923305ec9784da8a5dc3521f65ccb12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:31.877091 1904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260318 02:51:31.879317 1812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260318 02:51:31.889441 1880 consensus_queue.cc:1048] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:31.890450 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet d4e3346edd274750a5e27ec2393d08bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.784134 1760 raft_consensus.cc:515] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.892076 1760 leader_election.cc:290] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:31.892635 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 93479517a1d34d2d99633018a6a57127 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fec974d146f44aeb72df483fa85b287) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.893801 1028 tablet_service.cc:1511] Processing CreateTablet for tablet b3a12a4854914f9892e614697fe3a7b4 (DEFAULT_TABLE table=default.Table_3c8778ad1e5149aeafe6d2c059b95881 [id=190791c02bd64746995dc5f9be8786d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.896579 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 75ca99ca24f14cd48f29e49168ebca3f (DEFAULT_TABLE table=default.Table_aced9bb925c04f9b90e57d4edf3ac2ed [id=5ae56ba7b3a64296b3b96326e4b25e89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.896842 1174 tablet_bootstrap.cc:492] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:31.897023 1174 ts_tablet_manager.cc:1403] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.110s user 0.010s sys 0.014s
I20260318 02:51:31.897732 1034 tablet_service.cc:1511] Processing CreateTablet for tablet ecb2289a6bcd4b8ca6c3810b7d615bce (DEFAULT_TABLE table=default.Table_09ea62fe8c224d87944f84b6ef7e4edc [id=2bcc38ee2a1e498497ab70123ae65c28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.898654 1040 tablet_service.cc:1511] Processing CreateTablet for tablet e1d897fa1eb9435e8a4b59f4a984336a (DEFAULT_TABLE table=default.Table_86fd2b4ab3b54217a92aca9959fc9238 [id=ec2cf4f52e874f878ca7474096094514]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.898840 1174 raft_consensus.cc:359] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:31.899567 1026 tablet_service.cc:1511] Processing CreateTablet for tablet da178159cde84dda9546952d9b2bbb63 (DEFAULT_TABLE table=default.Table_821f8a94668d4ed19f00cb007a56b34d [id=3b2e6568e33c4563b1ac66fe86d06343]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.900350 1174 raft_consensus.cc:385] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:31.900667 1174 raft_consensus.cc:740] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:31.901288 1174 consensus_queue.cc:260] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:31.901809 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 2e16272bcf9c435a80b32ba9cba9c738 (table default.Table_c15b5791e7ca4928bfeccb13448f1cf9 [id=259a4cc85c2f4ecdbf865398fefcb0e9]) successfully deleted
W20260318 02:51:31.904553 999 leader_election.cc:343] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: f1ff303b23184d4b92994bde194229b4
I20260318 02:51:31.905193 1172 tablet_bootstrap.cc:492] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:31.905648 1172 ts_tablet_manager.cc:1403] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.075s user 0.001s sys 0.020s
I20260318 02:51:31.906982 1756 raft_consensus.cc:493] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:31.907122 1756 raft_consensus.cc:515] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.833493 899 tablet_service.cc:1511] Processing CreateTablet for tablet ecb2289a6bcd4b8ca6c3810b7d615bce (DEFAULT_TABLE table=default.Table_09ea62fe8c224d87944f84b6ef7e4edc [id=2bcc38ee2a1e498497ab70123ae65c28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.907760 1756 leader_election.cc:290] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:31.838586 905 tablet_service.cc:1511] Processing CreateTablet for tablet e1d897fa1eb9435e8a4b59f4a984336a (DEFAULT_TABLE table=default.Table_86fd2b4ab3b54217a92aca9959fc9238 [id=ec2cf4f52e874f878ca7474096094514]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.840838 906 tablet_service.cc:1511] Processing CreateTablet for tablet da178159cde84dda9546952d9b2bbb63 (DEFAULT_TABLE table=default.Table_821f8a94668d4ed19f00cb007a56b34d [id=3b2e6568e33c4563b1ac66fe86d06343]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.865911 902 tablet_service.cc:1511] Processing CreateTablet for tablet 41b7d422014d4b2a85b0b97593677e3d (DEFAULT_TABLE table=default.Table_a65f49199efd42e6a69e1765c4723285 [id=45529e6b1ab34748b7c098b9599a5812]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.865994 898 tablet_service.cc:1511] Processing CreateTablet for tablet 15b052ebecbe4652b1a337d18712011f (DEFAULT_TABLE table=default.Table_320b02e7f0f648b98ffa56a638cc5283 [id=41a18b5945d249ca8971e875778177d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.869076 889 tablet_service.cc:1511] Processing CreateTablet for tablet 3f1a75b4559440c1bf38d4ae0c52d4e5 (DEFAULT_TABLE table=default.Table_8a690b74a1804277b7f6584b8900ac0a [id=121343e06cec4300b41705fc1dee9404]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.869665 895 tablet_service.cc:1511] Processing CreateTablet for tablet 8c1ba16db9d040708f8fd75c852bdbb1 (DEFAULT_TABLE table=default.Table_aebead9c64604ea689e8c748f2b54d18 [id=fe8fd84e0d4748c8ba46f09978cfdb87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.883271 1780 raft_consensus.cc:493] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:31.903710 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c8264f69f934d3ba2e41434ce350f3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.909122 1780 raft_consensus.cc:515] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:31.909992 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3cda2afa253041449b3c5dcb0547160b consensus state has no leader
I20260318 02:51:31.910463 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ea08fcfa1efe4bc2a486fc1423ce06ce" } new_table_name: "default.Table_268e9858449d471ca088f8b1f2492fe6" modify_external_catalogs: true
I20260318 02:51:31.910905 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet abfa81c3c78a498285e2961530272a39
I20260318 02:51:31.911746 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6b19fea4f7ad44fb900d8bf1f165d331" } modify_external_catalogs: true
I20260318 02:51:31.911928 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6b19fea4f7ad44fb900d8bf1f165d331" } modify_external_catalogs: true
I20260318 02:51:31.913395 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 2bd6ac47ba044099ad9bd211ef8d26a2 (table default.Table_55d80bc4ac3d4e72b2c5e6a694968f83 [id=541170c7c4bf49deb86cd4c15ffdd04f]) successfully deleted
I20260318 02:51:31.914103 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0d5c3ad34b094deb9c076110a43cbe09" } new_table_name: "default.Table_ea4a3406cfef4aeebcb377d76728e974" modify_external_catalogs: true
I20260318 02:51:31.914772 900 tablet_service.cc:1558] Processing DeleteTablet for tablet abfa81c3c78a498285e2961530272a39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.915050 759 tablet_service.cc:1558] Processing DeleteTablet for tablet abfa81c3c78a498285e2961530272a39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:31.915496 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet e1d804f5e9564f6d83efb77e6c18724b
I20260318 02:51:31.916079 452 master_service.cc:954] ReplaceTablet: received request to replace tablet 1ac9581312964ad6afcc96f798fa534a from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:31.915997 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 41b7d422014d4b2a85b0b97593677e3d (DEFAULT_TABLE table=default.Table_a65f49199efd42e6a69e1765c4723285 [id=45529e6b1ab34748b7c098b9599a5812]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.916436 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 3291ecec94e642e3a995a2d7006619e7
I20260318 02:51:31.916822 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 15b052ebecbe4652b1a337d18712011f (DEFAULT_TABLE table=default.Table_320b02e7f0f648b98ffa56a638cc5283 [id=41a18b5945d249ca8971e875778177d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.917459 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 3f1a75b4559440c1bf38d4ae0c52d4e5 (DEFAULT_TABLE table=default.Table_8a690b74a1804277b7f6584b8900ac0a [id=121343e06cec4300b41705fc1dee9404]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.917992 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 8c1ba16db9d040708f8fd75c852bdbb1 (DEFAULT_TABLE table=default.Table_aebead9c64604ea689e8c748f2b54d18 [id=fe8fd84e0d4748c8ba46f09978cfdb87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:31.918458 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet abfa81c3c78a498285e2961530272a39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.919008 759 tablet_service.cc:1558] Processing DeleteTablet for tablet e1d804f5e9564f6d83efb77e6c18724b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:31.920207 997 consensus_peers.cc:597] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:31.920660 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 3291ecec94e642e3a995a2d7006619e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:31.923100 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04f057571584d31b1821e690ae7c75c" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:31.923671 719 leader_election.cc:343] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:31.925334 1812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260318 02:51:31.906912 1172 raft_consensus.cc:359] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:31.927274 1172 raft_consensus.cc:385] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:31.927618 1172 raft_consensus.cc:740] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:31.928251 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ff303b23184d4b92994bde194229b4" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:31.928782 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet e1d804f5e9564f6d83efb77e6c18724b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.928867 925 raft_consensus.cc:2468] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:31.930192 454 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_a168ed2816204e05aa65aaed95173a8f [id=ee10bea676fa4d1a837737c939f3306b] alter complete (version 5)
I20260318 02:51:31.929746 1172 consensus_queue.cc:260] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:31.931049 1172 ts_tablet_manager.cc:1434] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.025s user 0.001s sys 0.001s
I20260318 02:51:31.931324 1172 tablet_bootstrap.cc:492] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:31.932466 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04f057571584d31b1821e690ae7c75c" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:31.934055 1780 leader_election.cc:290] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:31.934851 862 leader_election.cc:343] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 0c8264f69f934d3ba2e41434ce350f3e
I20260318 02:51:31.936244 900 tablet_service.cc:1558] Processing DeleteTablet for tablet e1d804f5e9564f6d83efb77e6c18724b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.938006 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c8264f69f934d3ba2e41434ce350f3e" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:31.938236 1061 raft_consensus.cc:2468] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:31.938715 860 leader_election.cc:304] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:31.939023 1883 raft_consensus.cc:2804] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:31.939095 1883 raft_consensus.cc:493] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:31.939152 1883 raft_consensus.cc:3060] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:31.939985 1172 tablet_bootstrap.cc:654] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:31.940913 1174 ts_tablet_manager.cc:1434] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.043s user 0.006s sys 0.000s
I20260318 02:51:31.941227 457 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 8c20810ad3354126bf49bbeeb6edb098 (table default.Table_4775eaa0e7e84642aa0a8f8b2885610e [id=463a6721eb0d43d09deeb283d1cc4233]). Expected version 1 got 0
I20260318 02:51:31.941865 1174 tablet_bootstrap.cc:492] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:31.943286 1174 tablet_bootstrap.cc:654] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:31.945178 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 3291ecec94e642e3a995a2d7006619e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.946595 900 tablet_service.cc:1558] Processing DeleteTablet for tablet f1ff303b23184d4b92994bde194229b4 with delete_type TABLET_DATA_DELETED (replaced by tablet b5c19bc5e07949088c84cedbf944dfdb) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:31.940730 997 leader_election.cc:304] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:31.948498 1874 raft_consensus.cc:2804] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:31.948652 1874 raft_consensus.cc:493] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:31.948848 1874 raft_consensus.cc:3060] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:31.951640 719 leader_election.cc:343] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:31.951790 719 leader_election.cc:304] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:31.952157 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 3291ecec94e642e3a995a2d7006619e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.952651 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d343e53f2354a3386b19d71ef00d5a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.956233 1174 tablet_bootstrap.cc:492] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:31.956496 1174 ts_tablet_manager.cc:1403] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.002s
I20260318 02:51:31.958880 1874 raft_consensus.cc:515] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.959548 1874 leader_election.cc:290] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:31.960659 1174 raft_consensus.cc:359] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.960996 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3a12a4854914f9892e614697fe3a7b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.960978 1174 raft_consensus.cc:385] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:31.961048 759 tablet_service.cc:1558] Processing DeleteTablet for tablet f04f057571584d31b1821e690ae7c75c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:31.961058 1174 raft_consensus.cc:740] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:31.961284 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c1ba16db9d040708f8fd75c852bdbb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.961285 1174 consensus_queue.cc:260] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:31.961475 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75ca99ca24f14cd48f29e49168ebca3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.961517 1756 raft_consensus.cc:2749] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:31.961889 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb2289a6bcd4b8ca6c3810b7d615bce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.962069 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1a75b4559440c1bf38d4ae0c52d4e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.962236 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d897fa1eb9435e8a4b59f4a984336a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.962440 1174 ts_tablet_manager.cc:1434] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260318 02:51:31.962646 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da178159cde84dda9546952d9b2bbb63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.962700 1174 tablet_bootstrap.cc:492] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:31.962889 457 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 8c20810ad3354126bf49bbeeb6edb098 (table default.Table_4775eaa0e7e84642aa0a8f8b2885610e [id=463a6721eb0d43d09deeb283d1cc4233]). Expected version 1 got 0
I20260318 02:51:31.962998 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41b7d422014d4b2a85b0b97593677e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.963369 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15b052ebecbe4652b1a337d18712011f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:31.964057 1174 tablet_bootstrap.cc:654] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:31.966488 759 tablet_service.cc:1558] Processing DeleteTablet for tablet e3999f53c1cc4cb5a1d91eed23785cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:31.969851 457 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet ab158343adb14eab85c595fa5405145d (table default.Table_b76c4b353fbe45c8a866d4cd2c4e264c [id=d20f8f1bd66d4dceab3b7bc72608da2a]). Expected version 2 got 0
I20260318 02:51:31.970821 1174 tablet_bootstrap.cc:492] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:31.970997 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 8c20810ad3354126bf49bbeeb6edb098 (table default.Table_4775eaa0e7e84642aa0a8f8b2885610e [id=463a6721eb0d43d09deeb283d1cc4233]). Expected version 1 got 0
I20260318 02:51:31.971257 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet ab158343adb14eab85c595fa5405145d (table default.Table_b76c4b353fbe45c8a866d4cd2c4e264c [id=d20f8f1bd66d4dceab3b7bc72608da2a]). Expected version 2 got 0
I20260318 02:51:31.971616 1174 ts_tablet_manager.cc:1403] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.001s
I20260318 02:51:31.972676 1174 raft_consensus.cc:359] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:31.973906 1174 raft_consensus.cc:385] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:31.973979 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9ab2eed2c17e4f67b591a7dcf3cb0044"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:31.974303 1174 raft_consensus.cc:740] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
W20260318 02:51:31.974607 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ab2eed2c17e4f67b591a7dcf3cb0044 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:31.974874 1174 consensus_queue.cc:260] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:31.976493 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_aced9bb925c04f9b90e57d4edf3ac2ed" } modify_external_catalogs: true
I20260318 02:51:31.976814 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_aced9bb925c04f9b90e57d4edf3ac2ed" } modify_external_catalogs: true
I20260318 02:51:31.976951 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c5038e9e1074f46976a1a5bb4282944 with delete_type TABLET_DATA_DELETED (replaced by tablet 27fc03c90b584becb250546100af736c) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.977660 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet d1a884fde2c145518a2cb14b7780b6dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.978092 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e38dec0d2e9417e8571e202036e7117 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:31.977342 1174 ts_tablet_manager.cc:1434] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:31.979462 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_838c707d24944e01a2673fd7c893bdd0" } new_table_name: "default.Table_f9d29b4a6da5460faa8dad3cbe9d77ee" modify_external_catalogs: true
W20260318 02:51:31.979722 441 consensus_peers.cc:597] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a -> Peer 8b701993861d4c11b3394a2d6588b3b7 (127.0.104.189:45933): Couldn't send request to peer 8b701993861d4c11b3394a2d6588b3b7. Status: Network error: Client connection negotiation failed: client connection to 127.0.104.189:45933: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260318 02:51:31.980849 999 leader_election.cc:343] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: f1ff303b23184d4b92994bde194229b4
I20260318 02:51:31.980989 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e34821e167a74d5f9b309576e5ae88fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:31.981474 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e34821e167a74d5f9b309576e5ae88fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:31.983691 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_047c32916d874670a158b134391f6d44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:31.984252 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_047c32916d874670a158b134391f6d44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:31.984418 1172 tablet_bootstrap.cc:492] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:31.984586 1172 ts_tablet_manager.cc:1403] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.053s user 0.008s sys 0.004s
I20260318 02:51:31.985471 1172 raft_consensus.cc:359] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:31.985697 1172 raft_consensus.cc:385] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:31.985796 1172 raft_consensus.cc:740] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:31.986040 1812 hybrid_clock.cc:648] HybridClock initialized: now 1773802291985911 us; error 113 us; skew 500 ppm
I20260318 02:51:31.986446 1172 consensus_queue.cc:260] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:31.986544 1812 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260318 02:51:31.989086 1172 ts_tablet_manager.cc:1434] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:31.990180 1172 tablet_bootstrap.cc:492] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:31.992070 1172 tablet_bootstrap.cc:654] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:31.978878 1174 tablet_bootstrap.cc:492] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:31.994201 1174 tablet_bootstrap.cc:654] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.013604 1172 tablet_bootstrap.cc:492] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:32.014300 1174 tablet_bootstrap.cc:492] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:32.014567 1174 ts_tablet_manager.cc:1403] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.012s
I20260318 02:51:32.014761 1172 ts_tablet_manager.cc:1403] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.025s user 0.010s sys 0.000s
I20260318 02:51:32.017621 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet e867dcd3ff3e4eb7b923305a037c5a79
W20260318 02:51:32.018450 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 105326aea9f744779ca76e0cbb2448cd consensus state has no leader
I20260318 02:51:32.018924 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d82119158d114a78b7929b9a041b2496"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:32.019548 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d82119158d114a78b7929b9a041b2496 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:32.019798 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ac9581312964ad6afcc96f798fa534a consensus state has no leader
I20260318 02:51:32.020203 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5a156fe6b45b41aa8ea012482b2c5378"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:32.020783 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a156fe6b45b41aa8ea012482b2c5378 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.025074 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet e867dcd3ff3e4eb7b923305a037c5a79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:32.029728 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3a12a4854914f9892e614697fe3a7b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.029987 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75ca99ca24f14cd48f29e49168ebca3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.030246 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da178159cde84dda9546952d9b2bbb63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.030776 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41b7d422014d4b2a85b0b97593677e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.030766 1174 raft_consensus.cc:359] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.030938 1174 raft_consensus.cc:385] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260318 02:51:32.030962 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf73a9f8f67b42d9baf1396d70a1a3a9 consensus state has no leader
I20260318 02:51:32.031002 1174 raft_consensus.cc:740] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.030254 1172 raft_consensus.cc:359] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.031191 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15b052ebecbe4652b1a337d18712011f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.031247 1172 raft_consensus.cc:385] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.031162 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_bedeeedc2725413f9e998b586e766faa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:32.031306 1172 raft_consensus.cc:740] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.031549 1172 consensus_queue.cc:260] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.021250 759 tablet_service.cc:1558] Processing DeleteTablet for tablet e867dcd3ff3e4eb7b923305a037c5a79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:32.031733 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bedeeedc2725413f9e998b586e766faa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.031860 1174 consensus_queue.cc:260] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.032373 1174 ts_tablet_manager.cc:1434] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:32.036232 1172 ts_tablet_manager.cc:1434] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260318 02:51:32.036633 1172 tablet_bootstrap.cc:492] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:32.038385 1172 tablet_bootstrap.cc:654] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.038549 888 tablet_service.cc:1558] Processing DeleteTablet for tablet e867dcd3ff3e4eb7b923305a037c5a79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:32.040354 1174 tablet_bootstrap.cc:492] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:32.041178 454 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet ab158343adb14eab85c595fa5405145d (table default.Table_b76c4b353fbe45c8a866d4cd2c4e264c [id=d20f8f1bd66d4dceab3b7bc72608da2a]). Expected version 2 got 0
I20260318 02:51:32.041453 454 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 8c20810ad3354126bf49bbeeb6edb098 (table default.Table_4775eaa0e7e84642aa0a8f8b2885610e [id=463a6721eb0d43d09deeb283d1cc4233]). Expected version 1 got 0
I20260318 02:51:32.042469 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c1ba16db9d040708f8fd75c852bdbb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.035602 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ff303b23184d4b92994bde194229b4" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:32.045445 927 raft_consensus.cc:3060] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:32.046255 1174 tablet_bootstrap.cc:654] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.047235 1915 raft_consensus.cc:493] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.047380 1915 raft_consensus.cc:515] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.047982 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f1a75b4559440c1bf38d4ae0c52d4e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.048422 1915 leader_election.cc:290] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:32.048813 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d897fa1eb9435e8a4b59f4a984336a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.048897 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f5e1cad5794c15a0b62e64d9e86417" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:32.049656 719 leader_election.cc:343] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.050318 1915 raft_consensus.cc:493] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.050441 1915 raft_consensus.cc:515] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.051424 1915 leader_election.cc:290] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:32.051748 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc1543d0e1b1431baf6d2ab6a0484ca6" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:32.052205 719 leader_election.cc:343] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.053272 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb2289a6bcd4b8ca6c3810b7d615bce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.061316 1175 ts_tablet_manager.cc:1929] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:32.061540 1175 log.cc:1199] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/2bd6ac47ba044099ad9bd211ef8d26a2
I20260318 02:51:32.061880 1172 tablet_bootstrap.cc:492] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:32.062057 1172 ts_tablet_manager.cc:1403] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.004s
I20260318 02:51:32.062983 1172 raft_consensus.cc:359] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.063755 1172 raft_consensus.cc:385] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.063859 1172 raft_consensus.cc:740] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.064107 1175 ts_tablet_manager.cc:1950] T 2bd6ac47ba044099ad9bd211ef8d26a2 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:32.064270 1174 tablet_bootstrap.cc:492] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:32.064127 1172 consensus_queue.cc:260] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.064414 1174 ts_tablet_manager.cc:1403] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.025s user 0.008s sys 0.002s
I20260318 02:51:32.064762 1172 ts_tablet_manager.cc:1434] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:32.065066 1172 tablet_bootstrap.cc:492] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:32.054896 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc1543d0e1b1431baf6d2ab6a0484ca6" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:32.065238 1174 raft_consensus.cc:359] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.065402 1174 raft_consensus.cc:385] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.065461 1174 raft_consensus.cc:740] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
W20260318 02:51:32.065616 719 leader_election.cc:343] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.065663 1174 consensus_queue.cc:260] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.065752 719 leader_election.cc:304] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.066020 1915 raft_consensus.cc:2749] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:32.066443 1174 ts_tablet_manager.cc:1434] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:32.066928 1172 tablet_bootstrap.cc:654] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.068918 1174 tablet_bootstrap.cc:492] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:32.069553 450 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 105326aea9f744779ca76e0cbb2448cd (table default.Table_268e9858449d471ca088f8b1f2492fe6 [id=58354360683d422dbdcc43826b39dbc8]). Expected version 4 got 0
I20260318 02:51:32.061677 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f5e1cad5794c15a0b62e64d9e86417" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:32.071589 719 leader_election.cc:343] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.071729 719 leader_election.cc:304] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.072178 1915 raft_consensus.cc:2749] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:32.072696 1174 tablet_bootstrap.cc:654] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.073004 449 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 3868406102b748a5b13420b24bf16485 (table default.Table_ad02fb74a8e54e76ba7370a1d85c60b8 [id=a7ad61d6d9264ec4ac482798b1ea992e]). Expected version 3 got 0
I20260318 02:51:32.073381 1033 tablet_service.cc:1511] Processing CreateTablet for tablet c207ffbbf36d46ff9755e3f739b3a25c (DEFAULT_TABLE table=default.Table_bf41e4bbbe2e4a3bbf8740b2ab558311 [id=d5c1767f0653467da0cb96c4cc8b2c25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.073918 1026 tablet_service.cc:1511] Processing CreateTablet for tablet b34cc689a9a94f22bd2aa84b7d2eaee9 (DEFAULT_TABLE table=default.Table_d22d1d6f0ce44b6fba47b797e8d6e18d [id=88166b7fa78a42e492606b1f0207a6ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.076881 888 tablet_service.cc:1511] Processing CreateTablet for tablet c207ffbbf36d46ff9755e3f739b3a25c (DEFAULT_TABLE table=default.Table_bf41e4bbbe2e4a3bbf8740b2ab558311 [id=d5c1767f0653467da0cb96c4cc8b2c25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.077947 896 tablet_service.cc:1511] Processing CreateTablet for tablet 98ac6bdd852d468ba6821af6c85bfd19 (DEFAULT_TABLE table=default.Table_6a96af2ea8f04b2a8b13896020fb7bf0 [id=872a488e089544cf87211bcd618c8627]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.078305 900 tablet_service.cc:1511] Processing CreateTablet for tablet b34cc689a9a94f22bd2aa84b7d2eaee9 (DEFAULT_TABLE table=default.Table_d22d1d6f0ce44b6fba47b797e8d6e18d [id=88166b7fa78a42e492606b1f0207a6ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.078539 1172 tablet_bootstrap.cc:492] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:32.078747 1172 ts_tablet_manager.cc:1403] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.005s
I20260318 02:51:32.080097 1172 raft_consensus.cc:359] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:32.080336 1172 raft_consensus.cc:385] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.080425 1172 raft_consensus.cc:740] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.080654 1172 consensus_queue.cc:260] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:32.081146 1874 raft_consensus.cc:493] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.081249 1874 raft_consensus.cc:515] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.081756 1874 leader_election.cc:290] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:32.082046 1173 tablet_bootstrap.cc:654] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.082232 1915 raft_consensus.cc:493] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.082346 1915 raft_consensus.cc:515] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:32.082458 759 tablet_service.cc:1511] Processing CreateTablet for tablet c207ffbbf36d46ff9755e3f739b3a25c (DEFAULT_TABLE table=default.Table_bf41e4bbbe2e4a3bbf8740b2ab558311 [id=d5c1767f0653467da0cb96c4cc8b2c25]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:32.082578 999 leader_election.cc:343] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 547762347d7843e989e55e0449ad9fcb
I20260318 02:51:32.082877 1915 leader_election.cc:290] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:32.083473 1172 ts_tablet_manager.cc:1434] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260318 02:51:32.084738 1174 tablet_bootstrap.cc:492] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:32.084882 1174 ts_tablet_manager.cc:1403] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260318 02:51:32.085662 1174 raft_consensus.cc:359] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.085831 1174 raft_consensus.cc:385] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.085884 1174 raft_consensus.cc:740] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.086071 1174 consensus_queue.cc:260] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.086524 1174 ts_tablet_manager.cc:1434] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:32.086889 1874 consensus_queue.cc:1048] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:32.090099 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3999f53c1cc4cb5a1d91eed23785cc6" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:32.090921 1172 tablet_bootstrap.cc:492] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:32.091295 1709 raft_consensus.cc:493] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260318 02:51:32.092203 719 leader_election.cc:343] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.092446 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 65c50b0813b04f30896568ab2b680ba8 with delete_type TABLET_DATA_DELETED (replaced by tablet 20a492fdea6c44ba8439614b0dcc2ba6) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:32.092634 761 tablet_service.cc:1558] Processing DeleteTablet for tablet cc1543d0e1b1431baf6d2ab6a0484ca6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:32.092788 1172 tablet_bootstrap.cc:654] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.093051 748 tablet_service.cc:1511] Processing CreateTablet for tablet b34cc689a9a94f22bd2aa84b7d2eaee9 (DEFAULT_TABLE table=default.Table_d22d1d6f0ce44b6fba47b797e8d6e18d [id=88166b7fa78a42e492606b1f0207a6ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.094903 897 tablet_service.cc:1511] Processing CreateTablet for tablet 2f3309339d61445eaf38baf068216ef4 (DEFAULT_TABLE table=default.Table_6aa6181c2ea647e9a91f1a0ec07fdfa3 [id=79792b4bfc8d4fc2b5c4f5f8f2c803f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.095779 450 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 105326aea9f744779ca76e0cbb2448cd (table default.Table_268e9858449d471ca088f8b1f2492fe6 [id=58354360683d422dbdcc43826b39dbc8]). Expected version 4 got 0
I20260318 02:51:32.095875 891 tablet_service.cc:1511] Processing CreateTablet for tablet 6b0be67e8f064e879f9a790a87d8b27b (DEFAULT_TABLE table=default.Table_842d2c36399843b293a023c3043c631d [id=2ba822c07cbc4d93964ad3d76d201886]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.096016 450 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 1516525b471540288c6cb5d61120d430 (table default.Table_4e770bc308894d9094b88315d9093ba5 [id=433e7aa77412424ebb38784bb073d1fb]). Expected version 6 got 0
I20260318 02:51:32.096192 450 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 99e807c8ff5e457fb6c97c6d1b277eab (table default.Table_fd8edd9c8882403f8541f00d0728e3b7 [id=568e88222ca648ce88ee962e91a84588]). Expected version 1 got 0
I20260318 02:51:32.096807 761 tablet_service.cc:1511] Processing CreateTablet for tablet 98ac6bdd852d468ba6821af6c85bfd19 (DEFAULT_TABLE table=default.Table_6a96af2ea8f04b2a8b13896020fb7bf0 [id=872a488e089544cf87211bcd618c8627]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.097239 756 tablet_service.cc:1511] Processing CreateTablet for tablet 2f3309339d61445eaf38baf068216ef4 (DEFAULT_TABLE table=default.Table_6aa6181c2ea647e9a91f1a0ec07fdfa3 [id=79792b4bfc8d4fc2b5c4f5f8f2c803f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.100775 750 tablet_service.cc:1511] Processing CreateTablet for tablet 6b0be67e8f064e879f9a790a87d8b27b (DEFAULT_TABLE table=default.Table_842d2c36399843b293a023c3043c631d [id=2ba822c07cbc4d93964ad3d76d201886]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.101389 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c207ffbbf36d46ff9755e3f739b3a25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.101315 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 6b0be67e8f064e879f9a790a87d8b27b (DEFAULT_TABLE table=default.Table_842d2c36399843b293a023c3043c631d [id=2ba822c07cbc4d93964ad3d76d201886]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.101488 1174 tablet_bootstrap.cc:492] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:32.102541 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 547762347d7843e989e55e0449ad9fcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:32.102989 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 2f3309339d61445eaf38baf068216ef4 (DEFAULT_TABLE table=default.Table_6aa6181c2ea647e9a91f1a0ec07fdfa3 [id=79792b4bfc8d4fc2b5c4f5f8f2c803f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.103356 1174 tablet_bootstrap.cc:654] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.103535 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 98ac6bdd852d468ba6821af6c85bfd19 (DEFAULT_TABLE table=default.Table_6a96af2ea8f04b2a8b13896020fb7bf0 [id=872a488e089544cf87211bcd618c8627]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.106264 1709 raft_consensus.cc:515] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.106491 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b34cc689a9a94f22bd2aa84b7d2eaee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.108956 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ac6bdd852d468ba6821af6c85bfd19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.109730 1709 leader_election.cc:290] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:32.110499 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6267d3f6e142579c62bbb4b14da4b0" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:32.110713 1061 raft_consensus.cc:2468] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
W20260318 02:51:32.110932 862 leader_election.cc:343] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2b6267d3f6e142579c62bbb4b14da4b0
I20260318 02:51:32.111137 860 leader_election.cc:304] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:32.111925 1709 raft_consensus.cc:2804] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:32.112022 1709 raft_consensus.cc:493] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:32.112085 1709 raft_consensus.cc:3060] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:32.112967 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3309339d61445eaf38baf068216ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.113188 1184 ts_tablet_manager.cc:1929] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:32.113291 1184 log.cc:1199] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/2adcc9f1ad69458c997475111bb787cf
I20260318 02:51:32.113497 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "547762347d7843e989e55e0449ad9fcb" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:32.113652 1184 ts_tablet_manager.cc:1950] T 2adcc9f1ad69458c997475111bb787cf P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
W20260318 02:51:32.114482 997 leader_election.cc:343] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.114609 997 leader_election.cc:304] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.114876 1813 raft_consensus.cc:2749] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:32.116596 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c207ffbbf36d46ff9755e3f739b3a25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.117174 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b34cc689a9a94f22bd2aa84b7d2eaee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.117208 1176 ts_tablet_manager.cc:1929] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:32.117316 1176 log.cc:1199] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/2789a1195e7344c18dd226e196e2f302
I20260318 02:51:32.117566 1176 ts_tablet_manager.cc:1950] T 2789a1195e7344c18dd226e196e2f302 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
W20260318 02:51:32.118140 997 consensus_peers.cc:597] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:32.118248 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b0be67e8f064e879f9a790a87d8b27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.119374 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ac6bdd852d468ba6821af6c85bfd19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.120153 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b0be67e8f064e879f9a790a87d8b27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.120625 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3309339d61445eaf38baf068216ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.121630 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c207ffbbf36d46ff9755e3f739b3a25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.122439 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b34cc689a9a94f22bd2aa84b7d2eaee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.126209 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_fceb58989e784893aefdc7fb9497f621" } new_table_name: "default.Table_6238662cdd5443a694ee4feec8bc0413" modify_external_catalogs: true
I20260318 02:51:32.126471 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2a5da32146c44463ad1d7eb9f8ba6232"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:32.127342 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8621d3fea96942a7845b8eb3f3781633" } new_table_name: "default.Table_48e9661e2fda49c384c75e438fe90937" modify_external_catalogs: true
I20260318 02:51:32.127833 450 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 1516525b471540288c6cb5d61120d430 (table default.Table_4e770bc308894d9094b88315d9093ba5 [id=433e7aa77412424ebb38784bb073d1fb]). Expected version 6 got 0
W20260318 02:51:32.128616 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a5da32146c44463ad1d7eb9f8ba6232 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.129604 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_465da657f4fc40d6acdf67f2bff44278"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:32.130151 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_465da657f4fc40d6acdf67f2bff44278 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.126243 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c880704226ff4e89bf538efec8f0b892" } modify_external_catalogs: true
I20260318 02:51:32.130621 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c880704226ff4e89bf538efec8f0b892" } modify_external_catalogs: true
I20260318 02:51:32.135582 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c11f92b1245f4babb6bb88a53d3a6b66"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:32.136207 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c11f92b1245f4babb6bb88a53d3a6b66 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.137130 1175 tablet_replica.cc:333] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:32.137187 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 2bd6ac47ba044099ad9bd211ef8d26a2 (table default.Table_55d80bc4ac3d4e72b2c5e6a694968f83 [id=541170c7c4bf49deb86cd4c15ffdd04f]) successfully deleted
I20260318 02:51:32.137521 1175 raft_consensus.cc:2243] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.137815 1175 raft_consensus.cc:2272] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.138914 1175 ts_tablet_manager.cc:1916] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.132592 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_42a80fd8d8eb4cffadcbe255e0c315b2" } modify_external_catalogs: true
I20260318 02:51:32.140656 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_42a80fd8d8eb4cffadcbe255e0c315b2" } modify_external_catalogs: true
I20260318 02:51:32.145840 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_320b02e7f0f648b98ffa56a638cc5283" } modify_external_catalogs: true
I20260318 02:51:32.146179 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_320b02e7f0f648b98ffa56a638cc5283" } modify_external_catalogs: true
I20260318 02:51:32.150682 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 676) took 1267 ms. Trace:
I20260318 02:51:32.151005 1176 rpcz_store.cc:276] 0318 02:51:30.883620 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:30.883672 (+ 52us) service_pool.cc:225] Handling call
0318 02:51:31.576120 (+692448us) ts_tablet_manager.cc:1151] Deleting tablet 2789a1195e7344c18dd226e196e2f302
0318 02:51:31.576130 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:31.813122 (+236992us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.117084 (+303962us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.150606 (+ 33522us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":692255}
I20260318 02:51:32.151973 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 2789a1195e7344c18dd226e196e2f302 (table default.Table_a9ca2b8e5b9042279576e9b9c6701069 [id=3066ad66b0914b759c32fe9296ca90bc]) successfully deleted
I20260318 02:51:32.151997 903 tablet_service.cc:1511] Processing CreateTablet for tablet 98101333a294447aa6df09c7fa62b565 (DEFAULT_TABLE table=default.Table_8621d3fea96942a7845b8eb3f3781633 [id=ab5fa2dbcf34491daaae2eabeaf4feca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.152549 1176 tablet_replica.cc:333] T a20b9dc70b5147ff8798946eda3131ca P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:32.155143 1172 tablet_bootstrap.cc:492] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:32.155391 1172 ts_tablet_manager.cc:1403] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.065s user 0.007s sys 0.013s
I20260318 02:51:32.155526 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 1ac9581312964ad6afcc96f798fa534a
I20260318 02:51:32.155966 452 catalog_manager.cc:6741] ReplaceTablet: tablet 1ac9581312964ad6afcc96f798fa534a deleted and replaced by tablet 7dbcee4d14064cbdbcf7641cfc1c58d4
I20260318 02:51:32.155867 907 tablet_service.cc:1511] Processing CreateTablet for tablet e918bb008e0743a9bf7ada170812146e (DEFAULT_TABLE table=default.Table_c8ea19bed9e54eaf91af95c365e46851 [id=551f7031c6b84904836a915c07704492]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.156399 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6003288b595443658b3deb596c5f9c48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:32.156524 1172 raft_consensus.cc:359] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.156886 1172 raft_consensus.cc:385] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260318 02:51:32.156967 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b698d732a905469caaf564d9512ba02c consensus state has no leader
I20260318 02:51:32.157002 1172 raft_consensus.cc:740] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.157322 1172 consensus_queue.cc:260] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.157419 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 75ca99ca24f14cd48f29e49168ebca3f
I20260318 02:51:32.158047 1172 ts_tablet_manager.cc:1434] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:32.158324 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ac9581312964ad6afcc96f798fa534a with delete_type TABLET_DATA_DELETED (replaced by tablet 7dbcee4d14064cbdbcf7641cfc1c58d4) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:32.158375 1172 tablet_bootstrap.cc:492] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:32.158699 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6003288b595443658b3deb596c5f9c48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.159318 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 75ca99ca24f14cd48f29e49168ebca3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:32.159984 1172 tablet_bootstrap.cc:654] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:32.160104 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98101333a294447aa6df09c7fa62b565 consensus state has no leader
I20260318 02:51:32.161756 1174 tablet_bootstrap.cc:492] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:32.161899 1174 ts_tablet_manager.cc:1403] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.060s user 0.012s sys 0.005s
I20260318 02:51:32.163332 1174 raft_consensus.cc:359] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.163486 1174 raft_consensus.cc:385] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.163529 1174 raft_consensus.cc:740] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.163746 1174 consensus_queue.cc:260] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.161872 1176 raft_consensus.cc:2243] T a20b9dc70b5147ff8798946eda3131ca P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.164220 1174 ts_tablet_manager.cc:1434] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:32.165787 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ac9581312964ad6afcc96f798fa534a with delete_type TABLET_DATA_DELETED (replaced by tablet 7dbcee4d14064cbdbcf7641cfc1c58d4) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:32.165959 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 75ca99ca24f14cd48f29e49168ebca3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:32.166078 761 tablet_service.cc:1511] Processing CreateTablet for tablet 98101333a294447aa6df09c7fa62b565 (DEFAULT_TABLE table=default.Table_8621d3fea96942a7845b8eb3f3781633 [id=ab5fa2dbcf34491daaae2eabeaf4feca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.166527 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98101333a294447aa6df09c7fa62b565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.168248 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 98101333a294447aa6df09c7fa62b565 (DEFAULT_TABLE table=default.Table_8621d3fea96942a7845b8eb3f3781633 [id=ab5fa2dbcf34491daaae2eabeaf4feca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.168633 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98101333a294447aa6df09c7fa62b565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.168759 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 75ca99ca24f14cd48f29e49168ebca3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:32.169659 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fa7c1d6879c40ebb8d989ebae205e9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:32.168243 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ac9581312964ad6afcc96f798fa534a with delete_type TABLET_DATA_DELETED (replaced by tablet 7dbcee4d14064cbdbcf7641cfc1c58d4) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:32.172362 759 tablet_service.cc:1511] Processing CreateTablet for tablet e918bb008e0743a9bf7ada170812146e (DEFAULT_TABLE table=default.Table_c8ea19bed9e54eaf91af95c365e46851 [id=551f7031c6b84904836a915c07704492]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.173147 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e918bb008e0743a9bf7ada170812146e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.180186 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 4e54f71cd47a4738b0f640382edee907
I20260318 02:51:32.181255 451 master_service.cc:954] ReplaceTablet: received request to replace tablet 64c2a579264e43b9a1e25ded000d4d9f from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:32.181222 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e54f71cd47a4738b0f640382edee907 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:32.183650 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e54f71cd47a4738b0f640382edee907 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:32.113837 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3999f53c1cc4cb5a1d91eed23785cc6" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:32.185391 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 651) took 1133 ms. Trace:
I20260318 02:51:32.185479 1184 rpcz_store.cc:276] 0318 02:51:31.051414 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.051461 (+ 47us) service_pool.cc:225] Handling call
0318 02:51:31.841793 (+790332us) ts_tablet_manager.cc:1151] Deleting tablet 2adcc9f1ad69458c997475111bb787cf
0318 02:51:31.841803 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.025261 (+183458us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.113075 (+ 87814us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.185369 (+ 72294us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":790093}
I20260318 02:51:32.185817 1184 tablet_replica.cc:333] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:32.185976 1184 raft_consensus.cc:2243] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.186101 1184 raft_consensus.cc:2272] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:32.186324 719 leader_election.cc:343] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.186452 719 leader_election.cc:304] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.186579 1184 ts_tablet_manager.cc:1916] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.186676 1915 raft_consensus.cc:2749] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:32.186901 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98101333a294447aa6df09c7fa62b565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.187052 1915 raft_consensus.cc:493] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.187152 1915 raft_consensus.cc:515] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.187513 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e918bb008e0743a9bf7ada170812146e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.187697 1915 leader_election.cc:290] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:32.188063 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b0be67e8f064e879f9a790a87d8b27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.188555 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ac6bdd852d468ba6821af6c85bfd19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.189795 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b439fa2481a43c78d2c486d8711175f" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:32.190318 719 leader_election.cc:343] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.190595 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3309339d61445eaf38baf068216ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.191962 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b439fa2481a43c78d2c486d8711175f" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:32.194621 719 leader_election.cc:343] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.194738 719 leader_election.cc:304] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.194962 1915 raft_consensus.cc:2749] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:32.198155 754 tablet_service.cc:1511] Processing CreateTablet for tablet 36c3a417e8c04108b22d28674e570b9b (DEFAULT_TABLE table=default.Table_52514fef886048238fee929512ba027f [id=7710786a2b6a406da91136a06a45a35d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.198549 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c3a417e8c04108b22d28674e570b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.207254 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 2adcc9f1ad69458c997475111bb787cf (table default.Table_8fdbd48eef374965b592274f14ea8ee1 [id=e7071ce844664614a646a3554c38ae41]) successfully deleted
I20260318 02:51:32.208725 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e54f71cd47a4738b0f640382edee907 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:32.209182 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 36c3a417e8c04108b22d28674e570b9b (DEFAULT_TABLE table=default.Table_52514fef886048238fee929512ba027f [id=7710786a2b6a406da91136a06a45a35d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.211396 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c3a417e8c04108b22d28674e570b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.209311 1027 tablet_service.cc:1511] Processing CreateTablet for tablet e918bb008e0743a9bf7ada170812146e (DEFAULT_TABLE table=default.Table_c8ea19bed9e54eaf91af95c365e46851 [id=551f7031c6b84904836a915c07704492]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.214298 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e918bb008e0743a9bf7ada170812146e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.214295 894 tablet_service.cc:1511] Processing CreateTablet for tablet 36c3a417e8c04108b22d28674e570b9b (DEFAULT_TABLE table=default.Table_52514fef886048238fee929512ba027f [id=7710786a2b6a406da91136a06a45a35d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.215746 1813 raft_consensus.cc:493] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.215875 1813 raft_consensus.cc:515] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.216490 1813 leader_election.cc:290] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:32.216897 1184 ts_tablet_manager.cc:1929] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:32.216991 1184 log.cc:1199] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/0c8264f69f934d3ba2e41434ce350f3e
I20260318 02:51:32.217044 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c3a417e8c04108b22d28674e570b9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.206547 1709 raft_consensus.cc:515] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.217279 1184 ts_tablet_manager.cc:1950] T 0c8264f69f934d3ba2e41434ce350f3e P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
W20260318 02:51:32.217506 999 leader_election.cc:343] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: d1a884fde2c145518a2cb14b7780b6dd
I20260318 02:51:32.217991 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 652) took 1166 ms. Trace:
I20260318 02:51:32.218075 1184 rpcz_store.cc:276] 0318 02:51:31.051552 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.052111 (+ 559us) service_pool.cc:225] Handling call
0318 02:51:32.185768 (+1133657us) ts_tablet_manager.cc:1151] Deleting tablet 0c8264f69f934d3ba2e41434ce350f3e
0318 02:51:32.185779 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.205993 (+ 20214us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.216789 (+ 10796us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.217972 (+ 1183us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1133447}
I20260318 02:51:32.218379 1184 tablet_replica.cc:333] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:32.218525 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 0c8264f69f934d3ba2e41434ce350f3e (table default.Table_50e2d197579e426787bc46d7494e2f74 [id=83452e9434ad488c9cda6c178ec3b182]) successfully deleted
I20260318 02:51:32.220137 1174 tablet_bootstrap.cc:492] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:32.221707 1174 tablet_bootstrap.cc:654] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.222530 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f4736cb671be4feda1ede6bc973d14c2" } new_table_name: "default.Table_da86a39b826541a9972e82d6cb145a84" modify_external_catalogs: true
I20260318 02:51:32.222601 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bedeeedc2725413f9e998b586e766faa" } new_table_name: "default.Table_1d010d3bbddc4061b497aaeb03506d39" modify_external_catalogs: true
I20260318 02:51:32.223269 1709 leader_election.cc:290] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:32.225274 862 leader_election.cc:343] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2b6267d3f6e142579c62bbb4b14da4b0
I20260318 02:51:32.219782 1813 raft_consensus.cc:493] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.227593 1813 raft_consensus.cc:515] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.228291 1813 leader_election.cc:290] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:32.229020 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a15e4303742a999fe9a96d450c827" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:32.229213 785 raft_consensus.cc:2468] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:32.229620 999 leader_election.cc:304] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:32.229921 1813 raft_consensus.cc:2804] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:32.229988 1813 raft_consensus.cc:493] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:32.230039 1813 raft_consensus.cc:3060] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:32.219812 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b6267d3f6e142579c62bbb4b14da4b0" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:32.232278 1061 raft_consensus.cc:3060] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:32.234826 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a884fde2c145518a2cb14b7780b6dd" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:32.235881 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a15e4303742a999fe9a96d450c827" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:32.249440 1174 tablet_bootstrap.cc:492] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:32.249601 1174 ts_tablet_manager.cc:1403] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.030s user 0.007s sys 0.003s
I20260318 02:51:32.250308 1174 raft_consensus.cc:359] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:32.250484 1174 raft_consensus.cc:385] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.250537 1174 raft_consensus.cc:740] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.250779 1174 consensus_queue.cc:260] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:32.251379 1174 ts_tablet_manager.cc:1434] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:32.251880 1174 tablet_bootstrap.cc:492] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:32.253402 1174 tablet_bootstrap.cc:654] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.255569 1174 tablet_bootstrap.cc:492] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:32.255702 1174 ts_tablet_manager.cc:1403] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:32.256389 1174 raft_consensus.cc:359] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.256572 1174 raft_consensus.cc:385] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.256620 1174 raft_consensus.cc:740] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.256829 1174 consensus_queue.cc:260] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.257402 1174 ts_tablet_manager.cc:1434] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:32.257678 1174 tablet_bootstrap.cc:492] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:32.260690 1174 tablet_bootstrap.cc:654] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:32.264261 441 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet b698d732a905469caaf564d9512ba02c (table default.Table_6238662cdd5443a694ee4feec8bc0413 [id=eb11e3d1c3ef4295ac9b6ee657ac233a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b698d732a905469caaf564d9512ba02c consensus state has no leader
I20260318 02:51:32.265017 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6d1032d49d3244f0b80bf144e88b3d12" } new_table_name: "default.Table_e9b8f702f842482eacfb1e5cd1c160a6" modify_external_catalogs: true
I20260318 02:51:32.266253 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_55141c44691c4ea0a2b3df6a456db916"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:32.267973 1883 raft_consensus.cc:515] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:32.270092 860 leader_election.cc:343] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 0c8264f69f934d3ba2e41434ce350f3e
I20260318 02:51:32.270963 1883 leader_election.cc:290] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:32.271364 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55141c44691c4ea0a2b3df6a456db916 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.272109 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1ac62abf756c4328933c7bf6db14a7f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:32.272814 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ac62abf756c4328933c7bf6db14a7f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.273557 1915 raft_consensus.cc:493] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.273696 1915 raft_consensus.cc:515] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.273708 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4600a261d8844254ba70e12cd1dc1676" } modify_external_catalogs: true
W20260318 02:51:32.274075 862 leader_election.cc:343] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 0c8264f69f934d3ba2e41434ce350f3e
I20260318 02:51:32.274211 862 leader_election.cc:304] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:32.274297 1915 leader_election.cc:290] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:32.275277 1883 raft_consensus.cc:2749] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260318 02:51:32.275333 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868406102b748a5b13420b24bf16485" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:32.276008 719 leader_election.cc:343] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.279268 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868406102b748a5b13420b24bf16485" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:32.285794 1174 tablet_bootstrap.cc:492] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:32.285966 1174 ts_tablet_manager.cc:1403] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.001s
I20260318 02:51:32.286712 1174 raft_consensus.cc:359] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.286890 1174 raft_consensus.cc:385] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.286950 1174 raft_consensus.cc:740] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
W20260318 02:51:32.287072 719 leader_election.cc:343] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.287158 1174 consensus_queue.cc:260] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.287400 719 leader_election.cc:304] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.287784 1174 ts_tablet_manager.cc:1434] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260318 02:51:32.287829 1915 raft_consensus.cc:2749] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:32.288153 1174 tablet_bootstrap.cc:492] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:32.289858 1174 tablet_bootstrap.cc:654] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.298882 927 raft_consensus.cc:2468] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:32.302523 1061 raft_consensus.cc:2468] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:32.302915 1184 raft_consensus.cc:2243] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.303548 1184 raft_consensus.cc:2272] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.304122 1184 ts_tablet_manager.cc:1916] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.309355 860 leader_election.cc:304] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:32.309733 1883 raft_consensus.cc:2804] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:32.309880 1883 raft_consensus.cc:697] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:32.310148 1883 consensus_queue.cc:237] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.310221 1813 raft_consensus.cc:515] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.311553 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a15e4303742a999fe9a96d450c827" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:32.311757 785 raft_consensus.cc:3060] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:32.314441 785 raft_consensus.cc:2468] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:32.315026 999 leader_election.cc:304] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:32.315867 1874 raft_consensus.cc:493] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.316038 1874 raft_consensus.cc:515] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.316695 1874 leader_election.cc:290] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:32.315886 997 leader_election.cc:343] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.318630 997 leader_election.cc:304] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.319554 1874 raft_consensus.cc:2749] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:32.320272 1813 leader_election.cc:290] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:32.322134 997 leader_election.cc:343] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.328675 1184 ts_tablet_manager.cc:1929] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:32.329021 1184 log.cc:1199] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/2b6267d3f6e142579c62bbb4b14da4b0
I20260318 02:51:32.329633 1184 ts_tablet_manager.cc:1950] T 2b6267d3f6e142579c62bbb4b14da4b0 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:32.331357 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 653) took 1278 ms. Trace:
I20260318 02:51:32.326283 997 leader_election.cc:304] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:32.331558 1184 rpcz_store.cc:276] 0318 02:51:31.052464 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.052504 (+ 40us) service_pool.cc:225] Handling call
0318 02:51:32.218334 (+1165830us) ts_tablet_manager.cc:1151] Deleting tablet 2b6267d3f6e142579c62bbb4b14da4b0
0318 02:51:32.218344 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.303435 (+ 85091us) spinlock_profiling.cc:243] Waited 67.4 ms on lock 0x616000181054. stack: 00007fb72b236c56 00007fb72b236a10 00007fb72a2113ad 0000000000986fb4 0000000000986f7d 000000000098694a 00007fb737169460 00007fb7384b7b83 00007fb73b079957 00007fb73b0ac944 00007fb73b08d440 00007fb73b08d1cd 0000000000a8b58c 00007fb72b27cf7f 00007fb72b28029b 00007fb72b280118
0318 02:51:32.307160 (+ 3725us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.328513 (+ 21353us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.331298 (+ 2785us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":154970368,"tablet-delete.queue_time_us":1165556}
I20260318 02:51:32.335449 1813 raft_consensus.cc:2804] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:32.335680 1813 raft_consensus.cc:697] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:32.335994 1813 consensus_queue.cc:237] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.338433 1184 tablet_replica.cc:333] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:32.339792 1812 webserver.cc:492] Webserver started at http://127.0.104.189:44181/ using document root <none> and password file <none>
I20260318 02:51:32.342257 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e38dec0d2e9417e8571e202036e7117" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:32.341898 1184 raft_consensus.cc:2243] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.343225 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b51a15e4303742a999fe9a96d450c827" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:32.344883 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 2b6267d3f6e142579c62bbb4b14da4b0 (table default.Table_5ea72896ec3f438ca7ea9e8b599829f2 [id=a0b50d2be41f469f8e63545b054b9e33]) successfully deleted
I20260318 02:51:32.344466 1184 raft_consensus.cc:2272] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.350296 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ede8be1193444907a6bd408586d75882"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:32.351058 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ede8be1193444907a6bd408586d75882 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.352209 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet cdafabcad8a64c2094a3e55ea52178bd
I20260318 02:51:32.352124 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4600a261d8844254ba70e12cd1dc1676" } modify_external_catalogs: true
I20260318 02:51:32.353564 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_124aa7be83924c4493ebb650dcb06219"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:32.354113 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_124aa7be83924c4493ebb650dcb06219 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.354281 891 tablet_service.cc:1558] Processing DeleteTablet for tablet cdafabcad8a64c2094a3e55ea52178bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:32.354499 1874 raft_consensus.cc:493] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.354624 1874 raft_consensus.cc:515] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:32.355197 1874 leader_election.cc:290] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:32.356204 1184 ts_tablet_manager.cc:1916] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.356482 751 tablet_service.cc:1558] Processing DeleteTablet for tablet cdafabcad8a64c2094a3e55ea52178bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:32.356914 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 15b052ebecbe4652b1a337d18712011f
I20260318 02:51:32.356534 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet cdafabcad8a64c2094a3e55ea52178bd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:32.357666 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f0c81012ed0143bbbeee1d0e6af9594d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:32.358857 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0c81012ed0143bbbeee1d0e6af9594d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.360447 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 15b052ebecbe4652b1a337d18712011f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:32.356752 997 leader_election.cc:343] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.361944 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 15b052ebecbe4652b1a337d18712011f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:32.364468 1812 fs_manager.cc:362] Metadata directory not provided
I20260318 02:51:32.365199 1173 tablet_bootstrap.cc:492] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:32.365373 1173 ts_tablet_manager.cc:1403] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.552s user 0.005s sys 0.001s
I20260318 02:51:32.366143 1173 raft_consensus.cc:359] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.366380 1173 raft_consensus.cc:385] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.366482 1173 raft_consensus.cc:740] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.366900 1173 consensus_queue.cc:260] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.367535 1173 ts_tablet_manager.cc:1434] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:32.368013 1173 tablet_bootstrap.cc:492] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:32.375288 1812 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260318 02:51:32.375842 1915 raft_consensus.cc:493] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.375999 1915 raft_consensus.cc:515] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.376600 1915 leader_election.cc:290] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:32.371199 1184 ts_tablet_manager.cc:1929] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:32.377059 1184 log.cc:1199] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/e55bbc320b0e4f9595bae9816e594b82
I20260318 02:51:32.379329 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c50b0813b04f30896568ab2b680ba8" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:32.379886 719 leader_election.cc:343] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.385782 1176 raft_consensus.cc:2272] T a20b9dc70b5147ff8798946eda3131ca P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.386749 1176 ts_tablet_manager.cc:1916] T a20b9dc70b5147ff8798946eda3131ca P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.393990 1184 ts_tablet_manager.cc:1950] T e55bbc320b0e4f9595bae9816e594b82 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:32.397439 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 64c2a579264e43b9a1e25ded000d4d9f
I20260318 02:51:32.397970 451 catalog_manager.cc:6741] ReplaceTablet: tablet 64c2a579264e43b9a1e25ded000d4d9f deleted and replaced by tablet 5ce282f91c2f44b59c0b6ea836ad5d0e
I20260318 02:51:32.399009 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 64c2a579264e43b9a1e25ded000d4d9f with delete_type TABLET_DATA_DELETED (replaced by tablet 5ce282f91c2f44b59c0b6ea836ad5d0e) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:32.399322 1813 raft_consensus.cc:493] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.399474 1813 raft_consensus.cc:515] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.401448 1173 tablet_bootstrap.cc:654] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.404275 886 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:37534 (request call id 132) took 1134 ms. Trace:
I20260318 02:51:32.404388 886 rpcz_store.cc:276] 0318 02:51:31.269374 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.270386 (+ 1012us) service_pool.cc:225] Handling call
0318 02:51:31.703380 (+432994us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x6160000b4a54. stack: 00007f1f600b0c56 00007f1f600b0a10 00007f1f5f08b3ad 0000000000986fb4 0000000000986f7d 000000000098694a 00007f1f6bfb2540 00007f1f6fe64d2f 00007f1f6a287c36 00007f1f6a287965 00007f1f670b255e 00007f1f670b143e 00007f1f670b7675 00007f1f670b7f9f 00007f1f670b7dc8 0000000000a8b58c
0318 02:51:31.715087 (+ 11707us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x6160000d7854. stack: 00007f1f600b0c56 00007f1f600b0a10 00007f1f5f08b3ad 0000000000986fb4 0000000000986f7d 000000000098694a 00007f1f6bfb2540 00007f1f6fe64d2f 00007f1f6a287c36 00007f1f6a287965 00007f1f670b255e 00007f1f670b143e 00007f1f670b7675 00007f1f670b7f9f 00007f1f670b7dc8 0000000000a8b58c
0318 02:51:31.895511 (+180424us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x6160000a3054. stack: 00007f1f600b0c56 00007f1f600b0a10 00007f1f5f08b3ad 0000000000986fb4 0000000000986f7d 000000000098694a 00007f1f6bfb2540 00007f1f6fe64d2f 00007f1f6a287c36 00007f1f6a287965 00007f1f670b255e 00007f1f670b143e 00007f1f670b7675 00007f1f670b7f9f 00007f1f670b7dc8 0000000000a8b58c
0318 02:51:31.933071 (+ 37560us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x6160000d7e54. stack: 00007f1f600b0c56 00007f1f600b0a10 00007f1f5f08b3ad 0000000000986fb4 0000000000986f7d 000000000098694a 00007f1f6bfb2540 00007f1f6fe64d2f 00007f1f6a287c36 00007f1f6a287965 00007f1f670b255e 00007f1f670b143e 00007f1f670b7675 00007f1f670b7f9f 00007f1f670b7dc8 0000000000a8b58c
0318 02:51:32.404233 (+471162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":645404544}
I20260318 02:51:32.408294 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 64c2a579264e43b9a1e25ded000d4d9f with delete_type TABLET_DATA_DELETED (replaced by tablet 5ce282f91c2f44b59c0b6ea836ad5d0e) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:32.411692 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ff090fadc6b47d6ba551dc59d4dad2c has no consensus state
I20260318 02:51:32.412201 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_289825d07f72420781509902b8843ead"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:32.412825 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_289825d07f72420781509902b8843ead in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:32.414372 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c152446c906c4ed6b5eb0e3ee4d1917e consensus state has no leader
I20260318 02:51:32.414804 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_837986fdf0204eea89656e0edb23e67c" } new_table_name: "default.Table_6de905c387094641af62b74f3e0cee37" modify_external_catalogs: true
I20260318 02:51:32.416489 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b1d3f1dcf5d3445a817d681110d65f37" } modify_external_catalogs: true
I20260318 02:51:32.416671 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b1d3f1dcf5d3445a817d681110d65f37" } modify_external_catalogs: true
I20260318 02:51:32.420102 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4628ee4bf3294e908b99ec30079b8cc9" } new_table_name: "default.Table_c2a579089c6c405f9470b3a97dfbbbcd" modify_external_catalogs: true
I20260318 02:51:32.423012 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 654) took 1370 ms. Trace:
I20260318 02:51:32.423143 1184 rpcz_store.cc:276] 0318 02:51:31.052909 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.052957 (+ 48us) service_pool.cc:225] Handling call
0318 02:51:32.337431 (+1284474us) ts_tablet_manager.cc:1151] Deleting tablet e55bbc320b0e4f9595bae9816e594b82
0318 02:51:32.337445 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.367951 (+ 30506us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.371072 (+ 3121us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.422977 (+ 51905us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1514,"tablet-delete.queue_time_us":1283076}
I20260318 02:51:32.423527 1184 tablet_replica.cc:333] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:32.423713 1184 raft_consensus.cc:2243] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:32.423934 1184 pending_rounds.cc:70] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d: Trying to abort 1 pending ops.
I20260318 02:51:32.423977 1184 pending_rounds.cc:77] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494186033123328 op_type: NO_OP noop_request { }
I20260318 02:51:32.424062 1184 raft_consensus.cc:2889] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:32.424147 1184 raft_consensus.cc:2272] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.424624 1813 leader_election.cc:290] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:32.428845 1184 ts_tablet_manager.cc:1916] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.441402 1175 ts_tablet_manager.cc:1929] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:32.442775 1174 tablet_bootstrap.cc:492] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:32.442945 1174 ts_tablet_manager.cc:1403] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.155s user 0.047s sys 0.051s
I20260318 02:51:32.443701 1174 raft_consensus.cc:359] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:32.443889 1174 raft_consensus.cc:385] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.443958 1174 raft_consensus.cc:740] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.444150 1174 consensus_queue.cc:260] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:32.444738 1174 ts_tablet_manager.cc:1434] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:32.445015 1174 tablet_bootstrap.cc:492] T e1d804f5e9564f6d83efb77e6c18724b P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:32.441527 1175 log.cc:1199] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/30205728339f4bcf8b7d94d6f373e01c
I20260318 02:51:32.446151 1175 ts_tablet_manager.cc:1950] T 30205728339f4bcf8b7d94d6f373e01c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:32.446898 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 650) took 1310 ms. Trace:
I20260318 02:51:32.446996 1175 rpcz_store.cc:276] 0318 02:51:31.136044 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.136081 (+ 37us) service_pool.cc:225] Handling call
0318 02:51:32.137011 (+1000930us) ts_tablet_manager.cc:1151] Deleting tablet 30205728339f4bcf8b7d94d6f373e01c
0318 02:51:32.137056 (+ 45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.394712 (+257656us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.441273 (+ 46561us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.446874 (+ 5601us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1000786}
I20260318 02:51:32.447321 1175 tablet_replica.cc:333] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:32.447501 1175 raft_consensus.cc:2243] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.447638 1175 raft_consensus.cc:2272] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.448160 1175 ts_tablet_manager.cc:1916] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.450857 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 30205728339f4bcf8b7d94d6f373e01c (table default.Table_7442f04ad30e435b84996fb8990e0a44 [id=40612e2dc3b7447f8f4f753bf5474c22]) successfully deleted
I20260318 02:51:32.452133 1173 tablet_bootstrap.cc:492] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:32.452276 1173 ts_tablet_manager.cc:1403] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.084s user 0.002s sys 0.000s
I20260318 02:51:32.458392 1184 ts_tablet_manager.cc:1929] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:32.458609 1184 log.cc:1199] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/30205728339f4bcf8b7d94d6f373e01c
I20260318 02:51:32.459039 1184 ts_tablet_manager.cc:1950] T 30205728339f4bcf8b7d94d6f373e01c P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:32.460165 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 655) took 1406 ms. Trace:
I20260318 02:51:32.460314 1184 rpcz_store.cc:276] 0318 02:51:31.053232 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.053267 (+ 35us) service_pool.cc:225] Handling call
0318 02:51:32.423473 (+1370206us) ts_tablet_manager.cc:1151] Deleting tablet 30205728339f4bcf8b7d94d6f373e01c
0318 02:51:32.423486 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.455019 (+ 31533us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.458287 (+ 3268us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.460142 (+ 1855us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1370073}
I20260318 02:51:32.461505 1174 tablet_bootstrap.cc:654] T e1d804f5e9564f6d83efb77e6c18724b P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.462844 1184 tablet_replica.cc:333] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:32.463300 1173 raft_consensus.cc:359] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.463425 1176 ts_tablet_manager.cc:1929] T a20b9dc70b5147ff8798946eda3131ca P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:32.463615 1176 log.cc:1199] T a20b9dc70b5147ff8798946eda3131ca P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/a20b9dc70b5147ff8798946eda3131ca
I20260318 02:51:32.463817 1184 raft_consensus.cc:2243] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.463965 1176 ts_tablet_manager.cc:1950] T a20b9dc70b5147ff8798946eda3131ca P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:32.464076 1184 raft_consensus.cc:2272] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.464629 1184 ts_tablet_manager.cc:1916] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.464802 1173 raft_consensus.cc:385] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.464920 1173 raft_consensus.cc:740] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.464931 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 677) took 1561 ms. Trace:
I20260318 02:51:32.465003 1176 rpcz_store.cc:276] 0318 02:51:30.903278 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:30.922455 (+ 19177us) service_pool.cc:225] Handling call
0318 02:51:32.152464 (+1230009us) ts_tablet_manager.cc:1151] Deleting tablet a20b9dc70b5147ff8798946eda3131ca
0318 02:51:32.152474 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.427697 (+275223us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.463319 (+ 35622us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.464900 (+ 1581us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1229758}
I20260318 02:51:32.465199 1173 consensus_queue.cc:260] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.465670 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet a20b9dc70b5147ff8798946eda3131ca (table default.Table_1852ce7593344cc790f3c957fb56cd32 [id=7f9afbebeec541b9a89c049f168e87b7]) successfully deleted
I20260318 02:51:32.466001 1915 raft_consensus.cc:493] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.466142 1915 raft_consensus.cc:515] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.466341 1176 tablet_replica.cc:333] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:32.466507 1176 raft_consensus.cc:2243] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.466629 1176 raft_consensus.cc:2272] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.466713 1915 leader_election.cc:290] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:32.467111 1176 ts_tablet_manager.cc:1916] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.467420 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083493ab9d26493a924025fbd96ab1d7" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:32.469206 719 leader_election.cc:343] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.470073 1173 ts_tablet_manager.cc:1434] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20260318 02:51:32.470711 1173 tablet_bootstrap.cc:492] T 916b5b77fb2f4003b78a71025319ed15 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:32.472354 456 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet bc47f35f9c2c4e5085ab482285effc91 (table default.Table_9867792729394010ba769354562198f3 [id=1515573be85644d7a4f046947aa1537b]). Expected version 3 got 0
I20260318 02:51:32.473649 1172 tablet_bootstrap.cc:492] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:32.473791 1172 ts_tablet_manager.cc:1403] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.315s user 0.014s sys 0.072s
I20260318 02:51:32.471029 897 tablet_service.cc:1558] Processing DeleteTablet for tablet af793623466249e695b262ab451d4dc9 with delete_type TABLET_DATA_DELETED (replaced by tablet e57dbb1276114cd6b7d26f7167b99f25) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:32.474494 1172 raft_consensus.cc:359] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:32.474663 1172 raft_consensus.cc:385] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.474704 1172 raft_consensus.cc:740] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.474932 1172 consensus_queue.cc:260] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:32.475423 1172 ts_tablet_manager.cc:1434] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:32.475688 1172 tablet_bootstrap.cc:492] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:32.477047 1173 tablet_bootstrap.cc:654] T 916b5b77fb2f4003b78a71025319ed15 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.482903 1184 ts_tablet_manager.cc:1929] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:32.483310 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 95f15079d1df4314b6dd5c7afd896af5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:32.490667 1915 raft_consensus.cc:493] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.490823 1915 raft_consensus.cc:515] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.491478 1915 leader_election.cc:290] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:32.487308 997 leader_election.cc:343] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:32.491891 997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 130901us
I20260318 02:51:32.493337 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 64c2a579264e43b9a1e25ded000d4d9f with delete_type TABLET_DATA_DELETED (replaced by tablet 5ce282f91c2f44b59c0b6ea836ad5d0e) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:32.493479 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5afc5611d3481e9a6d48381dc67e86" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:32.493907 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 15b052ebecbe4652b1a337d18712011f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:32.490417 1175 ts_tablet_manager.cc:1929] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:32.494390 1175 log.cc:1199] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/2adcc9f1ad69458c997475111bb787cf
I20260318 02:51:32.494755 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e807c8ff5e457fb6c97c6d1b277eab" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:32.494863 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105326aea9f744779ca76e0cbb2448cd" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:32.495257 1175 ts_tablet_manager.cc:1950] T 2adcc9f1ad69458c997475111bb787cf P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:32.495806 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet e55bbc320b0e4f9595bae9816e594b82 (table default.Table_31d713ee51bc47c1a98874825f31a240 [id=f64d22ad510d4dd587445837c79a53c9]) successfully deleted
I20260318 02:51:32.496124 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 30205728339f4bcf8b7d94d6f373e01c (table default.Table_7442f04ad30e435b84996fb8990e0a44 [id=40612e2dc3b7447f8f4f753bf5474c22]) successfully deleted
I20260318 02:51:32.496543 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 651) took 1300 ms. Trace:
I20260318 02:51:32.496625 1175 rpcz_store.cc:276] 0318 02:51:31.195993 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.196103 (+ 110us) service_pool.cc:225] Handling call
0318 02:51:32.447275 (+1251172us) ts_tablet_manager.cc:1151] Deleting tablet 2adcc9f1ad69458c997475111bb787cf
0318 02:51:32.447285 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.451120 (+ 3835us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.490297 (+ 39177us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.496525 (+ 6228us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1245013}
W20260318 02:51:32.496829 997 leader_election.cc:343] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:32.497031 997 leader_election.cc:343] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.497112 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 2adcc9f1ad69458c997475111bb787cf (table default.Table_8fdbd48eef374965b592274f14ea8ee1 [id=e7071ce844664614a646a3554c38ae41]) successfully deleted
W20260318 02:51:32.497506 719 leader_election.cc:343] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.499198 1184 log.cc:1199] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/2e16272bcf9c435a80b32ba9cba9c738
I20260318 02:51:32.499913 1173 tablet_bootstrap.cc:492] T 916b5b77fb2f4003b78a71025319ed15 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:32.500483 1813 raft_consensus.cc:2804] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:32.500603 1813 raft_consensus.cc:697] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:32.500808 1812 fs_manager.cc:714] Time spent opening directory manager: real 0.115s user 0.002s sys 0.004s
I20260318 02:51:32.500865 1813 consensus_queue.cc:237] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.504310 1172 tablet_bootstrap.cc:654] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:32.505436 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3aa05403966349ae9056777d913a0db6 consensus state has no leader
I20260318 02:51:32.506124 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 76109acb76424b1f96ede9ab1f018e5e
I20260318 02:51:32.507261 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 76109acb76424b1f96ede9ab1f018e5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:32.507419 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 76109acb76424b1f96ede9ab1f018e5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:32.508992 1174 tablet_bootstrap.cc:492] T e1d804f5e9564f6d83efb77e6c18724b P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:32.509123 1174 ts_tablet_manager.cc:1403] T e1d804f5e9564f6d83efb77e6c18724b P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.064s user 0.004s sys 0.005s
I20260318 02:51:32.509868 1174 raft_consensus.cc:359] T e1d804f5e9564f6d83efb77e6c18724b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.510031 1174 raft_consensus.cc:385] T e1d804f5e9564f6d83efb77e6c18724b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.510082 1174 raft_consensus.cc:740] T e1d804f5e9564f6d83efb77e6c18724b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.510267 1174 consensus_queue.cc:260] T e1d804f5e9564f6d83efb77e6c18724b P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.513198 1174 ts_tablet_manager.cc:1434] T e1d804f5e9564f6d83efb77e6c18724b P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:32.513859 1172 tablet_bootstrap.cc:492] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:32.514024 1172 ts_tablet_manager.cc:1403] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.000s
I20260318 02:51:32.514573 1174 tablet_bootstrap.cc:492] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:32.515407 1172 raft_consensus.cc:359] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.515585 1172 raft_consensus.cc:385] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.515640 1172 raft_consensus.cc:740] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
W20260318 02:51:32.516026 999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.129:46711, user_credentials={real_user=slave}} blocked reactor thread for 201041us
I20260318 02:51:32.518285 1874 raft_consensus.cc:493] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.518427 1874 raft_consensus.cc:515] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.518558 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105326aea9f744779ca76e0cbb2448cd" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:32.518718 785 raft_consensus.cc:2468] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:32.518958 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e807c8ff5e457fb6c97c6d1b277eab" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:32.519059 1874 leader_election.cc:290] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:32.519102 784 raft_consensus.cc:2468] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:32.516357 1184 ts_tablet_manager.cc:1950] T 2e16272bcf9c435a80b32ba9cba9c738 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:32.521914 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 656) took 1468 ms. Trace:
I20260318 02:51:32.503222 1175 tablet_replica.cc:333] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:32.506932 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 76109acb76424b1f96ede9ab1f018e5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:32.520206 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d343e53f2354a3386b19d71ef00d5a4" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:32.522511 1173 ts_tablet_manager.cc:1403] T 916b5b77fb2f4003b78a71025319ed15 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.052s user 0.006s sys 0.000s
I20260318 02:51:32.522997 1946 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260318 02:51:32.523152 1175 raft_consensus.cc:2243] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:32.523226 1173 raft_consensus.cc:359] T 916b5b77fb2f4003b78a71025319ed15 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.525905 1174 tablet_bootstrap.cc:654] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.526269 1184 rpcz_store.cc:276] 0318 02:51:31.053546 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.053580 (+ 34us) service_pool.cc:225] Handling call
0318 02:51:32.462790 (+1409210us) ts_tablet_manager.cc:1151] Deleting tablet 2e16272bcf9c435a80b32ba9cba9c738
0318 02:51:32.462801 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.468356 (+ 5555us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.482780 (+ 14424us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.521893 (+ 39113us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1409057}
W20260318 02:51:32.522899 997 leader_election.cc:343] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.524538 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c50b0813b04f30896568ab2b680ba8" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:32.536638 1173 raft_consensus.cc:385] T 916b5b77fb2f4003b78a71025319ed15 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.524843 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5afc5611d3481e9a6d48381dc67e86" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:32.536779 1173 raft_consensus.cc:740] T 916b5b77fb2f4003b78a71025319ed15 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.523392 1175 pending_rounds.cc:70] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18: Trying to abort 1 pending ops.
I20260318 02:51:32.536895 1175 pending_rounds.cc:77] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494186013114368 op_type: NO_OP noop_request { }
I20260318 02:51:32.537055 1175 raft_consensus.cc:2889] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:32.537075 1184 tablet_replica.cc:333] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:32.537135 1175 raft_consensus.cc:2272] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.525113 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083493ab9d26493a924025fbd96ab1d7" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:32.537254 1184 raft_consensus.cc:2243] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:32.537462 1184 pending_rounds.cc:70] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d: Trying to abort 1 pending ops.
I20260318 02:51:32.537499 1184 pending_rounds.cc:77] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494189411545088 op_type: NO_OP noop_request { }
I20260318 02:51:32.537580 1184 raft_consensus.cc:2889] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:32.537669 1184 raft_consensus.cc:2272] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.521930 1172 consensus_queue.cc:260] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.538151 1172 ts_tablet_manager.cc:1434] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.024s user 0.001s sys 0.000s
I20260318 02:51:32.538445 1172 tablet_bootstrap.cc:492] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:32.538472 1175 ts_tablet_manager.cc:1916] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.538517 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a61fc584a9fb41fa9d17ab0aef58582d" } modify_external_catalogs: true
I20260318 02:51:32.538722 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a61fc584a9fb41fa9d17ab0aef58582d" } modify_external_catalogs: true
I20260318 02:51:32.539182 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 2e16272bcf9c435a80b32ba9cba9c738 (table default.Table_c15b5791e7ca4928bfeccb13448f1cf9 [id=259a4cc85c2f4ecdbf865398fefcb0e9]) successfully deleted
W20260318 02:51:32.539497 999 leader_election.cc:343] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 3e38dec0d2e9417e8571e202036e7117
I20260318 02:51:32.539603 999 leader_election.cc:304] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.539983 999 leader_election.cc:304] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.540268 1173 consensus_queue.cc:260] T 916b5b77fb2f4003b78a71025319ed15 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.540455 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d2abf77a628943db8e72558732f7c73c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:32.541085 1874 raft_consensus.cc:2749] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:32.541249 1874 raft_consensus.cc:2804] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:32.541327 1874 raft_consensus.cc:493] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:32.541392 1874 raft_consensus.cc:3060] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:32.541811 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2abf77a628943db8e72558732f7c73c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.544312 1874 raft_consensus.cc:515] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:32.545068 1874 leader_election.cc:290] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:32.545483 999 leader_election.cc:304] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.545830 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105326aea9f744779ca76e0cbb2448cd" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:32.541692 1915 raft_consensus.cc:493] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.546507 1915 raft_consensus.cc:515] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:32.547137 1915 leader_election.cc:290] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:32.547884 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27fc03c90b584becb250546100af736c" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:32.548455 719 leader_election.cc:343] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.549679 1173 ts_tablet_manager.cc:1434] T 916b5b77fb2f4003b78a71025319ed15 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20260318 02:51:32.550788 1813 raft_consensus.cc:2804] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:32.550918 1813 raft_consensus.cc:493] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:32.551056 1813 raft_consensus.cc:3060] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:32.552196 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_925458fc4c6f4a8b8e07a345204dabf3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:32.552819 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_925458fc4c6f4a8b8e07a345204dabf3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.553061 1173 tablet_bootstrap.cc:492] T bc47f35f9c2c4e5085ab482285effc91 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:32.554311 1915 raft_consensus.cc:493] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.554440 1173 tablet_bootstrap.cc:654] T bc47f35f9c2c4e5085ab482285effc91 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.554441 1915 raft_consensus.cc:515] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:32.555009 1915 leader_election.cc:290] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:32.546346 1172 tablet_bootstrap.cc:654] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:32.546456 997 leader_election.cc:343] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.555593 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fec974d146f44aeb72df483fa85b287" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:32.556381 719 leader_election.cc:343] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:32.557034 719 leader_election.cc:343] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.557134 719 leader_election.cc:304] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.558029 1915 raft_consensus.cc:2749] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:32.560520 719 leader_election.cc:343] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.560629 719 leader_election.cc:304] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.561105 1915 raft_consensus.cc:2749] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:32.561964 719 leader_election.cc:343] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.562062 719 leader_election.cc:304] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.562455 1915 raft_consensus.cc:2749] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:32.562995 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9972d91768fa4b3c9bc308d6a07475e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:32.563105 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105326aea9f744779ca76e0cbb2448cd" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:32.563254 785 raft_consensus.cc:3060] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:32.563653 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9972d91768fa4b3c9bc308d6a07475e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:32.563887 999 leader_election.cc:343] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 0d343e53f2354a3386b19d71ef00d5a4
I20260318 02:51:32.563997 999 leader_election.cc:304] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.564873 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27fc03c90b584becb250546100af736c" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:32.565146 455 master_service.cc:954] ReplaceTablet: received request to replace tablet 6858334d4c8b41b89c57b4b6f127a1c7 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:32.565222 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fec974d146f44aeb72df483fa85b287" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:32.565641 1874 raft_consensus.cc:2749] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:32.566710 785 raft_consensus.cc:2468] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:32.568389 1812 fs_manager.cc:730] Time spent opening block manager: real 0.050s user 0.002s sys 0.000s
W20260318 02:51:32.569007 719 leader_election.cc:343] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.569135 719 leader_election.cc:304] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.569272 1175 ts_tablet_manager.cc:1929] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:32.569396 1175 log.cc:1199] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/e55bbc320b0e4f9595bae9816e594b82
I20260318 02:51:32.569502 1915 raft_consensus.cc:2749] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:32.569730 1175 ts_tablet_manager.cc:1950] T e55bbc320b0e4f9595bae9816e594b82 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
W20260318 02:51:32.570013 719 leader_election.cc:343] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.568643 1812 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/data,/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/wal
uuid: "8b701993861d4c11b3394a2d6588b3b7"
format_stamp: "Formatted at 2026-03-18 02:51:16 on dist-test-slave-km68"
I20260318 02:51:32.570078 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 652) took 1362 ms. Trace:
I20260318 02:51:32.570123 719 leader_election.cc:304] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.570161 1175 rpcz_store.cc:276] 0318 02:51:31.207601 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.207722 (+ 121us) service_pool.cc:225] Handling call
0318 02:51:32.503161 (+1295439us) ts_tablet_manager.cc:1151] Deleting tablet e55bbc320b0e4f9595bae9816e594b82
0318 02:51:32.503174 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.559376 (+ 56202us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.569154 (+ 9778us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.570059 (+ 905us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1291263}
I20260318 02:51:32.570444 1915 raft_consensus.cc:2749] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:32.570276 1812 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260318 02:51:32.570627 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet e55bbc320b0e4f9595bae9816e594b82 (table default.Table_31d713ee51bc47c1a98874825f31a240 [id=f64d22ad510d4dd587445837c79a53c9]) successfully deleted
I20260318 02:51:32.571249 999 leader_election.cc:304] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.574383 1184 ts_tablet_manager.cc:1916] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.574682 1813 raft_consensus.cc:515] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.575820 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e807c8ff5e457fb6c97c6d1b277eab" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:32.576265 1874 raft_consensus.cc:2804] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
W20260318 02:51:32.576452 997 leader_election.cc:343] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.576778 1813 leader_election.cc:290] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:32.577572 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 653) took 1344 ms. Trace:
I20260318 02:51:32.577723 1175 rpcz_store.cc:276] 0318 02:51:31.233518 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.233647 (+ 129us) service_pool.cc:225] Handling call
0318 02:51:32.577304 (+1343657us) ts_tablet_manager.cc:1151] Deleting tablet a20b9dc70b5147ff8798946eda3131ca
0318 02:51:32.577316 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.577426 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1343357}
W20260318 02:51:32.578977 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet a20b9dc70b5147ff8798946eda3131ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a20b9dc70b5147ff8798946eda3131ca already in progress: creating tablet
I20260318 02:51:32.579345 1176 ts_tablet_manager.cc:1929] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:32.579555 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e807c8ff5e457fb6c97c6d1b277eab" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:32.579735 784 raft_consensus.cc:3060] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:32.582338 784 raft_consensus.cc:2468] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:32.582968 999 leader_election.cc:304] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.583039 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 654) took 1335 ms. Trace:
I20260318 02:51:32.583312 1948 raft_consensus.cc:2804] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:32.583480 1948 raft_consensus.cc:697] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:32.583793 1948 consensus_queue.cc:237] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.584373 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet c5765355efaa4ef4ab3b68ea33f51536
W20260318 02:51:32.584988 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9777963ff20c4a799de2870555f6b335 consensus state has no leader
I20260318 02:51:32.585175 448 master_service.cc:954] ReplaceTablet: received request to replace tablet 0c8264f69f934d3ba2e41434ce350f3e from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:32.585265 457 master_service.cc:954] ReplaceTablet: received request to replace tablet c0349def0e4045f2b1e9a02dd654a174 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:32.585839 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c23e7504b2474f1686592467b684da52" } modify_external_catalogs: true
I20260318 02:51:32.585884 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5d3c36baac1f40b8a09948ec623482fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:32.585996 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet c5765355efaa4ef4ab3b68ea33f51536 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:32.586057 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c23e7504b2474f1686592467b684da52" } modify_external_catalogs: true
W20260318 02:51:32.586489 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d3c36baac1f40b8a09948ec623482fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.586836 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8b91091dce7d43b9b2abf2ef5262b12c" } modify_external_catalogs: true
I20260318 02:51:32.586992 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8b91091dce7d43b9b2abf2ef5262b12c" } modify_external_catalogs: true
I20260318 02:51:32.587744 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet bfb352bce9cc4e8aa899d691954d28d2
I20260318 02:51:32.588045 759 tablet_service.cc:1558] Processing DeleteTablet for tablet c5765355efaa4ef4ab3b68ea33f51536 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:32.588495 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 480f4438de13453fa84ce8c37388aeb1 consensus state has no leader
I20260318 02:51:32.588616 759 tablet_service.cc:1558] Processing DeleteTablet for tablet bfb352bce9cc4e8aa899d691954d28d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:32.588874 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet bfb352bce9cc4e8aa899d691954d28d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:32.585611 900 tablet_service.cc:1558] Processing DeleteTablet for tablet c5765355efaa4ef4ab3b68ea33f51536 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:32.588501 897 tablet_service.cc:1558] Processing DeleteTablet for tablet bfb352bce9cc4e8aa899d691954d28d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:32.590705 1175 rpcz_store.cc:276] 0318 02:51:31.247737 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.247874 (+ 137us) service_pool.cc:225] Handling call
0318 02:51:32.582847 (+1334973us) ts_tablet_manager.cc:1151] Deleting tablet b51a15e4303742a999fe9a96d450c827
0318 02:51:32.582859 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.583014 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1315488}
W20260318 02:51:32.591743 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet b51a15e4303742a999fe9a96d450c827 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b51a15e4303742a999fe9a96d450c827 already in progress: creating tablet
I20260318 02:51:32.579663 1176 log.cc:1199] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/b51a15e4303742a999fe9a96d450c827
I20260318 02:51:32.592321 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 656) took 1324 ms. Trace:
I20260318 02:51:32.592413 1175 rpcz_store.cc:276] 0318 02:51:31.268260 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.268354 (+ 94us) service_pool.cc:225] Handling call
0318 02:51:32.592181 (+1323827us) ts_tablet_manager.cc:1151] Deleting tablet 2a7ddc0807d742cea258f889390e2142
0318 02:51:32.592194 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.592301 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1319663}
I20260318 02:51:32.592660 1176 ts_tablet_manager.cc:1950] T b51a15e4303742a999fe9a96d450c827 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
W20260318 02:51:32.592903 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2a7ddc0807d742cea258f889390e2142 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a7ddc0807d742cea258f889390e2142 already in progress: creating tablet
I20260318 02:51:32.593540 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 678) took 1677 ms. Trace:
I20260318 02:51:32.593676 1176 rpcz_store.cc:276] 0318 02:51:30.916226 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:30.925680 (+ 9454us) service_pool.cc:225] Handling call
0318 02:51:32.466079 (+1540399us) ts_tablet_manager.cc:1151] Deleting tablet b51a15e4303742a999fe9a96d450c827
0318 02:51:32.466296 (+ 217us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.509726 (+ 43430us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.579222 (+ 69496us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.593518 (+ 14296us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1540122}
I20260318 02:51:32.594237 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet b51a15e4303742a999fe9a96d450c827 (table default.Table_c9fa61fd1bdb405f89a32f500da8f182 [id=9aa1a9e376e8459987f5ef2231598bd0]) successfully deleted
I20260318 02:51:32.594360 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 657) took 1316 ms. Trace:
I20260318 02:51:32.594447 1175 rpcz_store.cc:276] 0318 02:51:31.277468 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.277576 (+ 108us) service_pool.cc:225] Handling call
0318 02:51:32.594231 (+1316655us) ts_tablet_manager.cc:1151] Deleting tablet 2dab268da5e843cab5c28a521217df97
0318 02:51:32.594242 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.594340 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1314269}
I20260318 02:51:32.594769 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 679) took 1419 ms. Trace:
W20260318 02:51:32.594873 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2dab268da5e843cab5c28a521217df97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2dab268da5e843cab5c28a521217df97 already in progress: creating tablet
I20260318 02:51:32.594894 1176 rpcz_store.cc:276] 0318 02:51:31.175391 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.175459 (+ 68us) service_pool.cc:225] Handling call
0318 02:51:32.594566 (+1419107us) ts_tablet_manager.cc:1151] Deleting tablet 2a7ddc0807d742cea258f889390e2142
0318 02:51:32.594576 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.594749 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1343777}
W20260318 02:51:32.595418 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2a7ddc0807d742cea258f889390e2142 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a7ddc0807d742cea258f889390e2142 already in progress: creating tablet
I20260318 02:51:32.595852 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 680) took 1414 ms. Trace:
I20260318 02:51:32.595973 1176 rpcz_store.cc:276] 0318 02:51:31.181719 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.181861 (+ 142us) service_pool.cc:225] Handling call
0318 02:51:32.595702 (+1413841us) ts_tablet_manager.cc:1151] Deleting tablet 2dab268da5e843cab5c28a521217df97
0318 02:51:32.595712 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.595793 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1344803}
I20260318 02:51:32.596279 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 658) took 1316 ms. Trace:
I20260318 02:51:32.596361 1175 rpcz_store.cc:276] 0318 02:51:31.279659 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.279774 (+ 115us) service_pool.cc:225] Handling call
0318 02:51:32.596163 (+1316389us) ts_tablet_manager.cc:1151] Deleting tablet 44cc50429d4f4c109629a9ad08b06bb3
0318 02:51:32.596175 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.596260 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1302627}
W20260318 02:51:32.596402 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2dab268da5e843cab5c28a521217df97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2dab268da5e843cab5c28a521217df97 already in progress: creating tablet
W20260318 02:51:32.596781 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 44cc50429d4f4c109629a9ad08b06bb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44cc50429d4f4c109629a9ad08b06bb3 already in progress: creating tablet
I20260318 02:51:32.596800 1874 raft_consensus.cc:697] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:32.597090 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 681) took 1415 ms. Trace:
I20260318 02:51:32.597093 1874 consensus_queue.cc:237] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:32.597206 1176 rpcz_store.cc:276] 0318 02:51:31.181815 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.182031 (+ 216us) service_pool.cc:225] Handling call
0318 02:51:32.596992 (+1414961us) ts_tablet_manager.cc:1151] Deleting tablet 44cc50429d4f4c109629a9ad08b06bb3
0318 02:51:32.597001 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.597074 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1346024}
W20260318 02:51:32.597723 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 44cc50429d4f4c109629a9ad08b06bb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44cc50429d4f4c109629a9ad08b06bb3 already in progress: creating tablet
I20260318 02:51:32.598117 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 683) took 1394 ms. Trace:
I20260318 02:51:32.598165 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 660) took 1303 ms. Trace:
I20260318 02:51:32.598251 1175 rpcz_store.cc:276] 0318 02:51:31.294657 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.295096 (+ 439us) service_pool.cc:225] Handling call
0318 02:51:32.598047 (+1302951us) ts_tablet_manager.cc:1151] Deleting tablet 6deb99f7937144f39409929f99b135c5
0318 02:51:32.598057 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.598145 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1280903}
W20260318 02:51:32.598632 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 6deb99f7937144f39409929f99b135c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6deb99f7937144f39409929f99b135c5 already in progress: creating tablet
I20260318 02:51:32.605651 1173 tablet_bootstrap.cc:492] T bc47f35f9c2c4e5085ab482285effc91 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:32.606026 1173 ts_tablet_manager.cc:1403] T bc47f35f9c2c4e5085ab482285effc91 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.006s
I20260318 02:51:32.606923 1173 raft_consensus.cc:359] T bc47f35f9c2c4e5085ab482285effc91 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.607219 1173 raft_consensus.cc:385] T bc47f35f9c2c4e5085ab482285effc91 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.607326 1173 raft_consensus.cc:740] T bc47f35f9c2c4e5085ab482285effc91 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.607623 1173 consensus_queue.cc:260] T bc47f35f9c2c4e5085ab482285effc91 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.608312 1173 ts_tablet_manager.cc:1434] T bc47f35f9c2c4e5085ab482285effc91 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:32.609616 1173 tablet_bootstrap.cc:492] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:32.612154 451 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet bc47f35f9c2c4e5085ab482285effc91 (table default.Table_9867792729394010ba769354562198f3 [id=1515573be85644d7a4f046947aa1537b]). Expected version 3 got 0
I20260318 02:51:32.613564 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ea4a3406cfef4aeebcb377d76728e974" } new_table_name: "default.Table_40a4f002cc3e4375a317fa86d31c975f" modify_external_catalogs: true
I20260318 02:51:32.616046 453 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet bc47f35f9c2c4e5085ab482285effc91 (table default.Table_9867792729394010ba769354562198f3 [id=1515573be85644d7a4f046947aa1537b]). Expected version 3 got 0
I20260318 02:51:32.616839 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4247fd2723c44dfd9773172a8052e0e7" } new_table_name: "default.Table_74c5ce654ad549c29bb6da72f895dfc4" modify_external_catalogs: true
I20260318 02:51:32.619112 1173 tablet_bootstrap.cc:654] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.620189 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 674) took 1214 ms. Trace:
I20260318 02:51:32.620289 1175 rpcz_store.cc:276] 0318 02:51:31.405582 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.405623 (+ 41us) service_pool.cc:225] Handling call
0318 02:51:32.602300 (+1196677us) ts_tablet_manager.cc:1151] Deleting tablet c0c33cfa1c194a65bfc64d0e1e9434ff
0318 02:51:32.602313 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.620164 (+ 17851us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1196494}
W20260318 02:51:32.620785 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet c0c33cfa1c194a65bfc64d0e1e9434ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0c33cfa1c194a65bfc64d0e1e9434ff already in progress: creating tablet
I20260318 02:51:32.623040 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_65dbad4ac5b24e5eb1768ac4e6c3127b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:32.623555 1172 tablet_bootstrap.cc:492] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
W20260318 02:51:32.623656 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65dbad4ac5b24e5eb1768ac4e6c3127b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.623700 1172 ts_tablet_manager.cc:1403] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.085s user 0.007s sys 0.006s
I20260318 02:51:32.624199 1813 raft_consensus.cc:493] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.624316 1813 raft_consensus.cc:515] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:32.624939 1813 leader_election.cc:290] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:32.625470 1175 tablet_replica.cc:333] T 916b5b77fb2f4003b78a71025319ed15 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:32.625674 1175 raft_consensus.cc:2243] T 916b5b77fb2f4003b78a71025319ed15 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.625623 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1516525b471540288c6cb5d61120d430" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:32.625829 1175 raft_consensus.cc:2272] T 916b5b77fb2f4003b78a71025319ed15 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:32.626412 997 leader_election.cc:343] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.627249 1172 raft_consensus.cc:359] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.627408 1172 raft_consensus.cc:385] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.627457 1172 raft_consensus.cc:740] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.627628 1172 consensus_queue.cc:260] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.628248 1175 ts_tablet_manager.cc:1916] T 916b5b77fb2f4003b78a71025319ed15 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.636492 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2f3393db9c104844995b512bb2ecc2ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:32.637400 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f3393db9c104844995b512bb2ecc2ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.622749 1174 tablet_bootstrap.cc:492] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:32.627044 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1516525b471540288c6cb5d61120d430" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:32.648774 1176 rpcz_store.cc:276] 0318 02:51:31.203939 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.205052 (+ 1113us) service_pool.cc:225] Handling call
0318 02:51:32.598009 (+1392957us) ts_tablet_manager.cc:1151] Deleting tablet 6deb99f7937144f39409929f99b135c5
0318 02:51:32.598019 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.598100 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1346373}
I20260318 02:51:32.648985 1174 ts_tablet_manager.cc:1403] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.135s user 0.006s sys 0.009s
I20260318 02:51:32.649042 784 raft_consensus.cc:2468] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
W20260318 02:51:32.649318 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 6deb99f7937144f39409929f99b135c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6deb99f7937144f39409929f99b135c5 already in progress: creating tablet
I20260318 02:51:32.649552 999 leader_election.cc:304] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.649734 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 697) took 1335 ms. Trace:
I20260318 02:51:32.649817 1176 rpcz_store.cc:276] 0318 02:51:31.314687 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.314755 (+ 68us) service_pool.cc:225] Handling call
0318 02:51:32.649597 (+1334842us) ts_tablet_manager.cc:1151] Deleting tablet c0c33cfa1c194a65bfc64d0e1e9434ff
0318 02:51:32.649611 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.649716 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1334579}
W20260318 02:51:32.650261 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet c0c33cfa1c194a65bfc64d0e1e9434ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0c33cfa1c194a65bfc64d0e1e9434ff already in progress: creating tablet
I20260318 02:51:32.650218 1174 raft_consensus.cc:359] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.650377 1174 raft_consensus.cc:385] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.650434 1174 raft_consensus.cc:740] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.650571 1176 tablet_replica.cc:333] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:32.650676 1174 consensus_queue.cc:260] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.650753 1176 raft_consensus.cc:2243] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.651777 1948 raft_consensus.cc:493] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.651926 1948 raft_consensus.cc:515] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:32.652455 1948 leader_election.cc:290] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:32.652581 1948 raft_consensus.cc:2804] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:32.652632 1948 raft_consensus.cc:493] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:32.652685 1948 raft_consensus.cc:3060] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:32.653115 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5038e9e1074f46976a1a5bb4282944" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:32.653550 997 leader_election.cc:343] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.656183 1948 raft_consensus.cc:515] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:32.658142 1948 leader_election.cc:290] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:32.658763 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1516525b471540288c6cb5d61120d430" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:32.659299 997 leader_election.cc:343] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.662602 1172 ts_tablet_manager.cc:1434] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.039s user 0.001s sys 0.001s
I20260318 02:51:32.664047 1176 raft_consensus.cc:2272] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.664839 1174 ts_tablet_manager.cc:1434] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260318 02:51:32.665381 1176 ts_tablet_manager.cc:1916] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.672175 1172 tablet_bootstrap.cc:492] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:32.672354 1174 tablet_bootstrap.cc:492] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:32.672935 999 leader_election.cc:343] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2c5038e9e1074f46976a1a5bb4282944
I20260318 02:51:32.673163 999 leader_election.cc:304] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.672609 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1516525b471540288c6cb5d61120d430" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:32.673662 785 raft_consensus.cc:3060] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:32.674069 452 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet b5c19bc5e07949088c84cedbf944dfdb (table default.Table_cec1585fa5824e7682f05533101d20eb [id=873432f002e14a4fa7065dcfe5caebd5]). Expected version 5 got 0
I20260318 02:51:32.675268 1174 tablet_bootstrap.cc:654] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.676290 785 raft_consensus.cc:2468] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:32.676687 999 leader_election.cc:304] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.676831 1960 raft_consensus.cc:2749] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:32.677069 1960 raft_consensus.cc:2804] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:32.677359 456 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 27fc03c90b584becb250546100af736c (table default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]). Expected version 1 got 0
I20260318 02:51:32.677461 1960 raft_consensus.cc:697] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:32.678269 1172 tablet_bootstrap.cc:654] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:32.678625 456 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 27fc03c90b584becb250546100af736c (table default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 27fc03c90b584becb250546100af736c consensus state has no leader
I20260318 02:51:32.681286 900 tablet_service.cc:1511] Processing CreateTablet for tablet b0c90eaefcf749eb98be03f2fd518b5a (DEFAULT_TABLE table=default.Table_c11f92b1245f4babb6bb88a53d3a6b66 [id=96e3801b751d4607b522b1c4c664f712]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.681720 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0c90eaefcf749eb98be03f2fd518b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.681777 1175 ts_tablet_manager.cc:1929] T 916b5b77fb2f4003b78a71025319ed15 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:32.681902 1175 log.cc:1199] T 916b5b77fb2f4003b78a71025319ed15 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/916b5b77fb2f4003b78a71025319ed15
I20260318 02:51:32.682159 1175 ts_tablet_manager.cc:1950] T 916b5b77fb2f4003b78a71025319ed15 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:32.682154 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd5884046c14e688c18f6cb173d176d (DEFAULT_TABLE table=default.Table_9ab2eed2c17e4f67b591a7dcf3cb0044 [id=acd282255a1d4747a2ec6d99b2c1899f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.682214 897 tablet_service.cc:1511] Processing CreateTablet for tablet 975926724611403e85d5466f7bcc08d6 (DEFAULT_TABLE table=default.Table_465da657f4fc40d6acdf67f2bff44278 [id=e54b351c257741cb8790f5812b3ed2e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.682511 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 975926724611403e85d5466f7bcc08d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.683168 759 tablet_service.cc:1511] Processing CreateTablet for tablet 975926724611403e85d5466f7bcc08d6 (DEFAULT_TABLE table=default.Table_465da657f4fc40d6acdf67f2bff44278 [id=e54b351c257741cb8790f5812b3ed2e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.683557 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 975926724611403e85d5466f7bcc08d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.684960 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 975926724611403e85d5466f7bcc08d6 (DEFAULT_TABLE table=default.Table_465da657f4fc40d6acdf67f2bff44278 [id=e54b351c257741cb8790f5812b3ed2e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.684953 891 tablet_service.cc:1511] Processing CreateTablet for tablet fae818515c7744899b80b87bd6dcd198 (DEFAULT_TABLE table=default.Table_2a5da32146c44463ad1d7eb9f8ba6232 [id=542d9ef198aa49ca8e90b5aea32b641b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.685258 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae818515c7744899b80b87bd6dcd198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.685393 1028 tablet_service.cc:1511] Processing CreateTablet for tablet b0c90eaefcf749eb98be03f2fd518b5a (DEFAULT_TABLE table=default.Table_c11f92b1245f4babb6bb88a53d3a6b66 [id=96e3801b751d4607b522b1c4c664f712]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.685787 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff090fadc6b47d6ba551dc59d4dad2c (DEFAULT_TABLE table=default.Table_1d010d3bbddc4061b497aaeb03506d39 [id=0ec49cae5403451a86ceb35e7d7e8fec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.685828 1176 ts_tablet_manager.cc:1929] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:32.685922 1176 log.cc:1199] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/916b5b77fb2f4003b78a71025319ed15
I20260318 02:51:32.686229 1176 ts_tablet_manager.cc:1950] T 916b5b77fb2f4003b78a71025319ed15 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:32.686949 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 698) took 1285 ms. Trace:
I20260318 02:51:32.687022 1176 rpcz_store.cc:276] 0318 02:51:31.401150 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.401200 (+ 50us) service_pool.cc:225] Handling call
0318 02:51:32.650521 (+1249321us) ts_tablet_manager.cc:1151] Deleting tablet 916b5b77fb2f4003b78a71025319ed15
0318 02:51:32.650531 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.669405 (+ 18874us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.685737 (+ 16332us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.686928 (+ 1191us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12665,"tablet-delete.queue_time_us":1249132}
I20260318 02:51:32.687436 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 699) took 1028 ms. Trace:
I20260318 02:51:32.687508 1176 rpcz_store.cc:276] 0318 02:51:31.659158 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.659232 (+ 74us) service_pool.cc:225] Handling call
0318 02:51:32.687320 (+1028088us) ts_tablet_manager.cc:1151] Deleting tablet d4e3346edd274750a5e27ec2393d08bc
0318 02:51:32.687331 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.687422 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1027838}
I20260318 02:51:32.687661 750 tablet_service.cc:1511] Processing CreateTablet for tablet fae818515c7744899b80b87bd6dcd198 (DEFAULT_TABLE table=default.Table_2a5da32146c44463ad1d7eb9f8ba6232 [id=542d9ef198aa49ca8e90b5aea32b641b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.687708 751 tablet_service.cc:1511] Processing CreateTablet for tablet b0c90eaefcf749eb98be03f2fd518b5a (DEFAULT_TABLE table=default.Table_c11f92b1245f4babb6bb88a53d3a6b66 [id=96e3801b751d4607b522b1c4c664f712]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.687935 1176 tablet_replica.cc:333] T e1d804f5e9564f6d83efb77e6c18724b P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:32.687969 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae818515c7744899b80b87bd6dcd198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.688102 1176 raft_consensus.cc:2243] T e1d804f5e9564f6d83efb77e6c18724b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.688979 907 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff090fadc6b47d6ba551dc59d4dad2c (DEFAULT_TABLE table=default.Table_1d010d3bbddc4061b497aaeb03506d39 [id=0ec49cae5403451a86ceb35e7d7e8fec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.689316 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff090fadc6b47d6ba551dc59d4dad2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.692997 903 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd5884046c14e688c18f6cb173d176d (DEFAULT_TABLE table=default.Table_9ab2eed2c17e4f67b591a7dcf3cb0044 [id=acd282255a1d4747a2ec6d99b2c1899f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.693364 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd5884046c14e688c18f6cb173d176d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.693969 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 916b5b77fb2f4003b78a71025319ed15 (table default.Table_6d506ddf2c854df0a30d396a197e4032 [id=57891ff71e194a8f8959294ba552fb23]) successfully deleted
I20260318 02:51:32.694746 897 tablet_service.cc:1511] Processing CreateTablet for tablet 548d7a5fb42d40c4aae1adc23c3eb54a (DEFAULT_TABLE table=default.Table_047c32916d874670a158b134391f6d44 [id=0dd1de0becbf414a92bff72023344548]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.694775 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 2b818b2d7f194db2bbd0cc4ad837fb00 (DEFAULT_TABLE table=default.Table_e34821e167a74d5f9b309576e5ae88fe [id=ff0d5115c285407bac5f1eda80953eae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.695080 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 548d7a5fb42d40c4aae1adc23c3eb54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.696472 893 tablet_service.cc:1511] Processing CreateTablet for tablet 2b818b2d7f194db2bbd0cc4ad837fb00 (DEFAULT_TABLE table=default.Table_e34821e167a74d5f9b309576e5ae88fe [id=ff0d5115c285407bac5f1eda80953eae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.696990 1040 tablet_service.cc:1511] Processing CreateTablet for tablet fae818515c7744899b80b87bd6dcd198 (DEFAULT_TABLE table=default.Table_2a5da32146c44463ad1d7eb9f8ba6232 [id=542d9ef198aa49ca8e90b5aea32b641b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.697489 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 548d7a5fb42d40c4aae1adc23c3eb54a (DEFAULT_TABLE table=default.Table_047c32916d874670a158b134391f6d44 [id=0dd1de0becbf414a92bff72023344548]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.697883 896 tablet_service.cc:1511] Processing CreateTablet for tablet 6c9249900bd748de9fe70280c239a1ac (DEFAULT_TABLE table=default.Table_f923305ec9784da8a5dc3521f65ccb12 [id=4dc3ad85975f4f07ad5cfd0f5bcd8b3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.698192 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c9249900bd748de9fe70280c239a1ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.700685 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b818b2d7f194db2bbd0cc4ad837fb00. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:32.701202 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet d4e3346edd274750a5e27ec2393d08bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4e3346edd274750a5e27ec2393d08bc already in progress: creating tablet
W20260318 02:51:32.701455 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet abfa81c3c78a498285e2961530272a39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet abfa81c3c78a498285e2961530272a39 already in progress: creating tablet
I20260318 02:51:32.701516 1176 raft_consensus.cc:2272] T e1d804f5e9564f6d83efb77e6c18724b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.702241 766 tablet_service.cc:1511] Processing CreateTablet for tablet 548d7a5fb42d40c4aae1adc23c3eb54a (DEFAULT_TABLE table=default.Table_047c32916d874670a158b134391f6d44 [id=0dd1de0becbf414a92bff72023344548]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.703063 1176 ts_tablet_manager.cc:1916] T e1d804f5e9564f6d83efb77e6c18724b P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.695998 756 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff090fadc6b47d6ba551dc59d4dad2c (DEFAULT_TABLE table=default.Table_1d010d3bbddc4061b497aaeb03506d39 [id=0ec49cae5403451a86ceb35e7d7e8fec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.696166 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 083493ab9d26493a924025fbd96ab1d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:32.696310 752 tablet_service.cc:1558] Processing DeleteTablet for tablet e57dbb1276114cd6b7d26f7167b99f25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:32.696358 754 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd5884046c14e688c18f6cb173d176d (DEFAULT_TABLE table=default.Table_9ab2eed2c17e4f67b591a7dcf3cb0044 [id=acd282255a1d4747a2ec6d99b2c1899f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.696525 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b439fa2481a43c78d2c486d8711175f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:32.696573 762 tablet_service.cc:1511] Processing CreateTablet for tablet 2b818b2d7f194db2bbd0cc4ad837fb00 (DEFAULT_TABLE table=default.Table_e34821e167a74d5f9b309576e5ae88fe [id=ff0d5115c285407bac5f1eda80953eae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.689155 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0c90eaefcf749eb98be03f2fd518b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.706010 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 548d7a5fb42d40c4aae1adc23c3eb54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.708863 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff090fadc6b47d6ba551dc59d4dad2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.710606 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 6c9249900bd748de9fe70280c239a1ac (DEFAULT_TABLE table=default.Table_f923305ec9784da8a5dc3521f65ccb12 [id=4dc3ad85975f4f07ad5cfd0f5bcd8b3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.712054 759 tablet_service.cc:1511] Processing CreateTablet for tablet 6c9249900bd748de9fe70280c239a1ac (DEFAULT_TABLE table=default.Table_f923305ec9784da8a5dc3521f65ccb12 [id=4dc3ad85975f4f07ad5cfd0f5bcd8b3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.714244 452 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet bc47f35f9c2c4e5085ab482285effc91 (table default.Table_9867792729394010ba769354562198f3 [id=1515573be85644d7a4f046947aa1537b]). Expected version 3 got 0
I20260318 02:51:32.714898 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 104cd36774df4bc0adf1d449224304d5 (table default.Table_c978284529db4de7883f9f0664c4a158 [id=8b5e3535d9e44b1a86dc59211a31deb6]). Expected version 1 got 0
I20260318 02:51:32.715152 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet bc47f35f9c2c4e5085ab482285effc91 (table default.Table_9867792729394010ba769354562198f3 [id=1515573be85644d7a4f046947aa1537b]). Expected version 3 got 0
I20260318 02:51:32.715378 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet ab158343adb14eab85c595fa5405145d (table default.Table_b76c4b353fbe45c8a866d4cd2c4e264c [id=d20f8f1bd66d4dceab3b7bc72608da2a]). Expected version 2 got 0
I20260318 02:51:32.715646 456 catalog_manager.cc:5671] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:32.715803 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_75e9c86b388f4ece810c6d095af5da19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:32.677767 1960 consensus_queue.cc:237] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:32.716410 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75e9c86b388f4ece810c6d095af5da19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.716361 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d41ae6aee5434ad5b137a8e293b24cef" } new_table_name: "default.Table_b87c8d210af448238e2ed324e0fa82b3" modify_external_catalogs: true
I20260318 02:51:32.717770 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 99e807c8ff5e457fb6c97c6d1b277eab (table default.Table_fd8edd9c8882403f8541f00d0728e3b7 [id=568e88222ca648ce88ee962e91a84588]). Expected version 1 got 0
I20260318 02:51:32.718025 456 catalog_manager.cc:5671] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:32.718387 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 900c6ef2dc634a788239dd5b77c4bde0 with delete_type TABLET_DATA_DELETED (replaced by tablet 20ecb11db30e409b9090ebfc4a4f0785) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:32.718421 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 105326aea9f744779ca76e0cbb2448cd (table default.Table_268e9858449d471ca088f8b1f2492fe6 [id=58354360683d422dbdcc43826b39dbc8]). Expected version 4 got 0
I20260318 02:51:32.718570 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c9249900bd748de9fe70280c239a1ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.718770 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd5884046c14e688c18f6cb173d176d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.719347 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd5884046c14e688c18f6cb173d176d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.719547 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c9249900bd748de9fe70280c239a1ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.719720 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff090fadc6b47d6ba551dc59d4dad2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.720124 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0c90eaefcf749eb98be03f2fd518b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.721031 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b818b2d7f194db2bbd0cc4ad837fb00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.721822 903 tablet_service.cc:1511] Processing CreateTablet for tablet c93e05eb5c9e4d5da1b688a03312ad8e (DEFAULT_TABLE table=default.Table_13562b9955cc4b1da96a7682ee85967a [id=e6d117d2c5e74967b6ba0886bbc8f67f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.721930 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 548d7a5fb42d40c4aae1adc23c3eb54a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.722183 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93e05eb5c9e4d5da1b688a03312ad8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.722301 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 975926724611403e85d5466f7bcc08d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.722656 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b818b2d7f194db2bbd0cc4ad837fb00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.723034 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae818515c7744899b80b87bd6dcd198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.728832 766 tablet_service.cc:1511] Processing CreateTablet for tablet c93e05eb5c9e4d5da1b688a03312ad8e (DEFAULT_TABLE table=default.Table_13562b9955cc4b1da96a7682ee85967a [id=e6d117d2c5e74967b6ba0886bbc8f67f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.730751 1038 tablet_service.cc:1511] Processing CreateTablet for tablet cb79f266cdfd498babbc5d1313ef0b72 (DEFAULT_TABLE table=default.Table_af46ed3654604db1bc563c9ecd3e82df [id=e796794fdcb54591bc05904afeda57dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.731123 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb79f266cdfd498babbc5d1313ef0b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.733004 1034 tablet_service.cc:1511] Processing CreateTablet for tablet c93e05eb5c9e4d5da1b688a03312ad8e (DEFAULT_TABLE table=default.Table_13562b9955cc4b1da96a7682ee85967a [id=e6d117d2c5e74967b6ba0886bbc8f67f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.733335 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93e05eb5c9e4d5da1b688a03312ad8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.741047 900 tablet_service.cc:1511] Processing CreateTablet for tablet cb79f266cdfd498babbc5d1313ef0b72 (DEFAULT_TABLE table=default.Table_af46ed3654604db1bc563c9ecd3e82df [id=e796794fdcb54591bc05904afeda57dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.741482 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb79f266cdfd498babbc5d1313ef0b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.744544 1176 ts_tablet_manager.cc:1929] T e1d804f5e9564f6d83efb77e6c18724b P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:32.745488 1173 tablet_bootstrap.cc:492] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:32.745684 1173 ts_tablet_manager.cc:1403] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.136s user 0.020s sys 0.025s
I20260318 02:51:32.752483 1173 raft_consensus.cc:359] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.757019 1176 log.cc:1199] T e1d804f5e9564f6d83efb77e6c18724b P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/e1d804f5e9564f6d83efb77e6c18724b
I20260318 02:51:32.757756 1176 ts_tablet_manager.cc:1950] T e1d804f5e9564f6d83efb77e6c18724b P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:32.759076 897 tablet_service.cc:1511] Processing CreateTablet for tablet bdb950b9207d4528a86fac1da0ae6538 (DEFAULT_TABLE table=default.Table_d82119158d114a78b7929b9a041b2496 [id=235e62aecd3d4054b182b138b54a80ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.759316 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 675) took 1296 ms. Trace:
I20260318 02:51:32.757956 761 tablet_service.cc:1511] Processing CreateTablet for tablet bdb950b9207d4528a86fac1da0ae6538 (DEFAULT_TABLE table=default.Table_d82119158d114a78b7929b9a041b2496 [id=235e62aecd3d4054b182b138b54a80ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.759018 752 tablet_service.cc:1511] Processing CreateTablet for tablet 7dbcee4d14064cbdbcf7641cfc1c58d4 (DEFAULT_TABLE table=default.Table_ea4a3406cfef4aeebcb377d76728e974 [id=cafdea84974648a2b072c366228502ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.761987 1033 tablet_service.cc:1511] Processing CreateTablet for tablet bdb950b9207d4528a86fac1da0ae6538 (DEFAULT_TABLE table=default.Table_d82119158d114a78b7929b9a041b2496 [id=235e62aecd3d4054b182b138b54a80ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.762197 748 tablet_service.cc:1511] Processing CreateTablet for tablet 121659c2b4da4c4f932dea3d0d0ee8cb (DEFAULT_TABLE table=default.Table_7db492f7397146c69ce52c4e361c31d4 [id=b94b1f6d82f64073a57c219c58c87bc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.762440 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdb950b9207d4528a86fac1da0ae6538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.763276 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dbcee4d14064cbdbcf7641cfc1c58d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.767198 750 tablet_service.cc:1511] Processing CreateTablet for tablet cb79f266cdfd498babbc5d1313ef0b72 (DEFAULT_TABLE table=default.Table_af46ed3654604db1bc563c9ecd3e82df [id=e796794fdcb54591bc05904afeda57dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.767550 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb79f266cdfd498babbc5d1313ef0b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.769003 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 7dbcee4d14064cbdbcf7641cfc1c58d4 (DEFAULT_TABLE table=default.Table_ea4a3406cfef4aeebcb377d76728e974 [id=cafdea84974648a2b072c366228502ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.769409 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dbcee4d14064cbdbcf7641cfc1c58d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.769500 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 121659c2b4da4c4f932dea3d0d0ee8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.769979 1176 tablet_replica.cc:333] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:32.770143 1176 raft_consensus.cc:2243] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.770265 1176 raft_consensus.cc:2272] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.770740 1176 ts_tablet_manager.cc:1916] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.772804 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 121659c2b4da4c4f932dea3d0d0ee8cb (DEFAULT_TABLE table=default.Table_7db492f7397146c69ce52c4e361c31d4 [id=b94b1f6d82f64073a57c219c58c87bc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.773034 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdb950b9207d4528a86fac1da0ae6538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.773164 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 121659c2b4da4c4f932dea3d0d0ee8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.776072 1176 ts_tablet_manager.cc:1929] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:32.776192 1176 log.cc:1199] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/f04f057571584d31b1821e690ae7c75c
I20260318 02:51:32.776460 1176 ts_tablet_manager.cc:1950] T f04f057571584d31b1821e690ae7c75c P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:32.777315 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet e1d804f5e9564f6d83efb77e6c18724b (table default.Table_017276a514464042a76dbff62faa6f82 [id=61b10b92b10b48a4a139b129f8797ea3]) successfully deleted
W20260318 02:51:32.777554 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 3291ecec94e642e3a995a2d7006619e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3291ecec94e642e3a995a2d7006619e7 already in progress: creating tablet
I20260318 02:51:32.759513 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdb950b9207d4528a86fac1da0ae6538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.779561 1175 rpcz_store.cc:276] 0318 02:51:31.463175 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.463415 (+ 240us) service_pool.cc:225] Handling call
0318 02:51:32.625410 (+1161995us) ts_tablet_manager.cc:1151] Deleting tablet 916b5b77fb2f4003b78a71025319ed15
0318 02:51:32.625421 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.631239 (+ 5818us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.681667 (+ 50428us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.759300 (+ 77633us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1154604}
I20260318 02:51:32.758492 1173 raft_consensus.cc:385] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.779887 1173 raft_consensus.cc:740] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.780153 1173 consensus_queue.cc:260] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.780416 1175 tablet_replica.cc:333] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:32.780673 1173 ts_tablet_manager.cc:1434] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.035s user 0.001s sys 0.001s
I20260318 02:51:32.782747 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 916b5b77fb2f4003b78a71025319ed15 (table default.Table_6d506ddf2c854df0a30d396a197e4032 [id=57891ff71e194a8f8959294ba552fb23]) successfully deleted
I20260318 02:51:32.760226 900 tablet_service.cc:1511] Processing CreateTablet for tablet 7dbcee4d14064cbdbcf7641cfc1c58d4 (DEFAULT_TABLE table=default.Table_ea4a3406cfef4aeebcb377d76728e974 [id=cafdea84974648a2b072c366228502ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.788753 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dbcee4d14064cbdbcf7641cfc1c58d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.768186 903 tablet_service.cc:1511] Processing CreateTablet for tablet 121659c2b4da4c4f932dea3d0d0ee8cb (DEFAULT_TABLE table=default.Table_7db492f7397146c69ce52c4e361c31d4 [id=b94b1f6d82f64073a57c219c58c87bc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.790200 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 121659c2b4da4c4f932dea3d0d0ee8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.789054 1173 tablet_bootstrap.cc:492] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:32.793985 1173 tablet_bootstrap.cc:654] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.801643 1175 raft_consensus.cc:2243] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:32.802155 1175 pending_rounds.cc:70] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18: Trying to abort 1 pending ops.
I20260318 02:51:32.779018 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93e05eb5c9e4d5da1b688a03312ad8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.806679 1184 ts_tablet_manager.cc:1929] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:32.806813 1184 log.cc:1199] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/f1ff303b23184d4b92994bde194229b4
I20260318 02:51:32.807242 1184 ts_tablet_manager.cc:1950] T f1ff303b23184d4b92994bde194229b4 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:32.808574 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 657) took 1754 ms. Trace:
I20260318 02:51:32.808779 1184 rpcz_store.cc:276] 0318 02:51:31.053840 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.054196 (+ 356us) service_pool.cc:225] Handling call
0318 02:51:32.537011 (+1482815us) ts_tablet_manager.cc:1151] Deleting tablet f1ff303b23184d4b92994bde194229b4
0318 02:51:32.537025 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.577553 (+ 40528us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.806549 (+228996us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.808549 (+ 2000us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1482617}
I20260318 02:51:32.809355 1184 tablet_replica.cc:333] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:32.809384 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet f1ff303b23184d4b92994bde194229b4 (table default.Table_cec1585fa5824e7682f05533101d20eb [id=873432f002e14a4fa7065dcfe5caebd5]) successfully deleted
I20260318 02:51:32.809655 1184 raft_consensus.cc:2243] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.809865 1184 raft_consensus.cc:2272] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.810425 1184 ts_tablet_manager.cc:1916] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.820384 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 5d119a78d39542f6bc3b92fdf5f82c2a (DEFAULT_TABLE table=default.Table_5a156fe6b45b41aa8ea012482b2c5378 [id=6d04ef5149f3407c89ae77c934652971]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.821236 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d119a78d39542f6bc3b92fdf5f82c2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.828225 759 tablet_service.cc:1511] Processing CreateTablet for tablet 5d119a78d39542f6bc3b92fdf5f82c2a (DEFAULT_TABLE table=default.Table_5a156fe6b45b41aa8ea012482b2c5378 [id=6d04ef5149f3407c89ae77c934652971]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.828745 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d119a78d39542f6bc3b92fdf5f82c2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.838239 1176 tablet_replica.cc:333] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:32.838430 1176 raft_consensus.cc:2243] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.838546 1176 raft_consensus.cc:2272] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.839016 1176 ts_tablet_manager.cc:1916] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.816396 903 tablet_service.cc:1511] Processing CreateTablet for tablet 5d119a78d39542f6bc3b92fdf5f82c2a (DEFAULT_TABLE table=default.Table_5a156fe6b45b41aa8ea012482b2c5378 [id=6d04ef5149f3407c89ae77c934652971]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:32.839623 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d119a78d39542f6bc3b92fdf5f82c2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:32.845281 1176 ts_tablet_manager.cc:1929] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:32.845471 1176 log.cc:1199] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/e3999f53c1cc4cb5a1d91eed23785cc6
I20260318 02:51:32.845820 1176 ts_tablet_manager.cc:1950] T e3999f53c1cc4cb5a1d91eed23785cc6 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:32.839273 1173 tablet_bootstrap.cc:492] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:32.846239 1173 ts_tablet_manager.cc:1403] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.057s user 0.006s sys 0.000s
I20260318 02:51:32.846939 1173 raft_consensus.cc:359] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.847096 1173 raft_consensus.cc:385] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.847134 1173 raft_consensus.cc:740] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.847337 1173 consensus_queue.cc:260] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.847795 1173 ts_tablet_manager.cc:1434] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260318 02:51:32.848094 1173 tablet_bootstrap.cc:492] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:32.850535 1175 pending_rounds.cc:77] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494189305020416 op_type: NO_OP noop_request { }
I20260318 02:51:32.850636 1175 raft_consensus.cc:2889] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:32.850704 1175 raft_consensus.cc:2272] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.853134 1175 ts_tablet_manager.cc:1916] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.854193 1176 tablet_replica.cc:333] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:32.854389 1176 raft_consensus.cc:2243] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.854530 1176 raft_consensus.cc:2272] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.855007 1176 ts_tablet_manager.cc:1916] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.859488 1174 tablet_bootstrap.cc:492] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:32.859707 1174 ts_tablet_manager.cc:1403] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.194s user 0.025s sys 0.014s
I20260318 02:51:32.860484 1174 raft_consensus.cc:359] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.860742 1174 raft_consensus.cc:385] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.860845 1174 raft_consensus.cc:740] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.861127 1174 consensus_queue.cc:260] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.862331 1174 ts_tablet_manager.cc:1434] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:32.864811 927 raft_consensus.cc:3060] T bc47f35f9c2c4e5085ab482285effc91 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:32.868438 1184 ts_tablet_manager.cc:1929] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:32.868547 1184 log.cc:1199] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/af793623466249e695b262ab451d4dc9
I20260318 02:51:32.868850 1184 ts_tablet_manager.cc:1950] T af793623466249e695b262ab451d4dc9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
W20260318 02:51:32.871711 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f7d7767fa514821981f7086ef152091 consensus state has no leader
I20260318 02:51:32.873673 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 666c2992fa4f479ab4ffd7ac0c3a9c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:32.875332 1174 tablet_bootstrap.cc:492] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:32.875588 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 658) took 1821 ms. Trace:
I20260318 02:51:32.875936 1173 tablet_bootstrap.cc:654] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.878151 1915 raft_consensus.cc:493] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.878283 1915 raft_consensus.cc:515] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:32.878823 1915 leader_election.cc:290] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:32.879681 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57dbb1276114cd6b7d26f7167b99f25" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:32.879827 1184 rpcz_store.cc:276] 0318 02:51:31.054527 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.054842 (+ 315us) service_pool.cc:225] Handling call
0318 02:51:32.809299 (+1754457us) ts_tablet_manager.cc:1151] Deleting tablet af793623466249e695b262ab451d4dc9
0318 02:51:32.809311 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.864336 (+ 55025us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.868343 (+ 4007us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.875560 (+ 7217us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1754000}
W20260318 02:51:32.880235 719 leader_election.cc:343] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.877200 1172 tablet_bootstrap.cc:492] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:32.879631 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57dbb1276114cd6b7d26f7167b99f25" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:32.881006 1184 tablet_replica.cc:333] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
W20260318 02:51:32.881040 719 leader_election.cc:343] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.881138 719 leader_election.cc:304] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.881342 1184 raft_consensus.cc:2243] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.881494 1184 raft_consensus.cc:2272] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.881491 1915 raft_consensus.cc:2749] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:32.880813 1172 ts_tablet_manager.cc:1403] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.218s user 0.017s sys 0.022s
I20260318 02:51:32.883176 1174 tablet_bootstrap.cc:654] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.882412 1184 ts_tablet_manager.cc:1916] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.882931 1172 raft_consensus.cc:359] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.883580 1172 raft_consensus.cc:385] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.883680 1172 raft_consensus.cc:740] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.883929 1172 consensus_queue.cc:260] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:32.887110 999 consensus_peers.cc:597] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d -> Peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Couldn't send request to peer 6a903d876086423b8016d705b98895ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 916b5b77fb2f4003b78a71025319ed15. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:32.887619 1172 ts_tablet_manager.cc:1434] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260318 02:51:32.887718 1175 ts_tablet_manager.cc:1929] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:32.888010 1172 tablet_bootstrap.cc:492] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:32.888648 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7dbcee4d14064cbdbcf7641cfc1c58d4 consensus state has no leader
I20260318 02:51:32.889470 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet af793623466249e695b262ab451d4dc9 (table default.Table_9c0322ee5c694253958b5d9583c3708e [id=34553220f38c4ffd99cf61e1679bdb81]) successfully deleted
I20260318 02:51:32.890550 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6b7904942dc9449cbe5e72949e06d2ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:32.891335 1172 tablet_bootstrap.cc:654] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:32.891398 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b7904942dc9449cbe5e72949e06d2ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.892484 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet f04f057571584d31b1821e690ae7c75c (table default.Table_62dcfd8adef34929a08c11dfcf174ff7 [id=4a0a65332f00440f87102e8ebab708cd]) successfully deleted
I20260318 02:51:32.892676 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 5a92761edfe74a9798da4d93964383ea
I20260318 02:51:32.894802 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a92761edfe74a9798da4d93964383ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:32.896672 454 master_service.cc:954] ReplaceTablet: received request to replace tablet 5dd894706cc2466a8cd4e4df67856862 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:32.897792 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1006656cce8d403ca7be0b25477c41cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:32.898366 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1006656cce8d403ca7be0b25477c41cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.899983 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b81a2f1910364b37874f85258bf76a65"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:32.901484 1184 ts_tablet_manager.cc:1929] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260318 02:51:32.904289 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b81a2f1910364b37874f85258bf76a65 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:32.905270 443 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.104.129:46711, user_credentials={real_user=slave}} blocked reactor thread for 51309.1us
I20260318 02:51:32.905905 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9fdb7241643a4fb38c07adf178cdc452" } modify_external_catalogs: true
I20260318 02:51:32.906059 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 065ebc3c000a4ad3873ee031ecf9986b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:32.906082 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9fdb7241643a4fb38c07adf178cdc452" } modify_external_catalogs: true
I20260318 02:51:32.906344 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a92761edfe74a9798da4d93964383ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:32.907230 1174 tablet_bootstrap.cc:492] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:32.907403 1174 ts_tablet_manager.cc:1403] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.000s
I20260318 02:51:32.908197 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet e3999f53c1cc4cb5a1d91eed23785cc6 (table default.Table_7442f04ad30e435b84996fb8990e0a44 [id=40612e2dc3b7447f8f4f753bf5474c22]) successfully deleted
W20260318 02:51:32.908407 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet e867dcd3ff3e4eb7b923305a037c5a79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e867dcd3ff3e4eb7b923305a037c5a79 already in progress: creating tablet
I20260318 02:51:32.908157 1174 raft_consensus.cc:359] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.909277 1174 raft_consensus.cc:385] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.909375 1174 raft_consensus.cc:740] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.909632 1174 consensus_queue.cc:260] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.911592 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 6858334d4c8b41b89c57b4b6f127a1c7
I20260318 02:51:32.912129 455 catalog_manager.cc:6741] ReplaceTablet: tablet 6858334d4c8b41b89c57b4b6f127a1c7 deleted and replaced by tablet b3605a5c703c4df5b2f32edf185cb126
I20260318 02:51:32.914150 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 6858334d4c8b41b89c57b4b6f127a1c7 with delete_type TABLET_DATA_DELETED (replaced by tablet b3605a5c703c4df5b2f32edf185cb126) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:32.914319 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_705682c0d1ba4277b50c02540d92b99e" } modify_external_catalogs: true
I20260318 02:51:32.914490 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_705682c0d1ba4277b50c02540d92b99e" } modify_external_catalogs: true
I20260318 02:51:32.914894 1174 ts_tablet_manager.cc:1434] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260318 02:51:32.919130 1174 tablet_bootstrap.cc:492] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:32.920215 1184 log.cc:1199] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/0ed4350e0fde4c8690970bc69830fcb3
I20260318 02:51:32.894654 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a92761edfe74a9798da4d93964383ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:32.912671 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 6858334d4c8b41b89c57b4b6f127a1c7 with delete_type TABLET_DATA_DELETED (replaced by tablet b3605a5c703c4df5b2f32edf185cb126) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:32.921043 1174 tablet_bootstrap.cc:654] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.915445 1173 tablet_bootstrap.cc:492] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:32.921386 1173 ts_tablet_manager.cc:1403] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.073s user 0.005s sys 0.001s
I20260318 02:51:32.912972 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 6858334d4c8b41b89c57b4b6f127a1c7 with delete_type TABLET_DATA_DELETED (replaced by tablet b3605a5c703c4df5b2f32edf185cb126) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:32.903823 1172 tablet_bootstrap.cc:492] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:32.921949 1172 ts_tablet_manager.cc:1403] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.004s
I20260318 02:51:32.922663 1172 raft_consensus.cc:359] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.922835 1172 raft_consensus.cc:385] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.922897 1172 raft_consensus.cc:740] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.922219 1175 log.cc:1199] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/2b6267d3f6e142579c62bbb4b14da4b0
I20260318 02:51:32.923087 1172 consensus_queue.cc:260] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.923530 1172 ts_tablet_manager.cc:1434] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:32.923768 1184 ts_tablet_manager.cc:1950] T 0ed4350e0fde4c8690970bc69830fcb3 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:32.924180 1172 tablet_bootstrap.cc:492] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:32.926663 1175 ts_tablet_manager.cc:1950] T 2b6267d3f6e142579c62bbb4b14da4b0 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:32.926906 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 659) took 1871 ms. Trace:
I20260318 02:51:32.928202 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 677) took 1157 ms. Trace:
I20260318 02:51:32.928948 1184 rpcz_store.cc:276] 0318 02:51:31.055535 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.055615 (+ 80us) service_pool.cc:225] Handling call
0318 02:51:32.880955 (+1825340us) ts_tablet_manager.cc:1151] Deleting tablet 0ed4350e0fde4c8690970bc69830fcb3
0318 02:51:32.880967 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.898360 (+ 17393us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.901376 (+ 3016us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.926885 (+ 25509us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1824581}
I20260318 02:51:32.927062 1172 tablet_bootstrap.cc:654] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.930716 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 647) took 1881 ms. Trace:
I20260318 02:51:32.932561 1812 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260318 02:51:32.932741 1184 rpcz_store.cc:276] 0318 02:51:31.049040 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.056327 (+ 7287us) service_pool.cc:225] Handling call
0318 02:51:32.930587 (+1874260us) ts_tablet_manager.cc:1151] Deleting tablet c0349def0e4045f2b1e9a02dd654a174
0318 02:51:32.930595 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.930698 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1873591}
I20260318 02:51:32.932992 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 0ed4350e0fde4c8690970bc69830fcb3 (table default.Table_4ced5c1198ce406b85fbee4bbe6368c0 [id=a1f776ccb9f44dba98f77ad3fec5df41]) successfully deleted
W20260318 02:51:32.933292 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet c0349def0e4045f2b1e9a02dd654a174 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0349def0e4045f2b1e9a02dd654a174 already in progress: creating tablet
I20260318 02:51:32.933301 1915 raft_consensus.cc:493] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:32.933360 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 648) took 1884 ms. Trace:
I20260318 02:51:32.933420 1184 rpcz_store.cc:276] 0318 02:51:31.049214 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.059223 (+ 10009us) service_pool.cc:225] Handling call
0318 02:51:32.933239 (+1874016us) ts_tablet_manager.cc:1151] Deleting tablet 0e99c2956a764e6cb07cbc41e4a6f2f8
0318 02:51:32.933249 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.933345 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1873713}
I20260318 02:51:32.933435 1915 raft_consensus.cc:515] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.934021 1915 leader_election.cc:290] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:32.934397 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 0e99c2956a764e6cb07cbc41e4a6f2f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e99c2956a764e6cb07cbc41e4a6f2f8 already in progress: creating tablet
I20260318 02:51:32.934618 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065ebc3c000a4ad3873ee031ecf9986b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:32.934996 1184 tablet_replica.cc:333] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:32.935173 1184 raft_consensus.cc:2243] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:32.935226 719 leader_election.cc:343] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.935320 1184 raft_consensus.cc:2272] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.934876 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065ebc3c000a4ad3873ee031ecf9986b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:32.935859 1175 rpcz_store.cc:276] 0318 02:51:31.771177 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.776506 (+ 5329us) service_pool.cc:225] Handling call
0318 02:51:32.780370 (+1003864us) ts_tablet_manager.cc:1151] Deleting tablet 2b6267d3f6e142579c62bbb4b14da4b0
0318 02:51:32.780382 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.855304 (+ 74922us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.887597 (+ 32293us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.928185 (+ 40588us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":21031,"tablet-delete.queue_time_us":1002643}
I20260318 02:51:32.936021 1184 ts_tablet_manager.cc:1916] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.936305 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 2b6267d3f6e142579c62bbb4b14da4b0 (table default.Table_5ea72896ec3f438ca7ea9e8b599829f2 [id=a0b50d2be41f469f8e63545b054b9e33]) successfully deleted
W20260318 02:51:32.936479 719 leader_election.cc:343] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:32.936568 719 leader_election.cc:304] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:32.927716 1173 raft_consensus.cc:359] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.936806 1173 raft_consensus.cc:385] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.936878 1173 raft_consensus.cc:740] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.937124 1915 raft_consensus.cc:2749] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:32.938215 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 85e6ad2a9817444caecb78eabde5d222
I20260318 02:51:32.940163 1812 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260318 02:51:32.940277 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 85e6ad2a9817444caecb78eabde5d222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:32.940472 1812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260318 02:51:32.941347 1174 tablet_bootstrap.cc:492] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:32.941573 448 master_service.cc:954] ReplaceTablet: received request to replace tablet d0b01131720748688ca6c28985a3b3ff from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:32.941612 1174 ts_tablet_manager.cc:1403] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.000s
I20260318 02:51:32.942433 1174 raft_consensus.cc:359] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.942677 1174 raft_consensus.cc:385] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.942766 1174 raft_consensus.cc:740] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.943023 1174 consensus_queue.cc:260] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:32.943609 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e418df45882c435a8276e46a8abf6bdd consensus state has no leader
I20260318 02:51:32.944021 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_81d5251cb78d4efc811c7f615bf91ce4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:32.944610 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81d5251cb78d4efc811c7f615bf91ce4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:32.946156 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9867792729394010ba769354562198f3" } modify_external_catalogs: true
I20260318 02:51:32.946363 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9867792729394010ba769354562198f3" } modify_external_catalogs: true
I20260318 02:51:32.948208 1174 ts_tablet_manager.cc:1434] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260318 02:51:32.952541 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 85e6ad2a9817444caecb78eabde5d222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:32.953410 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 85e6ad2a9817444caecb78eabde5d222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:32.953456 1174 tablet_bootstrap.cc:492] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:32.955022 1174 tablet_bootstrap.cc:654] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.957667 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 676) took 1189 ms. Trace:
I20260318 02:51:32.961923 1176 ts_tablet_manager.cc:1929] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:32.961956 1184 ts_tablet_manager.cc:1929] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:32.962059 1184 log.cc:1199] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/666c2992fa4f479ab4ffd7ac0c3a9c92
I20260318 02:51:32.963212 1175 rpcz_store.cc:276] 0318 02:51:31.768422 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.776701 (+ 8279us) service_pool.cc:225] Handling call
0318 02:51:32.957503 (+1180802us) ts_tablet_manager.cc:1151] Deleting tablet d4e3346edd274750a5e27ec2393d08bc
0318 02:51:32.957516 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.957643 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1179566}
I20260318 02:51:32.963688 1176 log.cc:1199] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/65c50b0813b04f30896568ab2b680ba8
W20260318 02:51:32.963801 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet d4e3346edd274750a5e27ec2393d08bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4e3346edd274750a5e27ec2393d08bc already in progress: creating tablet
I20260318 02:51:32.958302 1173 consensus_queue.cc:260] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.964210 1176 ts_tablet_manager.cc:1950] T 65c50b0813b04f30896568ab2b680ba8 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:32.964660 1173 ts_tablet_manager.cc:1434] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.042s user 0.001s sys 0.001s
I20260318 02:51:32.966094 1184 ts_tablet_manager.cc:1950] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:32.966614 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 65c50b0813b04f30896568ab2b680ba8 (table default.Table_d2f73355578d4f4391b25e72718cfa1e [id=0bd115a0960941ff9d49b4566fe1c666]) successfully deleted
I20260318 02:51:32.963809 1973 tablet.cc:1723] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:32.964286 1974 tablet.cc:1723] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:32.965492 1174 tablet_bootstrap.cc:492] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:32.973003 1174 ts_tablet_manager.cc:1403] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.003s
I20260318 02:51:32.973795 1174 raft_consensus.cc:359] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.974045 1174 raft_consensus.cc:385] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:32.974143 1174 raft_consensus.cc:740] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:32.974380 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 662) took 1887 ms. Trace:
I20260318 02:51:32.974386 1174 consensus_queue.cc:260] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:32.977142 1184 rpcz_store.cc:276] 0318 02:51:31.087106 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.087234 (+ 128us) service_pool.cc:225] Handling call
0318 02:51:32.934952 (+1847718us) ts_tablet_manager.cc:1151] Deleting tablet 666c2992fa4f479ab4ffd7ac0c3a9c92
0318 02:51:32.934961 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.949866 (+ 14905us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.961806 (+ 11940us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:32.974358 (+ 12552us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12672,"tablet-delete.queue_time_us":1847158}
I20260318 02:51:32.979396 1173 tablet_bootstrap.cc:492] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:32.980194 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 666c2992fa4f479ab4ffd7ac0c3a9c92 (table default.Table_113ffa1cc0ef491cbc6786967482632f [id=504539970798458680abc4a9307656fa]) successfully deleted
I20260318 02:51:32.980556 1174 ts_tablet_manager.cc:1434] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260318 02:51:32.980665 1184 tablet_replica.cc:333] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:32.981163 1173 tablet_bootstrap.cc:654] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.981253 1184 raft_consensus.cc:2243] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.981684 1184 raft_consensus.cc:2272] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.978885 1175 tablet_replica.cc:333] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:32.982357 1175 raft_consensus.cc:2243] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.982399 1184 ts_tablet_manager.cc:1916] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.982554 1175 raft_consensus.cc:2272] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.983084 1175 ts_tablet_manager.cc:1916] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:32.988313 1174 tablet_bootstrap.cc:492] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:32.989923 1174 tablet_bootstrap.cc:654] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:32.990159 1176 tablet_replica.cc:333] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:32.990978 1176 raft_consensus.cc:2243] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:32.991204 1176 raft_consensus.cc:2272] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:32.991742 1176 ts_tablet_manager.cc:1916] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.000078 1960 raft_consensus.cc:493] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.000476 1176 ts_tablet_manager.cc:1929] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.000339 1960 raft_consensus.cc:515] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.001554 1960 leader_election.cc:290] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:33.002346 999 leader_election.cc:343] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 29541950221544e396ada303fbbb5002
I20260318 02:51:33.004006 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29541950221544e396ada303fbbb5002" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:33.004190 1174 tablet_bootstrap.cc:492] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:33.004424 1174 ts_tablet_manager.cc:1403] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.001s
W20260318 02:51:33.004576 997 leader_election.cc:343] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.004752 997 leader_election.cc:304] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.004999 1960 raft_consensus.cc:2749] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.005194 1174 raft_consensus.cc:359] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.005434 1174 raft_consensus.cc:385] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.005532 1174 raft_consensus.cc:740] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.005796 1174 consensus_queue.cc:260] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.009408 1174 ts_tablet_manager.cc:1434] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260318 02:51:33.010143 1174 tablet_bootstrap.cc:492] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:33.014321 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 5dd894706cc2466a8cd4e4df67856862
I20260318 02:51:33.014461 1184 ts_tablet_manager.cc:1929] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.014828 454 catalog_manager.cc:6741] ReplaceTablet: tablet 5dd894706cc2466a8cd4e4df67856862 deleted and replaced by tablet fc96b13affd442eca3b671a3741b6000
I20260318 02:51:33.015465 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dd894706cc2466a8cd4e4df67856862 with delete_type TABLET_DATA_DELETED (replaced by tablet fc96b13affd442eca3b671a3741b6000) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.016389 1176 log.cc:1199] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/cc1543d0e1b1431baf6d2ab6a0484ca6
I20260318 02:51:33.016606 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dd894706cc2466a8cd4e4df67856862 with delete_type TABLET_DATA_DELETED (replaced by tablet fc96b13affd442eca3b671a3741b6000) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.016893 1174 tablet_bootstrap.cc:654] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.017081 1176 ts_tablet_manager.cc:1950] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:33.020171 1176 tablet_replica.cc:333] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:33.020406 1176 raft_consensus.cc:2243] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.020602 1176 raft_consensus.cc:2272] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.015702 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dd894706cc2466a8cd4e4df67856862 with delete_type TABLET_DATA_DELETED (replaced by tablet fc96b13affd442eca3b671a3741b6000) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.021054 1184 log.cc:1199] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/95f15079d1df4314b6dd5c7afd896af5
I20260318 02:51:33.020915 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet cc1543d0e1b1431baf6d2ab6a0484ca6 (table default.Table_d9fd8f01d59b47d9bc3053e485415619 [id=e7c0679f0795485db510de58088251a3]) successfully deleted
I20260318 02:51:33.021351 1184 ts_tablet_manager.cc:1950] T 95f15079d1df4314b6dd5c7afd896af5 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:33.021469 1176 ts_tablet_manager.cc:1916] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:33.021621 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 1ac9581312964ad6afcc96f798fa534a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ac9581312964ad6afcc96f798fa534a already in progress: creating tablet
W20260318 02:51:33.021950 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 75ca99ca24f14cd48f29e49168ebca3f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75ca99ca24f14cd48f29e49168ebca3f already in progress: creating tablet
W20260318 02:51:33.022228 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 4e54f71cd47a4738b0f640382edee907 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e54f71cd47a4738b0f640382edee907 already in progress: creating tablet
W20260318 02:51:33.022452 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet cdafabcad8a64c2094a3e55ea52178bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cdafabcad8a64c2094a3e55ea52178bd already in progress: creating tablet
W20260318 02:51:33.022719 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 15b052ebecbe4652b1a337d18712011f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15b052ebecbe4652b1a337d18712011f already in progress: creating tablet
W20260318 02:51:33.022948 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 64c2a579264e43b9a1e25ded000d4d9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64c2a579264e43b9a1e25ded000d4d9f already in progress: creating tablet
W20260318 02:51:33.023232 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 76109acb76424b1f96ede9ab1f018e5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76109acb76424b1f96ede9ab1f018e5e already in progress: creating tablet
I20260318 02:51:33.023285 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 660) took 1936 ms. Trace:
I20260318 02:51:33.024369 1184 rpcz_store.cc:276] 0318 02:51:31.086848 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.087957 (+ 1109us) service_pool.cc:225] Handling call
0318 02:51:32.980612 (+1892655us) ts_tablet_manager.cc:1151] Deleting tablet 95f15079d1df4314b6dd5c7afd896af5
0318 02:51:32.980624 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:32.995020 (+ 14396us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.013862 (+ 18842us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.023259 (+ 9397us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1892135}
I20260318 02:51:33.025210 1172 tablet_bootstrap.cc:492] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:33.025449 1172 ts_tablet_manager.cc:1403] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.101s user 0.006s sys 0.012s
I20260318 02:51:33.026257 1172 raft_consensus.cc:359] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.026489 1172 raft_consensus.cc:385] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.026580 1172 raft_consensus.cc:740] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.026832 1172 consensus_queue.cc:260] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.027489 1172 ts_tablet_manager.cc:1434] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260318 02:51:33.027871 1172 tablet_bootstrap.cc:492] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:33.029402 1176 ts_tablet_manager.cc:1929] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:33.030468 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 95f15079d1df4314b6dd5c7afd896af5 (table default.Table_74486e0a87264fb8ae22f015c8eb3fbe [id=5d87c85c334642829cb97e4b4cc4d95f]) successfully deleted
I20260318 02:51:33.030910 1184 tablet_replica.cc:333] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:33.031158 1184 raft_consensus.cc:2243] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.031378 1184 raft_consensus.cc:2272] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.031639 1172 tablet_bootstrap.cc:654] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.033105 1176 log.cc:1199] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/c5765355efaa4ef4ab3b68ea33f51536
I20260318 02:51:33.033463 1184 ts_tablet_manager.cc:1916] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.033911 1176 ts_tablet_manager.cc:1950] T c5765355efaa4ef4ab3b68ea33f51536 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:33.035485 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet c5765355efaa4ef4ab3b68ea33f51536 (table default.Table_a61fc584a9fb41fa9d17ab0aef58582d [id=a1611aa744774532bf8c16d8cc701c49]) successfully deleted
I20260318 02:51:33.036576 1176 tablet_replica.cc:333] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:33.036793 1176 raft_consensus.cc:2243] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.036948 1176 raft_consensus.cc:2272] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.037457 1176 ts_tablet_manager.cc:1916] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.038028 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_acd2793d6aea4258be0afe46caa5d732" } new_table_name: "default.Table_4579d5ae750244f7a9eea47094f30eb7" modify_external_catalogs: true
I20260318 02:51:33.039582 1172 tablet_bootstrap.cc:492] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:33.039728 1172 ts_tablet_manager.cc:1403] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.002s
I20260318 02:51:33.040575 1172 raft_consensus.cc:359] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.040783 1172 raft_consensus.cc:385] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.040849 1172 raft_consensus.cc:740] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.043982 1173 tablet_bootstrap.cc:492] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:33.047124 1172 consensus_queue.cc:260] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.051028 1176 ts_tablet_manager.cc:1929] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.051157 1176 log.cc:1199] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/bfb352bce9cc4e8aa899d691954d28d2
I20260318 02:51:33.051221 1172 ts_tablet_manager.cc:1434] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260318 02:51:33.051429 1176 ts_tablet_manager.cc:1950] T bfb352bce9cc4e8aa899d691954d28d2 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:33.052302 1960 raft_consensus.cc:493] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.052443 1960 raft_consensus.cc:515] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.053047 1960 leader_election.cc:290] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:33.054014 999 leader_election.cc:343] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 4fa7c1d6879c40ebb8d989ebae205e9e
I20260318 02:51:33.054718 1176 tablet_replica.cc:333] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:33.054909 1176 raft_consensus.cc:2243] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.055066 1176 raft_consensus.cc:2272] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.055097 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet bfb352bce9cc4e8aa899d691954d28d2 (table default.Table_b1d3f1dcf5d3445a817d681110d65f37 [id=e0b93f047d414aa5bc01df1a1dcb8878]) successfully deleted
I20260318 02:51:33.055552 1176 ts_tablet_manager.cc:1916] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.056830 1172 tablet_bootstrap.cc:492] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:33.060443 1184 ts_tablet_manager.cc:1929] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.060539 1184 log.cc:1199] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/08307bc69291479eb8ee0d7aec124829
I20260318 02:51:33.060825 1184 ts_tablet_manager.cc:1950] T 08307bc69291479eb8ee0d7aec124829 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:33.063973 1176 ts_tablet_manager.cc:1929] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.064080 1176 log.cc:1199] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/083493ab9d26493a924025fbd96ab1d7
I20260318 02:51:33.064348 1176 ts_tablet_manager.cc:1950] T 083493ab9d26493a924025fbd96ab1d7 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:33.067620 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 661) took 1980 ms. Trace:
I20260318 02:51:33.067682 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e4ceb961c2c249888bf307e9b4f8590c" } new_table_name: "default.Table_5652594c1782460c99b7ca166eafb347" modify_external_catalogs: true
I20260318 02:51:33.068789 1184 rpcz_store.cc:276] 0318 02:51:31.086970 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.087454 (+ 484us) service_pool.cc:225] Handling call
0318 02:51:33.030839 (+1943385us) ts_tablet_manager.cc:1151] Deleting tablet 08307bc69291479eb8ee0d7aec124829
0318 02:51:33.030862 (+ 23us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.042147 (+ 11285us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.060335 (+ 18188us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.067592 (+ 7257us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1941402}
I20260318 02:51:33.069535 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 08307bc69291479eb8ee0d7aec124829 (table default.Table_80f976f24d184e2cbaf4f63b8495c8ab [id=2597ecaa93914543870472f2af156dc2]) successfully deleted
I20260318 02:51:33.062314 1172 tablet_bootstrap.cc:654] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.072173 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 083493ab9d26493a924025fbd96ab1d7 (table default.Table_0bc143d5f9bf42be85f911249422e04d [id=607d58701fef4551addddb65e64f7dcd]) successfully deleted
I20260318 02:51:33.073314 1184 tablet_replica.cc:333] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:33.054023 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa7c1d6879c40ebb8d989ebae205e9e" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:33.073792 1173 ts_tablet_manager.cc:1403] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.095s user 0.003s sys 0.000s
W20260318 02:51:33.074117 997 leader_election.cc:343] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.074314 997 leader_election.cc:304] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.074554 1960 raft_consensus.cc:2749] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.074599 1173 raft_consensus.cc:359] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.074774 1173 raft_consensus.cc:385] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.074826 1173 raft_consensus.cc:740] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.075016 1173 consensus_queue.cc:260] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.075606 1173 ts_tablet_manager.cc:1434] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:33.076246 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet ebbe05c64ae14c509584dd86e45b4aa1
I20260318 02:51:33.077201 900 tablet_service.cc:1558] Processing DeleteTablet for tablet ebbe05c64ae14c509584dd86e45b4aa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.077744 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet ebbe05c64ae14c509584dd86e45b4aa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.078042 759 tablet_service.cc:1558] Processing DeleteTablet for tablet ebbe05c64ae14c509584dd86e45b4aa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.077791 1184 raft_consensus.cc:2243] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:33.078629 1184 pending_rounds.cc:70] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d: Trying to abort 1 pending ops.
I20260318 02:51:33.079150 1184 pending_rounds.cc:77] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494190086049792 op_type: NO_OP noop_request { }
I20260318 02:51:33.079563 1184 raft_consensus.cc:2889] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:33.079793 1175 ts_tablet_manager.cc:1929] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.079918 1175 log.cc:1199] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/0c8264f69f934d3ba2e41434ce350f3e
I20260318 02:51:33.080057 1184 raft_consensus.cc:2272] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.080205 1175 ts_tablet_manager.cc:1950] T 0c8264f69f934d3ba2e41434ce350f3e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:33.081239 1176 tablet_replica.cc:333] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:33.081429 1176 raft_consensus.cc:2243] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.081569 1176 raft_consensus.cc:2272] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.081979 1172 tablet_bootstrap.cc:492] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:33.082070 1176 ts_tablet_manager.cc:1916] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.082259 1883 raft_consensus.cc:493] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.082404 1883 raft_consensus.cc:515] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.083037 1883 leader_election.cc:290] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:33.084111 862 leader_election.cc:343] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 9d20847fa6f9461cb6137f56ea680cb6
I20260318 02:51:33.088658 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_10d477a4d7cb43a48cdee08a22f2e127"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:33.089023 1172 ts_tablet_manager.cc:1403] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.002s
W20260318 02:51:33.089298 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10d477a4d7cb43a48cdee08a22f2e127 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.082762 1184 ts_tablet_manager.cc:1916] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.083581 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d20847fa6f9461cb6137f56ea680cb6" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:33.090404 1062 raft_consensus.cc:2468] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:33.090888 860 leader_election.cc:304] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:33.091591 1883 raft_consensus.cc:2804] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:33.091672 1883 raft_consensus.cc:493] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:33.091734 1883 raft_consensus.cc:3060] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:33.092486 1172 raft_consensus.cc:359] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.093075 1172 raft_consensus.cc:385] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.093132 1172 raft_consensus.cc:740] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.094013 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 8b99d05da31c4b77a78a94baf55b28fa
I20260318 02:51:33.094178 1883 raft_consensus.cc:515] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.095124 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b99d05da31c4b77a78a94baf55b28fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.095578 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b99d05da31c4b77a78a94baf55b28fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.095721 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b99d05da31c4b77a78a94baf55b28fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:33.095779 862 leader_election.cc:343] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 9d20847fa6f9461cb6137f56ea680cb6
I20260318 02:51:33.096004 1176 ts_tablet_manager.cc:1929] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.096109 1176 log.cc:1199] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/e57dbb1276114cd6b7d26f7167b99f25
I20260318 02:51:33.096388 1176 ts_tablet_manager.cc:1950] T e57dbb1276114cd6b7d26f7167b99f25 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:33.096858 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d20847fa6f9461cb6137f56ea680cb6" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:33.097035 1062 raft_consensus.cc:3060] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:33.097174 1915 raft_consensus.cc:493] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.097326 1915 raft_consensus.cc:515] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.097929 1915 leader_election.cc:290] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:33.098337 1915 raft_consensus.cc:493] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.098451 1915 raft_consensus.cc:515] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.098938 1915 leader_election.cc:290] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:33.099212 1172 consensus_queue.cc:260] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.099720 1062 raft_consensus.cc:2468] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:33.102651 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet e57dbb1276114cd6b7d26f7167b99f25 (table default.Table_9c0322ee5c694253958b5d9583c3708e [id=34553220f38c4ffd99cf61e1679bdb81]) successfully deleted
I20260318 02:51:33.103359 1176 tablet_replica.cc:333] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:33.103796 1176 raft_consensus.cc:2243] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.104218 1176 raft_consensus.cc:2272] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.105019 1176 ts_tablet_manager.cc:1916] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.105618 1983 tablet.cc:1723] T bc47f35f9c2c4e5085ab482285effc91 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:33.100044 1172 ts_tablet_manager.cc:1434] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260318 02:51:33.102253 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3348b200e5ca4f6ebecb2c25ddbe27bf" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:33.102326 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "900c6ef2dc634a788239dd5b77c4bde0" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:33.106353 1172 tablet_bootstrap.cc:492] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:33.106812 719 leader_election.cc:343] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:33.107017 719 leader_election.cc:343] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.109184 1172 tablet_bootstrap.cc:654] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.109813 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ae9aba2a307a4ccbb1c86607f3432233"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:33.110436 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae9aba2a307a4ccbb1c86607f3432233 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.111577 860 leader_election.cc:304] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:33.112017 1883 leader_election.cc:290] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:33.112612 1883 raft_consensus.cc:2804] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:33.112845 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "900c6ef2dc634a788239dd5b77c4bde0" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:33.112845 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3348b200e5ca4f6ebecb2c25ddbe27bf" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:33.113339 1184 ts_tablet_manager.cc:1929] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260318 02:51:33.113507 719 leader_election.cc:343] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.113651 719 leader_election.cc:304] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:33.114023 719 leader_election.cc:343] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.114116 719 leader_election.cc:304] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.114423 1915 raft_consensus.cc:2749] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.114578 1915 raft_consensus.cc:2749] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.115092 1173 tablet_bootstrap.cc:492] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:33.116688 1883 raft_consensus.cc:697] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:33.117246 1883 consensus_queue.cc:237] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.122776 1174 tablet_bootstrap.cc:492] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:33.123014 1174 ts_tablet_manager.cc:1403] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.113s user 0.017s sys 0.022s
I20260318 02:51:33.123847 1184 log.cc:1199] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/b51a15e4303742a999fe9a96d450c827
I20260318 02:51:33.124150 1174 raft_consensus.cc:359] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.124322 1174 raft_consensus.cc:385] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.124373 1174 raft_consensus.cc:740] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.123301 1172 tablet_bootstrap.cc:492] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:33.124444 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_aa14256b7d72462f9010a2e4db787517"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:33.124737 1174 consensus_queue.cc:260] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.124617 1172 ts_tablet_manager.cc:1403] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.002s
W20260318 02:51:33.125144 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa14256b7d72462f9010a2e4db787517 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.126425 1172 raft_consensus.cc:359] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.127663 1172 raft_consensus.cc:385] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.127978 1172 raft_consensus.cc:740] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.125579 1184 ts_tablet_manager.cc:1950] T b51a15e4303742a999fe9a96d450c827 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:33.129253 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 665) took 2038 ms. Trace:
I20260318 02:51:33.130144 1184 rpcz_store.cc:276] 0318 02:51:31.090421 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.090469 (+ 48us) service_pool.cc:225] Handling call
0318 02:51:33.073257 (+1982788us) ts_tablet_manager.cc:1151] Deleting tablet b51a15e4303742a999fe9a96d450c827
0318 02:51:33.073268 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.104235 (+ 30967us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.113223 (+ 8988us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.129229 (+ 16006us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1982499}
I20260318 02:51:33.130381 1174 ts_tablet_manager.cc:1434] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260318 02:51:33.131027 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet b51a15e4303742a999fe9a96d450c827 (table default.Table_c9fa61fd1bdb405f89a32f500da8f182 [id=9aa1a9e376e8459987f5ef2231598bd0]) successfully deleted
I20260318 02:51:33.129915 1172 consensus_queue.cc:260] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.132455 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet bc47f35f9c2c4e5085ab482285effc91
I20260318 02:51:33.133158 457 master_service.cc:954] ReplaceTablet: received request to replace tablet 5a92761edfe74a9798da4d93964383ea from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:33.133278 900 tablet_service.cc:1558] Processing DeleteTablet for tablet bc47f35f9c2c4e5085ab482285effc91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.131621 1172 ts_tablet_manager.cc:1434] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260318 02:51:33.134663 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet b51a15e4303742a999fe9a96d450c827 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.134763 456 master_service.cc:954] ReplaceTablet: received request to replace tablet e418df45882c435a8276e46a8abf6bdd from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:33.135135 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 65f63eb5e114464988b3b89e3af61b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.135214 1174 tablet_bootstrap.cc:492] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:33.133876 1184 tablet_replica.cc:333] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:33.136077 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet bc47f35f9c2c4e5085ab482285effc91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.135406 1184 raft_consensus.cc:2243] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.137012 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d20847fa6f9461cb6137f56ea680cb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.137331 1184 raft_consensus.cc:2272] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.137877 1915 raft_consensus.cc:493] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.138015 1915 raft_consensus.cc:515] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.138312 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_aebead9c64604ea689e8c748f2b54d18" } new_table_name: "default.Table_f7e51d065520474d8d059d64c4693451" modify_external_catalogs: true
I20260318 02:51:33.138567 1915 leader_election.cc:290] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:33.139189 1174 tablet_bootstrap.cc:654] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.139678 759 tablet_service.cc:1558] Processing DeleteTablet for tablet bc47f35f9c2c4e5085ab482285effc91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.140231 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1350684961f645e089fc3fd9ba3a5b09" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:33.141322 1176 ts_tablet_manager.cc:1929] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.141427 1176 log.cc:1199] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/1b439fa2481a43c78d2c486d8711175f
I20260318 02:51:33.141592 1184 ts_tablet_manager.cc:1916] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.141702 1176 ts_tablet_manager.cc:1950] T 1b439fa2481a43c78d2c486d8711175f P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:33.142663 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 1b439fa2481a43c78d2c486d8711175f (table default.Table_46d782df1eb242b081563aeb0ae51278 [id=2cc63f24c25a4fc396e6d026ce1ba876]) successfully deleted
W20260318 02:51:33.143075 719 leader_election.cc:343] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.143052 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1350684961f645e089fc3fd9ba3a5b09" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:33.143290 1176 tablet_replica.cc:333] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:33.140997 1172 tablet_bootstrap.cc:492] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:33.143487 1176 raft_consensus.cc:2243] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:33.143522 719 leader_election.cc:343] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.143625 719 leader_election.cc:304] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.143831 1915 raft_consensus.cc:2749] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.143647 1176 raft_consensus.cc:2272] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.144357 1173 tablet_bootstrap.cc:654] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.144816 1176 ts_tablet_manager.cc:1916] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.145237 1172 tablet_bootstrap.cc:654] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.146728 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 687) took 1243 ms. Trace:
I20260318 02:51:33.148056 1174 tablet_bootstrap.cc:492] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:33.148245 1174 ts_tablet_manager.cc:1403] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260318 02:51:33.149089 1174 raft_consensus.cc:359] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.149328 1174 raft_consensus.cc:385] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.149415 1174 raft_consensus.cc:740] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.149696 1174 consensus_queue.cc:260] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.155203 1174 ts_tablet_manager.cc:1434] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260318 02:51:33.156015 1172 tablet_bootstrap.cc:492] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:33.156199 1172 ts_tablet_manager.cc:1403] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260318 02:51:33.157379 1176 ts_tablet_manager.cc:1929] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.157491 1176 log.cc:1199] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/900c6ef2dc634a788239dd5b77c4bde0
I20260318 02:51:33.157757 1176 ts_tablet_manager.cc:1950] T 900c6ef2dc634a788239dd5b77c4bde0 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:33.158179 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet d0b01131720748688ca6c28985a3b3ff
I20260318 02:51:33.158628 1176 tablet_replica.cc:333] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:33.158694 448 catalog_manager.cc:6741] ReplaceTablet: tablet d0b01131720748688ca6c28985a3b3ff deleted and replaced by tablet fa68d30736044b71b38938fded1b314b
I20260318 02:51:33.158805 1176 raft_consensus.cc:2243] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.158771 1960 raft_consensus.cc:493] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.158946 1176 raft_consensus.cc:2272] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.158936 1960 raft_consensus.cc:515] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.159588 1960 leader_election.cc:290] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:33.160408 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet d0b01131720748688ca6c28985a3b3ff with delete_type TABLET_DATA_DELETED (replaced by tablet fa68d30736044b71b38938fded1b314b) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.160758 759 tablet_service.cc:1558] Processing DeleteTablet for tablet d0b01131720748688ca6c28985a3b3ff with delete_type TABLET_DATA_DELETED (replaced by tablet fa68d30736044b71b38938fded1b314b) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:33.160408 999 leader_election.cc:343] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: f5a829abed0444b79c48ab080d024824
I20260318 02:51:33.161168 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 900c6ef2dc634a788239dd5b77c4bde0 (table default.Table_c2d16f88924544cbaf4ed64b9c5bc7a6 [id=8749d9c9086f43a99348c9bfe995e6e6]) successfully deleted
I20260318 02:51:33.164237 1174 tablet_bootstrap.cc:492] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:33.164804 1172 raft_consensus.cc:359] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.165014 1172 raft_consensus.cc:385] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.165081 1172 raft_consensus.cc:740] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.166965 1174 tablet_bootstrap.cc:654] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.167893 1172 consensus_queue.cc:260] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.168607 1172 ts_tablet_manager.cc:1434] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260318 02:51:33.169654 1184 ts_tablet_manager.cc:1929] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.170818 1184 log.cc:1199] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/9d20847fa6f9461cb6137f56ea680cb6
I20260318 02:51:33.171404 1184 ts_tablet_manager.cc:1950] T 9d20847fa6f9461cb6137f56ea680cb6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:33.172741 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 663) took 2082 ms. Trace:
I20260318 02:51:33.173476 1176 ts_tablet_manager.cc:1916] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.175659 1174 tablet_bootstrap.cc:492] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:33.175809 1174 ts_tablet_manager.cc:1403] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20260318 02:51:33.170069 1172 tablet_bootstrap.cc:492] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:33.176625 1174 raft_consensus.cc:359] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.176832 1174 raft_consensus.cc:385] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.176899 1174 raft_consensus.cc:740] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.177143 1174 consensus_queue.cc:260] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.178572 1174 ts_tablet_manager.cc:1434] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:33.179210 1174 tablet_bootstrap.cc:492] T 7cdd554113bf4a7092da876365a89456 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:33.180922 1174 tablet_bootstrap.cc:654] T 7cdd554113bf4a7092da876365a89456 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:33.182026 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a4918d7f2f2645e88b7f3e1d52926fb1 consensus state has no leader
I20260318 02:51:33.184413 1172 tablet_bootstrap.cc:654] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.175823 1184 rpcz_store.cc:276] 0318 02:51:31.090191 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.090790 (+ 599us) service_pool.cc:225] Handling call
0318 02:51:33.132652 (+2041862us) ts_tablet_manager.cc:1151] Deleting tablet 9d20847fa6f9461cb6137f56ea680cb6
0318 02:51:33.132662 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.151954 (+ 19292us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.169522 (+ 17568us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.172665 (+ 3143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2041625}
I20260318 02:51:33.185839 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 9d20847fa6f9461cb6137f56ea680cb6 (table default.Table_30dc528b33264c9faed7f9f325d93738 [id=ed55cf5473c34c8b95532da9cfa81fad]) successfully deleted
I20260318 02:51:33.186344 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 664) took 2096 ms. Trace:
I20260318 02:51:33.186503 1184 rpcz_store.cc:276] 0318 02:51:31.090306 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.091052 (+ 746us) service_pool.cc:225] Handling call
0318 02:51:33.186168 (+2095116us) ts_tablet_manager.cc:1151] Deleting tablet a20b9dc70b5147ff8798946eda3131ca
0318 02:51:33.186180 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.186289 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2094897}
W20260318 02:51:33.187485 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet a20b9dc70b5147ff8798946eda3131ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a20b9dc70b5147ff8798946eda3131ca already in progress: creating tablet
I20260318 02:51:33.187954 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 667) took 2004 ms. Trace:
I20260318 02:51:33.188140 1184 rpcz_store.cc:276] 0318 02:51:31.183832 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.183886 (+ 54us) service_pool.cc:225] Handling call
0318 02:51:33.187797 (+2003911us) ts_tablet_manager.cc:1151] Deleting tablet 2dab268da5e843cab5c28a521217df97
0318 02:51:33.187806 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.187892 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1969244}
W20260318 02:51:33.188655 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2dab268da5e843cab5c28a521217df97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2dab268da5e843cab5c28a521217df97 already in progress: creating tablet
I20260318 02:51:33.189474 785 raft_consensus.cc:1275] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Refusing update from remote peer 9422bb7011f342b08be0b073a88c4c4d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260318 02:51:33.189728 997 consensus_peers.cc:597] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:33.190074 1959 consensus_queue.cc:1048] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:33.190274 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a99ee13e334549a2b8222bd8bad5bf77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:33.189420 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 668) took 2004 ms. Trace:
W20260318 02:51:33.190932 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a99ee13e334549a2b8222bd8bad5bf77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.190950 1184 rpcz_store.cc:276] 0318 02:51:31.184617 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.184663 (+ 46us) service_pool.cc:225] Handling call
0318 02:51:33.189282 (+2004619us) ts_tablet_manager.cc:1151] Deleting tablet 44cc50429d4f4c109629a9ad08b06bb3
0318 02:51:33.189291 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.189368 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1970656}
W20260318 02:51:33.191756 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 44cc50429d4f4c109629a9ad08b06bb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44cc50429d4f4c109629a9ad08b06bb3 already in progress: creating tablet
I20260318 02:51:33.192469 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 669) took 1988 ms. Trace:
I20260318 02:51:33.196777 1184 rpcz_store.cc:276] 0318 02:51:31.204194 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.207548 (+ 3354us) service_pool.cc:225] Handling call
0318 02:51:33.192326 (+1984778us) ts_tablet_manager.cc:1151] Deleting tablet 6deb99f7937144f39409929f99b135c5
0318 02:51:33.192336 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.192419 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1973554}
W20260318 02:51:33.197463 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 6deb99f7937144f39409929f99b135c5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6deb99f7937144f39409929f99b135c5 already in progress: creating tablet
I20260318 02:51:33.198019 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 666) took 2015 ms. Trace:
I20260318 02:51:33.198166 1184 rpcz_store.cc:276] 0318 02:51:31.182842 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.266610 (+ 83768us) service_pool.cc:225] Handling call
0318 02:51:33.197837 (+1931227us) ts_tablet_manager.cc:1151] Deleting tablet 2a7ddc0807d742cea258f889390e2142
0318 02:51:33.197849 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.197952 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1764665}
W20260318 02:51:33.198652 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2a7ddc0807d742cea258f889390e2142 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a7ddc0807d742cea258f889390e2142 already in progress: creating tablet
I20260318 02:51:33.199029 1184 tablet_replica.cc:333] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:33.199281 1184 raft_consensus.cc:2243] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:33.199746 1184 raft_consensus.cc:2272] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.201452 1184 ts_tablet_manager.cc:1916] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.203387 1172 tablet_bootstrap.cc:492] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:33.203595 1172 ts_tablet_manager.cc:1403] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.000s
I20260318 02:51:33.204432 1172 raft_consensus.cc:359] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.204814 1172 raft_consensus.cc:385] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.204960 1172 raft_consensus.cc:740] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.205233 1172 consensus_queue.cc:260] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.205940 1172 ts_tablet_manager.cc:1434] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:33.206697 1172 tablet_bootstrap.cc:492] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:33.160238 900 tablet_service.cc:1558] Processing DeleteTablet for tablet d0b01131720748688ca6c28985a3b3ff with delete_type TABLET_DATA_DELETED (replaced by tablet fa68d30736044b71b38938fded1b314b) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.160989 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a829abed0444b79c48ab080d024824" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:33.164012 860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.131:37025, user_credentials={real_user=slave}} blocked reactor thread for 52478.1us
I20260318 02:51:33.172258 2008 raft_consensus.cc:493] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260318 02:51:33.209486 997 leader_election.cc:343] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.209628 997 leader_election.cc:304] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.209554 2008 raft_consensus.cc:515] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.210088 1959 raft_consensus.cc:2749] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.210166 2008 leader_election.cc:290] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:33.210399 1973 tablet.cc:1723] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260318 02:51:33.188807 1173 tablet_bootstrap.cc:492] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:33.190534 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d343e53f2354a3386b19d71ef00d5a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.190686 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 93479517a1d34d2d99633018a6a57127 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fec974d146f44aeb72df483fa85b287) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.210837 1173 ts_tablet_manager.cc:1403] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.096s user 0.005s sys 0.002s
I20260318 02:51:33.195503 1883 raft_consensus.cc:493] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.211000 1883 raft_consensus.cc:515] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:33.211275 862 leader_election.cc:343] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 95f15079d1df4314b6dd5c7afd896af5
I20260318 02:51:33.211512 1883 leader_election.cc:290] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:33.202672 2009 raft_consensus.cc:493] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.211632 1173 raft_consensus.cc:359] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.211666 2009 raft_consensus.cc:515] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.211778 1173 raft_consensus.cc:385] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.211822 1173 raft_consensus.cc:740] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.212051 1173 consensus_queue.cc:260] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.212137 2009 leader_election.cc:290] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:33.212563 1173 ts_tablet_manager.cc:1434] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:33.213735 1176 ts_tablet_manager.cc:1929] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.214151 1176 log.cc:1199] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/065ebc3c000a4ad3873ee031ecf9986b
I20260318 02:51:33.214432 1176 ts_tablet_manager.cc:1950] T 065ebc3c000a4ad3873ee031ecf9986b P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:33.215358 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 065ebc3c000a4ad3873ee031ecf9986b (table default.Table_a1fc9d74bf8b4be5a48c0480aa55d189 [id=62eb3b210f764eaaa081488904cf8aa7]) successfully deleted
W20260318 02:51:33.215700 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 5a92761edfe74a9798da4d93964383ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a92761edfe74a9798da4d93964383ea already in progress: creating tablet
W20260318 02:51:33.215929 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 6858334d4c8b41b89c57b4b6f127a1c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6858334d4c8b41b89c57b4b6f127a1c7 already in progress: creating tablet
W20260318 02:51:33.216470 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 85e6ad2a9817444caecb78eabde5d222 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85e6ad2a9817444caecb78eabde5d222 already in progress: creating tablet
W20260318 02:51:33.216696 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 5dd894706cc2466a8cd4e4df67856862 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dd894706cc2466a8cd4e4df67856862 already in progress: creating tablet
I20260318 02:51:33.217192 1176 tablet_replica.cc:333] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
W20260318 02:51:33.217185 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet ebbe05c64ae14c509584dd86e45b4aa1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebbe05c64ae14c509584dd86e45b4aa1 already in progress: creating tablet
W20260318 02:51:33.217365 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 8b99d05da31c4b77a78a94baf55b28fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b99d05da31c4b77a78a94baf55b28fa already in progress: creating tablet
I20260318 02:51:33.217393 1176 raft_consensus.cc:2243] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.217581 1176 raft_consensus.cc:2272] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:33.217672 862 leader_election.cc:343] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 666c2992fa4f479ab4ffd7ac0c3a9c92
I20260318 02:51:33.219172 1184 ts_tablet_manager.cc:1929] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:33.219308 1184 log.cc:1199] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/916b5b77fb2f4003b78a71025319ed15
I20260318 02:51:33.219460 1974 tablet.cc:1723] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260318 02:51:33.219671 1184 ts_tablet_manager.cc:1950] T 916b5b77fb2f4003b78a71025319ed15 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:33.220424 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 685) took 1760 ms. Trace:
I20260318 02:51:33.220546 1184 rpcz_store.cc:276] 0318 02:51:31.460208 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.460275 (+ 67us) service_pool.cc:225] Handling call
0318 02:51:33.198935 (+1738660us) ts_tablet_manager.cc:1151] Deleting tablet 916b5b77fb2f4003b78a71025319ed15
0318 02:51:33.198945 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.211984 (+ 13039us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.219032 (+ 7048us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.220390 (+ 1358us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1738394}
I20260318 02:51:33.222214 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 916b5b77fb2f4003b78a71025319ed15 (table default.Table_6d506ddf2c854df0a30d396a197e4032 [id=57891ff71e194a8f8959294ba552fb23]) successfully deleted
W20260318 02:51:33.223232 862 leader_election.cc:343] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: af793623466249e695b262ab451d4dc9
W20260318 02:51:33.223635 860 leader_election.cc:343] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: af793623466249e695b262ab451d4dc9
I20260318 02:51:33.223760 860 leader_election.cc:304] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
W20260318 02:51:33.224128 860 leader_election.cc:343] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 666c2992fa4f479ab4ffd7ac0c3a9c92
I20260318 02:51:33.224216 860 leader_election.cc:304] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:33.224359 1176 ts_tablet_manager.cc:1916] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:33.224543 860 leader_election.cc:343] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 95f15079d1df4314b6dd5c7afd896af5
I20260318 02:51:33.224625 860 leader_election.cc:304] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:33.225451 2008 raft_consensus.cc:2749] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.225625 2008 raft_consensus.cc:2749] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.227207 1172 tablet_bootstrap.cc:654] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.228112 1173 tablet_bootstrap.cc:492] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:33.229924 1173 tablet_bootstrap.cc:654] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.233354 2009 raft_consensus.cc:2749] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.234512 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 684) took 1774 ms. Trace:
I20260318 02:51:33.235152 1184 rpcz_store.cc:276] 0318 02:51:31.460126 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.465505 (+ 5379us) service_pool.cc:225] Handling call
0318 02:51:33.234326 (+1768821us) ts_tablet_manager.cc:1151] Deleting tablet c0c33cfa1c194a65bfc64d0e1e9434ff
0318 02:51:33.234340 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.234465 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1761903}
I20260318 02:51:33.210767 1175 rpcz_store.cc:276] 0318 02:51:31.903589 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.903644 (+ 55us) service_pool.cc:225] Handling call
0318 02:51:32.978826 (+1075182us) ts_tablet_manager.cc:1151] Deleting tablet 0c8264f69f934d3ba2e41434ce350f3e
0318 02:51:32.978839 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.075837 (+ 96998us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.079678 (+ 3841us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.146699 (+ 67021us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1069787}
I20260318 02:51:33.235754 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 0c8264f69f934d3ba2e41434ce350f3e (table default.Table_50e2d197579e426787bc46d7494e2f74 [id=83452e9434ad488c9cda6c178ec3b182]) successfully deleted
I20260318 02:51:33.236238 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 688) took 1321 ms. Trace:
I20260318 02:51:33.236430 1173 tablet_bootstrap.cc:492] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:33.236374 1175 rpcz_store.cc:276] 0318 02:51:31.914452 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.914703 (+ 251us) service_pool.cc:225] Handling call
0318 02:51:33.236083 (+1321380us) ts_tablet_manager.cc:1151] Deleting tablet abfa81c3c78a498285e2961530272a39
0318 02:51:33.236094 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.236218 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1321173}
I20260318 02:51:33.236683 1173 ts_tablet_manager.cc:1403] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.001s
W20260318 02:51:33.237037 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet abfa81c3c78a498285e2961530272a39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet abfa81c3c78a498285e2961530272a39 already in progress: creating tablet
I20260318 02:51:33.237471 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 689) took 1302 ms. Trace:
I20260318 02:51:33.237584 1173 raft_consensus.cc:359] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.237591 1175 rpcz_store.cc:276] 0318 02:51:31.935386 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.935612 (+ 226us) service_pool.cc:225] Handling call
0318 02:51:33.237360 (+1301748us) ts_tablet_manager.cc:1151] Deleting tablet e1d804f5e9564f6d83efb77e6c18724b
0318 02:51:33.237369 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.237455 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1300979}
I20260318 02:51:33.237864 1173 raft_consensus.cc:385] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.238009 1173 raft_consensus.cc:740] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.238327 1173 consensus_queue.cc:260] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.238586 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 686) took 1348 ms. Trace:
W20260318 02:51:33.238677 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60a4e38c14f84e6ba9d0402b62f7432c consensus state has no leader
I20260318 02:51:33.239157 1173 ts_tablet_manager.cc:1434] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260318 02:51:33.239491 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet c0c33cfa1c194a65bfc64d0e1e9434ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0c33cfa1c194a65bfc64d0e1e9434ff already in progress: creating tablet
W20260318 02:51:33.239753 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet e1d804f5e9564f6d83efb77e6c18724b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1d804f5e9564f6d83efb77e6c18724b already in progress: creating tablet
I20260318 02:51:33.241006 1173 tablet_bootstrap.cc:492] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:33.242333 1184 rpcz_store.cc:276] 0318 02:51:31.890340 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.890391 (+ 51us) service_pool.cc:225] Handling call
0318 02:51:33.238426 (+1348035us) ts_tablet_manager.cc:1151] Deleting tablet d4e3346edd274750a5e27ec2393d08bc
0318 02:51:33.238438 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.238542 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1347755}
W20260318 02:51:33.243245 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet d4e3346edd274750a5e27ec2393d08bc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4e3346edd274750a5e27ec2393d08bc already in progress: creating tablet
I20260318 02:51:33.243539 1173 tablet_bootstrap.cc:654] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.243741 1184 tablet_replica.cc:333] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:33.243676 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ba684d1d27e94924bc3c7db526d083cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:33.244266 1184 raft_consensus.cc:2243] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:33.244290 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba684d1d27e94924bc3c7db526d083cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.244902 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 690) took 1308 ms. Trace:
I20260318 02:51:33.245314 1175 rpcz_store.cc:276] 0318 02:51:31.936588 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.936638 (+ 50us) service_pool.cc:225] Handling call
0318 02:51:33.244570 (+1307932us) ts_tablet_manager.cc:1151] Deleting tablet 3291ecec94e642e3a995a2d7006619e7
0318 02:51:33.244727 (+ 157us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.244825 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1299218}
W20260318 02:51:33.245820 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 3291ecec94e642e3a995a2d7006619e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3291ecec94e642e3a995a2d7006619e7 already in progress: creating tablet
I20260318 02:51:33.246207 1175 tablet_replica.cc:333] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:33.246878 1175 raft_consensus.cc:2243] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.247565 1175 raft_consensus.cc:2272] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.249643 1175 ts_tablet_manager.cc:1916] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.253453 1176 ts_tablet_manager.cc:1929] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:33.253611 1176 log.cc:1199] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/bc47f35f9c2c4e5085ab482285effc91
I20260318 02:51:33.254009 1176 ts_tablet_manager.cc:1950] T bc47f35f9c2c4e5085ab482285effc91 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:33.256268 1915 raft_consensus.cc:493] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.256268 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet bc47f35f9c2c4e5085ab482285effc91 (table default.Table_9867792729394010ba769354562198f3 [id=1515573be85644d7a4f046947aa1537b]) successfully deleted
I20260318 02:51:33.256433 1915 raft_consensus.cc:515] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.257051 1915 leader_election.cc:290] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:33.257977 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef3181adc0542229897369591a30465" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:33.258086 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef3181adc0542229897369591a30465" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:33.258566 719 leader_election.cc:343] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:33.258769 719 leader_election.cc:343] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.258843 719 leader_election.cc:304] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.259305 1915 raft_consensus.cc:2749] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.261683 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c163a32a9f1541b892b0883ae968defc" } new_table_name: "default.Table_01108ecf756748c989c72cdacfbce742" modify_external_catalogs: true
I20260318 02:51:33.261933 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 08307bc69291479eb8ee0d7aec124829 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.262161 903 tablet_service.cc:1558] Processing DeleteTablet for tablet b51a15e4303742a999fe9a96d450c827 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:33.263842 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet d0b01131720748688ca6c28985a3b3ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0b01131720748688ca6c28985a3b3ff already in progress: creating tablet
W20260318 02:51:33.267374 444 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet e418df45882c435a8276e46a8abf6bdd (table default.Table_b87c8d210af448238e2ed324e0fa82b3 [id=3b169945a7bc477bb1a48b662948f322], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet e418df45882c435a8276e46a8abf6bdd consensus state has no leader
I20260318 02:51:33.268745 1172 tablet_bootstrap.cc:492] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:33.268906 1172 ts_tablet_manager.cc:1403] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.063s user 0.012s sys 0.011s
I20260318 02:51:33.269613 1172 raft_consensus.cc:359] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.269785 1172 raft_consensus.cc:385] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.269840 1172 raft_consensus.cc:740] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.270040 1172 consensus_queue.cc:260] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.270514 1172 ts_tablet_manager.cc:1434] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:33.270965 1172 tablet_bootstrap.cc:492] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:33.272693 1172 tablet_bootstrap.cc:654] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.277743 1184 raft_consensus.cc:2272] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.278515 1184 ts_tablet_manager.cc:1916] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.285171 1184 ts_tablet_manager.cc:1929] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.285403 1184 log.cc:1199] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/93479517a1d34d2d99633018a6a57127
I20260318 02:51:33.285751 1184 ts_tablet_manager.cc:1950] T 93479517a1d34d2d99633018a6a57127 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:33.286580 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 687) took 1394 ms. Trace:
I20260318 02:51:33.286751 1184 rpcz_store.cc:276] 0318 02:51:31.892512 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.892567 (+ 55us) service_pool.cc:225] Handling call
0318 02:51:33.243665 (+1351098us) ts_tablet_manager.cc:1151] Deleting tablet 93479517a1d34d2d99633018a6a57127
0318 02:51:33.243678 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.281941 (+ 38263us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.285034 (+ 3093us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.286543 (+ 1509us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1350746}
I20260318 02:51:33.287320 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 93479517a1d34d2d99633018a6a57127 (table default.Table_167a79354e7844aabe2ae725df4f536c [id=095e4b55b1544007a032a984ba934743]) successfully deleted
I20260318 02:51:33.287679 1175 ts_tablet_manager.cc:1929] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.287839 1175 log.cc:1199] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/f1ff303b23184d4b92994bde194229b4
I20260318 02:51:33.287968 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 697) took 1369 ms. Trace:
I20260318 02:51:33.288086 1184 rpcz_store.cc:276] 0318 02:51:31.918334 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.918385 (+ 51us) service_pool.cc:225] Handling call
0318 02:51:33.287698 (+1369313us) ts_tablet_manager.cc:1151] Deleting tablet abfa81c3c78a498285e2961530272a39
0318 02:51:33.287710 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.287883 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1369101}
I20260318 02:51:33.288203 1175 ts_tablet_manager.cc:1950] T f1ff303b23184d4b92994bde194229b4 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:33.288537 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 691) took 1342 ms. Trace:
W20260318 02:51:33.288648 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet abfa81c3c78a498285e2961530272a39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet abfa81c3c78a498285e2961530272a39 already in progress: creating tablet
I20260318 02:51:33.288661 1175 rpcz_store.cc:276] 0318 02:51:31.945913 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.945977 (+ 64us) service_pool.cc:225] Handling call
0318 02:51:33.246122 (+1300145us) ts_tablet_manager.cc:1151] Deleting tablet f1ff303b23184d4b92994bde194229b4
0318 02:51:33.246131 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.273128 (+ 26997us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.287529 (+ 14401us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.288492 (+ 963us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1299381}
I20260318 02:51:33.289090 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet f1ff303b23184d4b92994bde194229b4 (table default.Table_cec1585fa5824e7682f05533101d20eb [id=873432f002e14a4fa7065dcfe5caebd5]) successfully deleted
I20260318 02:51:33.289489 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 698) took 1360 ms. Trace:
I20260318 02:51:33.289620 1184 rpcz_store.cc:276] 0318 02:51:31.928636 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.928692 (+ 56us) service_pool.cc:225] Handling call
0318 02:51:33.289361 (+1360669us) ts_tablet_manager.cc:1151] Deleting tablet e1d804f5e9564f6d83efb77e6c18724b
0318 02:51:33.289373 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.289471 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1360436}
W20260318 02:51:33.290117 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet e1d804f5e9564f6d83efb77e6c18724b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e1d804f5e9564f6d83efb77e6c18724b already in progress: creating tablet
I20260318 02:51:33.290488 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 699) took 1338 ms. Trace:
I20260318 02:51:33.290616 1184 rpcz_store.cc:276] 0318 02:51:31.952035 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.952095 (+ 60us) service_pool.cc:225] Handling call
0318 02:51:33.290381 (+1338286us) ts_tablet_manager.cc:1151] Deleting tablet 3291ecec94e642e3a995a2d7006619e7
0318 02:51:33.290390 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.290470 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1338085}
W20260318 02:51:33.291038 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 3291ecec94e642e3a995a2d7006619e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3291ecec94e642e3a995a2d7006619e7 already in progress: creating tablet
I20260318 02:51:33.291350 1184 tablet_replica.cc:333] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:33.291599 1184 raft_consensus.cc:2243] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.291800 1184 raft_consensus.cc:2272] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.292142 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 693) took 1254 ms. Trace:
I20260318 02:51:33.292264 1175 rpcz_store.cc:276] 0318 02:51:32.038107 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.038504 (+ 397us) service_pool.cc:225] Handling call
0318 02:51:33.291993 (+1253489us) ts_tablet_manager.cc:1151] Deleting tablet e867dcd3ff3e4eb7b923305a037c5a79
0318 02:51:33.292005 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.292103 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1253300}
W20260318 02:51:33.292680 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet e867dcd3ff3e4eb7b923305a037c5a79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e867dcd3ff3e4eb7b923305a037c5a79 already in progress: creating tablet
I20260318 02:51:33.292766 2009 raft_consensus.cc:493] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.292917 2009 raft_consensus.cc:515] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.293063 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5d3c36baac1f40b8a09948ec623482fa" } modify_external_catalogs: true
I20260318 02:51:33.293162 1184 ts_tablet_manager.cc:1916] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.293227 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5d3c36baac1f40b8a09948ec623482fa" } modify_external_catalogs: true
I20260318 02:51:33.293618 2009 leader_election.cc:290] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:33.293840 1960 raft_consensus.cc:493] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.293959 1960 raft_consensus.cc:515] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.294515 1960 leader_election.cc:290] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:33.294545 860 leader_election.cc:343] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 08307bc69291479eb8ee0d7aec124829
I20260318 02:51:33.295517 1174 tablet_bootstrap.cc:492] T 7cdd554113bf4a7092da876365a89456 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:33.295652 1174 ts_tablet_manager.cc:1403] T 7cdd554113bf4a7092da876365a89456 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.117s user 0.015s sys 0.016s
W20260318 02:51:33.295614 862 leader_election.cc:343] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 08307bc69291479eb8ee0d7aec124829
I20260318 02:51:33.295758 862 leader_election.cc:304] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:33.296530 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104cd36774df4bc0adf1d449224304d5" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:33.296478 1174 raft_consensus.cc:359] T 7cdd554113bf4a7092da876365a89456 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.296814 1174 raft_consensus.cc:385] T 7cdd554113bf4a7092da876365a89456 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.296890 1174 raft_consensus.cc:740] T 7cdd554113bf4a7092da876365a89456 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.297096 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104cd36774df4bc0adf1d449224304d5" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:33.297277 785 raft_consensus.cc:2468] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:33.297111 1174 consensus_queue.cc:260] T 7cdd554113bf4a7092da876365a89456 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.297820 999 leader_election.cc:304] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:33.298834 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 701) took 1140 ms. Trace:
I20260318 02:51:33.298959 1175 rpcz_store.cc:276] 0318 02:51:32.158194 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.158254 (+ 60us) service_pool.cc:225] Handling call
0318 02:51:33.298694 (+1140440us) ts_tablet_manager.cc:1151] Deleting tablet 1ac9581312964ad6afcc96f798fa534a
0318 02:51:33.298707 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.298799 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1140236}
I20260318 02:51:33.299324 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 702) took 1140 ms. Trace:
I20260318 02:51:33.299418 1175 rpcz_store.cc:276] 0318 02:51:32.159169 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.159235 (+ 66us) service_pool.cc:225] Handling call
0318 02:51:33.299209 (+1139974us) ts_tablet_manager.cc:1151] Deleting tablet 75ca99ca24f14cd48f29e49168ebca3f
0318 02:51:33.299218 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.299293 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1139768}
I20260318 02:51:33.300045 1174 ts_tablet_manager.cc:1434] T 7cdd554113bf4a7092da876365a89456 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:33.300673 1174 tablet_bootstrap.cc:492] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:33.301836 997 leader_election.cc:343] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:33.302371 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 1ac9581312964ad6afcc96f798fa534a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ac9581312964ad6afcc96f798fa534a already in progress: creating tablet
I20260318 02:51:33.304131 1960 raft_consensus.cc:2804] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:33.304229 1960 raft_consensus.cc:493] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:33.304286 1960 raft_consensus.cc:3060] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:33.305269 1174 tablet_bootstrap.cc:654] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.307153 1960 raft_consensus.cc:515] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.307328 1172 tablet_bootstrap.cc:492] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:33.307457 1172 ts_tablet_manager.cc:1403] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.037s user 0.000s sys 0.013s
I20260318 02:51:33.307925 2008 raft_consensus.cc:2749] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.308096 2008 raft_consensus.cc:493] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.308205 2008 raft_consensus.cc:515] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.308269 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_833f8bfd9c5f49bfbaefd932e597b22a" } modify_external_catalogs: true
I20260318 02:51:33.308444 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_833f8bfd9c5f49bfbaefd932e597b22a" } modify_external_catalogs: true
I20260318 02:51:33.308795 2008 leader_election.cc:290] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:33.308676 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104cd36774df4bc0adf1d449224304d5" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:33.309374 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d343e53f2354a3386b19d71ef00d5a4" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:33.309845 860 leader_election.cc:343] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: Tablet not RUNNING: STOPPED
W20260318 02:51:33.310004 862 leader_election.cc:343] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 0d343e53f2354a3386b19d71ef00d5a4
I20260318 02:51:33.310132 862 leader_election.cc:304] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:33.310702 2008 raft_consensus.cc:2749] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:33.311189 997 leader_election.cc:343] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.311296 1172 raft_consensus.cc:359] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.311453 1172 raft_consensus.cc:385] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.311506 1172 raft_consensus.cc:740] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.311683 1172 consensus_queue.cc:260] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.315368 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet e418df45882c435a8276e46a8abf6bdd
I20260318 02:51:33.315832 456 catalog_manager.cc:6741] ReplaceTablet: tablet e418df45882c435a8276e46a8abf6bdd deleted and replaced by tablet b510f3c213104798971cf84c95e357d7
I20260318 02:51:33.317111 903 tablet_service.cc:1558] Processing DeleteTablet for tablet e418df45882c435a8276e46a8abf6bdd with delete_type TABLET_DATA_DELETED (replaced by tablet b510f3c213104798971cf84c95e357d7) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.317615 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet e418df45882c435a8276e46a8abf6bdd with delete_type TABLET_DATA_DELETED (replaced by tablet b510f3c213104798971cf84c95e357d7) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.318163 759 tablet_service.cc:1558] Processing DeleteTablet for tablet e418df45882c435a8276e46a8abf6bdd with delete_type TABLET_DATA_DELETED (replaced by tablet b510f3c213104798971cf84c95e357d7) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.318576 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104cd36774df4bc0adf1d449224304d5" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:33.318765 785 raft_consensus.cc:3060] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:33.318876 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet e418df45882c435a8276e46a8abf6bdd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e418df45882c435a8276e46a8abf6bdd already in progress: creating tablet
I20260318 02:51:33.320199 1172 ts_tablet_manager.cc:1434] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.013s user 0.000s sys 0.002s
I20260318 02:51:33.320262 2009 raft_consensus.cc:493] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.320387 2009 raft_consensus.cc:515] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.320485 1172 tablet_bootstrap.cc:492] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:33.321012 2009 leader_election.cc:290] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:33.321938 1172 tablet_bootstrap.cc:654] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:33.322233 860 leader_election.cc:343] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 93479517a1d34d2d99633018a6a57127
I20260318 02:51:33.321636 785 raft_consensus.cc:2468] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:33.323159 999 leader_election.cc:304] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.323450 1874 raft_consensus.cc:2804] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:33.323583 1874 raft_consensus.cc:697] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
W20260318 02:51:33.323833 862 leader_election.cc:343] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 93479517a1d34d2d99633018a6a57127
I20260318 02:51:33.323844 1874 consensus_queue.cc:237] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.323961 862 leader_election.cc:304] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:33.324632 2009 raft_consensus.cc:2749] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.327090 1960 leader_election.cc:290] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:33.332587 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c2a579089c6c405f9470b3a97dfbbbcd" } new_table_name: "default.Table_5fac7eb852e84aa79c9d10337fe7e610" modify_external_catalogs: true
I20260318 02:51:33.334491 1184 ts_tablet_manager.cc:1929] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.334618 1184 log.cc:1199] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/0d343e53f2354a3386b19d71ef00d5a4
I20260318 02:51:33.334944 1184 ts_tablet_manager.cc:1950] T 0d343e53f2354a3386b19d71ef00d5a4 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:33.336048 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 700) took 1383 ms. Trace:
I20260318 02:51:33.336210 1184 rpcz_store.cc:276] 0318 02:51:31.952153 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.952565 (+ 412us) service_pool.cc:225] Handling call
0318 02:51:33.291301 (+1338736us) ts_tablet_manager.cc:1151] Deleting tablet 0d343e53f2354a3386b19d71ef00d5a4
0318 02:51:33.291311 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.330856 (+ 39545us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.334371 (+ 3515us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.336026 (+ 1655us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1338503}
I20260318 02:51:33.336817 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 0d343e53f2354a3386b19d71ef00d5a4 (table default.Table_7710260d7bd54a859b6fc9023ce450e2 [id=301be4fd1a6b44c6962f9386d1e7f91e]) successfully deleted
I20260318 02:51:33.337263 1173 tablet_bootstrap.cc:492] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:33.337282 1184 tablet_replica.cc:333] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:33.337428 1173 ts_tablet_manager.cc:1403] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.097s user 0.009s sys 0.007s
I20260318 02:51:33.337618 1184 raft_consensus.cc:2243] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.337829 1184 raft_consensus.cc:2272] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.338240 1173 raft_consensus.cc:359] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.338425 1173 raft_consensus.cc:385] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.338488 1173 raft_consensus.cc:740] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.338732 1184 ts_tablet_manager.cc:1916] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.338755 1173 consensus_queue.cc:260] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.339736 1173 ts_tablet_manager.cc:1434] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260318 02:51:33.342741 1172 tablet_bootstrap.cc:492] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:33.342898 1172 ts_tablet_manager.cc:1403] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20260318 02:51:33.343595 1172 raft_consensus.cc:359] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.343777 1172 raft_consensus.cc:385] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.343834 1172 raft_consensus.cc:740] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.345920 1172 consensus_queue.cc:260] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.351191 1184 ts_tablet_manager.cc:1929] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.351388 1184 log.cc:1199] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/2c5038e9e1074f46976a1a5bb4282944
I20260318 02:51:33.351540 1172 ts_tablet_manager.cc:1434] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260318 02:51:33.351902 1184 ts_tablet_manager.cc:1950] T 2c5038e9e1074f46976a1a5bb4282944 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:33.352452 1172 tablet_bootstrap.cc:492] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:33.353632 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 701) took 1377 ms. Trace:
I20260318 02:51:33.357937 1184 rpcz_store.cc:276] 0318 02:51:31.976629 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.976841 (+ 212us) service_pool.cc:225] Handling call
0318 02:51:33.337199 (+1360358us) ts_tablet_manager.cc:1151] Deleting tablet 2c5038e9e1074f46976a1a5bb4282944
0318 02:51:33.337210 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.343629 (+ 6419us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.351065 (+ 7436us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.353611 (+ 2546us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1360096}
I20260318 02:51:33.358521 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 2c5038e9e1074f46976a1a5bb4282944 (table default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]) successfully deleted
I20260318 02:51:33.358845 1173 tablet_bootstrap.cc:492] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:33.359073 1184 tablet_replica.cc:333] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:33.359829 1184 raft_consensus.cc:2243] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.360582 1184 raft_consensus.cc:2272] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:33.361160 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c1ba16db9d040708f8fd75c852bdbb1 consensus state has no leader
I20260318 02:51:33.362172 1172 tablet_bootstrap.cc:654] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.362355 1874 raft_consensus.cc:493] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.362473 1874 raft_consensus.cc:515] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:33.364204 999 leader_election.cc:343] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: f04f057571584d31b1821e690ae7c75c
I20260318 02:51:33.364338 1874 leader_election.cc:290] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:33.364676 1184 ts_tablet_manager.cc:1916] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.367657 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_21a21b6af7a7490983be4155ea8b15ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:33.367901 1174 tablet_bootstrap.cc:492] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:33.368036 1174 ts_tablet_manager.cc:1403] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.068s user 0.010s sys 0.000s
W20260318 02:51:33.368361 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21a21b6af7a7490983be4155ea8b15ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.368829 1174 raft_consensus.cc:359] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.368989 1174 raft_consensus.cc:385] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.369041 1174 raft_consensus.cc:740] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
W20260318 02:51:33.369127 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a0fe429edde49fe8702ffb13b034a6c consensus state has no leader
I20260318 02:51:33.369259 1174 consensus_queue.cc:260] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.369508 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_4c1ff8f187b34eb59f2b189fbf314142"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:33.369901 1174 ts_tablet_manager.cc:1434] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260318 02:51:33.370028 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c1ff8f187b34eb59f2b189fbf314142 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.370164 1174 tablet_bootstrap.cc:492] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:33.371974 1174 tablet_bootstrap.cc:654] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.373113 1184 ts_tablet_manager.cc:1929] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.375625 1184 log.cc:1199] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/d1a884fde2c145518a2cb14b7780b6dd
I20260318 02:51:33.375826 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_17df338b31d74ae787181f5263811168"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:33.376195 1184 ts_tablet_manager.cc:1950] T d1a884fde2c145518a2cb14b7780b6dd P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
W20260318 02:51:33.376565 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17df338b31d74ae787181f5263811168 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.376991 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 702) took 1399 ms. Trace:
I20260318 02:51:33.377077 1184 rpcz_store.cc:276] 0318 02:51:31.977551 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.977604 (+ 53us) service_pool.cc:225] Handling call
0318 02:51:33.359020 (+1381416us) ts_tablet_manager.cc:1151] Deleting tablet d1a884fde2c145518a2cb14b7780b6dd
0318 02:51:33.359031 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.369924 (+ 10893us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.373005 (+ 3081us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.376969 (+ 3964us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1381225}
I20260318 02:51:33.377557 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet d1a884fde2c145518a2cb14b7780b6dd (table default.Table_6372798c3d47435ea80a21ca734ce78f [id=b5127c54241a49309f32bfa4e5f6f2cd]) successfully deleted
I20260318 02:51:33.378732 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f95a3e0963444695ba709d458021d644"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:33.379233 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f95a3e0963444695ba709d458021d644 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.381665 1184 tablet_replica.cc:333] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:33.381927 1184 raft_consensus.cc:2243] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.382129 1184 raft_consensus.cc:2272] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.382920 1184 ts_tablet_manager.cc:1916] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.387280 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04f057571584d31b1821e690ae7c75c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:33.387974 997 leader_election.cc:343] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.388096 997 leader_election.cc:304] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.388497 1874 raft_consensus.cc:2749] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.389137 1174 tablet_bootstrap.cc:492] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:33.389283 1174 ts_tablet_manager.cc:1403] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260318 02:51:33.390201 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f7f8240ed325401da6344c8ee033ad43
I20260318 02:51:33.391453 759 tablet_service.cc:1558] Processing DeleteTablet for tablet f7f8240ed325401da6344c8ee033ad43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.391937 903 tablet_service.cc:1558] Processing DeleteTablet for tablet f7f8240ed325401da6344c8ee033ad43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:33.392167 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f7f8240ed325401da6344c8ee033ad43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7f8240ed325401da6344c8ee033ad43 already in progress: creating tablet
I20260318 02:51:33.392750 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet f7f8240ed325401da6344c8ee033ad43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:33.393505 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 480f4438de13453fa84ce8c37388aeb1 consensus state has no leader
I20260318 02:51:33.395258 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_997fb2399fa943e9b940ce4e2b1f31ca" } modify_external_catalogs: true
I20260318 02:51:33.395486 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_997fb2399fa943e9b940ce4e2b1f31ca" } modify_external_catalogs: true
I20260318 02:51:33.396221 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_167a79354e7844aabe2ae725df4f536c" } modify_external_catalogs: true
I20260318 02:51:33.396413 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_167a79354e7844aabe2ae725df4f536c" } modify_external_catalogs: true
I20260318 02:51:33.398592 1174 raft_consensus.cc:359] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.398783 1174 raft_consensus.cc:385] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.402264 1174 raft_consensus.cc:740] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.402701 1174 consensus_queue.cc:260] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.403348 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_537505805e734d2d82693fe1b781bab6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:33.403980 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_537505805e734d2d82693fe1b781bab6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.405846 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_13562b9955cc4b1da96a7682ee85967a" } new_table_name: "default.Table_2bde24aa44a6414f88f99376914827d7" modify_external_catalogs: true
I20260318 02:51:33.408401 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_af46ed3654604db1bc563c9ecd3e82df" } modify_external_catalogs: true
I20260318 02:51:33.408592 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_af46ed3654604db1bc563c9ecd3e82df" } modify_external_catalogs: true
I20260318 02:51:33.409614 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e38dec0d2e9417e8571e202036e7117 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.409999 1874 raft_consensus.cc:493] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.410137 1874 raft_consensus.cc:515] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.410516 1172 tablet_bootstrap.cc:492] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:33.410778 1874 leader_election.cc:290] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:33.410995 1172 ts_tablet_manager.cc:1403] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.059s user 0.009s sys 0.026s
I20260318 02:51:33.411604 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65f63eb5e114464988b3b89e3af61b61" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:33.411687 1172 raft_consensus.cc:359] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.411827 1172 raft_consensus.cc:385] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.411867 1172 raft_consensus.cc:740] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.412024 1172 consensus_queue.cc:260] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:33.412026 999 leader_election.cc:343] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 65f63eb5e114464988b3b89e3af61b61
I20260318 02:51:33.412454 1172 ts_tablet_manager.cc:1434] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20260318 02:51:33.412556 997 leader_election.cc:343] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.412649 997 leader_election.cc:304] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.412766 1172 tablet_bootstrap.cc:492] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:33.413919 1960 raft_consensus.cc:2749] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.414861 1172 tablet_bootstrap.cc:654] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.415247 1173 tablet_bootstrap.cc:654] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:33.415748 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 75ca99ca24f14cd48f29e49168ebca3f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75ca99ca24f14cd48f29e49168ebca3f already in progress: creating tablet
I20260318 02:51:33.418907 1874 raft_consensus.cc:493] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.419063 1874 raft_consensus.cc:515] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.419687 1874 leader_election.cc:290] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:33.421095 1184 ts_tablet_manager.cc:1929] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.421267 1184 log.cc:1199] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/3e38dec0d2e9417e8571e202036e7117
I20260318 02:51:33.421622 1184 ts_tablet_manager.cc:1950] T 3e38dec0d2e9417e8571e202036e7117 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:33.424364 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c19bc5e07949088c84cedbf944dfdb" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:33.424585 785 raft_consensus.cc:2468] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:33.425280 999 leader_election.cc:304] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:33.426235 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 703) took 1448 ms. Trace:
I20260318 02:51:33.426633 1184 rpcz_store.cc:276] 0318 02:51:31.978001 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:31.978043 (+ 42us) service_pool.cc:225] Handling call
0318 02:51:33.381607 (+1403564us) ts_tablet_manager.cc:1151] Deleting tablet 3e38dec0d2e9417e8571e202036e7117
0318 02:51:33.381619 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.397066 (+ 15447us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.420977 (+ 23911us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.426215 (+ 5238us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1403401}
I20260318 02:51:33.427752 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 704) took 1407 ms. Trace:
I20260318 02:51:33.427886 1184 rpcz_store.cc:276] 0318 02:51:32.019994 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.024985 (+ 4991us) service_pool.cc:225] Handling call
0318 02:51:33.427609 (+1402624us) ts_tablet_manager.cc:1151] Deleting tablet e867dcd3ff3e4eb7b923305a037c5a79
0318 02:51:33.427622 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.427734 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1398252}
I20260318 02:51:33.428295 1184 tablet_replica.cc:333] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:33.429611 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c19bc5e07949088c84cedbf944dfdb" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:33.430112 1184 raft_consensus.cc:2243] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.430323 1184 raft_consensus.cc:2272] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.430306 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 3e38dec0d2e9417e8571e202036e7117 (table default.Table_f6484117e54a4f2298a8d7365770c153 [id=c06168b4ee024f728f2f11a4cc39fc4e]) successfully deleted
W20260318 02:51:33.430588 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet e867dcd3ff3e4eb7b923305a037c5a79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e867dcd3ff3e4eb7b923305a037c5a79 already in progress: creating tablet
W20260318 02:51:33.430932 997 leader_election.cc:343] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.431036 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 703) took 1250 ms. Trace:
I20260318 02:51:33.431129 1175 rpcz_store.cc:276] 0318 02:51:32.181087 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.181148 (+ 61us) service_pool.cc:225] Handling call
0318 02:51:33.414485 (+1233337us) ts_tablet_manager.cc:1151] Deleting tablet 4e54f71cd47a4738b0f640382edee907
0318 02:51:33.430888 (+ 16403us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.431010 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1233113}
I20260318 02:51:33.431522 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 705) took 1078 ms. Trace:
I20260318 02:51:33.431599 1175 rpcz_store.cc:276] 0318 02:51:32.353090 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.354163 (+ 1073us) service_pool.cc:225] Handling call
0318 02:51:33.431392 (+1077229us) ts_tablet_manager.cc:1151] Deleting tablet cdafabcad8a64c2094a3e55ea52178bd
0318 02:51:33.431403 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.431486 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1076934}
W20260318 02:51:33.431676 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 4e54f71cd47a4738b0f640382edee907 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e54f71cd47a4738b0f640382edee907 already in progress: creating tablet
I20260318 02:51:33.431875 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 706) took 1070 ms. Trace:
I20260318 02:51:33.431938 1175 rpcz_store.cc:276] 0318 02:51:32.361329 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.361881 (+ 552us) service_pool.cc:225] Handling call
0318 02:51:33.431783 (+1069902us) ts_tablet_manager.cc:1151] Deleting tablet 15b052ebecbe4652b1a337d18712011f
0318 02:51:33.431791 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.431864 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1069652}
I20260318 02:51:33.432184 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 708) took 1033 ms. Trace:
I20260318 02:51:33.432250 1874 raft_consensus.cc:2804] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:33.432248 1175 rpcz_store.cc:276] 0318 02:51:32.398322 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.398938 (+ 616us) service_pool.cc:225] Handling call
0318 02:51:33.432105 (+1033167us) ts_tablet_manager.cc:1151] Deleting tablet 64c2a579264e43b9a1e25ded000d4d9f
0318 02:51:33.432111 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.432171 (+ 60us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1032836}
I20260318 02:51:33.432320 1874 raft_consensus.cc:493] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:33.432377 1874 raft_consensus.cc:3060] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:33.432467 1175 tablet_replica.cc:333] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:33.432641 1175 raft_consensus.cc:2243] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.432823 1175 raft_consensus.cc:2272] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.433395 1175 ts_tablet_manager.cc:1916] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.430944 1184 ts_tablet_manager.cc:1916] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.437398 1874 raft_consensus.cc:515] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.437743 1174 ts_tablet_manager.cc:1434] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.048s user 0.002s sys 0.000s
I20260318 02:51:33.438131 1174 tablet_bootstrap.cc:492] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:33.439589 1960 consensus_queue.cc:1048] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:33.441067 1174 tablet_bootstrap.cc:654] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.444060 1175 ts_tablet_manager.cc:1929] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.444200 1175 log.cc:1199] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/af793623466249e695b262ab451d4dc9
W20260318 02:51:33.444770 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet cdafabcad8a64c2094a3e55ea52178bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cdafabcad8a64c2094a3e55ea52178bd already in progress: creating tablet
I20260318 02:51:33.444909 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_40a4f002cc3e4375a317fa86d31c975f" } new_table_name: "default.Table_09ec6b975c384c24bc5e3e6dbe92caa6" modify_external_catalogs: true
W20260318 02:51:33.445071 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 15b052ebecbe4652b1a337d18712011f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15b052ebecbe4652b1a337d18712011f already in progress: creating tablet
W20260318 02:51:33.445271 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 64c2a579264e43b9a1e25ded000d4d9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64c2a579264e43b9a1e25ded000d4d9f already in progress: creating tablet
I20260318 02:51:33.451316 450 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 3fccf1f2bc3547e9ba8cc5fe9419f70b (table default.Table_3406e803538541a5b564a3ae03dfedd6 [id=f282f0ee83114539bad2c36e8311e05e]). Expected version 1 got 0
I20260318 02:51:33.454053 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c19bc5e07949088c84cedbf944dfdb" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:33.454269 784 raft_consensus.cc:3060] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:33.457928 784 raft_consensus.cc:2468] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:33.457798 448 catalog_manager.cc:5671] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:33.458261 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 1516525b471540288c6cb5d61120d430 (table default.Table_4e770bc308894d9094b88315d9093ba5 [id=433e7aa77412424ebb38784bb073d1fb]). Expected version 6 got 0
I20260318 02:51:33.458642 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 8c20810ad3354126bf49bbeeb6edb098 (table default.Table_4775eaa0e7e84642aa0a8f8b2885610e [id=463a6721eb0d43d09deeb283d1cc4233]). Expected version 1 got 0
I20260318 02:51:33.460968 766 tablet_service.cc:1511] Processing CreateTablet for tablet 47069b65872d4a3ab33771eba3da781e (DEFAULT_TABLE table=default.Table_d2abf77a628943db8e72558732f7c73c [id=92a51e4e1c5149158052545d909fac6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.461089 759 tablet_service.cc:1511] Processing CreateTablet for tablet 729c3c55ca184de1abac46e0140830f2 (DEFAULT_TABLE table=default.Table_925458fc4c6f4a8b8e07a345204dabf3 [id=46533c11f06143f2a72169b756062f2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.461123 752 tablet_service.cc:1511] Processing CreateTablet for tablet fe5e322cda974cd9997fb77a8e3279cf (DEFAULT_TABLE table=default.Table_ede8be1193444907a6bd408586d75882 [id=3ccb309d777e47548e729ebae17b9f08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.461412 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47069b65872d4a3ab33771eba3da781e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.461580 748 tablet_service.cc:1511] Processing CreateTablet for tablet c58d9d141c364802a3f597b5925f4806 (DEFAULT_TABLE table=default.Table_55141c44691c4ea0a2b3df6a456db916 [id=bc2a8506edf64b678e2d5e77ea52faf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.464048 761 tablet_service.cc:1511] Processing CreateTablet for tablet 6717c5dd460c45b78258e33773f92a9f (DEFAULT_TABLE table=default.Table_6003288b595443658b3deb596c5f9c48 [id=fecdcfcebc864cfcbeaf9d5f2fc51e9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.461413 750 tablet_service.cc:1511] Processing CreateTablet for tablet 5432a4de98274d4aaf13019c81069081 (DEFAULT_TABLE table=default.Table_289825d07f72420781509902b8843ead [id=89a4c4b5c9c9424db59ed0273a255863]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.465238 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5e322cda974cd9997fb77a8e3279cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.448628 1184 ts_tablet_manager.cc:1929] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.465396 756 tablet_service.cc:1511] Processing CreateTablet for tablet e5641e430b0a4ddf9e1111f834246755 (DEFAULT_TABLE table=default.Table_9972d91768fa4b3c9bc308d6a07475e2 [id=c36baa3e86984fc19975c1bb8455443f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.465448 1184 log.cc:1199] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/547762347d7843e989e55e0449ad9fcb
I20260318 02:51:33.465737 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5641e430b0a4ddf9e1111f834246755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.465770 1184 ts_tablet_manager.cc:1950] T 547762347d7843e989e55e0449ad9fcb P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:33.458581 999 leader_election.cc:304] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:33.466547 1960 raft_consensus.cc:2804] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:33.466681 1960 raft_consensus.cc:697] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:33.466910 1960 consensus_queue.cc:237] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.468976 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c58d9d141c364802a3f597b5925f4806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.469584 1915 raft_consensus.cc:493] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.469718 1915 raft_consensus.cc:515] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.470315 1915 leader_election.cc:290] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:33.470504 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 710) took 1372 ms. Trace:
I20260318 02:51:33.470580 1184 rpcz_store.cc:276] 0318 02:51:32.098490 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.102473 (+ 3983us) service_pool.cc:225] Handling call
0318 02:51:33.428252 (+1325779us) ts_tablet_manager.cc:1151] Deleting tablet 547762347d7843e989e55e0449ad9fcb
0318 02:51:33.428260 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.444028 (+ 15768us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.448507 (+ 4479us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.470483 (+ 21976us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1325508}
I20260318 02:51:33.471022 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 713) took 1302 ms. Trace:
I20260318 02:51:33.470996 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305cc777ed0c46e497c80f15b8e6ead1" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:33.471084 1184 rpcz_store.cc:276] 0318 02:51:32.168595 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.168672 (+ 77us) service_pool.cc:225] Handling call
0318 02:51:33.470886 (+1302214us) ts_tablet_manager.cc:1151] Deleting tablet 75ca99ca24f14cd48f29e49168ebca3f
0318 02:51:33.470903 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.471006 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1301993}
I20260318 02:51:33.471335 1184 tablet_replica.cc:333] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:33.471509 1184 raft_consensus.cc:2243] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:33.471513 719 leader_election.cc:343] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.471647 1184 raft_consensus.cc:2272] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.472146 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305cc777ed0c46e497c80f15b8e6ead1" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:33.472618 719 leader_election.cc:343] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.472755 719 leader_election.cc:304] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.472927 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6717c5dd460c45b78258e33773f92a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.473131 1915 raft_consensus.cc:2749] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.476846 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5432a4de98274d4aaf13019c81069081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.477857 1874 leader_election.cc:290] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:33.478353 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5c19bc5e07949088c84cedbf944dfdb" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:33.478479 903 tablet_service.cc:1511] Processing CreateTablet for tablet 729c3c55ca184de1abac46e0140830f2 (DEFAULT_TABLE table=default.Table_925458fc4c6f4a8b8e07a345204dabf3 [id=46533c11f06143f2a72169b756062f2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.478875 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729c3c55ca184de1abac46e0140830f2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:33.479002 997 leader_election.cc:343] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.480927 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729c3c55ca184de1abac46e0140830f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.485502 903 tablet_service.cc:1511] Processing CreateTablet for tablet 47069b65872d4a3ab33771eba3da781e (DEFAULT_TABLE table=default.Table_d2abf77a628943db8e72558732f7c73c [id=92a51e4e1c5149158052545d909fac6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.485896 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47069b65872d4a3ab33771eba3da781e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.485935 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 729c3c55ca184de1abac46e0140830f2 (DEFAULT_TABLE table=default.Table_925458fc4c6f4a8b8e07a345204dabf3 [id=46533c11f06143f2a72169b756062f2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.486289 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729c3c55ca184de1abac46e0140830f2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:33.486802 997 consensus_peers.cc:597] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:33.487836 1184 ts_tablet_manager.cc:1916] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.489105 1874 raft_consensus.cc:493] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.489336 1874 raft_consensus.cc:515] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:33.490729 999 leader_election.cc:343] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 4fa6bf38381740a1bab1088ede6ede1c
I20260318 02:51:33.491518 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa6bf38381740a1bab1088ede6ede1c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:33.492244 997 leader_election.cc:343] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.492370 997 leader_election.cc:304] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.492450 897 tablet_service.cc:1511] Processing CreateTablet for tablet 5432a4de98274d4aaf13019c81069081 (DEFAULT_TABLE table=default.Table_289825d07f72420781509902b8843ead [id=89a4c4b5c9c9424db59ed0273a255863]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.492430 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 47069b65872d4a3ab33771eba3da781e (DEFAULT_TABLE table=default.Table_d2abf77a628943db8e72558732f7c73c [id=92a51e4e1c5149158052545d909fac6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.492590 1947 raft_consensus.cc:2749] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.492815 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47069b65872d4a3ab33771eba3da781e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.492816 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5432a4de98274d4aaf13019c81069081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.493296 1874 leader_election.cc:290] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:33.499814 900 tablet_service.cc:1511] Processing CreateTablet for tablet c58d9d141c364802a3f597b5925f4806 (DEFAULT_TABLE table=default.Table_55141c44691c4ea0a2b3df6a456db916 [id=bc2a8506edf64b678e2d5e77ea52faf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.499840 1033 tablet_service.cc:1511] Processing CreateTablet for tablet fe5e322cda974cd9997fb77a8e3279cf (DEFAULT_TABLE table=default.Table_ede8be1193444907a6bd408586d75882 [id=3ccb309d777e47548e729ebae17b9f08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.500219 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5e322cda974cd9997fb77a8e3279cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.500219 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c58d9d141c364802a3f597b5925f4806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.504873 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 5432a4de98274d4aaf13019c81069081 (DEFAULT_TABLE table=default.Table_289825d07f72420781509902b8843ead [id=89a4c4b5c9c9424db59ed0273a255863]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.505313 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5432a4de98274d4aaf13019c81069081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.507361 897 tablet_service.cc:1511] Processing CreateTablet for tablet fe5e322cda974cd9997fb77a8e3279cf (DEFAULT_TABLE table=default.Table_ede8be1193444907a6bd408586d75882 [id=3ccb309d777e47548e729ebae17b9f08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.507802 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5e322cda974cd9997fb77a8e3279cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.513856 900 tablet_service.cc:1511] Processing CreateTablet for tablet 6717c5dd460c45b78258e33773f92a9f (DEFAULT_TABLE table=default.Table_6003288b595443658b3deb596c5f9c48 [id=fecdcfcebc864cfcbeaf9d5f2fc51e9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.514317 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6717c5dd460c45b78258e33773f92a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.515156 1172 tablet_bootstrap.cc:492] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:33.515288 1172 ts_tablet_manager.cc:1403] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.103s user 0.008s sys 0.003s
W20260318 02:51:33.515739 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c93e05eb5c9e4d5da1b688a03312ad8e consensus state has no leader
I20260318 02:51:33.515759 1184 ts_tablet_manager.cc:1929] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.515864 1184 log.cc:1199] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/4fa7c1d6879c40ebb8d989ebae205e9e
I20260318 02:51:33.516001 1172 raft_consensus.cc:359] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.516121 1184 ts_tablet_manager.cc:1950] T 4fa7c1d6879c40ebb8d989ebae205e9e P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:33.516148 1172 raft_consensus.cc:385] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260318 02:51:33.516165 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7dbcee4d14064cbdbcf7641cfc1c58d4 consensus state has no leader
I20260318 02:51:33.516193 1172 raft_consensus.cc:740] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.516849 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 714) took 1347 ms. Trace:
I20260318 02:51:33.522032 891 tablet_service.cc:1511] Processing CreateTablet for tablet e5641e430b0a4ddf9e1111f834246755 (DEFAULT_TABLE table=default.Table_9972d91768fa4b3c9bc308d6a07475e2 [id=c36baa3e86984fc19975c1bb8455443f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.522642 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5641e430b0a4ddf9e1111f834246755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.530041 1173 tablet_bootstrap.cc:492] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:33.530267 1173 ts_tablet_manager.cc:1403] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.172s user 0.003s sys 0.008s
I20260318 02:51:33.532979 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 6a0c53d87ad84eebaa11f5b44dd7c0b5
I20260318 02:51:33.534587 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 5fec974d146f44aeb72df483fa85b287
I20260318 02:51:33.535732 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet cb79f266cdfd498babbc5d1313ef0b72
I20260318 02:51:33.517505 1172 consensus_queue.cc:260] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.537123 1184 rpcz_store.cc:276] 0318 02:51:32.169544 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.169597 (+ 53us) service_pool.cc:225] Handling call
0318 02:51:33.471294 (+1301697us) ts_tablet_manager.cc:1151] Deleting tablet 4fa7c1d6879c40ebb8d989ebae205e9e
0318 02:51:33.471302 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.490620 (+ 19318us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.515658 (+ 25038us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.516817 (+ 1159us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1301531}
I20260318 02:51:33.538636 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 21e6e89e5a0a4d1bb952e74be1b7e551
I20260318 02:51:33.540079 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 21e6e89e5a0a4d1bb952e74be1b7e551 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.540980 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fec974d146f44aeb72df483fa85b287 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:33.541563 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 21e6e89e5a0a4d1bb952e74be1b7e551 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21e6e89e5a0a4d1bb952e74be1b7e551 already in progress: creating tablet
I20260318 02:51:33.541878 748 tablet_service.cc:1558] Processing DeleteTablet for tablet cb79f266cdfd498babbc5d1313ef0b72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.542553 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a0c53d87ad84eebaa11f5b44dd7c0b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.542848 1176 tablet_replica.cc:333] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:33.543038 1176 raft_consensus.cc:2243] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.543182 1176 raft_consensus.cc:2272] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.543725 1176 ts_tablet_manager.cc:1916] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.545658 1173 raft_consensus.cc:359] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.545825 1173 raft_consensus.cc:385] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.545879 1173 raft_consensus.cc:740] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.546249 1175 ts_tablet_manager.cc:1950] T af793623466249e695b262ab451d4dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:33.546576 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 710) took 1075 ms. Trace:
I20260318 02:51:33.546650 1175 rpcz_store.cc:276] 0318 02:51:32.470894 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.470980 (+ 86us) service_pool.cc:225] Handling call
0318 02:51:33.432422 (+961442us) ts_tablet_manager.cc:1151] Deleting tablet af793623466249e695b262ab451d4dc9
0318 02:51:33.432430 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.436682 (+ 4252us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.443928 (+ 7246us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.546556 (+102628us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":957716}
I20260318 02:51:33.547209 1173 consensus_queue.cc:260] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.547631 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 547762347d7843e989e55e0449ad9fcb (table default.Table_6d3695295b794364b4cdc7849155a559 [id=71965e8878d84c45a022d4438ea04e0e]) successfully deleted
W20260318 02:51:33.547904 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 75ca99ca24f14cd48f29e49168ebca3f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75ca99ca24f14cd48f29e49168ebca3f already in progress: creating tablet
I20260318 02:51:33.548590 452 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 99e807c8ff5e457fb6c97c6d1b277eab (table default.Table_fd8edd9c8882403f8541f00d0728e3b7 [id=568e88222ca648ce88ee962e91a84588]). Expected version 1 got 0
I20260318 02:51:33.550809 1176 ts_tablet_manager.cc:1929] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.550915 1176 log.cc:1199] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/5fec974d146f44aeb72df483fa85b287
I20260318 02:51:33.551174 1176 ts_tablet_manager.cc:1950] T 5fec974d146f44aeb72df483fa85b287 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:33.552671 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 5fec974d146f44aeb72df483fa85b287 (table default.Table_167a79354e7844aabe2ae725df4f536c [id=095e4b55b1544007a032a984ba934743]) successfully deleted
I20260318 02:51:33.553050 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_bf3af9d6919949a6a752d58fd7782bc0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:33.553630 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf3af9d6919949a6a752d58fd7782bc0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.556767 456 master_service.cc:954] ReplaceTablet: received request to replace tablet d4332d4afb164b35bee3b0146e26b4e1 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:33.558701 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_fb4d36f8e2cf4fab8b4e072b67797e98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:33.558887 455 master_service.cc:954] ReplaceTablet: received request to replace tablet 565add8c21f343f2b11c12a9bb7ff111 from {username='slave'} at 127.0.0.1:47158
W20260318 02:51:33.559381 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb4d36f8e2cf4fab8b4e072b67797e98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.562366 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d3f9c221caf74f098016962ca5ae047e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:33.537431 1172 ts_tablet_manager.cc:1434] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
W20260318 02:51:33.562906 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3f9c221caf74f098016962ca5ae047e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.563053 1172 tablet_bootstrap.cc:492] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:33.563134 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 712) took 1395 ms. Trace:
I20260318 02:51:33.563154 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a0c53d87ad84eebaa11f5b44dd7c0b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.563197 1184 rpcz_store.cc:276] 0318 02:51:32.168137 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.168192 (+ 55us) service_pool.cc:225] Handling call
0318 02:51:33.563012 (+1394820us) ts_tablet_manager.cc:1151] Deleting tablet 1ac9581312964ad6afcc96f798fa534a
0318 02:51:33.563021 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.563120 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1392117}
I20260318 02:51:33.564023 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fec974d146f44aeb72df483fa85b287 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.564363 1174 tablet_bootstrap.cc:492] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:33.564555 1174 ts_tablet_manager.cc:1403] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.127s user 0.007s sys 0.005s
I20260318 02:51:33.564687 1172 tablet_bootstrap.cc:654] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.565181 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fec974d146f44aeb72df483fa85b287 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.543000 1874 raft_consensus.cc:493] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.565531 1874 raft_consensus.cc:515] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.565907 1174 raft_consensus.cc:359] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.566053 1174 raft_consensus.cc:385] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.566100 1174 raft_consensus.cc:740] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.566110 1874 leader_election.cc:290] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:33.548238 1959 raft_consensus.cc:493] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.566311 1174 consensus_queue.cc:260] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.566385 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet cb79f266cdfd498babbc5d1313ef0b72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.566473 1959 raft_consensus.cc:515] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.566964 1959 leader_election.cc:290] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:33.565830 903 tablet_service.cc:1558] Processing DeleteTablet for tablet cb79f266cdfd498babbc5d1313ef0b72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.567083 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb352bce9cc4e8aa899d691954d28d2" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:33.568063 452 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_268e9858449d471ca088f8b1f2492fe6 [id=58354360683d422dbdcc43826b39dbc8] alter complete (version 4)
W20260318 02:51:33.568442 997 leader_election.cc:343] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.567771 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abfdba1f21e44652b2bce62cd3e6681f" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:33.569589 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 421e5223d6af4da1a8e07534f942d016 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:33.569945 997 leader_election.cc:343] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:33.570305 999 leader_election.cc:343] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: abfdba1f21e44652b2bce62cd3e6681f
I20260318 02:51:33.570392 999 leader_election.cc:304] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:33.570739 999 leader_election.cc:343] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: bfb352bce9cc4e8aa899d691954d28d2
I20260318 02:51:33.570817 999 leader_election.cc:304] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.571508 1959 raft_consensus.cc:2749] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.571661 1959 raft_consensus.cc:2749] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.572957 1173 ts_tablet_manager.cc:1434] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.042s user 0.001s sys 0.001s
I20260318 02:51:33.553293 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 6717c5dd460c45b78258e33773f92a9f (DEFAULT_TABLE table=default.Table_6003288b595443658b3deb596c5f9c48 [id=fecdcfcebc864cfcbeaf9d5f2fc51e9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.573468 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a0c53d87ad84eebaa11f5b44dd7c0b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.573081 1175 tablet_replica.cc:333] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:33.553589 1027 tablet_service.cc:1511] Processing CreateTablet for tablet c58d9d141c364802a3f597b5925f4806 (DEFAULT_TABLE table=default.Table_55141c44691c4ea0a2b3df6a456db916 [id=bc2a8506edf64b678e2d5e77ea52faf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.573468 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet f9bc73d3f85745ecb62d861b6375a987 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.573721 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6717c5dd460c45b78258e33773f92a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.573901 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c58d9d141c364802a3f597b5925f4806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.573935 1175 raft_consensus.cc:2243] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.574164 1175 raft_consensus.cc:2272] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.574623 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet f5a829abed0444b79c48ab080d024824 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.576516 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 29541950221544e396ada303fbbb5002 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.553905 1032 tablet_service.cc:1511] Processing CreateTablet for tablet e5641e430b0a4ddf9e1111f834246755 (DEFAULT_TABLE table=default.Table_9972d91768fa4b3c9bc308d6a07475e2 [id=c36baa3e86984fc19975c1bb8455443f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.576965 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5641e430b0a4ddf9e1111f834246755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.579377 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 7883f526d06e442c81f1b66fd89d2cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.577069 1173 tablet_bootstrap.cc:492] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:33.580031 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet abfdba1f21e44652b2bce62cd3e6681f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.580547 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 21e6e89e5a0a4d1bb952e74be1b7e551 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.581319 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 21e6e89e5a0a4d1bb952e74be1b7e551 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.575980 1175 ts_tablet_manager.cc:1916] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.583073 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet af793623466249e695b262ab451d4dc9 (table default.Table_9c0322ee5c694253958b5d9583c3708e [id=34553220f38c4ffd99cf61e1679bdb81]) successfully deleted
I20260318 02:51:33.583815 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a6d1808417419dac0d2b2e80c5ca22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.584183 903 tablet_service.cc:1558] Processing DeleteTablet for tablet d1a884fde2c145518a2cb14b7780b6dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.584226 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 305cc777ed0c46e497c80f15b8e6ead1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.584506 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ef3181adc0542229897369591a30465 with delete_type TABLET_DATA_DELETED (replaced by tablet defda79dd0f34c37ae16ea808df0754b) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.584601 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 4fa7c1d6879c40ebb8d989ebae205e9e (table default.Table_d6ad068d690949058bd4fdeea68e31a3 [id=3557006319a041e69cf884ccd2ddd5dc]) successfully deleted
W20260318 02:51:33.584893 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 1ac9581312964ad6afcc96f798fa534a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ac9581312964ad6afcc96f798fa534a already in progress: creating tablet
I20260318 02:51:33.586081 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet d4332d4afb164b35bee3b0146e26b4e1
I20260318 02:51:33.586583 456 catalog_manager.cc:6741] ReplaceTablet: tablet d4332d4afb164b35bee3b0146e26b4e1 deleted and replaced by tablet 243a2f81711f4712ab21c8ae5bdc94a8
I20260318 02:51:33.586977 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 565add8c21f343f2b11c12a9bb7ff111
I20260318 02:51:33.587359 455 catalog_manager.cc:6741] ReplaceTablet: tablet 565add8c21f343f2b11c12a9bb7ff111 deleted and replaced by tablet 036c17d033b145a681843d14f67ab575
I20260318 02:51:33.587639 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5fac7eb852e84aa79c9d10337fe7e610" } new_table_name: "default.Table_85adec1c70d14a57bfcf04d35aaeb2ee" modify_external_catalogs: true
I20260318 02:51:33.589010 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6800c6f047d6426daca032c1a2866084"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:33.589510 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6800c6f047d6426daca032c1a2866084 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.590373 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9724bed50bdb463db42189c0d44f43a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:33.590899 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9724bed50bdb463db42189c0d44f43a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.591117 1172 tablet_bootstrap.cc:492] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:33.591435 1172 ts_tablet_manager.cc:1403] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.003s
I20260318 02:51:33.592674 1172 raft_consensus.cc:359] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.592867 1172 raft_consensus.cc:385] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.592914 1172 raft_consensus.cc:740] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.593117 1172 consensus_queue.cc:260] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.593210 1173 tablet_bootstrap.cc:654] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.593734 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 565add8c21f343f2b11c12a9bb7ff111 with delete_type TABLET_DATA_DELETED (replaced by tablet 036c17d033b145a681843d14f67ab575) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.593894 1172 ts_tablet_manager.cc:1434] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:33.594240 761 tablet_service.cc:1558] Processing DeleteTablet for tablet d4332d4afb164b35bee3b0146e26b4e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 243a2f81711f4712ab21c8ae5bdc94a8) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.594494 759 tablet_service.cc:1558] Processing DeleteTablet for tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.594975 1172 tablet_bootstrap.cc:492] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:33.594965 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 785f6728f94d41f3997961e3d1ebee34 with delete_type TABLET_DATA_DELETED (replaced by tablet ca4e1eec9a2148488295416cd68ca607) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.595227 750 tablet_service.cc:1558] Processing DeleteTablet for tablet b8a46b4db30a48c99addf763f7edfb16 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e9a5b965cb141e1a5dd1c96f590ad5a) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.595419 903 tablet_service.cc:1558] Processing DeleteTablet for tablet d4332d4afb164b35bee3b0146e26b4e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 243a2f81711f4712ab21c8ae5bdc94a8) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.596007 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet d4332d4afb164b35bee3b0146e26b4e1 with delete_type TABLET_DATA_DELETED (replaced by tablet 243a2f81711f4712ab21c8ae5bdc94a8) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.596988 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 565add8c21f343f2b11c12a9bb7ff111 with delete_type TABLET_DATA_DELETED (replaced by tablet 036c17d033b145a681843d14f67ab575) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.597031 1172 tablet_bootstrap.cc:654] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.597899 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 565add8c21f343f2b11c12a9bb7ff111 with delete_type TABLET_DATA_DELETED (replaced by tablet 036c17d033b145a681843d14f67ab575) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.600122 761 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce282f91c2f44b59c0b6ea836ad5d0e (DEFAULT_TABLE table=default.Table_c662869530134cb08ab6cc52957d07d9 [id=fda071b90fe64716b46fd1ab46f4b934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.600555 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce282f91c2f44b59c0b6ea836ad5d0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.601066 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cdd554113bf4a7092da876365a89456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.601606 1174 ts_tablet_manager.cc:1434] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.037s user 0.001s sys 0.000s
I20260318 02:51:33.603708 903 tablet_service.cc:1511] Processing CreateTablet for tablet 6a0c53d87ad84eebaa11f5b44dd7c0b5 (DEFAULT_TABLE table=default.Table_5d3c36baac1f40b8a09948ec623482fa [id=8a85cd7bc9864d26999af5501448009f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.604142 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a0c53d87ad84eebaa11f5b44dd7c0b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.605069 759 tablet_service.cc:1511] Processing CreateTablet for tablet d72b431f1fdc43f8a4c8925745a0a7ae (DEFAULT_TABLE table=default.Table_124aa7be83924c4493ebb650dcb06219 [id=6c8f408e2f85427cb5bda8aacfb94dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.605484 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72b431f1fdc43f8a4c8925745a0a7ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.606191 1915 raft_consensus.cc:493] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.606359 1915 raft_consensus.cc:515] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.606966 1915 leader_election.cc:290] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:33.607089 1915 raft_consensus.cc:493] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.607204 1915 raft_consensus.cc:515] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.607722 1915 leader_election.cc:290] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:33.607710 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a46b4db30a48c99addf763f7edfb16" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:33.607964 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a46b4db30a48c99addf763f7edfb16" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:33.608542 719 leader_election.cc:343] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:33.608748 719 leader_election.cc:343] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.608819 719 leader_election.cc:304] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.609189 748 tablet_service.cc:1511] Processing CreateTablet for tablet fca751e8fa5e4098b33093766e80d933 (DEFAULT_TABLE table=default.Table_1ac62abf756c4328933c7bf6db14a7f2 [id=b768a791f93e45d0990825b83815e250]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.609544 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca751e8fa5e4098b33093766e80d933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.609522 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a6d1808417419dac0d2b2e80c5ca22" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:33.610204 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a6d1808417419dac0d2b2e80c5ca22" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:33.611301 719 leader_election.cc:343] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:33.611490 719 leader_election.cc:343] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.611553 719 leader_election.cc:304] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.611747 2010 raft_consensus.cc:2749] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.611896 2010 raft_consensus.cc:2749] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.611979 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b4f218d2fea54a31be80372e05eaa6ae" } new_table_name: "default.Table_713e6cda2b4749cd8bdb238845c39be0" modify_external_catalogs: true
I20260318 02:51:33.613626 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 6a0c53d87ad84eebaa11f5b44dd7c0b5 (DEFAULT_TABLE table=default.Table_5d3c36baac1f40b8a09948ec623482fa [id=8a85cd7bc9864d26999af5501448009f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.613868 900 tablet_service.cc:1511] Processing CreateTablet for tablet fca751e8fa5e4098b33093766e80d933 (DEFAULT_TABLE table=default.Table_1ac62abf756c4328933c7bf6db14a7f2 [id=b768a791f93e45d0990825b83815e250]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.614180 1174 tablet_bootstrap.cc:492] T ed697b98352c4f65931c154b1f160991 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:33.614233 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca751e8fa5e4098b33093766e80d933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.614130 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a0c53d87ad84eebaa11f5b44dd7c0b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.614845 750 tablet_service.cc:1511] Processing CreateTablet for tablet 6a0c53d87ad84eebaa11f5b44dd7c0b5 (DEFAULT_TABLE table=default.Table_5d3c36baac1f40b8a09948ec623482fa [id=8a85cd7bc9864d26999af5501448009f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.615216 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a0c53d87ad84eebaa11f5b44dd7c0b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.616007 1174 tablet_bootstrap.cc:654] T ed697b98352c4f65931c154b1f160991 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.617282 1040 tablet_service.cc:1511] Processing CreateTablet for tablet fca751e8fa5e4098b33093766e80d933 (DEFAULT_TABLE table=default.Table_1ac62abf756c4328933c7bf6db14a7f2 [id=b768a791f93e45d0990825b83815e250]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.618077 897 tablet_service.cc:1511] Processing CreateTablet for tablet d72b431f1fdc43f8a4c8925745a0a7ae (DEFAULT_TABLE table=default.Table_124aa7be83924c4493ebb650dcb06219 [id=6c8f408e2f85427cb5bda8aacfb94dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.618462 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72b431f1fdc43f8a4c8925745a0a7ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.628835 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca751e8fa5e4098b33093766e80d933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.628976 1874 raft_consensus.cc:493] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.629122 1874 raft_consensus.cc:515] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.629734 1874 leader_election.cc:290] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:33.630806 999 leader_election.cc:343] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 7883f526d06e442c81f1b66fd89d2cd0
I20260318 02:51:33.631449 1176 tablet_replica.cc:333] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:33.633577 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7883f526d06e442c81f1b66fd89d2cd0" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:33.634042 997 consensus_peers.cc:597] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260318 02:51:33.634222 997 leader_election.cc:343] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.634317 997 leader_election.cc:304] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.634521 1874 raft_consensus.cc:2749] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.637473 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 715) took 1428 ms. Trace:
I20260318 02:51:33.637574 1184 rpcz_store.cc:276] 0318 02:51:32.208585 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.208635 (+ 50us) service_pool.cc:225] Handling call
0318 02:51:33.617440 (+1408805us) ts_tablet_manager.cc:1151] Deleting tablet 4e54f71cd47a4738b0f640382edee907
0318 02:51:33.628563 (+ 11123us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.637458 (+ 8895us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1792,"tablet-delete.queue_time_us":1407951}
I20260318 02:51:33.638124 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 718) took 1283 ms. Trace:
I20260318 02:51:33.638206 1184 rpcz_store.cc:276] 0318 02:51:32.354653 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.356474 (+ 1821us) service_pool.cc:225] Handling call
0318 02:51:33.638020 (+1281546us) ts_tablet_manager.cc:1151] Deleting tablet cdafabcad8a64c2094a3e55ea52178bd
0318 02:51:33.638030 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.638109 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1280840}
I20260318 02:51:33.638581 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 720) took 1145 ms. Trace:
I20260318 02:51:33.638659 1184 rpcz_store.cc:276] 0318 02:51:32.493186 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.493261 (+ 75us) service_pool.cc:225] Handling call
0318 02:51:33.638492 (+1145231us) ts_tablet_manager.cc:1151] Deleting tablet 64c2a579264e43b9a1e25ded000d4d9f
0318 02:51:33.638501 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.638568 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1145012}
I20260318 02:51:33.639132 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 719) took 1146 ms. Trace:
I20260318 02:51:33.639205 1184 rpcz_store.cc:276] 0318 02:51:32.493065 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.493846 (+ 781us) service_pool.cc:225] Handling call
0318 02:51:33.639041 (+1145195us) ts_tablet_manager.cc:1151] Deleting tablet 15b052ebecbe4652b1a337d18712011f
0318 02:51:33.639050 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.639118 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1145017}
I20260318 02:51:33.639557 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 721) took 1132 ms. Trace:
I20260318 02:51:33.639628 1184 rpcz_store.cc:276] 0318 02:51:32.507144 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.507202 (+ 58us) service_pool.cc:225] Handling call
0318 02:51:33.639476 (+1132274us) ts_tablet_manager.cc:1151] Deleting tablet 76109acb76424b1f96ede9ab1f018e5e
0318 02:51:33.639484 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.639546 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1132085}
I20260318 02:51:33.639945 1184 tablet_replica.cc:333] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:33.640123 1184 raft_consensus.cc:2243] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:33.640420 1184 raft_consensus.cc:2272] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.640991 1184 ts_tablet_manager.cc:1916] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.644014 1175 ts_tablet_manager.cc:1929] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.644133 1175 log.cc:1199] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/95f15079d1df4314b6dd5c7afd896af5
I20260318 02:51:33.644389 1175 ts_tablet_manager.cc:1950] T 95f15079d1df4314b6dd5c7afd896af5 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:33.646018 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce282f91c2f44b59c0b6ea836ad5d0e (DEFAULT_TABLE table=default.Table_c662869530134cb08ab6cc52957d07d9 [id=fda071b90fe64716b46fd1ab46f4b934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.646464 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce282f91c2f44b59c0b6ea836ad5d0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.649013 1030 tablet_service.cc:1511] Processing CreateTablet for tablet d72b431f1fdc43f8a4c8925745a0a7ae (DEFAULT_TABLE table=default.Table_124aa7be83924c4493ebb650dcb06219 [id=6c8f408e2f85427cb5bda8aacfb94dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.649463 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d72b431f1fdc43f8a4c8925745a0a7ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.649901 2010 raft_consensus.cc:493] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.650050 2010 raft_consensus.cc:515] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.650681 2010 leader_election.cc:290] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:33.651585 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fccf1f2bc3547e9ba8cc5fe9419f70b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:33.651607 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fccf1f2bc3547e9ba8cc5fe9419f70b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:33.652220 719 leader_election.cc:343] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:33.652678 719 leader_election.cc:343] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.652793 719 leader_election.cc:304] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.653334 2010 raft_consensus.cc:2749] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.656549 897 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce282f91c2f44b59c0b6ea836ad5d0e (DEFAULT_TABLE table=default.Table_c662869530134cb08ab6cc52957d07d9 [id=fda071b90fe64716b46fd1ab46f4b934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.657045 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce282f91c2f44b59c0b6ea836ad5d0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.631635 1176 raft_consensus.cc:2243] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.660977 1176 raft_consensus.cc:2272] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.661604 900 tablet_service.cc:1511] Processing CreateTablet for tablet e85d612871014dc2bd9139adcbe639d2 (DEFAULT_TABLE table=default.Table_f0c81012ed0143bbbeee1d0e6af9594d [id=d30a6cfbde8846c1bb3aa928b10f2024]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.662230 1176 ts_tablet_manager.cc:1916] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.665189 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85d612871014dc2bd9139adcbe639d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.671357 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ba651a71312242f98acb8a2229bfb548" } new_table_name: "default.Table_3c6ca00ede95432386694a36856a4e6d" modify_external_catalogs: true
W20260318 02:51:33.671554 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 4e54f71cd47a4738b0f640382edee907 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e54f71cd47a4738b0f640382edee907 already in progress: creating tablet
W20260318 02:51:33.674211 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet cdafabcad8a64c2094a3e55ea52178bd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cdafabcad8a64c2094a3e55ea52178bd already in progress: creating tablet
I20260318 02:51:33.644675 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 711) took 1161 ms. Trace:
I20260318 02:51:33.683532 1175 rpcz_store.cc:276] 0318 02:51:32.483202 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.483255 (+ 53us) service_pool.cc:225] Handling call
0318 02:51:33.572393 (+1089138us) ts_tablet_manager.cc:1151] Deleting tablet 95f15079d1df4314b6dd5c7afd896af5
0318 02:51:33.572404 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.602038 (+ 29634us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.643920 (+ 41882us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.644658 (+ 738us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1088943}
W20260318 02:51:33.684067 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 64c2a579264e43b9a1e25ded000d4d9f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64c2a579264e43b9a1e25ded000d4d9f already in progress: creating tablet
I20260318 02:51:33.685251 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 712) took 1178 ms. Trace:
I20260318 02:51:33.685348 1175 rpcz_store.cc:276] 0318 02:51:32.506788 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.506861 (+ 73us) service_pool.cc:225] Handling call
0318 02:51:33.685112 (+1178251us) ts_tablet_manager.cc:1151] Deleting tablet 76109acb76424b1f96ede9ab1f018e5e
0318 02:51:33.685121 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.685229 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1162743}
I20260318 02:51:33.685787 1175 tablet_replica.cc:333] T c5765355efaa4ef4ab3b68ea33f51536 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
W20260318 02:51:33.686012 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet cb79f266cdfd498babbc5d1313ef0b72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb79f266cdfd498babbc5d1313ef0b72 already in progress: creating tablet
W20260318 02:51:33.686326 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 6a0c53d87ad84eebaa11f5b44dd7c0b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a0c53d87ad84eebaa11f5b44dd7c0b5 already in progress: creating tablet
W20260318 02:51:33.687332 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 480f4438de13453fa84ce8c37388aeb1 consensus state has no leader
I20260318 02:51:33.687919 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bb068517bfdb437c8f40639ce70b9ad0" } modify_external_catalogs: true
I20260318 02:51:33.688158 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bb068517bfdb437c8f40639ce70b9ad0" } modify_external_catalogs: true
I20260318 02:51:33.690339 455 catalog_manager.cc:5671] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:33.690788 455 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet b5c19bc5e07949088c84cedbf944dfdb (table default.Table_cec1585fa5824e7682f05533101d20eb [id=873432f002e14a4fa7065dcfe5caebd5]). Expected version 5 got 0
I20260318 02:51:33.692688 452 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 99e807c8ff5e457fb6c97c6d1b277eab (table default.Table_fd8edd9c8882403f8541f00d0728e3b7 [id=568e88222ca648ce88ee962e91a84588]). Expected version 1 got 0
I20260318 02:51:33.694466 759 tablet_service.cc:1511] Processing CreateTablet for tablet e85d612871014dc2bd9139adcbe639d2 (DEFAULT_TABLE table=default.Table_f0c81012ed0143bbbeee1d0e6af9594d [id=d30a6cfbde8846c1bb3aa928b10f2024]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.694425 455 catalog_manager.cc:5671] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:33.694877 455 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 104cd36774df4bc0adf1d449224304d5 (table default.Table_c978284529db4de7883f9f0664c4a158 [id=8b5e3535d9e44b1a86dc59211a31deb6]). Expected version 1 got 0
I20260318 02:51:33.695091 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85d612871014dc2bd9139adcbe639d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.695179 455 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 3868406102b748a5b13420b24bf16485 (table default.Table_ad02fb74a8e54e76ba7370a1d85c60b8 [id=a7ad61d6d9264ec4ac482798b1ea992e]). Expected version 3 got 0
I20260318 02:51:33.695348 455 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet ce0ab476b9a54cc586a4c28e23382bfc (table default.Table_51fd1fd451544782b3785014979adeba [id=94288205d88b4c6ca1f94de1b201a349]). Expected version 1 got 0
W20260318 02:51:33.696149 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 15b052ebecbe4652b1a337d18712011f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15b052ebecbe4652b1a337d18712011f already in progress: creating tablet
W20260318 02:51:33.696455 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 76109acb76424b1f96ede9ab1f018e5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76109acb76424b1f96ede9ab1f018e5e already in progress: creating tablet
I20260318 02:51:33.699379 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 95f15079d1df4314b6dd5c7afd896af5 (table default.Table_74486e0a87264fb8ae22f015c8eb3fbe [id=5d87c85c334642829cb97e4b4cc4d95f]) successfully deleted
W20260318 02:51:33.699743 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 76109acb76424b1f96ede9ab1f018e5e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76109acb76424b1f96ede9ab1f018e5e already in progress: creating tablet
I20260318 02:51:33.699447 1033 tablet_service.cc:1511] Processing CreateTablet for tablet e85d612871014dc2bd9139adcbe639d2 (DEFAULT_TABLE table=default.Table_f0c81012ed0143bbbeee1d0e6af9594d [id=d30a6cfbde8846c1bb3aa928b10f2024]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:33.700284 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f99f7e505e7444a29d448561083ad659"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:33.700423 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2724110f542d436cb7f291ebf813bc2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:33.700642 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c93ea1440624408191ad4e268dfed2c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:33.700989 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f99f7e505e7444a29d448561083ad659 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:33.701035 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2724110f542d436cb7f291ebf813bc2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.702214 1173 tablet_bootstrap.cc:492] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:33.702255 450 master_service.cc:954] ReplaceTablet: received request to replace tablet 41b7d422014d4b2a85b0b97593677e3d from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:33.702356 1173 ts_tablet_manager.cc:1403] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.127s user 0.005s sys 0.000s
I20260318 02:51:33.703135 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85d612871014dc2bd9139adcbe639d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:33.703181 1173 raft_consensus.cc:359] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.703341 1173 raft_consensus.cc:385] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.703384 1173 raft_consensus.cc:740] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.702273 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b07527a21cf24b8d92d0e12c0c896452"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:33.703642 1173 consensus_queue.cc:260] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:33.704044 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b07527a21cf24b8d92d0e12c0c896452 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:33.701105 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c93ea1440624408191ad4e268dfed2c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.707104 1173 ts_tablet_manager.cc:1434] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:33.708024 1173 tablet_bootstrap.cc:492] T 99e807c8ff5e457fb6c97c6d1b277eab P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:33.710166 1173 tablet_bootstrap.cc:654] T 99e807c8ff5e457fb6c97c6d1b277eab P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:33.710256 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fa077243d5634d888f3a191b7f9d2d19 consensus state has no leader
W20260318 02:51:33.710464 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3d7b339a29ef456997d74a7a95d4c03a consensus state has no leader
I20260318 02:51:33.710984 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet ef021185bb774cf3aa3e08d88eaa1923
I20260318 02:51:33.715178 1175 raft_consensus.cc:2243] T c5765355efaa4ef4ab3b68ea33f51536 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.715487 1175 raft_consensus.cc:2272] T c5765355efaa4ef4ab3b68ea33f51536 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.716118 1175 ts_tablet_manager.cc:1916] T c5765355efaa4ef4ab3b68ea33f51536 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.718984 449 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 3d7b339a29ef456997d74a7a95d4c03a (table default.Table_713e6cda2b4749cd8bdb238845c39be0 [id=545ec19ee7a34ceb8e7adb93b6eaecf8]). Expected version 1 got 0
I20260318 02:51:33.722816 2010 raft_consensus.cc:493] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.722980 2010 raft_consensus.cc:515] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.723591 2010 leader_election.cc:290] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:33.724774 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "785f6728f94d41f3997961e3d1ebee34" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:33.724869 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "785f6728f94d41f3997961e3d1ebee34" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:33.725461 719 leader_election.cc:343] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:33.725932 719 leader_election.cc:343] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.726030 719 leader_election.cc:304] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.726538 1960 raft_consensus.cc:493] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.726689 1960 raft_consensus.cc:515] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.727275 1960 leader_election.cc:290] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:33.727799 1176 ts_tablet_manager.cc:1929] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.727970 1176 log.cc:1199] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/96a6d1808417419dac0d2b2e80c5ca22
I20260318 02:51:33.728338 1176 ts_tablet_manager.cc:1950] T 96a6d1808417419dac0d2b2e80c5ca22 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:33.728365 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9bc73d3f85745ecb62d861b6375a987" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:33.728950 999 leader_election.cc:343] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: f9bc73d3f85745ecb62d861b6375a987
I20260318 02:51:33.729250 2010 raft_consensus.cc:2749] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:33.731279 997 leader_election.cc:343] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.731519 997 leader_election.cc:304] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.731910 1960 raft_consensus.cc:2749] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.732738 1176 tablet_replica.cc:333] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:33.732964 1176 raft_consensus.cc:2243] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.733093 1176 raft_consensus.cc:2272] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.733460 750 tablet_service.cc:1558] Processing DeleteTablet for tablet ef021185bb774cf3aa3e08d88eaa1923 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.738068 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c5038e9e1074f46976a1a5bb4282944 with delete_type TABLET_DATA_DELETED (replaced by tablet 27fc03c90b584becb250546100af736c) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.738586 903 tablet_service.cc:1558] Processing DeleteTablet for tablet ef021185bb774cf3aa3e08d88eaa1923 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.739082 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet ef021185bb774cf3aa3e08d88eaa1923 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.739967 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 2789a1195e7344c18dd226e196e2f302 with delete_type TABLET_DATA_DELETED (replaced by tablet f37ab96f13444fcbb5cfc3ad92d53c35) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.740123 1174 tablet_bootstrap.cc:492] T ed697b98352c4f65931c154b1f160991 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:33.740155 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fa6bf38381740a1bab1088ede6ede1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.740247 1174 ts_tablet_manager.cc:1403] T ed697b98352c4f65931c154b1f160991 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.126s user 0.005s sys 0.003s
I20260318 02:51:33.740386 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet f04f057571584d31b1821e690ae7c75c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.740609 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet e3999f53c1cc4cb5a1d91eed23785cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.741020 1174 raft_consensus.cc:359] T ed697b98352c4f65931c154b1f160991 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.741194 1174 raft_consensus.cc:385] T ed697b98352c4f65931c154b1f160991 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.741251 1174 raft_consensus.cc:740] T ed697b98352c4f65931c154b1f160991 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.741464 1174 consensus_queue.cc:260] T ed697b98352c4f65931c154b1f160991 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.743013 1184 ts_tablet_manager.cc:1929] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:33.743147 1184 log.cc:1199] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/c5765355efaa4ef4ab3b68ea33f51536
I20260318 02:51:33.743474 1184 ts_tablet_manager.cc:1950] T c5765355efaa4ef4ab3b68ea33f51536 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:33.744110 1174 ts_tablet_manager.cc:1434] T ed697b98352c4f65931c154b1f160991 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:33.744602 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 722) took 1158 ms. Trace:
I20260318 02:51:33.744683 1184 rpcz_store.cc:276] 0318 02:51:32.585872 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.585940 (+ 68us) service_pool.cc:225] Handling call
0318 02:51:33.639904 (+1053964us) ts_tablet_manager.cc:1151] Deleting tablet c5765355efaa4ef4ab3b68ea33f51536
0318 02:51:33.639912 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.679282 (+ 39370us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.742906 (+ 63624us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.744583 (+ 1677us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1053801}
I20260318 02:51:33.744885 1174 tablet_bootstrap.cc:492] T 20c6f1790ed34581b7507ec63ec66718 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:33.744975 1960 consensus_queue.cc:1048] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:33.747565 1174 tablet_bootstrap.cc:654] T 20c6f1790ed34581b7507ec63ec66718 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.747886 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet c5765355efaa4ef4ab3b68ea33f51536 (table default.Table_a61fc584a9fb41fa9d17ab0aef58582d [id=a1611aa744774532bf8c16d8cc701c49]) successfully deleted
I20260318 02:51:33.759263 750 tablet_service.cc:1558] Processing DeleteTablet for tablet ed697b98352c4f65931c154b1f160991 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.760226 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 96a6d1808417419dac0d2b2e80c5ca22 (table default.Table_8b0935ef185c46f8ba4fe96e60fad278 [id=a401bb840c9a4dddb1619805a406f8aa]) successfully deleted
I20260318 02:51:33.762705 1173 tablet_bootstrap.cc:492] T 99e807c8ff5e457fb6c97c6d1b277eab P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:33.763046 1173 ts_tablet_manager.cc:1403] T 99e807c8ff5e457fb6c97c6d1b277eab P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.055s user 0.003s sys 0.000s
I20260318 02:51:33.764546 1173 raft_consensus.cc:359] T 99e807c8ff5e457fb6c97c6d1b277eab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.764810 1173 raft_consensus.cc:385] T 99e807c8ff5e457fb6c97c6d1b277eab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.764926 1173 raft_consensus.cc:740] T 99e807c8ff5e457fb6c97c6d1b277eab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.765211 1173 consensus_queue.cc:260] T 99e807c8ff5e457fb6c97c6d1b277eab P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.765908 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_56f2e832d57c4171b2e0606f8a9f78e4" } new_table_name: "default.Table_357b13fa64234ab49f2349df67f8a0e2" modify_external_catalogs: true
I20260318 02:51:33.766433 1173 ts_tablet_manager.cc:1434] T 99e807c8ff5e457fb6c97c6d1b277eab P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260318 02:51:33.767599 1173 tablet_bootstrap.cc:492] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:33.767536 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_62c15aab881b46dba0f3fb97b039ec08" } modify_external_catalogs: true
I20260318 02:51:33.767961 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3443cae78cf74ae4a5cb61411ef7a6a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:33.768070 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_31dc7662988b47369de3999555752620" } new_table_name: "default.Table_04e409a69f51450a913d14a6a0086312" modify_external_catalogs: true
W20260318 02:51:33.768545 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3443cae78cf74ae4a5cb61411ef7a6a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.770275 1176 ts_tablet_manager.cc:1916] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.772301 453 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 99e807c8ff5e457fb6c97c6d1b277eab (table default.Table_fd8edd9c8882403f8541f00d0728e3b7 [id=568e88222ca648ce88ee962e91a84588]). Expected version 1 got 0
I20260318 02:51:33.773195 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3aa749750bd542738790c713a8ff0713" } modify_external_catalogs: true
I20260318 02:51:33.773391 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3aa749750bd542738790c713a8ff0713" } modify_external_catalogs: true
I20260318 02:51:33.774863 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_821f8a94668d4ed19f00cb007a56b34d" } modify_external_catalogs: true
I20260318 02:51:33.775039 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_821f8a94668d4ed19f00cb007a56b34d" } modify_external_catalogs: true
I20260318 02:51:33.776288 1176 ts_tablet_manager.cc:1929] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.776412 1176 log.cc:1199] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/305cc777ed0c46e497c80f15b8e6ead1
I20260318 02:51:33.776399 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 41b7d422014d4b2a85b0b97593677e3d
I20260318 02:51:33.776662 1176 ts_tablet_manager.cc:1950] T 305cc777ed0c46e497c80f15b8e6ead1 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:33.776815 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_62c15aab881b46dba0f3fb97b039ec08" } modify_external_catalogs: true
I20260318 02:51:33.778069 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 41b7d422014d4b2a85b0b97593677e3d with delete_type TABLET_DATA_DELETED (replaced by tablet 9e9de016a5414690999124a0d528b68b) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.778512 1184 tablet_replica.cc:333] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:33.778761 1184 raft_consensus.cc:2243] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.779814 1173 tablet_bootstrap.cc:654] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.780510 1184 raft_consensus.cc:2272] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.780731 455 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 99e807c8ff5e457fb6c97c6d1b277eab (table default.Table_fd8edd9c8882403f8541f00d0728e3b7 [id=568e88222ca648ce88ee962e91a84588]). Expected version 1 got 0
I20260318 02:51:33.781037 450 catalog_manager.cc:6741] ReplaceTablet: tablet 41b7d422014d4b2a85b0b97593677e3d deleted and replaced by tablet 9e9de016a5414690999124a0d528b68b
I20260318 02:51:33.781188 1184 ts_tablet_manager.cc:1916] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.784309 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_793e04a202214a95b056303786d5f5bd" } modify_external_catalogs: true
I20260318 02:51:33.784512 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_793e04a202214a95b056303786d5f5bd" } modify_external_catalogs: true
I20260318 02:51:33.786194 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 41b7d422014d4b2a85b0b97593677e3d with delete_type TABLET_DATA_DELETED (replaced by tablet 9e9de016a5414690999124a0d528b68b) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.786564 1175 ts_tablet_manager.cc:1929] T c5765355efaa4ef4ab3b68ea33f51536 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:33.787400 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_57dbd3d78d50438cb70fb8019c1521e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:33.787775 1175 log.cc:1199] T c5765355efaa4ef4ab3b68ea33f51536 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/c5765355efaa4ef4ab3b68ea33f51536
W20260318 02:51:33.787942 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57dbd3d78d50438cb70fb8019c1521e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.788404 1175 ts_tablet_manager.cc:1950] T c5765355efaa4ef4ab3b68ea33f51536 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:33.791194 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 713) took 1205 ms. Trace:
I20260318 02:51:33.791395 1175 rpcz_store.cc:276] 0318 02:51:32.585491 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.585556 (+ 65us) service_pool.cc:225] Handling call
0318 02:51:33.685737 (+1100181us) ts_tablet_manager.cc:1151] Deleting tablet c5765355efaa4ef4ab3b68ea33f51536
0318 02:51:33.685747 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.719817 (+ 34070us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.786447 (+ 66630us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.791150 (+ 4703us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1095228}
I20260318 02:51:33.792629 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet c5765355efaa4ef4ab3b68ea33f51536 (table default.Table_a61fc584a9fb41fa9d17ab0aef58582d [id=a1611aa744774532bf8c16d8cc701c49]) successfully deleted
I20260318 02:51:33.793854 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 714) took 1205 ms. Trace:
I20260318 02:51:33.794292 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 41b7d422014d4b2a85b0b97593677e3d with delete_type TABLET_DATA_DELETED (replaced by tablet 9e9de016a5414690999124a0d528b68b) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.794130 1175 rpcz_store.cc:276] 0318 02:51:32.588395 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.588452 (+ 57us) service_pool.cc:225] Handling call
0318 02:51:33.793369 (+1204917us) ts_tablet_manager.cc:1151] Deleting tablet bfb352bce9cc4e8aa899d691954d28d2
0318 02:51:33.793382 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.793718 (+ 336us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1202786}
W20260318 02:51:33.795022 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet bfb352bce9cc4e8aa899d691954d28d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfb352bce9cc4e8aa899d691954d28d2 already in progress: creating tablet
I20260318 02:51:33.781049 455 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 3868406102b748a5b13420b24bf16485 (table default.Table_ad02fb74a8e54e76ba7370a1d85c60b8 [id=a7ad61d6d9264ec4ac482798b1ea992e]). Expected version 3 got 0
I20260318 02:51:33.795440 1175 tablet_replica.cc:333] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:33.795964 1175 raft_consensus.cc:2243] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.796046 456 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 99e807c8ff5e457fb6c97c6d1b277eab (table default.Table_fd8edd9c8882403f8541f00d0728e3b7 [id=568e88222ca648ce88ee962e91a84588]). Expected version 1 got 0
I20260318 02:51:33.797641 1175 raft_consensus.cc:2272] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.797631 456 master_service.cc:954] ReplaceTablet: received request to replace tablet 88c0962c84624c3ea5f03c898f5ff348 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:33.800448 1175 ts_tablet_manager.cc:1916] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.802688 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b9655ed49f8b477083a8c01c883616a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:33.803601 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9655ed49f8b477083a8c01c883616a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.809051 1173 tablet_bootstrap.cc:492] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:33.809279 1173 ts_tablet_manager.cc:1403] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.004s
I20260318 02:51:33.810153 1173 raft_consensus.cc:359] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.812999 1173 raft_consensus.cc:385] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.813143 1173 raft_consensus.cc:740] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.813447 1173 consensus_queue.cc:260] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.816962 1173 ts_tablet_manager.cc:1434] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260318 02:51:33.817476 1173 tablet_bootstrap.cc:492] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:33.819435 1173 tablet_bootstrap.cc:654] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.825876 2075 tablet.cc:1723] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:33.826992 1184 ts_tablet_manager.cc:1929] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.826253 1176 tablet_replica.cc:333] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:33.827394 1176 raft_consensus.cc:2243] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.827620 1176 raft_consensus.cc:2272] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.828349 1176 ts_tablet_manager.cc:1916] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:33.829149 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a628b6d2523344edbf78695a041113cf consensus state has no leader
I20260318 02:51:33.830535 452 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 105326aea9f744779ca76e0cbb2448cd (table default.Table_268e9858449d471ca088f8b1f2492fe6 [id=58354360683d422dbdcc43826b39dbc8]). Expected version 4 got 0
I20260318 02:51:33.831308 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5df5e722b3b94721baa220f851b91d81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:33.831899 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5df5e722b3b94721baa220f851b91d81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.832975 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet defda79dd0f34c37ae16ea808df0754b
I20260318 02:51:33.833864 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet da178159cde84dda9546952d9b2bbb63
I20260318 02:51:33.834204 900 tablet_service.cc:1558] Processing DeleteTablet for tablet defda79dd0f34c37ae16ea808df0754b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.834604 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet ebfb14850afa4043848814f01eabf394
I20260318 02:51:33.834888 900 tablet_service.cc:1558] Processing DeleteTablet for tablet da178159cde84dda9546952d9b2bbb63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:33.835465 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7f21df58fac437da5747becfa3f28b4 consensus state has no leader
I20260318 02:51:33.835604 900 tablet_service.cc:1558] Processing DeleteTablet for tablet ebfb14850afa4043848814f01eabf394 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.838141 1184 log.cc:1199] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/bfb352bce9cc4e8aa899d691954d28d2
I20260318 02:51:33.838457 1184 ts_tablet_manager.cc:1950] T bfb352bce9cc4e8aa899d691954d28d2 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:33.839195 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 723) took 1250 ms. Trace:
I20260318 02:51:33.835122 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet da178159cde84dda9546952d9b2bbb63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.835866 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet ebfb14850afa4043848814f01eabf394 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.835990 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet defda79dd0f34c37ae16ea808df0754b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.840498 448 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 105326aea9f744779ca76e0cbb2448cd (table default.Table_268e9858449d471ca088f8b1f2492fe6 [id=58354360683d422dbdcc43826b39dbc8]). Expected version 4 got 0
I20260318 02:51:33.844250 1175 ts_tablet_manager.cc:1929] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.844373 1175 log.cc:1199] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/666c2992fa4f479ab4ffd7ac0c3a9c92
I20260318 02:51:33.844641 1175 ts_tablet_manager.cc:1950] T 666c2992fa4f479ab4ffd7ac0c3a9c92 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:33.839277 1184 rpcz_store.cc:276] 0318 02:51:32.588758 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:32.588806 (+ 48us) service_pool.cc:225] Handling call
0318 02:51:33.778447 (+1189641us) ts_tablet_manager.cc:1151] Deleting tablet bfb352bce9cc4e8aa899d691954d28d2
0318 02:51:33.778460 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:33.796282 (+ 17822us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.826889 (+ 30607us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:33.839175 (+ 12286us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1189431}
I20260318 02:51:33.846406 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet bfb352bce9cc4e8aa899d691954d28d2 (table default.Table_b1d3f1dcf5d3445a817d681110d65f37 [id=e0b93f047d414aa5bc01df1a1dcb8878]) successfully deleted
I20260318 02:51:33.847358 1184 tablet_replica.cc:333] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
W20260318 02:51:33.847477 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 5a92761edfe74a9798da4d93964383ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a92761edfe74a9798da4d93964383ea already in progress: creating tablet
I20260318 02:51:33.847566 1184 raft_consensus.cc:2243] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.847719 1184 raft_consensus.cc:2272] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:33.847714 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 6858334d4c8b41b89c57b4b6f127a1c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6858334d4c8b41b89c57b4b6f127a1c7 already in progress: creating tablet
W20260318 02:51:33.847949 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 85e6ad2a9817444caecb78eabde5d222 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85e6ad2a9817444caecb78eabde5d222 already in progress: creating tablet
W20260318 02:51:33.848148 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 5dd894706cc2466a8cd4e4df67856862 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dd894706cc2466a8cd4e4df67856862 already in progress: creating tablet
I20260318 02:51:33.848253 1184 ts_tablet_manager.cc:1916] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:33.848363 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet ebbe05c64ae14c509584dd86e45b4aa1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebbe05c64ae14c509584dd86e45b4aa1 already in progress: creating tablet
W20260318 02:51:33.848539 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 8b99d05da31c4b77a78a94baf55b28fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b99d05da31c4b77a78a94baf55b28fa already in progress: creating tablet
W20260318 02:51:33.848824 441 catalog_manager.cc:4969] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet b51a15e4303742a999fe9a96d450c827 because the tablet was not found. No further retry: Not found: Tablet not found: b51a15e4303742a999fe9a96d450c827
I20260318 02:51:33.848949 1174 tablet_bootstrap.cc:492] T 20c6f1790ed34581b7507ec63ec66718 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:33.849013 448 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 1516525b471540288c6cb5d61120d430 (table default.Table_4e770bc308894d9094b88315d9093ba5 [id=433e7aa77412424ebb38784bb073d1fb]). Expected version 6 got 0
I20260318 02:51:33.849089 1174 ts_tablet_manager.cc:1403] T 20c6f1790ed34581b7507ec63ec66718 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.105s user 0.002s sys 0.001s
I20260318 02:51:33.849864 1174 raft_consensus.cc:359] T 20c6f1790ed34581b7507ec63ec66718 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.850081 1174 raft_consensus.cc:385] T 20c6f1790ed34581b7507ec63ec66718 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.850176 1174 raft_consensus.cc:740] T 20c6f1790ed34581b7507ec63ec66718 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.850420 1174 consensus_queue.cc:260] T 20c6f1790ed34581b7507ec63ec66718 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.850945 2009 raft_consensus.cc:493] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.851071 2009 raft_consensus.cc:515] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.851656 2009 leader_election.cc:290] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:33.853036 860 leader_election.cc:343] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: d1a884fde2c145518a2cb14b7780b6dd
I20260318 02:51:33.853689 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 52b773c3412c4bc792471096802b3f1a
I20260318 02:51:33.854458 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 52b773c3412c4bc792471096802b3f1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.855018 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 52b773c3412c4bc792471096802b3f1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.857007 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 305cc777ed0c46e497c80f15b8e6ead1 (table default.Table_dbd509def99c4f02a35097ecbd42c1f1 [id=74932ba5f5794283833a97ff4ea61734]) successfully deleted
I20260318 02:51:33.857496 1173 tablet_bootstrap.cc:492] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:33.857623 1173 ts_tablet_manager.cc:1403] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.000s
I20260318 02:51:33.857715 748 tablet_service.cc:1558] Processing DeleteTablet for tablet ebfb14850afa4043848814f01eabf394 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.858162 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 52b773c3412c4bc792471096802b3f1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.858377 1173 raft_consensus.cc:359] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.858522 1173 raft_consensus.cc:385] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.858564 1173 raft_consensus.cc:740] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.858783 1173 consensus_queue.cc:260] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.859869 1173 ts_tablet_manager.cc:1434] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:33.861398 750 tablet_service.cc:1558] Processing DeleteTablet for tablet defda79dd0f34c37ae16ea808df0754b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.862429 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 666c2992fa4f479ab4ffd7ac0c3a9c92 (table default.Table_113ffa1cc0ef491cbc6786967482632f [id=504539970798458680abc4a9307656fa]) successfully deleted
I20260318 02:51:33.863122 1173 tablet_bootstrap.cc:492] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:33.865177 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 5a92761edfe74a9798da4d93964383ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a92761edfe74a9798da4d93964383ea already in progress: creating tablet
I20260318 02:51:33.865697 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 547762347d7843e989e55e0449ad9fcb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:33.866278 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 6858334d4c8b41b89c57b4b6f127a1c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6858334d4c8b41b89c57b4b6f127a1c7 already in progress: creating tablet
I20260318 02:51:33.866636 1173 tablet_bootstrap.cc:654] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:33.867424 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 85e6ad2a9817444caecb78eabde5d222 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85e6ad2a9817444caecb78eabde5d222 already in progress: creating tablet
W20260318 02:51:33.868011 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 5dd894706cc2466a8cd4e4df67856862 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dd894706cc2466a8cd4e4df67856862 already in progress: creating tablet
I20260318 02:51:33.868232 1959 raft_consensus.cc:493] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.868371 1959 raft_consensus.cc:515] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.868544 1175 tablet_replica.cc:333] T bc47f35f9c2c4e5085ab482285effc91 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:33.868788 1175 raft_consensus.cc:2243] T bc47f35f9c2c4e5085ab482285effc91 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.868959 1959 leader_election.cc:290] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:33.868975 1175 raft_consensus.cc:2272] T bc47f35f9c2c4e5085ab482285effc91 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.869793 1172 tablet_bootstrap.cc:492] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:33.869788 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ab476b9a54cc586a4c28e23382bfc" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:33.869937 1172 ts_tablet_manager.cc:1403] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.276s user 0.027s sys 0.037s
W20260318 02:51:33.870277 997 leader_election.cc:343] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.870735 1172 raft_consensus.cc:359] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.870908 1172 raft_consensus.cc:385] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.870958 1172 raft_consensus.cc:740] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.871280 786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ab476b9a54cc586a4c28e23382bfc" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:33.871356 1176 ts_tablet_manager.cc:1929] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.872819 1176 log.cc:1199] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/1ef3181adc0542229897369591a30465
I20260318 02:51:33.873243 1176 ts_tablet_manager.cc:1950] T 1ef3181adc0542229897369591a30465 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:33.874073 2083 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.104.189:45933 every 8 connection(s)
I20260318 02:51:33.874300 1175 ts_tablet_manager.cc:1916] T bc47f35f9c2c4e5085ab482285effc91 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.874480 1812 rpc_server.cc:307] RPC server started. Bound to: 127.0.104.189:45933
W20260318 02:51:33.877044 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet ebbe05c64ae14c509584dd86e45b4aa1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebbe05c64ae14c509584dd86e45b4aa1 already in progress: creating tablet
W20260318 02:51:33.877324 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 8b99d05da31c4b77a78a94baf55b28fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b99d05da31c4b77a78a94baf55b28fa already in progress: creating tablet
I20260318 02:51:33.871470 786 raft_consensus.cc:2468] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:33.876190 759 tablet_service.cc:1558] Processing DeleteTablet for tablet da178159cde84dda9546952d9b2bbb63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.878124 999 leader_election.cc:304] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.878554 1960 raft_consensus.cc:2804] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:33.878664 1960 raft_consensus.cc:493] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:33.878746 1960 raft_consensus.cc:3060] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:33.880645 1812 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-1/data/info.pb
I20260318 02:51:33.881313 418 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu as pid 1812
I20260318 02:51:33.882531 1960 raft_consensus.cc:515] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.883929 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ab476b9a54cc586a4c28e23382bfc" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:33.884882 997 leader_election.cc:343] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.885776 786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce0ab476b9a54cc586a4c28e23382bfc" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:33.885968 786 raft_consensus.cc:3060] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:33.888921 786 raft_consensus.cc:2468] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:33.889564 999 leader_election.cc:304] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.889962 1959 raft_consensus.cc:2804] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:33.890103 1959 raft_consensus.cc:697] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:33.890393 1959 consensus_queue.cc:237] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.892099 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 88c0962c84624c3ea5f03c898f5ff348
W20260318 02:51:33.892448 862 leader_election.cc:343] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: d1a884fde2c145518a2cb14b7780b6dd
I20260318 02:51:33.892562 456 catalog_manager.cc:6741] ReplaceTablet: tablet 88c0962c84624c3ea5f03c898f5ff348 deleted and replaced by tablet 2926ab20fd3542e69fb3f2f52d5acd0e
I20260318 02:51:33.892576 862 leader_election.cc:304] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:33.893008 2009 raft_consensus.cc:2749] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.893296 2009 raft_consensus.cc:493] T 99e807c8ff5e457fb6c97c6d1b277eab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.893415 2009 raft_consensus.cc:515] T 99e807c8ff5e457fb6c97c6d1b277eab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.894022 2009 leader_election.cc:290] T 99e807c8ff5e457fb6c97c6d1b277eab P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:33.895098 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e807c8ff5e457fb6c97c6d1b277eab" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:33.895716 1173 tablet_bootstrap.cc:492] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:33.896085 786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99e807c8ff5e457fb6c97c6d1b277eab" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:33.897185 1960 leader_election.cc:290] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:33.896908 862 leader_election.cc:304] T 99e807c8ff5e457fb6c97c6d1b277eab P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:33.898074 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 88c0962c84624c3ea5f03c898f5ff348 with delete_type TABLET_DATA_DELETED (replaced by tablet 2926ab20fd3542e69fb3f2f52d5acd0e) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.898957 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 88c0962c84624c3ea5f03c898f5ff348 with delete_type TABLET_DATA_DELETED (replaced by tablet 2926ab20fd3542e69fb3f2f52d5acd0e) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:33.899137 2009 raft_consensus.cc:2749] T 99e807c8ff5e457fb6c97c6d1b277eab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.899508 1173 ts_tablet_manager.cc:1403] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20260318 02:51:33.902067 1184 ts_tablet_manager.cc:1929] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:33.903024 1173 raft_consensus.cc:359] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.903206 1173 raft_consensus.cc:385] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.908219 1173 raft_consensus.cc:740] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.908661 1173 consensus_queue.cc:260] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.909519 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c291010cdfb64ef7bedaa156ed3338ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:33.910003 1173 ts_tablet_manager.cc:1434] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
W20260318 02:51:33.910341 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c291010cdfb64ef7bedaa156ed3338ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.911921 1173 tablet_bootstrap.cc:492] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:33.912667 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f88018436952478cb888ea867404843c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:33.912961 1184 log.cc:1199] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/65f63eb5e114464988b3b89e3af61b61
W20260318 02:51:33.913239 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f88018436952478cb888ea867404843c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.913302 1184 ts_tablet_manager.cc:1950] T 65f63eb5e114464988b3b89e3af61b61 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:33.914425 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 65f63eb5e114464988b3b89e3af61b61 (table default.Table_e285c48a68a04ddca6c3da148d0f43f1 [id=d7a2b53e58414b9b878a51724594ceda]) successfully deleted
I20260318 02:51:33.904213 1172 consensus_queue.cc:260] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:33.908761 999 consensus_peers.cc:597] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d -> Peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Couldn't send request to peer 6a903d876086423b8016d705b98895ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc47f35f9c2c4e5085ab482285effc91. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:33.915145 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_25f1927eaff447d8ab2f529f4cee83f6" } new_table_name: "default.Table_6799c18042274bc9a7f0a18d69756ecb" modify_external_catalogs: true
I20260318 02:51:33.915285 1172 ts_tablet_manager.cc:1434] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.045s user 0.001s sys 0.001s
I20260318 02:51:33.915608 1172 tablet_bootstrap.cc:492] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:33.917340 1172 tablet_bootstrap.cc:654] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.919200 1173 tablet_bootstrap.cc:654] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.922703 1175 ts_tablet_manager.cc:1929] T bc47f35f9c2c4e5085ab482285effc91 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:33.922808 1175 log.cc:1199] T bc47f35f9c2c4e5085ab482285effc91 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/bc47f35f9c2c4e5085ab482285effc91
I20260318 02:51:33.923172 1175 ts_tablet_manager.cc:1950] T bc47f35f9c2c4e5085ab482285effc91 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:33.924078 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet bc47f35f9c2c4e5085ab482285effc91 (table default.Table_9867792729394010ba769354562198f3 [id=1515573be85644d7a4f046947aa1537b]) successfully deleted
I20260318 02:51:33.924410 1175 tablet_replica.cc:333] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:33.924499 1960 raft_consensus.cc:493] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.924650 1960 raft_consensus.cc:515] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.926321 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421e5223d6af4da1a8e07534f942d016" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:33.926602 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 88c0962c84624c3ea5f03c898f5ff348 with delete_type TABLET_DATA_DELETED (replaced by tablet 2926ab20fd3542e69fb3f2f52d5acd0e) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:33.924580 1175 raft_consensus.cc:2243] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:33.927073 1175 pending_rounds.cc:70] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18: Trying to abort 1 pending ops.
W20260318 02:51:33.927100 997 leader_election.cc:343] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.927129 1175 pending_rounds.cc:77] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494192613924864 op_type: NO_OP noop_request { }
I20260318 02:51:33.927222 1175 raft_consensus.cc:2889] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:33.927320 1175 raft_consensus.cc:2272] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:33.928635 999 leader_election.cc:343] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 421e5223d6af4da1a8e07534f942d016
I20260318 02:51:33.928802 999 leader_election.cc:304] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:33.929086 1959 raft_consensus.cc:2749] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:33.929405 1960 leader_election.cc:290] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:33.930078 450 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 1516525b471540288c6cb5d61120d430 (table default.Table_4e770bc308894d9094b88315d9093ba5 [id=433e7aa77412424ebb38784bb073d1fb]). Expected version 6 got 0
I20260318 02:51:33.931836 1175 ts_tablet_manager.cc:1916] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.935617 1111 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:33.936055 1184 tablet_replica.cc:333] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:33.936295 1184 raft_consensus.cc:2243] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:33.936677 1184 raft_consensus.cc:2272] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.938360 1184 ts_tablet_manager.cc:1916] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.940001 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ac97b10d696748eabef55a19d976b4dd" } new_table_name: "default.Table_bdc9e78bc72e4869b7c76f5520a251df" modify_external_catalogs: true
I20260318 02:51:33.940775 1173 tablet_bootstrap.cc:492] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:33.940915 1173 ts_tablet_manager.cc:1403] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20260318 02:51:33.942204 1173 raft_consensus.cc:359] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.942368 1173 raft_consensus.cc:385] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.942413 1173 raft_consensus.cc:740] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.942619 1173 consensus_queue.cc:260] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:33.943167 1173 ts_tablet_manager.cc:1434] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:33.943768 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_cf5f0ff49fa24bf18b21a4ebbe45d2e4" } modify_external_catalogs: true
I20260318 02:51:33.943991 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_cf5f0ff49fa24bf18b21a4ebbe45d2e4" } modify_external_catalogs: true
I20260318 02:51:33.944783 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_09ea62fe8c224d87944f84b6ef7e4edc" } new_table_name: "default.Table_bca965fb1ef843d4a883221da8fb427b" modify_external_catalogs: true
I20260318 02:51:33.953763 1173 tablet_bootstrap.cc:492] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:33.955576 1172 tablet_bootstrap.cc:492] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:33.955752 1172 ts_tablet_manager.cc:1403] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.002s
I20260318 02:51:33.956622 1172 raft_consensus.cc:359] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.956902 1172 raft_consensus.cc:385] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.956988 1172 raft_consensus.cc:740] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.957193 1172 consensus_queue.cc:260] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.958158 1172 ts_tablet_manager.cc:1434] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:33.959818 900 tablet_service.cc:1558] Processing DeleteTablet for tablet e3999f53c1cc4cb5a1d91eed23785cc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:33.960505 974 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:33.961225 1173 tablet_bootstrap.cc:654] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.967453 1184 ts_tablet_manager.cc:1929] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:33.967696 1184 log.cc:1199] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/bc47f35f9c2c4e5085ab482285effc91
I20260318 02:51:33.968137 1184 ts_tablet_manager.cc:1950] T bc47f35f9c2c4e5085ab482285effc91 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:33.978572 1172 tablet_bootstrap.cc:492] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:33.979110 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_055394d8a16e46ce8e65895d5c3f7807"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:33.981916 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5a24eb0c55044d40ae13fa4fcb40bfd7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:33.982136 1173 tablet_bootstrap.cc:492] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:33.982302 1173 ts_tablet_manager.cc:1403] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.000s
W20260318 02:51:33.983160 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a24eb0c55044d40ae13fa4fcb40bfd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.984313 1173 raft_consensus.cc:359] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.984544 1173 raft_consensus.cc:385] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:33.984601 1173 raft_consensus.cc:740] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:33.984863 2085 sys_catalog.cc:263] Verifying existing consensus state
W20260318 02:51:33.979740 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_055394d8a16e46ce8e65895d5c3f7807 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:33.990139 1176 tablet_replica.cc:333] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:33.990396 1176 raft_consensus.cc:2243] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:33.990553 1176 raft_consensus.cc:2272] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:33.990628 1174 ts_tablet_manager.cc:1434] T 20c6f1790ed34581b7507ec63ec66718 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.141s user 0.000s sys 0.002s
I20260318 02:51:33.990912 1174 tablet_bootstrap.cc:492] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:33.991082 1176 ts_tablet_manager.cc:1916] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:33.992612 1174 tablet_bootstrap.cc:654] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:33.993664 1915 raft_consensus.cc:493] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:33.993777 1915 raft_consensus.cc:515] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:33.994330 1915 leader_election.cc:290] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:33.996250 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffcfc0784d947419fc9b22aa636521c" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:33.996527 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffcfc0784d947419fc9b22aa636521c" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:33.999058 719 leader_election.cc:343] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:33.999253 719 leader_election.cc:343] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:33.999329 719 leader_election.cc:304] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:34.001955 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 565add8c21f343f2b11c12a9bb7ff111 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 565add8c21f343f2b11c12a9bb7ff111 already in progress: creating tablet
W20260318 02:51:34.002328 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet d4332d4afb164b35bee3b0146e26b4e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4332d4afb164b35bee3b0146e26b4e1 already in progress: creating tablet
I20260318 02:51:34.003445 1175 ts_tablet_manager.cc:1929] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:34.003665 1175 log.cc:1199] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/9d20847fa6f9461cb6137f56ea680cb6
I20260318 02:51:34.004369 1175 ts_tablet_manager.cc:1950] T 9d20847fa6f9461cb6137f56ea680cb6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:34.004748 2010 raft_consensus.cc:2749] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.005234 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 9d20847fa6f9461cb6137f56ea680cb6 (table default.Table_30dc528b33264c9faed7f9f325d93738 [id=ed55cf5473c34c8b95532da9cfa81fad]) successfully deleted
W20260318 02:51:34.006111 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet d0b01131720748688ca6c28985a3b3ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0b01131720748688ca6c28985a3b3ff already in progress: creating tablet
I20260318 02:51:34.006486 1175 tablet_replica.cc:333] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:34.006798 1175 raft_consensus.cc:2243] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:34.007032 1175 raft_consensus.cc:2272] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.010035 1172 tablet_bootstrap.cc:654] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:34.010771 833 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:34.013268 1176 ts_tablet_manager.cc:1929] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:34.013401 1176 log.cc:1199] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/b4ed28b9a7f2471aa4ed7cd2e1efda1a
I20260318 02:51:34.013899 1176 ts_tablet_manager.cc:1950] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:34.014561 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a (table default.Table_8d6d4b35c7754174adfe3a4d4889cdae [id=9dc5f3bbe7a34ffab1bd5105bac98325]) successfully deleted
I20260318 02:51:34.015676 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet bc47f35f9c2c4e5085ab482285effc91 (table default.Table_9867792729394010ba769354562198f3 [id=1515573be85644d7a4f046947aa1537b]) successfully deleted
W20260318 02:51:34.016363 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet d0b01131720748688ca6c28985a3b3ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0b01131720748688ca6c28985a3b3ff already in progress: creating tablet
W20260318 02:51:34.016616 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet e418df45882c435a8276e46a8abf6bdd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e418df45882c435a8276e46a8abf6bdd already in progress: creating tablet
I20260318 02:51:34.016795 1184 tablet_replica.cc:333] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
W20260318 02:51:34.016834 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f7f8240ed325401da6344c8ee033ad43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7f8240ed325401da6344c8ee033ad43 already in progress: creating tablet
I20260318 02:51:34.017129 1184 raft_consensus.cc:2243] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:34.017330 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 5fec974d146f44aeb72df483fa85b287 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fec974d146f44aeb72df483fa85b287 already in progress: creating tablet
W20260318 02:51:34.017508 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet cb79f266cdfd498babbc5d1313ef0b72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb79f266cdfd498babbc5d1313ef0b72 already in progress: creating tablet
I20260318 02:51:34.017578 1173 consensus_queue.cc:260] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.018101 1173 ts_tablet_manager.cc:1434] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.036s user 0.003s sys 0.000s
I20260318 02:51:34.018380 1173 tablet_bootstrap.cc:492] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:34.023945 1176 tablet_replica.cc:333] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:34.024173 1176 raft_consensus.cc:2243] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:34.007978 1175 ts_tablet_manager.cc:1916] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:34.024991 1176 raft_consensus.cc:2272] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.025104 2076 tablet.cc:1723] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:34.025629 1176 ts_tablet_manager.cc:1916] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:34.029603 2075 tablet.cc:1723] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:34.037335 2097 tablet.cc:1723] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:34.042870 1173 tablet_bootstrap.cc:654] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:34.049010 1184 raft_consensus.cc:2272] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.050645 1184 ts_tablet_manager.cc:1916] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:34.051854 1172 tablet_bootstrap.cc:492] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:34.052124 1172 ts_tablet_manager.cc:1403] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.074s user 0.002s sys 0.005s
I20260318 02:51:34.052488 1959 raft_consensus.cc:493] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.052636 1959 raft_consensus.cc:515] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.052845 2085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7: Bootstrap starting.
I20260318 02:51:34.053285 1959 leader_election.cc:290] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:34.054731 1172 raft_consensus.cc:359] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.055028 1172 raft_consensus.cc:385] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.055143 1172 raft_consensus.cc:740] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.055424 1172 consensus_queue.cc:260] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.056560 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3999f53c1cc4cb5a1d91eed23785cc6" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:34.056861 1172 ts_tablet_manager.cc:1434] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260318 02:51:34.057070 922 raft_consensus.cc:2468] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:34.057170 1172 tablet_bootstrap.cc:492] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:34.057574 2097 tablet.cc:1723] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:34.057631 997 leader_election.cc:304] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:34.058013 1959 raft_consensus.cc:2804] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:34.058143 1959 raft_consensus.cc:493] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:34.058228 1959 raft_consensus.cc:3060] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:34.058833 1172 tablet_bootstrap.cc:654] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:34.061441 1959 raft_consensus.cc:515] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.062726 1959 leader_election.cc:290] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:34.062806 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3999f53c1cc4cb5a1d91eed23785cc6" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:34.062956 999 leader_election.cc:343] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: e3999f53c1cc4cb5a1d91eed23785cc6
I20260318 02:51:34.062997 927 raft_consensus.cc:3060] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:34.064002 2009 raft_consensus.cc:493] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.064133 2009 raft_consensus.cc:515] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.064745 2009 leader_election.cc:290] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:34.065704 860 leader_election.cc:343] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: b51a15e4303742a999fe9a96d450c827
I20260318 02:51:34.067988 927 raft_consensus.cc:2468] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:34.068969 997 leader_election.cc:304] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
W20260318 02:51:34.069690 999 leader_election.cc:343] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: e3999f53c1cc4cb5a1d91eed23785cc6
I20260318 02:51:34.070020 1960 raft_consensus.cc:2804] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:34.070183 1960 raft_consensus.cc:697] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:34.070423 1960 consensus_queue.cc:237] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.076980 1176 ts_tablet_manager.cc:1929] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:34.077121 1176 log.cc:1199] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/785f6728f94d41f3997961e3d1ebee34
I20260318 02:51:34.077476 1176 ts_tablet_manager.cc:1950] T 785f6728f94d41f3997961e3d1ebee34 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
W20260318 02:51:34.081112 862 leader_election.cc:343] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: b51a15e4303742a999fe9a96d450c827
I20260318 02:51:34.081278 862 leader_election.cc:304] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:34.081791 2009 raft_consensus.cc:2749] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.083079 1176 tablet_replica.cc:333] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:34.083276 1176 raft_consensus.cc:2243] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:34.083544 1176 raft_consensus.cc:2272] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.083271 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 785f6728f94d41f3997961e3d1ebee34 (table default.Table_496e7d616c09464a884078334d256839 [id=f6fae39c375b41e096459fe397b69b72]) successfully deleted
I20260318 02:51:34.084829 1174 tablet_bootstrap.cc:492] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:34.084966 1174 ts_tablet_manager.cc:1403] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.094s user 0.003s sys 0.000s
I20260318 02:51:34.085160 1176 ts_tablet_manager.cc:1916] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:34.085650 1174 raft_consensus.cc:359] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.085819 1174 raft_consensus.cc:385] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.085871 1174 raft_consensus.cc:740] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.087342 449 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_b76c4b353fbe45c8a866d4cd2c4e264c [id=d20f8f1bd66d4dceab3b7bc72608da2a] alter complete (version 2)
I20260318 02:51:34.091239 1174 consensus_queue.cc:260] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.092343 1174 ts_tablet_manager.cc:1434] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260318 02:51:34.092818 1174 tablet_bootstrap.cc:492] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:34.096277 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_fd929d02190f450bb0c5c1f45450ff40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:34.096503 900 tablet_service.cc:1558] Processing DeleteTablet for tablet bfb352bce9cc4e8aa899d691954d28d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:34.097011 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd929d02190f450bb0c5c1f45450ff40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:34.099316 1174 tablet_bootstrap.cc:654] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:34.100008 1176 ts_tablet_manager.cc:1929] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:34.100132 1176 log.cc:1199] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/b8a46b4db30a48c99addf763f7edfb16
I20260318 02:51:34.100458 1176 ts_tablet_manager.cc:1950] T b8a46b4db30a48c99addf763f7edfb16 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:34.101430 1176 tablet_replica.cc:333] T 7cdd554113bf4a7092da876365a89456 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:34.101627 1176 raft_consensus.cc:2243] T 7cdd554113bf4a7092da876365a89456 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:34.101766 1176 raft_consensus.cc:2272] T 7cdd554113bf4a7092da876365a89456 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.102334 1176 ts_tablet_manager.cc:1916] T 7cdd554113bf4a7092da876365a89456 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:34.106410 1959 raft_consensus.cc:493] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.106536 1174 tablet_bootstrap.cc:492] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:34.106660 1174 ts_tablet_manager.cc:1403] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260318 02:51:34.106600 1959 raft_consensus.cc:515] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.107314 1959 leader_election.cc:290] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:34.107400 1174 raft_consensus.cc:359] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.107545 1174 raft_consensus.cc:385] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.107589 1174 raft_consensus.cc:740] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.107844 1174 consensus_queue.cc:260] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.108479 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet b8a46b4db30a48c99addf763f7edfb16 (table default.Table_25494285095147fa885f1aa79e2f1722 [id=6f9a87f338414f20bb3969d3c3cdfa64]) successfully deleted
I20260318 02:51:34.110078 1176 ts_tablet_manager.cc:1929] T 7cdd554113bf4a7092da876365a89456 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:34.110204 1176 log.cc:1199] T 7cdd554113bf4a7092da876365a89456 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/7cdd554113bf4a7092da876365a89456
I20260318 02:51:34.110476 1176 ts_tablet_manager.cc:1950] T 7cdd554113bf4a7092da876365a89456 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:34.110877 2009 raft_consensus.cc:493] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.111016 2009 raft_consensus.cc:515] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.111670 2009 leader_election.cc:290] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:34.114089 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea25aaad60a4b2483a8832f995d1316" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:34.115559 1174 ts_tablet_manager.cc:1434] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260318 02:51:34.115845 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 7cdd554113bf4a7092da876365a89456 (table default.Table_3f656b3bee94423f80dd692ce3481733 [id=6f9427cec2ee40699e0c736524feb90f]) successfully deleted
I20260318 02:51:34.116277 1172 tablet_bootstrap.cc:492] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:34.116245 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1516525b471540288c6cb5d61120d430" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:34.116470 1172 ts_tablet_manager.cc:1403] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.059s user 0.003s sys 0.000s
I20260318 02:51:34.117192 1174 tablet_bootstrap.cc:492] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:34.120086 1172 raft_consensus.cc:359] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.120311 1172 raft_consensus.cc:385] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.120393 1172 raft_consensus.cc:740] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.120653 1172 consensus_queue.cc:260] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.121243 1172 ts_tablet_manager.cc:1434] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:34.121634 1172 tablet_bootstrap.cc:492] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:34.122011 1174 tablet_bootstrap.cc:654] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:34.122624 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet ef021185bb774cf3aa3e08d88eaa1923 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef021185bb774cf3aa3e08d88eaa1923 already in progress: creating tablet
I20260318 02:51:34.122943 1176 tablet_replica.cc:333] T ed697b98352c4f65931c154b1f160991 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:34.123129 1176 raft_consensus.cc:2243] T ed697b98352c4f65931c154b1f160991 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:34.123152 997 leader_election.cc:343] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.123281 1176 raft_consensus.cc:2272] T ed697b98352c4f65931c154b1f160991 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.124099 1176 ts_tablet_manager.cc:1916] T ed697b98352c4f65931c154b1f160991 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:34.125873 782 raft_consensus.cc:1275] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Refusing update from remote peer 9422bb7011f342b08be0b073a88c4c4d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:34.126528 1874 consensus_queue.cc:1048] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260318 02:51:34.129797 997 consensus_peers.cc:597] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:34.133246 1184 ts_tablet_manager.cc:1929] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:34.138854 1184 log.cc:1199] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/421e5223d6af4da1a8e07534f942d016
I20260318 02:51:34.139387 1184 ts_tablet_manager.cc:1950] T 421e5223d6af4da1a8e07534f942d016 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:34.140136 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 421e5223d6af4da1a8e07534f942d016 (table default.Table_8dfcbdb7d773436fb70053d0d4a1d9e8 [id=7979bbf5d6744b6eb56acde8ec69ba5d]) successfully deleted
I20260318 02:51:34.137337 1172 tablet_bootstrap.cc:654] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:34.137797 2075 tablet.cc:1723] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:34.140909 2097 tablet.cc:1723] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:34.143813 1176 ts_tablet_manager.cc:1929] T ed697b98352c4f65931c154b1f160991 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:34.143924 1176 log.cc:1199] T ed697b98352c4f65931c154b1f160991 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/ed697b98352c4f65931c154b1f160991
I20260318 02:51:34.144225 1176 ts_tablet_manager.cc:1950] T ed697b98352c4f65931c154b1f160991 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:34.144354 1174 tablet_bootstrap.cc:492] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:34.144556 1174 ts_tablet_manager.cc:1403] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.003s
I20260318 02:51:34.146762 1174 raft_consensus.cc:359] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.147043 1174 raft_consensus.cc:385] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.147157 1174 raft_consensus.cc:740] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.147738 1174 consensus_queue.cc:260] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.148751 1174 ts_tablet_manager.cc:1434] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260318 02:51:34.149223 1174 tablet_bootstrap.cc:492] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:34.154881 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet ed697b98352c4f65931c154b1f160991 (table default.Table_e8949513489d44e0a36b239de4fbed56 [id=412636f9a1d04551b9872e99570ba8fb]) successfully deleted
I20260318 02:51:34.155741 1174 tablet_bootstrap.cc:654] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:34.156539 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 6a0c53d87ad84eebaa11f5b44dd7c0b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a0c53d87ad84eebaa11f5b44dd7c0b5 already in progress: creating tablet
I20260318 02:51:34.157028 2009 raft_consensus.cc:493] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.157176 2009 raft_consensus.cc:515] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.157828 2009 leader_election.cc:290] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:34.158090 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 41b7d422014d4b2a85b0b97593677e3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41b7d422014d4b2a85b0b97593677e3d already in progress: creating tablet
W20260318 02:51:34.158924 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet ebfb14850afa4043848814f01eabf394 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebfb14850afa4043848814f01eabf394 already in progress: creating tablet
W20260318 02:51:34.158951 860 leader_election.cc:343] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: bfb352bce9cc4e8aa899d691954d28d2
I20260318 02:51:34.159767 1184 tablet_replica.cc:333] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
W20260318 02:51:34.160321 862 leader_election.cc:343] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: bfb352bce9cc4e8aa899d691954d28d2
I20260318 02:51:34.160427 862 leader_election.cc:304] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:34.160956 2009 raft_consensus.cc:2749] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:34.161295 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 52b773c3412c4bc792471096802b3f1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52b773c3412c4bc792471096802b3f1a already in progress: creating tablet
I20260318 02:51:34.161880 1184 raft_consensus.cc:2243] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:34.162135 1184 raft_consensus.cc:2272] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:34.162122 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet defda79dd0f34c37ae16ea808df0754b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet defda79dd0f34c37ae16ea808df0754b already in progress: creating tablet
I20260318 02:51:34.162838 1184 ts_tablet_manager.cc:1916] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:34.162947 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet da178159cde84dda9546952d9b2bbb63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da178159cde84dda9546952d9b2bbb63 already in progress: creating tablet
W20260318 02:51:34.163664 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 88c0962c84624c3ea5f03c898f5ff348 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88c0962c84624c3ea5f03c898f5ff348 already in progress: creating tablet
I20260318 02:51:34.167202 1174 tablet_bootstrap.cc:492] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:34.167464 1174 ts_tablet_manager.cc:1403] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.005s
I20260318 02:51:34.167757 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1516525b471540288c6cb5d61120d430" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:34.168391 862 leader_election.cc:304] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:34.168972 2009 raft_consensus.cc:2749] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.168958 1174 raft_consensus.cc:359] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.169209 1174 raft_consensus.cc:385] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.169286 1174 raft_consensus.cc:740] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.169623 1174 consensus_queue.cc:260] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.170286 1172 tablet_bootstrap.cc:492] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:34.170517 1172 ts_tablet_manager.cc:1403] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.049s user 0.004s sys 0.000s
I20260318 02:51:34.171314 1172 raft_consensus.cc:359] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.171623 1172 raft_consensus.cc:385] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.171737 1172 raft_consensus.cc:740] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.172777 1172 consensus_queue.cc:260] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.173483 1172 ts_tablet_manager.cc:1434] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260318 02:51:34.174150 999 leader_election.cc:343] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: dea25aaad60a4b2483a8832f995d1316
I20260318 02:51:34.176095 999 leader_election.cc:304] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:34.176581 1174 ts_tablet_manager.cc:1434] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260318 02:51:34.176982 1874 raft_consensus.cc:2749] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.178074 1172 tablet_bootstrap.cc:492] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:34.178943 1874 raft_consensus.cc:493] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.179322 2010 raft_consensus.cc:493] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.179455 2010 raft_consensus.cc:515] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.179458 1874 raft_consensus.cc:515] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.180033 2010 leader_election.cc:290] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:34.180123 1874 leader_election.cc:290] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:34.180950 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca23d4d0d3734fceb14966a4f2ad9c35" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:34.181483 719 leader_election.cc:343] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.183063 1174 tablet_bootstrap.cc:492] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:34.184857 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca23d4d0d3734fceb14966a4f2ad9c35" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:34.185104 1174 tablet_bootstrap.cc:654] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:34.185657 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2789a1195e7344c18dd226e196e2f302" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:34.185781 719 leader_election.cc:343] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.185901 719 leader_election.cc:304] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:34.186277 1915 raft_consensus.cc:2749] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:34.187074 997 leader_election.cc:343] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:34.187924 999 leader_election.cc:343] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2789a1195e7344c18dd226e196e2f302
I20260318 02:51:34.188041 999 leader_election.cc:304] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:34.188508 1874 raft_consensus.cc:2749] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.189489 2009 raft_consensus.cc:493] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.189664 2009 raft_consensus.cc:515] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.190372 2009 leader_election.cc:290] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:34.191654 1173 tablet_bootstrap.cc:492] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:34.191807 1173 ts_tablet_manager.cc:1403] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.173s user 0.010s sys 0.018s
W20260318 02:51:34.192426 860 leader_election.cc:343] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 3e38dec0d2e9417e8571e202036e7117
W20260318 02:51:34.195380 862 leader_election.cc:343] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 3e38dec0d2e9417e8571e202036e7117
I20260318 02:51:34.195523 862 leader_election.cc:304] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:34.195946 2009 raft_consensus.cc:2749] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.197474 2076 tablet.cc:1723] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:34.201786 1172 tablet_bootstrap.cc:654] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:34.208559 1175 ts_tablet_manager.cc:1929] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:34.209754 1175 log.cc:1199] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/0d343e53f2354a3386b19d71ef00d5a4
I20260318 02:51:34.210379 1174 tablet_bootstrap.cc:492] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:34.210551 1174 ts_tablet_manager.cc:1403] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.028s user 0.008s sys 0.015s
I20260318 02:51:34.211323 1174 raft_consensus.cc:359] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.211531 1174 raft_consensus.cc:385] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.211463 1175 ts_tablet_manager.cc:1950] T 0d343e53f2354a3386b19d71ef00d5a4 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:34.211580 1174 raft_consensus.cc:740] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.211778 1174 consensus_queue.cc:260] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.212270 1174 ts_tablet_manager.cc:1434] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:34.212604 1174 tablet_bootstrap.cc:492] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:34.214288 1174 tablet_bootstrap.cc:654] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:34.215337 1173 raft_consensus.cc:359] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.215539 1173 raft_consensus.cc:385] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.215603 1173 raft_consensus.cc:740] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.218538 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 739) took 1028 ms. Trace:
I20260318 02:51:34.216380 1173 consensus_queue.cc:260] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.218760 1175 rpcz_store.cc:276] 0318 02:51:33.190274 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.190452 (+ 178us) service_pool.cc:225] Handling call
0318 02:51:34.006381 (+815929us) ts_tablet_manager.cc:1151] Deleting tablet 0d343e53f2354a3386b19d71ef00d5a4
0318 02:51:34.006414 (+ 33us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:34.174709 (+168295us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:34.208417 (+ 33708us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:34.218516 (+ 10099us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":795517}
I20260318 02:51:34.221122 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 0d343e53f2354a3386b19d71ef00d5a4 (table default.Table_7710260d7bd54a859b6fc9023ce450e2 [id=301be4fd1a6b44c6962f9386d1e7f91e]) successfully deleted
I20260318 02:51:34.225944 1175 tablet_replica.cc:333] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:34.235554 1915 raft_consensus.cc:493] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.235724 1915 raft_consensus.cc:515] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.236371 1915 leader_election.cc:290] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:34.237782 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7b339a29ef456997d74a7a95d4c03a" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:34.239387 719 leader_election.cc:343] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.245550 1174 tablet_bootstrap.cc:492] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:34.245592 1175 raft_consensus.cc:2243] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:34.245702 1174 ts_tablet_manager.cc:1403] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s
I20260318 02:51:34.245867 1175 raft_consensus.cc:2272] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.246492 1175 ts_tablet_manager.cc:1916] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:34.246474 1174 raft_consensus.cc:359] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.246644 1174 raft_consensus.cc:385] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.246692 1174 raft_consensus.cc:740] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.246876 1174 consensus_queue.cc:260] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.247525 1174 ts_tablet_manager.cc:1434] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:34.247787 1174 tablet_bootstrap.cc:492] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:34.249362 1174 tablet_bootstrap.cc:654] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:34.253515 1175 ts_tablet_manager.cc:1929] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:34.253805 1175 log.cc:1199] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/93479517a1d34d2d99633018a6a57127
I20260318 02:51:34.254474 1175 ts_tablet_manager.cc:1950] T 93479517a1d34d2d99633018a6a57127 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:34.254639 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7b339a29ef456997d74a7a95d4c03a" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:34.255620 719 leader_election.cc:343] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.255769 719 leader_election.cc:304] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:34.256186 1915 raft_consensus.cc:2749] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.281824 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_098e49ac0c274f5fbb960f0e5aff1892"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:34.282483 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_098e49ac0c274f5fbb960f0e5aff1892 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:34.282931 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5f63108c062348b1ba995ea16f40a695 consensus state has no leader
I20260318 02:51:34.283360 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_48e9661e2fda49c384c75e438fe90937" } new_table_name: "default.Table_60d9a93bf8e343458e1eb745b39ea7e5" modify_external_catalogs: true
W20260318 02:51:34.283838 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ecb2289a6bcd4b8ca6c3810b7d615bce consensus state has no leader
I20260318 02:51:34.284170 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7db492f7397146c69ce52c4e361c31d4" } modify_external_catalogs: true
I20260318 02:51:34.284333 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7db492f7397146c69ce52c4e361c31d4" } modify_external_catalogs: true
W20260318 02:51:34.284907 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c7a128649e834d0a85f3833f2152e040 consensus state has no leader
I20260318 02:51:34.285220 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_65363a41f18f4b13b6e74847567c753b" } modify_external_catalogs: true
I20260318 02:51:34.285379 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_65363a41f18f4b13b6e74847567c753b" } modify_external_catalogs: true
I20260318 02:51:34.286068 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7d354ce302b6453b980bc1324e6cd3d7" } modify_external_catalogs: true
I20260318 02:51:34.286206 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7d354ce302b6453b980bc1324e6cd3d7" } modify_external_catalogs: true
I20260318 02:51:34.287011 2009 raft_consensus.cc:493] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.287138 2009 raft_consensus.cc:515] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.287727 2009 leader_election.cc:290] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:34.289788 860 leader_election.cc:343] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 547762347d7843e989e55e0449ad9fcb
I20260318 02:51:34.293463 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1e7bd39aa78143a98dbbbb347da75cb9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:34.294240 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e7bd39aa78143a98dbbbb347da75cb9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:34.297786 862 leader_election.cc:343] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 547762347d7843e989e55e0449ad9fcb
I20260318 02:51:34.297966 862 leader_election.cc:304] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:34.298413 2009 raft_consensus.cc:2749] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:34.300702 441 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 1ac9581312964ad6afcc96f798fa534a (table default.Table_09ec6b975c384c24bc5e3e6dbe92caa6 [id=cafdea84974648a2b072c366228502ce], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1ac9581312964ad6afcc96f798fa534a consensus state has no leader
I20260318 02:51:34.304024 1172 tablet_bootstrap.cc:492] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:34.304199 1172 ts_tablet_manager.cc:1403] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.126s user 0.002s sys 0.002s
I20260318 02:51:34.305691 2085 log.cc:826] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7: Log is configured to *not* fsync() on all Append() calls
I20260318 02:51:34.309859 1960 raft_consensus.cc:493] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.310081 1960 raft_consensus.cc:515] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.311003 1960 leader_election.cc:290] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:34.312477 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868406102b748a5b13420b24bf16485" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:34.312741 783 raft_consensus.cc:2468] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:34.313282 999 leader_election.cc:304] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:34.313652 1960 raft_consensus.cc:2804] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:34.313784 1960 raft_consensus.cc:493] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:34.313891 1960 raft_consensus.cc:3060] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:34.314800 1184 ts_tablet_manager.cc:1929] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:34.315052 1184 log.cc:1199] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/f9bc73d3f85745ecb62d861b6375a987
I20260318 02:51:34.315518 1184 ts_tablet_manager.cc:1950] T f9bc73d3f85745ecb62d861b6375a987 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:34.316876 1184 tablet_replica.cc:333] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:34.316841 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet f9bc73d3f85745ecb62d861b6375a987 (table default.Table_5e18692d41ef4f6b9ac36936944042f7 [id=dfd0c35772ae4d71a6679f3bdaec5068]) successfully deleted
I20260318 02:51:34.317314 1184 raft_consensus.cc:2243] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:34.317595 1184 raft_consensus.cc:2272] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.322655 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868406102b748a5b13420b24bf16485" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:34.329839 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 740) took 1139 ms. Trace:
I20260318 02:51:34.330026 1175 rpcz_store.cc:276] 0318 02:51:33.190401 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.190650 (+ 249us) service_pool.cc:225] Handling call
0318 02:51:34.225164 (+1034514us) ts_tablet_manager.cc:1151] Deleting tablet 93479517a1d34d2d99633018a6a57127
0318 02:51:34.225463 (+ 299us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:34.250025 (+ 24562us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:34.253380 (+ 3355us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:34.329809 (+ 76429us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1014220}
I20260318 02:51:34.330889 1175 tablet_replica.cc:333] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:34.330891 1174 tablet_bootstrap.cc:492] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:34.331033 1174 ts_tablet_manager.cc:1403] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.083s user 0.024s sys 0.020s
I20260318 02:51:34.331262 1175 raft_consensus.cc:2243] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:34.331482 1175 raft_consensus.cc:2272] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.332441 1175 ts_tablet_manager.cc:1916] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:34.318670 1172 raft_consensus.cc:359] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:34.324286 997 leader_election.cc:343] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.331838 1174 raft_consensus.cc:359] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.335707 1174 raft_consensus.cc:385] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.335855 1174 raft_consensus.cc:740] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.336257 1174 consensus_queue.cc:260] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.336422 1172 raft_consensus.cc:385] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.336671 1172 raft_consensus.cc:740] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.336973 1172 consensus_queue.cc:260] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.337141 1184 ts_tablet_manager.cc:1916] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:34.337265 1174 ts_tablet_manager.cc:1434] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260318 02:51:34.337800 1174 tablet_bootstrap.cc:492] T 503386365f6a49f6b84c64b59b764c10 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:34.344617 1874 consensus_queue.cc:1048] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:34.316664 1960 raft_consensus.cc:515] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.350003 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868406102b748a5b13420b24bf16485" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:34.350642 997 leader_election.cc:343] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.356238 1184 ts_tablet_manager.cc:1929] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:34.358258 454 catalog_manager.cc:5671] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:34.358621 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868406102b748a5b13420b24bf16485" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:34.358676 454 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet ce0ab476b9a54cc586a4c28e23382bfc (table default.Table_51fd1fd451544782b3785014979adeba [id=94288205d88b4c6ca1f94de1b201a349]). Expected version 1 got 0
I20260318 02:51:34.358870 785 raft_consensus.cc:3060] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:34.359120 454 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet d0652735b8c24c23ade92913c1c7ad0f (table default.Table_20867faf86da4889b7995990926923a7 [id=5bc787aad96b4abd82ab3e033020ea9c]). Expected version 1 got 0
I20260318 02:51:34.359501 454 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 1516525b471540288c6cb5d61120d430 (table default.Table_4e770bc308894d9094b88315d9093ba5 [id=433e7aa77412424ebb38784bb073d1fb]). Expected version 6 got 0
I20260318 02:51:34.359772 1184 log.cc:1199] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/f5a829abed0444b79c48ab080d024824
I20260318 02:51:34.360275 1184 ts_tablet_manager.cc:1950] T f5a829abed0444b79c48ab080d024824 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:34.361449 785 raft_consensus.cc:2468] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:34.362661 759 tablet_service.cc:1511] Processing CreateTablet for tablet 54b8f3520a4e4a5987bb7a6732c7b882 (DEFAULT_TABLE table=default.Table_9724bed50bdb463db42189c0d44f43a0 [id=27e3edfa63b3468fb147e122bc0ba28a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.362881 1184 tablet_replica.cc:333] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:34.357942 1960 leader_election.cc:290] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:34.363041 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b8f3520a4e4a5987bb7a6732c7b882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.363521 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet f5a829abed0444b79c48ab080d024824 (table default.Table_b81f87a10bfa4885ba1ad5ed5fdf1828 [id=bdcf510793fa400cb6b8ddd13fd3fe0b]) successfully deleted
I20260318 02:51:34.363973 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 54b8f3520a4e4a5987bb7a6732c7b882 (DEFAULT_TABLE table=default.Table_9724bed50bdb463db42189c0d44f43a0 [id=27e3edfa63b3468fb147e122bc0ba28a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.364387 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b8f3520a4e4a5987bb7a6732c7b882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.371527 750 tablet_service.cc:1511] Processing CreateTablet for tablet dff92dfca39e47f98d709cc67b97df66 (DEFAULT_TABLE table=default.Table_bf3af9d6919949a6a752d58fd7782bc0 [id=eddab2ab7aac4f45901e0b0c65c477b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.371665 1184 raft_consensus.cc:2243] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:34.371869 1184 raft_consensus.cc:2272] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.371968 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff92dfca39e47f98d709cc67b97df66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.372028 748 tablet_service.cc:1511] Processing CreateTablet for tablet 90c762eb274341ecb10deb28a0bd2d3a (DEFAULT_TABLE table=default.Table_f95a3e0963444695ba709d458021d644 [id=c0e2893fbfba4b2da0459ec8282b3884]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.372303 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c762eb274341ecb10deb28a0bd2d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.372467 1184 ts_tablet_manager.cc:1916] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:34.373629 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 1d3eb0cf4190436680ad3265a1c1c31b (DEFAULT_TABLE table=default.Table_21a21b6af7a7490983be4155ea8b15ac [id=48ff5914e26e4e8ea29cab72f7fb361b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.374006 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 90c762eb274341ecb10deb28a0bd2d3a (DEFAULT_TABLE table=default.Table_f95a3e0963444695ba709d458021d644 [id=c0e2893fbfba4b2da0459ec8282b3884]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.373629 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 24947904568c4bbf93e544c0e22d0054 (DEFAULT_TABLE table=default.Table_537505805e734d2d82693fe1b781bab6 [id=49d88cdb60264e9fbd95ef77457fe1d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.374501 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3eb0cf4190436680ad3265a1c1c31b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.375010 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24947904568c4bbf93e544c0e22d0054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.377638 761 tablet_service.cc:1511] Processing CreateTablet for tablet 1d3eb0cf4190436680ad3265a1c1c31b (DEFAULT_TABLE table=default.Table_21a21b6af7a7490983be4155ea8b15ac [id=48ff5914e26e4e8ea29cab72f7fb361b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.378019 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3eb0cf4190436680ad3265a1c1c31b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.385100 1172 ts_tablet_manager.cc:1434] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.081s user 0.003s sys 0.000s
I20260318 02:51:34.385516 1172 tablet_bootstrap.cc:492] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:34.385994 759 tablet_service.cc:1511] Processing CreateTablet for tablet 24947904568c4bbf93e544c0e22d0054 (DEFAULT_TABLE table=default.Table_537505805e734d2d82693fe1b781bab6 [id=49d88cdb60264e9fbd95ef77457fe1d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.386490 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24947904568c4bbf93e544c0e22d0054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.387037 1172 tablet_bootstrap.cc:654] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:34.389030 999 leader_election.cc:304] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:34.389039 1027 tablet_service.cc:1511] Processing CreateTablet for tablet dff92dfca39e47f98d709cc67b97df66 (DEFAULT_TABLE table=default.Table_bf3af9d6919949a6a752d58fd7782bc0 [id=eddab2ab7aac4f45901e0b0c65c477b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.389351 1874 raft_consensus.cc:493] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.389511 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff92dfca39e47f98d709cc67b97df66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.389456 1874 raft_consensus.cc:515] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.390028 1874 leader_election.cc:290] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:34.390154 1874 raft_consensus.cc:2804] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:34.390242 1874 raft_consensus.cc:697] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:34.390446 1874 consensus_queue.cc:237] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.392783 1111 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
W20260318 02:51:34.394192 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98101333a294447aa6df09c7fa62b565 consensus state has no leader
I20260318 02:51:34.394601 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_cec1585fa5824e7682f05533101d20eb" } new_table_name: "default.Table_79bea80cab3d40f5bead32f2fdcf09fa" modify_external_catalogs: true
I20260318 02:51:34.394932 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6de905c387094641af62b74f3e0cee37" } modify_external_catalogs: true
I20260318 02:51:34.395146 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6de905c387094641af62b74f3e0cee37" } modify_external_catalogs: true
I20260318 02:51:34.396486 748 tablet_service.cc:1511] Processing CreateTablet for tablet 4a60e189801440bca43f35fe787d3aa7 (DEFAULT_TABLE table=default.Table_4c1ff8f187b34eb59f2b189fbf314142 [id=01148f7db8934decb958485d618c88a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.396946 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a60e189801440bca43f35fe787d3aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.398849 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_38436e11a4b24cfc9f350d474dc9cb5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:34.399412 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38436e11a4b24cfc9f350d474dc9cb5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:34.399720 1915 raft_consensus.cc:493] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.399847 1915 raft_consensus.cc:515] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.400403 1915 leader_election.cc:290] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:34.402302 1040 tablet_service.cc:1511] Processing CreateTablet for tablet c2d50359bd0046c3890d184064175a65 (DEFAULT_TABLE table=default.Table_aa14256b7d72462f9010a2e4db787517 [id=a8b40135961e49ee85215fe4c4914218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.402534 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 4a60e189801440bca43f35fe787d3aa7 (DEFAULT_TABLE table=default.Table_4c1ff8f187b34eb59f2b189fbf314142 [id=01148f7db8934decb958485d618c88a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.402551 761 tablet_service.cc:1511] Processing CreateTablet for tablet f2f1023702ab42118253e4bbd603f7f7 (DEFAULT_TABLE table=default.Table_ba684d1d27e94924bc3c7db526d083cf [id=860307e2cfda46b08bd6e96703e57e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.402707 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d50359bd0046c3890d184064175a65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.402904 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f1023702ab42118253e4bbd603f7f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.403374 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6794f8a443f41b195fb326d49f56756" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:34.403894 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a60e189801440bca43f35fe787d3aa7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:34.403949 719 leader_election.cc:343] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.409713 1174 tablet_bootstrap.cc:654] T 503386365f6a49f6b84c64b59b764c10 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:34.402302 1033 tablet_service.cc:1511] Processing CreateTablet for tablet f2f1023702ab42118253e4bbd603f7f7 (DEFAULT_TABLE table=default.Table_ba684d1d27e94924bc3c7db526d083cf [id=860307e2cfda46b08bd6e96703e57e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.412545 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f1023702ab42118253e4bbd603f7f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.412987 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 121659c2b4da4c4f932dea3d0d0ee8cb
I20260318 02:51:34.413823 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_bf8a4d0fd01741ef9f71f8880663e4e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:34.414178 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 121659c2b4da4c4f932dea3d0d0ee8cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:34.414469 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf8a4d0fd01741ef9f71f8880663e4e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:34.415755 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a
I20260318 02:51:34.416635 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8a988f7cdf3b4dff9e4bbf98492e7644"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:34.417196 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a988f7cdf3b4dff9e4bbf98492e7644 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:34.417524 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6794f8a443f41b195fb326d49f56756" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:34.417718 785 raft_consensus.cc:2468] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:34.419271 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet d279b1b52366488f80097eaf52dfb2db
I20260318 02:51:34.419932 457 master_service.cc:954] ReplaceTablet: received request to replace tablet e916c5419e3c457f98a47c6a1c6cdd56 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:34.420346 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet ce82c595e30a4878be25be8eb3d30790
I20260318 02:51:34.422685 750 tablet_service.cc:1511] Processing CreateTablet for tablet c2d50359bd0046c3890d184064175a65 (DEFAULT_TABLE table=default.Table_aa14256b7d72462f9010a2e4db787517 [id=a8b40135961e49ee85215fe4c4914218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.423082 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d50359bd0046c3890d184064175a65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.417057 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:34.425195 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:34.425812 766 tablet_service.cc:1558] Processing DeleteTablet for tablet d279b1b52366488f80097eaf52dfb2db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:34.425845 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 121659c2b4da4c4f932dea3d0d0ee8cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:34.426584 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 20c6f1790ed34581b7507ec63ec66718 with delete_type TABLET_DATA_DELETED (replaced by tablet ce82c595e30a4878be25be8eb3d30790) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:34.427014 1176 tablet_replica.cc:333] T 20c6f1790ed34581b7507ec63ec66718 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:34.427182 1176 raft_consensus.cc:2243] T 20c6f1790ed34581b7507ec63ec66718 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:34.427312 1176 raft_consensus.cc:2272] T 20c6f1790ed34581b7507ec63ec66718 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.427827 1176 ts_tablet_manager.cc:1916] T 20c6f1790ed34581b7507ec63ec66718 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:34.424990 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet ce82c595e30a4878be25be8eb3d30790 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:34.428472 756 tablet_service.cc:1558] Processing DeleteTablet for tablet ce82c595e30a4878be25be8eb3d30790 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:34.418375 999 leader_election.cc:304] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:34.418377 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6794f8a443f41b195fb326d49f56756" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:34.428793 1960 raft_consensus.cc:2804] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:34.428874 1960 raft_consensus.cc:493] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:34.428934 1960 raft_consensus.cc:3060] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:34.431098 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet d279b1b52366488f80097eaf52dfb2db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:34.431394 1960 raft_consensus.cc:515] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.431990 900 tablet_service.cc:1511] Processing CreateTablet for tablet 54b8f3520a4e4a5987bb7a6732c7b882 (DEFAULT_TABLE table=default.Table_9724bed50bdb463db42189c0d44f43a0 [id=27e3edfa63b3468fb147e122bc0ba28a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.432403 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54b8f3520a4e4a5987bb7a6732c7b882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.433864 1176 ts_tablet_manager.cc:1929] T 20c6f1790ed34581b7507ec63ec66718 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:34.433974 1176 log.cc:1199] T 20c6f1790ed34581b7507ec63ec66718 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/20c6f1790ed34581b7507ec63ec66718
I20260318 02:51:34.434214 1176 ts_tablet_manager.cc:1950] T 20c6f1790ed34581b7507ec63ec66718 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:34.434227 897 tablet_service.cc:1511] Processing CreateTablet for tablet dff92dfca39e47f98d709cc67b97df66 (DEFAULT_TABLE table=default.Table_bf3af9d6919949a6a752d58fd7782bc0 [id=eddab2ab7aac4f45901e0b0c65c477b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.434585 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff92dfca39e47f98d709cc67b97df66. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:34.434875 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a already in progress: creating tablet
W20260318 02:51:34.435170 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet d279b1b52366488f80097eaf52dfb2db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d279b1b52366488f80097eaf52dfb2db already in progress: creating tablet
I20260318 02:51:34.435717 903 tablet_service.cc:1511] Processing CreateTablet for tablet 24947904568c4bbf93e544c0e22d0054 (DEFAULT_TABLE table=default.Table_537505805e734d2d82693fe1b781bab6 [id=49d88cdb60264e9fbd95ef77457fe1d4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:34.435842 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 121659c2b4da4c4f932dea3d0d0ee8cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 121659c2b4da4c4f932dea3d0d0ee8cb already in progress: creating tablet
I20260318 02:51:34.436033 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24947904568c4bbf93e544c0e22d0054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.436106 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 20c6f1790ed34581b7507ec63ec66718 (table default.Table_cf5f0ff49fa24bf18b21a4ebbe45d2e4 [id=c532f0623efe4c3f8d9c90ae9c3d02c3]) successfully deleted
W20260318 02:51:34.436358 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet ce82c595e30a4878be25be8eb3d30790 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce82c595e30a4878be25be8eb3d30790 already in progress: creating tablet
I20260318 02:51:34.436558 891 tablet_service.cc:1511] Processing CreateTablet for tablet 90c762eb274341ecb10deb28a0bd2d3a (DEFAULT_TABLE table=default.Table_f95a3e0963444695ba709d458021d644 [id=c0e2893fbfba4b2da0459ec8282b3884]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.436868 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c762eb274341ecb10deb28a0bd2d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.440676 750 tablet_service.cc:1511] Processing CreateTablet for tablet a7c35c13521b43789a1f0b6092b4d855 (DEFAULT_TABLE table=default.Table_81d5251cb78d4efc811c7f615bf91ce4 [id=a3d523c5f25e4e4eb647540d03a07988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.441287 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7c35c13521b43789a1f0b6092b4d855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.443042 457 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 1516525b471540288c6cb5d61120d430 (table default.Table_4e770bc308894d9094b88315d9093ba5 [id=433e7aa77412424ebb38784bb073d1fb]). Expected version 6 got 0
I20260318 02:51:34.443240 457 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet ca23d4d0d3734fceb14966a4f2ad9c35 (table default.Table_10f6937d0016448caceef24711896b5f [id=61241ff920584692bba476799b6a60e7]). Expected version 2 got 0
I20260318 02:51:34.443493 457 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet b5c19bc5e07949088c84cedbf944dfdb (table default.Table_cec1585fa5824e7682f05533101d20eb [id=873432f002e14a4fa7065dcfe5caebd5]). Expected version 5 got 0
I20260318 02:51:34.444222 457 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 061ebb62f4c54a2a8c24b90ec15402d3 (table default.Table_88caf570ec6a4dfea94952fb5718c9c6 [id=5a3571f0765948588578d8e5185807a8]). Expected version 1 got 0
I20260318 02:51:34.448305 748 tablet_service.cc:1511] Processing CreateTablet for tablet 416d5d20d0f649ca872de02471fa9cf8 (DEFAULT_TABLE table=default.Table_b81a2f1910364b37874f85258bf76a65 [id=b2cd57048fd346fd9f7e41dd7ee4dd93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.449409 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 9777963ff20c4a799de2870555f6b335
I20260318 02:51:34.449695 907 tablet_service.cc:1511] Processing CreateTablet for tablet 1d3eb0cf4190436680ad3265a1c1c31b (DEFAULT_TABLE table=default.Table_21a21b6af7a7490983be4155ea8b15ac [id=48ff5914e26e4e8ea29cab72f7fb361b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.450085 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3eb0cf4190436680ad3265a1c1c31b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.451619 2009 raft_consensus.cc:493] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.451742 2009 raft_consensus.cc:515] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.452195 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 9777963ff20c4a799de2870555f6b335 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:34.455016 761 tablet_service.cc:1511] Processing CreateTablet for tablet 6f0d30175b6c4dba8568ffc1e097b27c (DEFAULT_TABLE table=default.Table_1006656cce8d403ca7be0b25477c41cc [id=9ffc6abc64094bddade8625b47a4f777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.455662 896 tablet_service.cc:1511] Processing CreateTablet for tablet 4a60e189801440bca43f35fe787d3aa7 (DEFAULT_TABLE table=default.Table_4c1ff8f187b34eb59f2b189fbf314142 [id=01148f7db8934decb958485d618c88a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.456019 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a60e189801440bca43f35fe787d3aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.456585 2009 leader_election.cc:290] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:34.457203 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105326aea9f744779ca76e0cbb2448cd" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:34.457564 1063 raft_consensus.cc:2393] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a903d876086423b8016d705b98895ad in current term 1: Already voted for candidate 9422bb7011f342b08be0b073a88c4c4d in this term.
I20260318 02:51:34.458624 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105326aea9f744779ca76e0cbb2448cd" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:34.459306 719 leader_election.cc:304] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:34.440392 1172 tablet_bootstrap.cc:492] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:34.459672 1172 ts_tablet_manager.cc:1403] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.074s user 0.003s sys 0.000s
I20260318 02:51:34.459712 1915 raft_consensus.cc:3060] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:34.446413 1027 tablet_service.cc:1511] Processing CreateTablet for tablet a7c35c13521b43789a1f0b6092b4d855 (DEFAULT_TABLE table=default.Table_81d5251cb78d4efc811c7f615bf91ce4 [id=a3d523c5f25e4e4eb647540d03a07988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.446498 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 416d5d20d0f649ca872de02471fa9cf8 (DEFAULT_TABLE table=default.Table_b81a2f1910364b37874f85258bf76a65 [id=b2cd57048fd346fd9f7e41dd7ee4dd93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.460759 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416d5d20d0f649ca872de02471fa9cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.461361 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416d5d20d0f649ca872de02471fa9cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.462250 1915 raft_consensus.cc:2749] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.463085 1960 leader_election.cc:290] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:34.465834 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6794f8a443f41b195fb326d49f56756" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
W20260318 02:51:34.466511 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 9777963ff20c4a799de2870555f6b335 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9777963ff20c4a799de2870555f6b335 already in progress: creating tablet
I20260318 02:51:34.467621 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7c35c13521b43789a1f0b6092b4d855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.468268 783 raft_consensus.cc:2468] T f6794f8a443f41b195fb326d49f56756 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:34.469682 1184 ts_tablet_manager.cc:1929] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:34.470695 748 tablet_service.cc:1511] Processing CreateTablet for tablet fcbaf43f3ccc48a2b7f09d04c2da060d (DEFAULT_TABLE table=default.Table_6b7904942dc9449cbe5e72949e06d2ee [id=5d7c033b6448429f88c7849a7dd82e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.471104 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbaf43f3ccc48a2b7f09d04c2da060d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.471218 1184 log.cc:1199] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/29541950221544e396ada303fbbb5002
I20260318 02:51:34.471530 1184 ts_tablet_manager.cc:1950] T 29541950221544e396ada303fbbb5002 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:34.471766 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f0d30175b6c4dba8568ffc1e097b27c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.475831 893 tablet_service.cc:1511] Processing CreateTablet for tablet f2f1023702ab42118253e4bbd603f7f7 (DEFAULT_TABLE table=default.Table_ba684d1d27e94924bc3c7db526d083cf [id=860307e2cfda46b08bd6e96703e57e33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.476265 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2f1023702ab42118253e4bbd603f7f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.476900 860 leader_election.cc:304] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:34.477824 2009 raft_consensus.cc:2749] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.451059 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 9777963ff20c4a799de2870555f6b335 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:34.473402 1026 tablet_service.cc:1511] Processing CreateTablet for tablet fcbaf43f3ccc48a2b7f09d04c2da060d (DEFAULT_TABLE table=default.Table_6b7904942dc9449cbe5e72949e06d2ee [id=5d7c033b6448429f88c7849a7dd82e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.473771 1172 raft_consensus.cc:359] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.481037 1172 raft_consensus.cc:385] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.481117 1172 raft_consensus.cc:740] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.483296 1172 consensus_queue.cc:260] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.483978 1172 ts_tablet_manager.cc:1434] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260318 02:51:34.484265 1172 tablet_bootstrap.cc:492] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:34.484644 1184 tablet_replica.cc:333] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:34.484828 905 tablet_service.cc:1558] Processing DeleteTablet for tablet 121659c2b4da4c4f932dea3d0d0ee8cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:34.485212 894 tablet_service.cc:1511] Processing CreateTablet for tablet c2d50359bd0046c3890d184064175a65 (DEFAULT_TABLE table=default.Table_aa14256b7d72462f9010a2e4db787517 [id=a8b40135961e49ee85215fe4c4914218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.485605 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2d50359bd0046c3890d184064175a65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.487006 750 tablet_service.cc:1511] Processing CreateTablet for tablet ec96b885e9604bba9d425c3e3e3f61e6 (DEFAULT_TABLE table=default.Table_2f3393db9c104844995b512bb2ecc2ca [id=c47b40838bc0414cbf17134a1f43176e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.487396 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec96b885e9604bba9d425c3e3e3f61e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.488950 1184 raft_consensus.cc:2243] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:34.489221 1184 raft_consensus.cc:2272] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.489447 1033 tablet_service.cc:1511] Processing CreateTablet for tablet a3e2b123a4824b909286c3785ed21bdd (DEFAULT_TABLE table=default.Table_65dbad4ac5b24e5eb1768ac4e6c3127b [id=b48a6b22f34b443b8398717ce9b1ed0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.489748 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3976c82c914fbaa88df25e1642ed6c (DEFAULT_TABLE table=default.Table_d3f9c221caf74f098016962ca5ae047e [id=5597bd0e49214fbbaa3ea7e701ac2a23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.489840 1184 ts_tablet_manager.cc:1916] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:34.489974 1038 tablet_service.cc:1511] Processing CreateTablet for tablet d23a51e4c86142ac902fb46598abdd0c (DEFAULT_TABLE table=default.Table_a99ee13e334549a2b8222bd8bad5bf77 [id=1a67760627fc4817818bf6a72131ac55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.490188 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 29541950221544e396ada303fbbb5002 (table default.Table_f6489e5e0d7f47cb889864d493a7b77c [id=85cf06ab49054e56859af17f79130d0a]) successfully deleted
I20260318 02:51:34.490819 1040 tablet_service.cc:1511] Processing CreateTablet for tablet ec96b885e9604bba9d425c3e3e3f61e6 (DEFAULT_TABLE table=default.Table_2f3393db9c104844995b512bb2ecc2ca [id=c47b40838bc0414cbf17134a1f43176e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.492116 905 tablet_service.cc:1558] Processing DeleteTablet for tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:34.492627 888 tablet_service.cc:1558] Processing DeleteTablet for tablet ce82c595e30a4878be25be8eb3d30790 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:34.494299 759 tablet_service.cc:1511] Processing CreateTablet for tablet 036c17d033b145a681843d14f67ab575 (DEFAULT_TABLE table=default.Table_b4f791ee528d46b59428dc367b5be0a8 [id=e3979c7eefe84cd7bb1dd36fa9351b7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.494704 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036c17d033b145a681843d14f67ab575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.494663 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_45b910f654434aa5a5763c24dfef9168"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:34.494774 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8854e049411f4e6f88db15613e09aa46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:34.495093 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d61882f9637443aea484b9928b8a27c9" } new_table_name: "default.Table_e81309b34b2e485c9a338cb71f28c12a" modify_external_catalogs: true
W20260318 02:51:34.495263 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45b910f654434aa5a5763c24dfef9168 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:34.495292 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8854e049411f4e6f88db15613e09aa46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:34.496547 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ac071828b4034d5a9bf1ffbdf5e40849" } new_table_name: "default.Table_66f554b45dc74955b3c5b3b8594dbc62" modify_external_catalogs: true
I20260318 02:51:34.496559 756 tablet_service.cc:1511] Processing CreateTablet for tablet d23a51e4c86142ac902fb46598abdd0c (DEFAULT_TABLE table=default.Table_a99ee13e334549a2b8222bd8bad5bf77 [id=1a67760627fc4817818bf6a72131ac55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.497045 766 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3976c82c914fbaa88df25e1642ed6c (DEFAULT_TABLE table=default.Table_d3f9c221caf74f098016962ca5ae047e [id=5597bd0e49214fbbaa3ea7e701ac2a23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.497903 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2fc220fcd0234c5f91b510993149dd37"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:34.498423 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2fc220fcd0234c5f91b510993149dd37 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:34.499538 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3976c82c914fbaa88df25e1642ed6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.500216 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f9d29b4a6da5460faa8dad3cbe9d77ee" } new_table_name: "default.Table_c0889091422144f8af318ab6f38afd05" modify_external_catalogs: true
I20260318 02:51:34.501222 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d23a51e4c86142ac902fb46598abdd0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.502775 999 leader_election.cc:304] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:34.504027 1959 raft_consensus.cc:2804] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:34.504160 1959 raft_consensus.cc:697] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:34.504390 1959 consensus_queue.cc:237] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.504940 454 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_4775eaa0e7e84642aa0a8f8b2885610e [id=463a6721eb0d43d09deeb283d1cc4233] alter complete (version 1)
I20260318 02:51:34.505622 2075 tablet.cc:1723] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260318 02:51:34.508437 759 tablet_service.cc:1511] Processing CreateTablet for tablet fa68d30736044b71b38938fded1b314b (DEFAULT_TABLE table=default.Table_011412ca9e304055969a0ba44b82c555 [id=c21facd3dbe74a239960adf801256801]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.509004 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa68d30736044b71b38938fded1b314b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.513443 2097 tablet.cc:1723] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260318 02:51:34.516284 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_41b35eb8bd42409cbe13e96d577de423"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:34.517038 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41b35eb8bd42409cbe13e96d577de423 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:34.519124 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet b716c3a80d4a44d190de38f926098efc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:34.519629 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet dea25aaad60a4b2483a8832f995d1316 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:34.520404 1042 tablet_service.cc:1511] Processing CreateTablet for tablet fa68d30736044b71b38938fded1b314b (DEFAULT_TABLE table=default.Table_011412ca9e304055969a0ba44b82c555 [id=c21facd3dbe74a239960adf801256801]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.519204 748 tablet_service.cc:1511] Processing CreateTablet for tablet a3e2b123a4824b909286c3785ed21bdd (DEFAULT_TABLE table=default.Table_65dbad4ac5b24e5eb1768ac4e6c3127b [id=b48a6b22f34b443b8398717ce9b1ed0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.525460 750 tablet_service.cc:1511] Processing CreateTablet for tablet 243a2f81711f4712ab21c8ae5bdc94a8 (DEFAULT_TABLE table=default.Table_db8a1a6484c54822ad31ad887f108929 [id=e55712b310ea4b118a59b291a71d4291]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.523934 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e2b123a4824b909286c3785ed21bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.526821 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243a2f81711f4712ab21c8ae5bdc94a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.530582 900 tablet_service.cc:1558] Processing DeleteTablet for tablet d279b1b52366488f80097eaf52dfb2db with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:34.452220 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 6f0d30175b6c4dba8568ffc1e097b27c (DEFAULT_TABLE table=default.Table_1006656cce8d403ca7be0b25477c41cc [id=9ffc6abc64094bddade8625b47a4f777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.477224 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c762eb274341ecb10deb28a0bd2d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.533336 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec96b885e9604bba9d425c3e3e3f61e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.533649 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbaf43f3ccc48a2b7f09d04c2da060d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.533836 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3976c82c914fbaa88df25e1642ed6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.539574 888 tablet_service.cc:1511] Processing CreateTablet for tablet 416d5d20d0f649ca872de02471fa9cf8 (DEFAULT_TABLE table=default.Table_b81a2f1910364b37874f85258bf76a65 [id=b2cd57048fd346fd9f7e41dd7ee4dd93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.540067 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416d5d20d0f649ca872de02471fa9cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.539595 905 tablet_service.cc:1511] Processing CreateTablet for tablet 6f0d30175b6c4dba8568ffc1e097b27c (DEFAULT_TABLE table=default.Table_1006656cce8d403ca7be0b25477c41cc [id=9ffc6abc64094bddade8625b47a4f777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.540506 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d23a51e4c86142ac902fb46598abdd0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.540632 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f0d30175b6c4dba8568ffc1e097b27c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.548872 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e2b123a4824b909286c3785ed21bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.552919 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_98ca59366b9c4d358295432c55ccbc2b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:34.553203 900 tablet_service.cc:1511] Processing CreateTablet for tablet a7c35c13521b43789a1f0b6092b4d855 (DEFAULT_TABLE table=default.Table_81d5251cb78d4efc811c7f615bf91ce4 [id=a3d523c5f25e4e4eb647540d03a07988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.553617 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7c35c13521b43789a1f0b6092b4d855. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:34.553646 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98ca59366b9c4d358295432c55ccbc2b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:34.558323 1184 ts_tablet_manager.cc:1929] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:34.559952 2009 raft_consensus.cc:493] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.560108 2009 raft_consensus.cc:515] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.560781 2009 leader_election.cc:290] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:34.560284 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 243a2f81711f4712ab21c8ae5bdc94a8 (DEFAULT_TABLE table=default.Table_db8a1a6484c54822ad31ad887f108929 [id=e55712b310ea4b118a59b291a71d4291]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.561471 1184 log.cc:1199] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/7883f526d06e442c81f1b66fd89d2cd0
I20260318 02:51:34.560768 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 2aaac92ff81d4c9bb05cf21e7b4d9979 (DEFAULT_TABLE table=default.Table_ae9aba2a307a4ccbb1c86607f3432233 [id=68bb4ffe5aa04df0960be0d546961066]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.561697 1172 tablet_bootstrap.cc:654] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:34.561797 1184 ts_tablet_manager.cc:1950] T 7883f526d06e442c81f1b66fd89d2cd0 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
W20260318 02:51:34.561766 860 leader_election.cc:343] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 2c5038e9e1074f46976a1a5bb4282944
I20260318 02:51:34.561650 759 tablet_service.cc:1511] Processing CreateTablet for tablet 2aaac92ff81d4c9bb05cf21e7b4d9979 (DEFAULT_TABLE table=default.Table_ae9aba2a307a4ccbb1c86607f3432233 [id=68bb4ffe5aa04df0960be0d546961066]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.562738 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 036c17d033b145a681843d14f67ab575 (DEFAULT_TABLE table=default.Table_b4f791ee528d46b59428dc367b5be0a8 [id=e3979c7eefe84cd7bb1dd36fa9351b7e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:34.562801 862 leader_election.cc:343] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2c5038e9e1074f46976a1a5bb4282944
I20260318 02:51:34.562889 862 leader_election.cc:304] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:34.562783 1043 tablet_service.cc:1511] Processing CreateTablet for tablet be210e062db54f52883b4298f63d1821 (DEFAULT_TABLE table=default.Table_75e9c86b388f4ece810c6d095af5da19 [id=ee3fcb7c31814458b8161ea53f372f85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.562961 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aaac92ff81d4c9bb05cf21e7b4d9979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.563436 2009 raft_consensus.cc:2749] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.564270 750 tablet_service.cc:1511] Processing CreateTablet for tablet be210e062db54f52883b4298f63d1821 (DEFAULT_TABLE table=default.Table_75e9c86b388f4ece810c6d095af5da19 [id=ee3fcb7c31814458b8161ea53f372f85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.565002 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be210e062db54f52883b4298f63d1821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.565629 1035 tablet_service.cc:1511] Processing CreateTablet for tablet eb1a59d1153b41eb9d95b931ffafdd16 (DEFAULT_TABLE table=default.Table_fb4d36f8e2cf4fab8b4e072b67797e98 [id=17923acb4ccd455c8b5ee62354eb1052]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.566707 766 tablet_service.cc:1511] Processing CreateTablet for tablet eb1a59d1153b41eb9d95b931ffafdd16 (DEFAULT_TABLE table=default.Table_fb4d36f8e2cf4fab8b4e072b67797e98 [id=17923acb4ccd455c8b5ee62354eb1052]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.567143 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1a59d1153b41eb9d95b931ffafdd16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.567689 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa68d30736044b71b38938fded1b314b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.573804 761 tablet_service.cc:1511] Processing CreateTablet for tablet bb2152297eba46ac91e95de4157dd52c (DEFAULT_TABLE table=default.Table_17df338b31d74ae787181f5263811168 [id=309bffa06f77489ba2eb5d088c264aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.573889 1026 tablet_service.cc:1511] Processing CreateTablet for tablet bb2152297eba46ac91e95de4157dd52c (DEFAULT_TABLE table=default.Table_17df338b31d74ae787181f5263811168 [id=309bffa06f77489ba2eb5d088c264aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.574227 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2152297eba46ac91e95de4157dd52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.574227 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2152297eba46ac91e95de4157dd52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.580986 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f0d30175b6c4dba8568ffc1e097b27c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.583137 756 tablet_service.cc:1511] Processing CreateTablet for tablet b3605a5c703c4df5b2f32edf185cb126 (DEFAULT_TABLE table=default.Table_762224444e604c1fa386410335af4f48 [id=ef9a2a8300044eb19f2b50dc13cbe776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.583701 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3605a5c703c4df5b2f32edf185cb126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.586217 1915 raft_consensus.cc:493] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.586367 1915 raft_consensus.cc:515] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.587181 1915 leader_election.cc:290] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:34.587750 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a6983dce4e476cae97b3ecb1133077" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:34.587985 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a6983dce4e476cae97b3ecb1133077" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:34.588558 719 leader_election.cc:343] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:34.589022 719 leader_election.cc:343] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.589121 719 leader_election.cc:304] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:34.589236 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243a2f81711f4712ab21c8ae5bdc94a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.589529 1915 raft_consensus.cc:2749] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.590011 748 tablet_service.cc:1511] Processing CreateTablet for tablet fc96b13affd442eca3b671a3741b6000 (DEFAULT_TABLE table=default.Table_51ec88321a154803836994b4c5430993 [id=f4308b8efe454170bce7eff85fab0959]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.590425 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc96b13affd442eca3b671a3741b6000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.593000 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aaac92ff81d4c9bb05cf21e7b4d9979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.593253 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be210e062db54f52883b4298f63d1821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.595857 898 tablet_service.cc:1558] Processing DeleteTablet for tablet 9777963ff20c4a799de2870555f6b335 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:34.596124 1960 raft_consensus.cc:493] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.596428 902 tablet_service.cc:1511] Processing CreateTablet for tablet a3e2b123a4824b909286c3785ed21bdd (DEFAULT_TABLE table=default.Table_65dbad4ac5b24e5eb1768ac4e6c3127b [id=b48a6b22f34b443b8398717ce9b1ed0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.596359 1960 raft_consensus.cc:515] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.596886 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e2b123a4824b909286c3785ed21bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.598045 1960 leader_election.cc:290] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:34.600401 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 768) took 1023 ms. Trace:
I20260318 02:51:34.600492 1184 rpcz_store.cc:276] 0318 02:51:33.579255 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.579330 (+ 75us) service_pool.cc:225] Handling call
0318 02:51:34.484603 (+905273us) ts_tablet_manager.cc:1151] Deleting tablet 7883f526d06e442c81f1b66fd89d2cd0
0318 02:51:34.484610 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:34.538879 (+ 54269us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:34.558214 (+ 19335us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:34.600378 (+ 42164us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":905113}
W20260318 02:51:34.600836 999 leader_election.cc:343] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 65c50b0813b04f30896568ab2b680ba8
I20260318 02:51:34.600989 1184 tablet_replica.cc:333] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:34.601176 1184 raft_consensus.cc:2243] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:34.601333 1184 raft_consensus.cc:2272] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.601933 1184 ts_tablet_manager.cc:1916] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:34.603076 1038 tablet_service.cc:1511] Processing CreateTablet for tablet b3605a5c703c4df5b2f32edf185cb126 (DEFAULT_TABLE table=default.Table_762224444e604c1fa386410335af4f48 [id=ef9a2a8300044eb19f2b50dc13cbe776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.603574 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3605a5c703c4df5b2f32edf185cb126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.606693 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 7883f526d06e442c81f1b66fd89d2cd0 (table default.Table_bc4b73281db84d099008d5b137871ff9 [id=32f5b93025f84549a496e5827512aed5]) successfully deleted
I20260318 02:51:34.607846 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0dcf05cd68b046b0a50ee043026b97fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:34.608518 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0dcf05cd68b046b0a50ee043026b97fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:34.610378 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a1a0cf6e73df4034be50c53e585878c0" } new_table_name: "default.Table_278b10b38c074522b0e03e24d653346d" modify_external_catalogs: true
I20260318 02:51:34.610417 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c2807b5496c14bac97f8e7c9339da762"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:34.610966 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2807b5496c14bac97f8e7c9339da762 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:34.613807 1172 tablet_bootstrap.cc:492] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:34.620863 1172 ts_tablet_manager.cc:1403] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.137s user 0.001s sys 0.003s
I20260318 02:51:34.623457 1172 raft_consensus.cc:359] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.624156 759 tablet_service.cc:1511] Processing CreateTablet for tablet b510f3c213104798971cf84c95e357d7 (DEFAULT_TABLE table=default.Table_b87c8d210af448238e2ed324e0fa82b3 [id=3b169945a7bc477bb1a48b662948f322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.624615 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b510f3c213104798971cf84c95e357d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.630867 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6794f8a443f41b195fb326d49f56756" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:34.631567 892 tablet_service.cc:1511] Processing CreateTablet for tablet 036c17d033b145a681843d14f67ab575 (DEFAULT_TABLE table=default.Table_b4f791ee528d46b59428dc367b5be0a8 [id=e3979c7eefe84cd7bb1dd36fa9351b7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.631996 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036c17d033b145a681843d14f67ab575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.632560 895 tablet_service.cc:1511] Processing CreateTablet for tablet 7c3976c82c914fbaa88df25e1642ed6c (DEFAULT_TABLE table=default.Table_d3f9c221caf74f098016962ca5ae047e [id=5597bd0e49214fbbaa3ea7e701ac2a23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.632692 926 raft_consensus.cc:3060] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:34.632920 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3976c82c914fbaa88df25e1642ed6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.636754 924 raft_consensus.cc:3060] T 99e807c8ff5e457fb6c97c6d1b277eab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:34.637333 906 tablet_service.cc:1511] Processing CreateTablet for tablet fcbaf43f3ccc48a2b7f09d04c2da060d (DEFAULT_TABLE table=default.Table_6b7904942dc9449cbe5e72949e06d2ee [id=5d7c033b6448429f88c7849a7dd82e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.638798 896 tablet_service.cc:1511] Processing CreateTablet for tablet b3605a5c703c4df5b2f32edf185cb126 (DEFAULT_TABLE table=default.Table_762224444e604c1fa386410335af4f48 [id=ef9a2a8300044eb19f2b50dc13cbe776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.636260 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6794f8a443f41b195fb326d49f56756" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:34.642484 997 leader_election.cc:343] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:34.650408 997 consensus_peers.cc:597] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260318 02:51:34.650636 997 leader_election.cc:343] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.648566 1026 tablet_service.cc:1511] Processing CreateTablet for tablet fc96b13affd442eca3b671a3741b6000 (DEFAULT_TABLE table=default.Table_51ec88321a154803836994b4c5430993 [id=f4308b8efe454170bce7eff85fab0959]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.651437 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c50b0813b04f30896568ab2b680ba8" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:34.651564 889 tablet_service.cc:1511] Processing CreateTablet for tablet fa68d30736044b71b38938fded1b314b (DEFAULT_TABLE table=default.Table_011412ca9e304055969a0ba44b82c555 [id=c21facd3dbe74a239960adf801256801]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.651787 899 tablet_service.cc:1511] Processing CreateTablet for tablet d23a51e4c86142ac902fb46598abdd0c (DEFAULT_TABLE table=default.Table_a99ee13e334549a2b8222bd8bad5bf77 [id=1a67760627fc4817818bf6a72131ac55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.651338 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc96b13affd442eca3b671a3741b6000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.652104 904 tablet_service.cc:1511] Processing CreateTablet for tablet 2aaac92ff81d4c9bb05cf21e7b4d9979 (DEFAULT_TABLE table=default.Table_ae9aba2a307a4ccbb1c86607f3432233 [id=68bb4ffe5aa04df0960be0d546961066]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.652287 898 tablet_service.cc:1511] Processing CreateTablet for tablet ec96b885e9604bba9d425c3e3e3f61e6 (DEFAULT_TABLE table=default.Table_2f3393db9c104844995b512bb2ecc2ca [id=c47b40838bc0414cbf17134a1f43176e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.652401 890 tablet_service.cc:1511] Processing CreateTablet for tablet 243a2f81711f4712ab21c8ae5bdc94a8 (DEFAULT_TABLE table=default.Table_db8a1a6484c54822ad31ad887f108929 [id=e55712b310ea4b118a59b291a71d4291]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.653028 759 tablet_service.cc:1511] Processing CreateTablet for tablet c2a1700faed14baca936ec162e5715b6 (DEFAULT_TABLE table=default.Table_10d477a4d7cb43a48cdee08a22f2e127 [id=4e82d742aa2d4e08be269742e0f077b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.653370 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2a1700faed14baca936ec162e5715b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.651891 1172 raft_consensus.cc:385] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.656877 1172 raft_consensus.cc:740] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.657814 1172 consensus_queue.cc:260] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.658283 766 tablet_service.cc:1511] Processing CreateTablet for tablet 03dba645392b46c48cf543fefc6e4d53 (DEFAULT_TABLE table=default.Table_6800c6f047d6426daca032c1a2866084 [id=2595cc4a9c6846a4abf6fcb679f5d830]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.660317 1172 ts_tablet_manager.cc:1434] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.038s user 0.002s sys 0.000s
I20260318 02:51:34.660843 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03dba645392b46c48cf543fefc6e4d53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.661785 888 tablet_service.cc:1511] Processing CreateTablet for tablet eb1a59d1153b41eb9d95b931ffafdd16 (DEFAULT_TABLE table=default.Table_fb4d36f8e2cf4fab8b4e072b67797e98 [id=17923acb4ccd455c8b5ee62354eb1052]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.661546 1043 tablet_service.cc:1511] Processing CreateTablet for tablet b510f3c213104798971cf84c95e357d7 (DEFAULT_TABLE table=default.Table_b87c8d210af448238e2ed324e0fa82b3 [id=3b169945a7bc477bb1a48b662948f322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.662346 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 03dba645392b46c48cf543fefc6e4d53 (DEFAULT_TABLE table=default.Table_6800c6f047d6426daca032c1a2866084 [id=2595cc4a9c6846a4abf6fcb679f5d830]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.662678 1034 tablet_service.cc:1511] Processing CreateTablet for tablet c2a1700faed14baca936ec162e5715b6 (DEFAULT_TABLE table=default.Table_10d477a4d7cb43a48cdee08a22f2e127 [id=4e82d742aa2d4e08be269742e0f077b9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:34.663049 997 leader_election.cc:343] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.664775 997 leader_election.cc:304] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:34.665086 1874 raft_consensus.cc:2749] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.665758 897 tablet_service.cc:1511] Processing CreateTablet for tablet bb2152297eba46ac91e95de4157dd52c (DEFAULT_TABLE table=default.Table_17df338b31d74ae787181f5263811168 [id=309bffa06f77489ba2eb5d088c264aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.663513 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036c17d033b145a681843d14f67ab575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.666759 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1a59d1153b41eb9d95b931ffafdd16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.668526 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa68d30736044b71b38938fded1b314b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.669837 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b510f3c213104798971cf84c95e357d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.670226 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2a1700faed14baca936ec162e5715b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.671792 901 tablet_service.cc:1511] Processing CreateTablet for tablet be210e062db54f52883b4298f63d1821 (DEFAULT_TABLE table=default.Table_75e9c86b388f4ece810c6d095af5da19 [id=ee3fcb7c31814458b8161ea53f372f85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.674656 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d23a51e4c86142ac902fb46598abdd0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.675217 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbaf43f3ccc48a2b7f09d04c2da060d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.675437 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec96b885e9604bba9d425c3e3e3f61e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.679556 1174 tablet_bootstrap.cc:492] T 503386365f6a49f6b84c64b59b764c10 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:34.679788 1174 ts_tablet_manager.cc:1403] T 503386365f6a49f6b84c64b59b764c10 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.342s user 0.008s sys 0.006s
I20260318 02:51:34.619215 1184 ts_tablet_manager.cc:1929] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:34.680814 1174 raft_consensus.cc:359] T 503386365f6a49f6b84c64b59b764c10 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.680962 1184 log.cc:1199] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/abfdba1f21e44652b2bce62cd3e6681f
I20260318 02:51:34.681139 1174 raft_consensus.cc:385] T 503386365f6a49f6b84c64b59b764c10 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.681248 1174 raft_consensus.cc:740] T 503386365f6a49f6b84c64b59b764c10 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.681337 1184 ts_tablet_manager.cc:1950] T abfdba1f21e44652b2bce62cd3e6681f P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:34.681604 1174 consensus_queue.cc:260] T 503386365f6a49f6b84c64b59b764c10 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.682173 1174 ts_tablet_manager.cc:1434] T 503386365f6a49f6b84c64b59b764c10 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:34.682168 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 769) took 1102 ms. Trace:
I20260318 02:51:34.682257 1184 rpcz_store.cc:276] 0318 02:51:33.579946 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.579993 (+ 47us) service_pool.cc:225] Handling call
0318 02:51:34.600933 (+1020940us) ts_tablet_manager.cc:1151] Deleting tablet abfdba1f21e44652b2bce62cd3e6681f
0318 02:51:34.600945 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:34.616124 (+ 15179us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:34.619110 (+ 2986us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:34.682141 (+ 63031us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1020799}
I20260318 02:51:34.682578 1174 tablet_bootstrap.cc:492] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:34.682835 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 770) took 1102 ms. Trace:
I20260318 02:51:34.682979 1184 rpcz_store.cc:276] 0318 02:51:33.580458 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.580499 (+ 41us) service_pool.cc:225] Handling call
0318 02:51:34.682564 (+1102065us) ts_tablet_manager.cc:1151] Deleting tablet 21e6e89e5a0a4d1bb952e74be1b7e551
0318 02:51:34.682574 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:34.682680 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1101916}
I20260318 02:51:34.683565 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 771) took 1087 ms. Trace:
I20260318 02:51:34.683697 1184 rpcz_store.cc:276] 0318 02:51:33.595907 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.595962 (+ 55us) service_pool.cc:225] Handling call
0318 02:51:34.683438 (+1087476us) ts_tablet_manager.cc:1151] Deleting tablet d4332d4afb164b35bee3b0146e26b4e1
0318 02:51:34.683450 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:34.683548 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1087314}
I20260318 02:51:34.684399 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 772) took 1086 ms. Trace:
I20260318 02:51:34.684530 1184 rpcz_store.cc:276] 0318 02:51:33.597454 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.597841 (+ 387us) service_pool.cc:225] Handling call
0318 02:51:34.684291 (+1086450us) ts_tablet_manager.cc:1151] Deleting tablet 565add8c21f343f2b11c12a9bb7ff111
0318 02:51:34.684301 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:34.684384 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1086212}
I20260318 02:51:34.689607 1174 tablet_bootstrap.cc:654] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:34.696151 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03dba645392b46c48cf543fefc6e4d53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.699952 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3605a5c703c4df5b2f32edf185cb126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.700173 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1a59d1153b41eb9d95b931ffafdd16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.703464 1172 tablet_bootstrap.cc:492] T 86f5e1cad5794c15a0b62e64d9e86417 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:34.704994 1172 tablet_bootstrap.cc:654] T 86f5e1cad5794c15a0b62e64d9e86417 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:34.705818 1184 tablet_replica.cc:333] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:34.706068 1184 raft_consensus.cc:2243] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:34.706262 1184 raft_consensus.cc:2272] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.706791 1184 ts_tablet_manager.cc:1916] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:34.709626 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet abfdba1f21e44652b2bce62cd3e6681f (table default.Table_fc98457cd89d4e7386e8668c917c0db5 [id=832c20ba6970431893816d86c1ee374b]) successfully deleted
I20260318 02:51:34.712509 1184 ts_tablet_manager.cc:1929] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:34.713371 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb2152297eba46ac91e95de4157dd52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.712644 1915 raft_consensus.cc:493] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.720898 1915 raft_consensus.cc:515] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.721642 1915 leader_election.cc:290] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:34.722661 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9451d57fad72413c81443623c7995d4e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:34.723590 719 leader_election.cc:343] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:34.724347 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 21e6e89e5a0a4d1bb952e74be1b7e551 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21e6e89e5a0a4d1bb952e74be1b7e551 already in progress: creating tablet
W20260318 02:51:34.724639 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet d4332d4afb164b35bee3b0146e26b4e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4332d4afb164b35bee3b0146e26b4e1 already in progress: creating tablet
I20260318 02:51:34.724606 903 tablet_service.cc:1511] Processing CreateTablet for tablet fc96b13affd442eca3b671a3741b6000 (DEFAULT_TABLE table=default.Table_51ec88321a154803836994b4c5430993 [id=f4308b8efe454170bce7eff85fab0959]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:34.724865 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 565add8c21f343f2b11c12a9bb7ff111 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 565add8c21f343f2b11c12a9bb7ff111 already in progress: creating tablet
W20260318 02:51:34.725077 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet ef021185bb774cf3aa3e08d88eaa1923 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef021185bb774cf3aa3e08d88eaa1923 already in progress: creating tablet
I20260318 02:51:34.725687 907 tablet_service.cc:1511] Processing CreateTablet for tablet 03dba645392b46c48cf543fefc6e4d53 (DEFAULT_TABLE table=default.Table_6800c6f047d6426daca032c1a2866084 [id=2595cc4a9c6846a4abf6fcb679f5d830]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.726119 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03dba645392b46c48cf543fefc6e4d53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.727104 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243a2f81711f4712ab21c8ae5bdc94a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.727681 891 tablet_service.cc:1511] Processing CreateTablet for tablet c2a1700faed14baca936ec162e5715b6 (DEFAULT_TABLE table=default.Table_10d477a4d7cb43a48cdee08a22f2e127 [id=4e82d742aa2d4e08be269742e0f077b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.730301 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aaac92ff81d4c9bb05cf21e7b4d9979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.732580 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc96b13affd442eca3b671a3741b6000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.732882 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2a1700faed14baca936ec162e5715b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.733400 833 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
W20260318 02:51:34.739079 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f047e256dea04affa752abf1452d970f consensus state has no leader
W20260318 02:51:34.740664 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5ff3ee3ae21470a9bb636f03399d223 consensus state has no leader
I20260318 02:51:34.741081 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_53a7c49bab9b4d0c8b44a2456b7e392f" } modify_external_catalogs: true
I20260318 02:51:34.741251 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_53a7c49bab9b4d0c8b44a2456b7e392f" } modify_external_catalogs: true
I20260318 02:51:34.741981 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_be9d84a16e6f4af1a80125375ccfc8bb" } modify_external_catalogs: true
I20260318 02:51:34.742156 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_be9d84a16e6f4af1a80125375ccfc8bb" } modify_external_catalogs: true
W20260318 02:51:34.742674 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf73a9f8f67b42d9baf1396d70a1a3a9 consensus state has no leader
I20260318 02:51:34.742969 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a99ee13e334549a2b8222bd8bad5bf77" } modify_external_catalogs: true
I20260318 02:51:34.743134 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a99ee13e334549a2b8222bd8bad5bf77" } modify_external_catalogs: true
I20260318 02:51:34.743870 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_21a21b6af7a7490983be4155ea8b15ac" } modify_external_catalogs: true
I20260318 02:51:34.744016 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_21a21b6af7a7490983be4155ea8b15ac" } modify_external_catalogs: true
I20260318 02:51:34.744611 454 master_service.cc:954] ReplaceTablet: received request to replace tablet 44cc50429d4f4c109629a9ad08b06bb3 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:34.744989 1915 raft_consensus.cc:493] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.745131 1915 raft_consensus.cc:515] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.745232 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1e921769921d4b0281a7699560d75010" } new_table_name: "default.Table_a0e5cf2757bf4ff0a3232115f92e2def" modify_external_catalogs: true
I20260318 02:51:34.745821 1915 leader_election.cc:290] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:34.749051 1174 tablet_bootstrap.cc:492] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:34.749209 1174 ts_tablet_manager.cc:1403] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.067s user 0.004s sys 0.000s
I20260318 02:51:34.750061 1174 raft_consensus.cc:359] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.750248 1174 raft_consensus.cc:385] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.750305 1174 raft_consensus.cc:740] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.750531 1174 consensus_queue.cc:260] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.751034 1174 ts_tablet_manager.cc:1434] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:34.751804 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be210e062db54f52883b4298f63d1821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.759272 1915 raft_consensus.cc:493] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.759444 1915 raft_consensus.cc:515] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.760067 1915 leader_election.cc:290] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:34.761049 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ebb62f4c54a2a8c24b90ec15402d3" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:34.761875 719 leader_election.cc:343] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.751933 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6088f65949e24799973bd1f432b25dc7" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:34.763878 719 leader_election.cc:343] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.764145 895 tablet_service.cc:1511] Processing CreateTablet for tablet b510f3c213104798971cf84c95e357d7 (DEFAULT_TABLE table=default.Table_b87c8d210af448238e2ed324e0fa82b3 [id=3b169945a7bc477bb1a48b662948f322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.764537 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b510f3c213104798971cf84c95e357d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.726411 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9451d57fad72413c81443623c7995d4e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:34.746970 1959 raft_consensus.cc:493] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.747350 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6088f65949e24799973bd1f432b25dc7" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:34.752302 1960 raft_consensus.cc:493] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.761238 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ebb62f4c54a2a8c24b90ec15402d3" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:34.764631 1172 tablet_bootstrap.cc:492] T 86f5e1cad5794c15a0b62e64d9e86417 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:34.772245 1960 raft_consensus.cc:515] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:34.772768 719 leader_election.cc:343] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.772698 1959 raft_consensus.cc:515] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.772902 719 leader_election.cc:304] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:34.773196 1960 leader_election.cc:290] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:34.773335 719 leader_election.cc:343] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.773447 719 leader_election.cc:304] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:34.773488 1959 leader_election.cc:290] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:34.773793 1915 raft_consensus.cc:2749] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.773955 1915 raft_consensus.cc:2749] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:34.774878 999 leader_election.cc:343] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: b230018a95a54ababfe5ecf2ca1e2e49
W20260318 02:51:34.775065 999 leader_election.cc:343] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: b716c3a80d4a44d190de38f926098efc
I20260318 02:51:34.772469 1172 ts_tablet_manager.cc:1403] T 86f5e1cad5794c15a0b62e64d9e86417 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.001s
I20260318 02:51:34.776438 1172 raft_consensus.cc:359] T 86f5e1cad5794c15a0b62e64d9e86417 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.776878 1172 raft_consensus.cc:385] T 86f5e1cad5794c15a0b62e64d9e86417 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.776836 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b716c3a80d4a44d190de38f926098efc" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:34.777004 1172 raft_consensus.cc:740] T 86f5e1cad5794c15a0b62e64d9e86417 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.777235 1172 consensus_queue.cc:260] T 86f5e1cad5794c15a0b62e64d9e86417 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:34.777359 997 leader_election.cc:343] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.777484 997 leader_election.cc:304] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:34.777837 1960 raft_consensus.cc:2749] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.778232 1172 ts_tablet_manager.cc:1434] T 86f5e1cad5794c15a0b62e64d9e86417 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:34.778607 1172 tablet_bootstrap.cc:492] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:34.779206 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b230018a95a54ababfe5ecf2ca1e2e49" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:34.780100 1172 tablet_bootstrap.cc:654] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:34.780323 997 leader_election.cc:343] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.780454 997 leader_election.cc:304] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:34.780936 1960 raft_consensus.cc:2749] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.772140 1184 log.cc:1199] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/2789a1195e7344c18dd226e196e2f302
I20260318 02:51:34.781468 1184 ts_tablet_manager.cc:1950] T 2789a1195e7344c18dd226e196e2f302 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:34.782245 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 781) took 1042 ms. Trace:
I20260318 02:51:34.782400 1184 rpcz_store.cc:276] 0318 02:51:33.739883 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.739922 (+ 39us) service_pool.cc:225] Handling call
0318 02:51:34.705770 (+965848us) ts_tablet_manager.cc:1151] Deleting tablet 2789a1195e7344c18dd226e196e2f302
0318 02:51:34.705779 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:34.709708 (+ 3929us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:34.712401 (+ 2693us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:34.782226 (+ 69825us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":965682}
I20260318 02:51:34.782932 1184 tablet_replica.cc:333] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:34.783145 1184 raft_consensus.cc:2243] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:34.783322 1184 raft_consensus.cc:2272] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.784801 1184 ts_tablet_manager.cc:1916] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:34.788985 1915 raft_consensus.cc:493] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.789134 1915 raft_consensus.cc:515] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.789788 1915 leader_election.cc:290] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:34.790071 1175 ts_tablet_manager.cc:1929] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:34.785164 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 2789a1195e7344c18dd226e196e2f302 (table default.Table_a9ca2b8e5b9042279576e9b9c6701069 [id=3066ad66b0914b759c32fe9296ca90bc]) successfully deleted
I20260318 02:51:34.798902 1175 log.cc:1199] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/08307bc69291479eb8ee0d7aec124829
I20260318 02:51:34.799623 1175 ts_tablet_manager.cc:1950] T 08307bc69291479eb8ee0d7aec124829 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:34.800028 1174 tablet_bootstrap.cc:492] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:34.801764 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 741) took 1540 ms. Trace:
I20260318 02:51:34.803886 1172 tablet_bootstrap.cc:492] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:34.804121 1172 ts_tablet_manager.cc:1403] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260318 02:51:34.804132 1175 rpcz_store.cc:276] 0318 02:51:33.261642 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.261824 (+ 182us) service_pool.cc:225] Handling call
0318 02:51:34.330832 (+1069008us) ts_tablet_manager.cc:1151] Deleting tablet 08307bc69291479eb8ee0d7aec124829
0318 02:51:34.330844 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:34.756188 (+425344us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:34.789977 (+ 33789us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:34.801742 (+ 11765us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1068756}
I20260318 02:51:34.805070 1172 raft_consensus.cc:359] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.805325 1172 raft_consensus.cc:385] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.805416 1172 raft_consensus.cc:740] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.805534 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 08307bc69291479eb8ee0d7aec124829 (table default.Table_80f976f24d184e2cbaf4f63b8495c8ab [id=2597ecaa93914543870472f2af156dc2]) successfully deleted
I20260318 02:51:34.805720 1172 consensus_queue.cc:260] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.806085 1175 tablet_replica.cc:333] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:34.806730 1172 ts_tablet_manager.cc:1434] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:34.807077 1172 tablet_bootstrap.cc:492] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:34.808192 1175 raft_consensus.cc:2243] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:34.808741 1172 tablet_bootstrap.cc:654] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:34.809145 1174 tablet_bootstrap.cc:654] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:34.809789 1175 raft_consensus.cc:2272] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.811507 1175 ts_tablet_manager.cc:1916] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:34.816509 1184 ts_tablet_manager.cc:1929] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260318 02:51:34.824364 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2fb9c8f339444bc8d7c6479e7d87f44 consensus state has no leader
I20260318 02:51:34.824522 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_496e7d616c09464a884078334d256839" } modify_external_catalogs: true
I20260318 02:51:34.824759 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_496e7d616c09464a884078334d256839" } modify_external_catalogs: true
I20260318 02:51:34.824847 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_93eea9d4589e4d98bb49be9fa2cdaac6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:34.825436 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93eea9d4589e4d98bb49be9fa2cdaac6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:34.826771 1174 tablet_bootstrap.cc:492] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:34.826901 1174 ts_tablet_manager.cc:1403] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.000s
I20260318 02:51:34.827105 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b9a6151bd93c40cc9930c1116c12c1ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:34.827638 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9a6151bd93c40cc9930c1116c12c1ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:34.830912 1174 raft_consensus.cc:359] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.833571 1174 raft_consensus.cc:385] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:34.833909 1174 raft_consensus.cc:740] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:34.834511 1174 consensus_queue.cc:260] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:34.825292 921 raft_consensus.cc:3060] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:34.841281 885 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:37534 (request call id 143) took 1108 ms. Trace:
I20260318 02:51:34.841398 885 rpcz_store.cc:276] 0318 02:51:33.732891 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.733351 (+ 460us) service_pool.cc:225] Handling call
0318 02:51:34.191131 (+457780us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x616000143254. stack: 00007f1f600b0c56 00007f1f600b0a10 00007f1f5f08b3ad 0000000000986fb4 0000000000986f7d 000000000098694a 00007f1f6bfb2540 00007f1f6fe64d2f 00007f1f6a287c36 00007f1f6a287965 00007f1f670b255e 00007f1f670b143e 00007f1f670b7675 00007f1f670b7f9f 00007f1f670b7dc8 0000000000a8b58c
0318 02:51:34.275152 (+ 84021us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x616000195b30. stack: 00007f1f600b0c56 00007f1f600b0a10 00007f1f5f08b3ad 0000000000986fb4 0000000000986f7d 000000000098694a 00007f1f6d33b8c3 00007f1f6fe64b38 00007f1f6a287c36 00007f1f6a287965 00007f1f670b255e 00007f1f670b143e 00007f1f670b7675 00007f1f670b7f9f 00007f1f670b7dc8 0000000000a8b58c
0318 02:51:34.841228 (+566076us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":996079360}
I20260318 02:51:34.841718 1184 log.cc:1199] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/4fa6bf38381740a1bab1088ede6ede1c
I20260318 02:51:34.831920 1960 raft_consensus.cc:493] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.841897 1960 raft_consensus.cc:515] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.842024 1184 ts_tablet_manager.cc:1950] T 4fa6bf38381740a1bab1088ede6ede1c P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:34.842314 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 782) took 1102 ms. Trace:
I20260318 02:51:34.842386 1184 rpcz_store.cc:276] 0318 02:51:33.740097 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.740125 (+ 28us) service_pool.cc:225] Handling call
0318 02:51:34.782889 (+1042764us) ts_tablet_manager.cc:1151] Deleting tablet 4fa6bf38381740a1bab1088ede6ede1c
0318 02:51:34.782897 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:34.809876 (+ 26979us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:34.816406 (+ 6530us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:34.842298 (+ 25892us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1042643}
I20260318 02:51:34.842682 1184 tablet_replica.cc:333] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:34.842865 1184 raft_consensus.cc:2243] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:34.843027 1184 raft_consensus.cc:2272] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.843921 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0652735b8c24c23ade92913c1c7ad0f" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:34.844120 785 raft_consensus.cc:2468] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:34.845724 999 leader_election.cc:304] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:34.846057 1874 raft_consensus.cc:2804] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:34.846125 1874 raft_consensus.cc:493] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:34.846180 1874 raft_consensus.cc:3060] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:34.849300 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0652735b8c24c23ade92913c1c7ad0f" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:34.852844 1915 raft_consensus.cc:493] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.852993 1915 raft_consensus.cc:515] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:34.853084 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3348b200e5ca4f6ebecb2c25ddbe27bf consensus state has no leader
I20260318 02:51:34.853528 1915 leader_election.cc:290] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:34.853551 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8d234aec26b24c4d8aeca66b6539c362"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:34.853847 1960 leader_election.cc:290] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:34.854183 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d234aec26b24c4d8aeca66b6539c362 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:34.854363 997 leader_election.cc:343] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.833163 1959 consensus_queue.cc:1048] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:34.856233 1874 raft_consensus.cc:515] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.856921 1874 leader_election.cc:290] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:34.857990 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0652735b8c24c23ade92913c1c7ad0f" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:34.858284 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0652735b8c24c23ade92913c1c7ad0f" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:34.858464 783 raft_consensus.cc:3060] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:34.858531 997 leader_election.cc:343] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.865536 1874 raft_consensus.cc:493] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.865694 1874 raft_consensus.cc:515] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.867246 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet ce0ab476b9a54cc586a4c28e23382bfc (table default.Table_51fd1fd451544782b3785014979adeba [id=94288205d88b4c6ca1f94de1b201a349]). Expected version 1 got 0
W20260318 02:51:34.867340 999 leader_election.cc:343] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: a20b9dc70b5147ff8798946eda3131ca
I20260318 02:51:34.867497 1874 leader_election.cc:290] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:34.867640 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 99e807c8ff5e457fb6c97c6d1b277eab (table default.Table_fd8edd9c8882403f8541f00d0728e3b7 [id=568e88222ca648ce88ee962e91a84588]). Expected version 1 got 0
I20260318 02:51:34.868036 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20b9dc70b5147ff8798946eda3131ca" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:34.868234 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 1516525b471540288c6cb5d61120d430 (table default.Table_4e770bc308894d9094b88315d9093ba5 [id=433e7aa77412424ebb38784bb073d1fb]). Expected version 6 got 0
W20260318 02:51:34.868482 997 leader_election.cc:343] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.868580 997 leader_election.cc:304] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:34.868956 1874 raft_consensus.cc:2749] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.869920 748 tablet_service.cc:1511] Processing CreateTablet for tablet 7f2c321032c34a1596c37981f8c95cd5 (DEFAULT_TABLE table=default.Table_8854e049411f4e6f88db15613e09aa46 [id=dc77696ca5284b92b79338b2bcf5be7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.870363 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2c321032c34a1596c37981f8c95cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.874441 766 tablet_service.cc:1511] Processing CreateTablet for tablet d875e14b0d234da682e8a403aa51dc91 (DEFAULT_TABLE table=default.Table_45b910f654434aa5a5763c24dfef9168 [id=86e05eb50f7a4e92a13c69dfad4a871c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.874869 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d875e14b0d234da682e8a403aa51dc91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.878384 783 raft_consensus.cc:2468] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:34.881165 999 leader_election.cc:304] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:34.882031 1959 raft_consensus.cc:2804] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:34.882153 1959 raft_consensus.cc:697] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:34.882180 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 27fc03c90b584becb250546100af736c (table default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]). Expected version 1 got 0
I20260318 02:51:34.882391 1959 consensus_queue.cc:237] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.882784 1173 ts_tablet_manager.cc:1434] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.691s user 0.015s sys 0.003s
I20260318 02:51:34.882620 456 catalog_manager.cc:5671] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
W20260318 02:51:34.882897 1173 ts_tablet_manager.cc:1467] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18: Tablet startup took 691ms
W20260318 02:51:34.882969 1173 ts_tablet_manager.cc:1469] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18: Trace:
0318 02:51:22.754592 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:22.775186 (+ 20594us) service_pool.cc:225] Handling call
0318 02:51:22.775557 (+ 371us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0318 02:51:22.775576 (+ 19us) ts_tablet_manager.cc:682] Creating new metadata...
0318 02:51:22.778006 (+ 2430us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:22.905745 (+127739us) tablet_replica.cc:206] Creating consensus instance
0318 02:51:22.905884 (+ 139us) inbound_call.cc:173] Queueing success response
0318 02:51:34.018291 (+11112407us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0318 02:51:34.191882 (+173591us) ts_tablet_manager.cc:1435] Starting tablet replica
0318 02:51:34.214808 (+ 22926us) tablet_replica.cc:261] Starting instrumentation
0318 02:51:34.214930 (+ 122us) tablet_replica.cc:280] Starting consensus
Metrics: {"tablet-open.queue_time_us":11112444}
I20260318 02:51:34.883347 2009 raft_consensus.cc:493] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:34.883517 1173 tablet_bootstrap.cc:492] T 4fa6bf38381740a1bab1088ede6ede1c P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:34.883467 2009 raft_consensus.cc:515] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:34.884522 2009 leader_election.cc:290] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:34.886682 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104cd36774df4bc0adf1d449224304d5" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:34.889360 895 tablet_service.cc:1511] Processing CreateTablet for tablet d875e14b0d234da682e8a403aa51dc91 (DEFAULT_TABLE table=default.Table_45b910f654434aa5a5763c24dfef9168 [id=86e05eb50f7a4e92a13c69dfad4a871c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.889685 1026 tablet_service.cc:1511] Processing CreateTablet for tablet d875e14b0d234da682e8a403aa51dc91 (DEFAULT_TABLE table=default.Table_45b910f654434aa5a5763c24dfef9168 [id=86e05eb50f7a4e92a13c69dfad4a871c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.889923 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d875e14b0d234da682e8a403aa51dc91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.890038 890 tablet_service.cc:1511] Processing CreateTablet for tablet 7f2c321032c34a1596c37981f8c95cd5 (DEFAULT_TABLE table=default.Table_8854e049411f4e6f88db15613e09aa46 [id=dc77696ca5284b92b79338b2bcf5be7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.890352 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2c321032c34a1596c37981f8c95cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.894542 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "104cd36774df4bc0adf1d449224304d5" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:34.895913 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 7f2c321032c34a1596c37981f8c95cd5 (DEFAULT_TABLE table=default.Table_8854e049411f4e6f88db15613e09aa46 [id=dc77696ca5284b92b79338b2bcf5be7f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:34.897580 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.131:37025, user_credentials={real_user=slave}} blocked reactor thread for 124250us
I20260318 02:51:34.898753 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 4fa6bf38381740a1bab1088ede6ede1c (table default.Table_607d1941968145a6a336b9a5bb85b43e [id=85784a23699343ee80e0adb9e5f82413]) successfully deleted
W20260318 02:51:34.901866 719 leader_election.cc:343] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.901969 860 leader_election.cc:304] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:34.902594 719 leader_election.cc:304] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:34.903854 2127 raft_consensus.cc:2749] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.904492 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f53a203051444a50996e6b2c15103e5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:34.905332 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0d87304c41481299f1e2ddfdfcfdec" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:34.905848 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e0e3edb415604e8f84cacf82541e6112"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:34.906469 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0e3edb415604e8f84cacf82541e6112 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:34.908344 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f53a203051444a50996e6b2c15103e5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:34.904381 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0d87304c41481299f1e2ddfdfcfdec" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:34.909086 2121 raft_consensus.cc:2749] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.909814 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4eca5e16f84564b31933b8227fd980" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:34.910981 1173 tablet_bootstrap.cc:654] T 4fa6bf38381740a1bab1088ede6ede1c P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:34.911617 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4eca5e16f84564b31933b8227fd980" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:34.912972 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 1d3eb0cf4190436680ad3265a1c1c31b
I20260318 02:51:34.913627 452 master_service.cc:954] ReplaceTablet: received request to replace tablet 3291ecec94e642e3a995a2d7006619e7 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:34.914873 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet eaf1477c32ce45329a9a0ac19158d54e
I20260318 02:51:34.915686 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d3eb0cf4190436680ad3265a1c1c31b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:34.915906 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet d23a51e4c86142ac902fb46598abdd0c
I20260318 02:51:34.916438 1043 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d3eb0cf4190436680ad3265a1c1c31b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:34.917227 756 tablet_service.cc:1558] Processing DeleteTablet for tablet eaf1477c32ce45329a9a0ac19158d54e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:34.917330 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d3eb0cf4190436680ad3265a1c1c31b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:34.917559 750 tablet_service.cc:1558] Processing DeleteTablet for tablet d23a51e4c86142ac902fb46598abdd0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:34.918125 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet ca4e1eec9a2148488295416cd68ca607
I20260318 02:51:34.918588 903 tablet_service.cc:1558] Processing DeleteTablet for tablet eaf1477c32ce45329a9a0ac19158d54e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:34.918840 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet eaf1477c32ce45329a9a0ac19158d54e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eaf1477c32ce45329a9a0ac19158d54e already in progress: creating tablet
W20260318 02:51:34.919065 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 1d3eb0cf4190436680ad3265a1c1c31b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d3eb0cf4190436680ad3265a1c1c31b already in progress: creating tablet
I20260318 02:51:34.919183 1043 tablet_service.cc:1558] Processing DeleteTablet for tablet eaf1477c32ce45329a9a0ac19158d54e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:34.919257 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet d23a51e4c86142ac902fb46598abdd0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d23a51e4c86142ac902fb46598abdd0c already in progress: creating tablet
I20260318 02:51:34.919659 750 tablet_service.cc:1558] Processing DeleteTablet for tablet ca4e1eec9a2148488295416cd68ca607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:34.921257 719 leader_election.cc:343] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:34.921475 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet ca4e1eec9a2148488295416cd68ca607 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca4e1eec9a2148488295416cd68ca607 already in progress: creating tablet
I20260318 02:51:34.922361 890 tablet_service.cc:1558] Processing DeleteTablet for tablet d23a51e4c86142ac902fb46598abdd0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:34.923317 1043 tablet_service.cc:1558] Processing DeleteTablet for tablet d23a51e4c86142ac902fb46598abdd0c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:34.923625 719 leader_election.cc:343] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:34.930943 997 consensus_peers.cc:597] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:34.931908 1043 tablet_service.cc:1558] Processing DeleteTablet for tablet ca4e1eec9a2148488295416cd68ca607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:34.929207 761 tablet_service.cc:1511] Processing CreateTablet for tablet 373a94164167431c87025ce82c9b88d9 (DEFAULT_TABLE table=default.Table_5a24eb0c55044d40ae13fa4fcb40bfd7 [id=50c7aead7ee947cdb166831357b4d840]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.933959 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373a94164167431c87025ce82c9b88d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.899695 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 3868406102b748a5b13420b24bf16485 (table default.Table_ad02fb74a8e54e76ba7370a1d85c60b8 [id=a7ad61d6d9264ec4ac482798b1ea992e]). Expected version 3 got 0
I20260318 02:51:34.936043 456 catalog_manager.cc:5671] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:34.936548 895 tablet_service.cc:1558] Processing DeleteTablet for tablet ca4e1eec9a2148488295416cd68ca607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:34.936625 457 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_c978284529db4de7883f9f0664c4a158 [id=8b5e3535d9e44b1a86dc59211a31deb6] alter complete (version 1)
I20260318 02:51:34.929641 752 tablet_service.cc:1511] Processing CreateTablet for tablet 3d28aa6525184246a71ad198cf1df763 (DEFAULT_TABLE table=default.Table_5df5e722b3b94721baa220f851b91d81 [id=764acc58506f40b5978ed8bb22ab5a20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.937466 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d28aa6525184246a71ad198cf1df763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.931775 756 tablet_service.cc:1511] Processing CreateTablet for tablet 31b5e02c98d2462d91f57480dc023b6f (DEFAULT_TABLE table=default.Table_055394d8a16e46ce8e65895d5c3f7807 [id=78197608138e487d8bded0b61e35b2d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.941131 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b5e02c98d2462d91f57480dc023b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.944732 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 20c6f1790ed34581b7507ec63ec66718 with delete_type TABLET_DATA_DELETED (replaced by tablet ce82c595e30a4878be25be8eb3d30790) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:34.944991 751 tablet_service.cc:1558] Processing DeleteTablet for tablet 9451d57fad72413c81443623c7995d4e with delete_type TABLET_DATA_DELETED (replaced by tablet 535ff4839c9646a594db820dd5308d70) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:34.932082 759 tablet_service.cc:1511] Processing CreateTablet for tablet 14a7e8753094406baa5a0c32a81e2af4 (DEFAULT_TABLE table=default.Table_098e49ac0c274f5fbb960f0e5aff1892 [id=27a0b540137045258fde9f421a4ad665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.945147 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c0d87304c41481299f1e2ddfdfcfdec with delete_type TABLET_DATA_DELETED (replaced by tablet 565add8c21f343f2b11c12a9bb7ff111) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:34.945341 757 tablet_service.cc:1558] Processing DeleteTablet for tablet e916c5419e3c457f98a47c6a1c6cdd56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:34.945473 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a7e8753094406baa5a0c32a81e2af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.945690 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 42a6983dce4e476cae97b3ecb1133077 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:34.946081 1176 tablet_replica.cc:333] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:34.946262 1176 raft_consensus.cc:2243] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:34.946405 1176 raft_consensus.cc:2272] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.946983 1176 ts_tablet_manager.cc:1916] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:34.932569 750 tablet_service.cc:1511] Processing CreateTablet for tablet 53462f4293594dd59ca17b712a1426c8 (DEFAULT_TABLE table=default.Table_38436e11a4b24cfc9f350d474dc9cb5c [id=a374760d61ef4ed4955b811164122970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.949417 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53462f4293594dd59ca17b712a1426c8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:34.957193 443 catalog_manager.cc:4969] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 20c6f1790ed34581b7507ec63ec66718 because the tablet was not found. No further retry: Not found: Tablet not found: 20c6f1790ed34581b7507ec63ec66718
I20260318 02:51:34.969745 1176 ts_tablet_manager.cc:1929] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:34.969990 1176 log.cc:1199] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/9451d57fad72413c81443623c7995d4e
I20260318 02:51:34.970376 1176 ts_tablet_manager.cc:1950] T 9451d57fad72413c81443623c7995d4e P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:34.971580 1176 tablet_replica.cc:333] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:34.971879 1176 raft_consensus.cc:2243] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:34.972074 1176 raft_consensus.cc:2272] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:34.974162 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2a6f56dafead404eb1720276b07ea733
I20260318 02:51:34.975437 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 9451d57fad72413c81443623c7995d4e (table default.Table_734eb14f943e4eab8ff7d14d00729858 [id=2d188e1de3394072a2327c0d08901bf5]) successfully deleted
I20260318 02:51:34.977336 757 tablet_service.cc:1511] Processing CreateTablet for tablet d2d0da7541a44acd8486d71731e7a5eb (DEFAULT_TABLE table=default.Table_3443cae78cf74ae4a5cb61411ef7a6a6 [id=e3df4b8e861740dea1be48767fac0b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.977763 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2d0da7541a44acd8486d71731e7a5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.981842 761 tablet_service.cc:1511] Processing CreateTablet for tablet 68f1e792105e4dda965ca10d23d59bea (DEFAULT_TABLE table=default.Table_c93ea1440624408191ad4e268dfed2c4 [id=9063fe0c0b0d483381917c9d87fa806b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.982358 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68f1e792105e4dda965ca10d23d59bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.985956 750 tablet_service.cc:1511] Processing CreateTablet for tablet 2332d8dabb79471e8c8ea545228c1d18 (DEFAULT_TABLE table=default.Table_57dbd3d78d50438cb70fb8019c1521e8 [id=a1b49628fa7a422788801b745ccaee6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.986433 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2332d8dabb79471e8c8ea545228c1d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:34.988838 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a6f56dafead404eb1720276b07ea733 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:34.989318 748 tablet_service.cc:1511] Processing CreateTablet for tablet 6eae03ae22c440e69502471b6d36f240 (DEFAULT_TABLE table=default.Table_b9655ed49f8b477083a8c01c883616a1 [id=38c5002cd9084d20b832bd31f859f225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:34.989728 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eae03ae22c440e69502471b6d36f240. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:34.989878 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.131:37025, user_credentials={real_user=slave}} blocked reactor thread for 66269.4us
W20260318 02:51:34.990166 719 leader_election.cc:343] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.990316 719 leader_election.cc:304] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:34.990527 719 raft_consensus.cc:2686] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260318 02:51:34.990839 719 leader_election.cc:343] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:34.991004 719 leader_election.cc:304] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:34.997902 457 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet ce0ab476b9a54cc586a4c28e23382bfc (table default.Table_51fd1fd451544782b3785014979adeba [id=94288205d88b4c6ca1f94de1b201a349]). Expected version 1 got 0
I20260318 02:51:34.998430 2127 raft_consensus.cc:2749] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:34.999902 1174 ts_tablet_manager.cc:1434] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.173s user 0.001s sys 0.001s
I20260318 02:51:35.000283 1174 tablet_bootstrap.cc:492] T d1a67e637d934c0f99c00d04fb26df0d P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:35.002166 895 tablet_service.cc:1511] Processing CreateTablet for tablet 53462f4293594dd59ca17b712a1426c8 (DEFAULT_TABLE table=default.Table_38436e11a4b24cfc9f350d474dc9cb5c [id=a374760d61ef4ed4955b811164122970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.002470 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 53462f4293594dd59ca17b712a1426c8 (DEFAULT_TABLE table=default.Table_38436e11a4b24cfc9f350d474dc9cb5c [id=a374760d61ef4ed4955b811164122970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.002594 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53462f4293594dd59ca17b712a1426c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.005733 456 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_79bea80cab3d40f5bead32f2fdcf09fa [id=873432f002e14a4fa7065dcfe5caebd5] alter complete (version 6)
I20260318 02:51:34.972667 1176 ts_tablet_manager.cc:1916] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.014592 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 503386365f6a49f6b84c64b59b764c10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:35.014948 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 813702e53eee4a54a7d693fd6e03bbbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:35.016018 890 tablet_service.cc:1511] Processing CreateTablet for tablet 14a7e8753094406baa5a0c32a81e2af4 (DEFAULT_TABLE table=default.Table_098e49ac0c274f5fbb960f0e5aff1892 [id=27a0b540137045258fde9f421a4ad665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.016551 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a7e8753094406baa5a0c32a81e2af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.019212 1172 tablet_bootstrap.cc:492] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:35.019412 1172 ts_tablet_manager.cc:1403] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.212s user 0.003s sys 0.000s
I20260318 02:51:35.020246 1172 raft_consensus.cc:359] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.020543 1172 raft_consensus.cc:385] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.020639 1172 raft_consensus.cc:740] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.020951 1172 consensus_queue.cc:260] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.021636 1172 ts_tablet_manager.cc:1434] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:35.025869 1184 ts_tablet_manager.cc:1916] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.030120 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d875e14b0d234da682e8a403aa51dc91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.032147 1175 ts_tablet_manager.cc:1929] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.032287 1175 log.cc:1199] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/b51a15e4303742a999fe9a96d450c827
I20260318 02:51:35.032558 1175 ts_tablet_manager.cc:1950] T b51a15e4303742a999fe9a96d450c827 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:35.032951 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 742) took 1771 ms. Trace:
I20260318 02:51:35.035418 457 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet ce0ab476b9a54cc586a4c28e23382bfc (table default.Table_51fd1fd451544782b3785014979adeba [id=94288205d88b4c6ca1f94de1b201a349]). Expected version 1 got 0
I20260318 02:51:35.035975 457 catalog_manager.cc:5671] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:35.036466 457 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet d0652735b8c24c23ade92913c1c7ad0f (table default.Table_20867faf86da4889b7995990926923a7 [id=5bc787aad96b4abd82ab3e033020ea9c]). Expected version 1 got 0
I20260318 02:51:35.039019 750 tablet_service.cc:1511] Processing CreateTablet for tablet e169088ca92d4604bdffa4cec6debf36 (DEFAULT_TABLE table=default.Table_2724110f542d436cb7f291ebf813bc2a [id=1991222e53ea402e998589ef12299aa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.039563 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e169088ca92d4604bdffa4cec6debf36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.043239 748 tablet_service.cc:1511] Processing CreateTablet for tablet f933b142c113438d9c958e873769e1d0 (DEFAULT_TABLE table=default.Table_b07527a21cf24b8d92d0e12c0c896452 [id=3f9e445097fb4b7ea6d41b76afb9e933]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.043754 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f933b142c113438d9c958e873769e1d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.045248 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2c321032c34a1596c37981f8c95cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.046248 1959 consensus_queue.cc:1048] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:35.048945 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 14a7e8753094406baa5a0c32a81e2af4 (DEFAULT_TABLE table=default.Table_098e49ac0c274f5fbb960f0e5aff1892 [id=27a0b540137045258fde9f421a4ad665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.049328 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a7e8753094406baa5a0c32a81e2af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.051412 1174 tablet_bootstrap.cc:654] T d1a67e637d934c0f99c00d04fb26df0d P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.053011 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 31b5e02c98d2462d91f57480dc023b6f (DEFAULT_TABLE table=default.Table_055394d8a16e46ce8e65895d5c3f7807 [id=78197608138e487d8bded0b61e35b2d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.053369 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b5e02c98d2462d91f57480dc023b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.056981 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 373a94164167431c87025ce82c9b88d9 (DEFAULT_TABLE table=default.Table_5a24eb0c55044d40ae13fa4fcb40bfd7 [id=50c7aead7ee947cdb166831357b4d840]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.057336 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373a94164167431c87025ce82c9b88d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.060148 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a6f56dafead404eb1720276b07ea733 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:35.060472 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 3d28aa6525184246a71ad198cf1df763 (DEFAULT_TABLE table=default.Table_5df5e722b3b94721baa220f851b91d81 [id=764acc58506f40b5978ed8bb22ab5a20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.060823 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d28aa6525184246a71ad198cf1df763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.061427 1040 tablet_service.cc:1511] Processing CreateTablet for tablet d2d0da7541a44acd8486d71731e7a5eb (DEFAULT_TABLE table=default.Table_3443cae78cf74ae4a5cb61411ef7a6a6 [id=e3df4b8e861740dea1be48767fac0b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.061740 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2d0da7541a44acd8486d71731e7a5eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.064949 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 6eae03ae22c440e69502471b6d36f240 (DEFAULT_TABLE table=default.Table_b9655ed49f8b477083a8c01c883616a1 [id=38c5002cd9084d20b832bd31f859f225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.065253 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eae03ae22c440e69502471b6d36f240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.068974 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 2332d8dabb79471e8c8ea545228c1d18 (DEFAULT_TABLE table=default.Table_57dbd3d78d50438cb70fb8019c1521e8 [id=a1b49628fa7a422788801b745ccaee6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.069303 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2332d8dabb79471e8c8ea545228c1d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.073329 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53462f4293594dd59ca17b712a1426c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.073537 1172 tablet_bootstrap.cc:492] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:35.074901 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 68f1e792105e4dda965ca10d23d59bea (DEFAULT_TABLE table=default.Table_c93ea1440624408191ad4e268dfed2c4 [id=9063fe0c0b0d483381917c9d87fa806b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.075222 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68f1e792105e4dda965ca10d23d59bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.075416 1172 tablet_bootstrap.cc:654] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.077764 1026 tablet_service.cc:1511] Processing CreateTablet for tablet e169088ca92d4604bdffa4cec6debf36 (DEFAULT_TABLE table=default.Table_2724110f542d436cb7f291ebf813bc2a [id=1991222e53ea402e998589ef12299aa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.078213 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e169088ca92d4604bdffa4cec6debf36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.079937 1960 raft_consensus.cc:493] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:35.080080 1960 raft_consensus.cc:515] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.080865 1960 leader_election.cc:290] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:35.082201 999 leader_election.cc:343] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: cc1543d0e1b1431baf6d2ab6a0484ca6
I20260318 02:51:35.087504 1174 tablet_bootstrap.cc:492] T d1a67e637d934c0f99c00d04fb26df0d P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:35.088582 1174 ts_tablet_manager.cc:1403] T d1a67e637d934c0f99c00d04fb26df0d P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.088s user 0.003s sys 0.000s
I20260318 02:51:35.089993 1174 raft_consensus.cc:359] T d1a67e637d934c0f99c00d04fb26df0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.091131 1174 raft_consensus.cc:385] T d1a67e637d934c0f99c00d04fb26df0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.091351 1174 raft_consensus.cc:740] T d1a67e637d934c0f99c00d04fb26df0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.091703 1174 consensus_queue.cc:260] T d1a67e637d934c0f99c00d04fb26df0d P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.097502 1174 ts_tablet_manager.cc:1434] T d1a67e637d934c0f99c00d04fb26df0d P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260318 02:51:35.049312 895 tablet_service.cc:1511] Processing CreateTablet for tablet 31b5e02c98d2462d91f57480dc023b6f (DEFAULT_TABLE table=default.Table_055394d8a16e46ce8e65895d5c3f7807 [id=78197608138e487d8bded0b61e35b2d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.099920 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b5e02c98d2462d91f57480dc023b6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.104305 1174 tablet_bootstrap.cc:492] T 2a7ddc0807d742cea258f889390e2142 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:35.104758 756 tablet_service.cc:1558] Processing DeleteTablet for tablet d1a67e637d934c0f99c00d04fb26df0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:35.053355 903 tablet_service.cc:1511] Processing CreateTablet for tablet 373a94164167431c87025ce82c9b88d9 (DEFAULT_TABLE table=default.Table_5a24eb0c55044d40ae13fa4fcb40bfd7 [id=50c7aead7ee947cdb166831357b4d840]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.106097 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373a94164167431c87025ce82c9b88d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.057847 904 tablet_service.cc:1511] Processing CreateTablet for tablet 3d28aa6525184246a71ad198cf1df763 (DEFAULT_TABLE table=default.Table_5df5e722b3b94721baa220f851b91d81 [id=764acc58506f40b5978ed8bb22ab5a20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.107472 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d28aa6525184246a71ad198cf1df763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.110167 1174 tablet_bootstrap.cc:654] T 2a7ddc0807d742cea258f889390e2142 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.058401 898 tablet_service.cc:1511] Processing CreateTablet for tablet 6eae03ae22c440e69502471b6d36f240 (DEFAULT_TABLE table=default.Table_b9655ed49f8b477083a8c01c883616a1 [id=38c5002cd9084d20b832bd31f859f225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.113027 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eae03ae22c440e69502471b6d36f240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.059110 1173 tablet_bootstrap.cc:492] T 4fa6bf38381740a1bab1088ede6ede1c P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:35.059389 891 tablet_service.cc:1511] Processing CreateTablet for tablet 2332d8dabb79471e8c8ea545228c1d18 (DEFAULT_TABLE table=default.Table_57dbd3d78d50438cb70fb8019c1521e8 [id=a1b49628fa7a422788801b745ccaee6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.116878 1173 ts_tablet_manager.cc:1403] T 4fa6bf38381740a1bab1088ede6ede1c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.233s user 0.016s sys 0.012s
I20260318 02:51:35.117040 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2332d8dabb79471e8c8ea545228c1d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.117638 1173 raft_consensus.cc:359] T 4fa6bf38381740a1bab1088ede6ede1c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.117810 1173 raft_consensus.cc:385] T 4fa6bf38381740a1bab1088ede6ede1c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.117852 1173 raft_consensus.cc:740] T 4fa6bf38381740a1bab1088ede6ede1c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.118043 1173 consensus_queue.cc:260] T 4fa6bf38381740a1bab1088ede6ede1c P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.118490 1173 ts_tablet_manager.cc:1434] T 4fa6bf38381740a1bab1088ede6ede1c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:35.118758 1173 tablet_bootstrap.cc:492] T 7883f526d06e442c81f1b66fd89d2cd0 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:35.120126 1173 tablet_bootstrap.cc:654] T 7883f526d06e442c81f1b66fd89d2cd0 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.059903 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a6f56dafead404eb1720276b07ea733 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:35.060698 906 tablet_service.cc:1511] Processing CreateTablet for tablet d2d0da7541a44acd8486d71731e7a5eb (DEFAULT_TABLE table=default.Table_3443cae78cf74ae4a5cb61411ef7a6a6 [id=e3df4b8e861740dea1be48767fac0b67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.121122 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2d0da7541a44acd8486d71731e7a5eb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:35.127286 999 consensus_peers.cc:597] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d -> Peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Couldn't send request to peer 6a903d876086423b8016d705b98895ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3999f53c1cc4cb5a1d91eed23785cc6. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:35.129634 756 tablet_service.cc:1511] Processing CreateTablet for tablet 4ad0eb6882e5404a87db9890b78979d9 (DEFAULT_TABLE table=default.Table_f99f7e505e7444a29d448561083ad659 [id=ca7dafb537f5495b9076bd45faea2cc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.130216 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad0eb6882e5404a87db9890b78979d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.133852 757 tablet_service.cc:1511] Processing CreateTablet for tablet 848769c787374a2f83fcf68691da4111 (DEFAULT_TABLE table=default.Table_bf8a4d0fd01741ef9f71f8880663e4e5 [id=2945cc7d20e8471a8ada003d37580bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.134253 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848769c787374a2f83fcf68691da4111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.136860 2127 raft_consensus.cc:493] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:35.137033 2127 raft_consensus.cc:515] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.137738 2127 leader_election.cc:290] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:35.137950 1173 tablet_bootstrap.cc:492] T 7883f526d06e442c81f1b66fd89d2cd0 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:35.138129 1173 ts_tablet_manager.cc:1403] T 7883f526d06e442c81f1b66fd89d2cd0 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.002s
I20260318 02:51:35.138202 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813702e53eee4a54a7d693fd6e03bbbb" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:35.138789 719 leader_election.cc:343] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.138911 1173 raft_consensus.cc:359] T 7883f526d06e442c81f1b66fd89d2cd0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.139057 1173 raft_consensus.cc:385] T 7883f526d06e442c81f1b66fd89d2cd0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.139106 1173 raft_consensus.cc:740] T 7883f526d06e442c81f1b66fd89d2cd0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.139294 1173 consensus_queue.cc:260] T 7883f526d06e442c81f1b66fd89d2cd0 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.139839 1173 ts_tablet_manager.cc:1434] T 7883f526d06e442c81f1b66fd89d2cd0 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260318 02:51:35.140074 1173 tablet_bootstrap.cc:492] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:35.148473 2127 raft_consensus.cc:493] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:35.148702 2127 raft_consensus.cc:515] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.149868 2127 leader_election.cc:290] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:35.151371 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916c5419e3c457f98a47c6a1c6cdd56" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:35.152025 719 leader_election.cc:343] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.073253 2138 tablet.cc:1723] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260318 02:51:35.074172 899 tablet_service.cc:1511] Processing CreateTablet for tablet 68f1e792105e4dda965ca10d23d59bea (DEFAULT_TABLE table=default.Table_c93ea1440624408191ad4e268dfed2c4 [id=9063fe0c0b0d483381917c9d87fa806b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.077518 901 tablet_service.cc:1511] Processing CreateTablet for tablet e169088ca92d4604bdffa4cec6debf36 (DEFAULT_TABLE table=default.Table_2724110f542d436cb7f291ebf813bc2a [id=1991222e53ea402e998589ef12299aa2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.153745 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68f1e792105e4dda965ca10d23d59bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.155855 1173 tablet_bootstrap.cc:654] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.157248 455 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 105326aea9f744779ca76e0cbb2448cd (table default.Table_268e9858449d471ca088f8b1f2492fe6 [id=58354360683d422dbdcc43826b39dbc8]). Expected version 4 got 0
I20260318 02:51:35.083106 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc1543d0e1b1431baf6d2ab6a0484ca6" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:35.161113 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813702e53eee4a54a7d693fd6e03bbbb" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:35.161134 997 leader_election.cc:343] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.161300 997 leader_election.cc:304] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:35.161509 1176 ts_tablet_manager.cc:1929] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.161626 1176 log.cc:1199] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/7c0d87304c41481299f1e2ddfdfcfdec
I20260318 02:51:35.161727 1960 raft_consensus.cc:2749] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:35.162225 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916c5419e3c457f98a47c6a1c6cdd56" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:35.162783 719 leader_election.cc:343] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.162892 719 leader_election.cc:304] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:35.163866 719 leader_election.cc:343] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.165973 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e169088ca92d4604bdffa4cec6debf36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.165838 1175 rpcz_store.cc:276] 0318 02:51:33.261773 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.262110 (+ 337us) service_pool.cc:225] Handling call
0318 02:51:34.806027 (+1543917us) ts_tablet_manager.cc:1151] Deleting tablet b51a15e4303742a999fe9a96d450c827
0318 02:51:34.806041 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:34.838862 (+ 32821us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.032009 (+193147us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.032921 (+ 912us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1543776}
I20260318 02:51:35.166428 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 743) took 1849 ms. Trace:
I20260318 02:51:35.166579 1175 rpcz_store.cc:276] 0318 02:51:33.316976 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.317041 (+ 65us) service_pool.cc:225] Handling call
0318 02:51:35.166294 (+1849253us) ts_tablet_manager.cc:1151] Deleting tablet e418df45882c435a8276e46a8abf6bdd
0318 02:51:35.166304 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.166410 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1849023}
I20260318 02:51:35.167150 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 744) took 1775 ms. Trace:
I20260318 02:51:35.167284 1175 rpcz_store.cc:276] 0318 02:51:33.391819 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.391884 (+ 65us) service_pool.cc:225] Handling call
0318 02:51:35.167039 (+1775155us) ts_tablet_manager.cc:1151] Deleting tablet f7f8240ed325401da6344c8ee033ad43
0318 02:51:35.167048 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.167135 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1774966}
I20260318 02:51:35.167728 1175 tablet_replica.cc:333] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:35.167984 1175 raft_consensus.cc:2243] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.168197 1175 raft_consensus.cc:2272] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.168833 1175 ts_tablet_manager.cc:1916] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.172631 2127 raft_consensus.cc:2749] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:35.174693 455 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 105326aea9f744779ca76e0cbb2448cd (table default.Table_268e9858449d471ca088f8b1f2492fe6 [id=58354360683d422dbdcc43826b39dbc8]). Expected version 4 got 0
I20260318 02:51:35.175107 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet cc1543d0e1b1431baf6d2ab6a0484ca6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:35.175367 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 65c50b0813b04f30896568ab2b680ba8 with delete_type TABLET_DATA_DELETED (replaced by tablet 20a492fdea6c44ba8439614b0dcc2ba6) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:35.175542 903 tablet_service.cc:1511] Processing CreateTablet for tablet f933b142c113438d9c958e873769e1d0 (DEFAULT_TABLE table=default.Table_b07527a21cf24b8d92d0e12c0c896452 [id=3f9e445097fb4b7ea6d41b76afb9e933]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.176004 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f933b142c113438d9c958e873769e1d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.175825 455 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 99e807c8ff5e457fb6c97c6d1b277eab (table default.Table_fd8edd9c8882403f8541f00d0728e3b7 [id=568e88222ca648ce88ee962e91a84588]). Expected version 1 got 0
I20260318 02:51:35.176692 455 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 104cd36774df4bc0adf1d449224304d5 (table default.Table_c978284529db4de7883f9f0664c4a158 [id=8b5e3535d9e44b1a86dc59211a31deb6]). Expected version 1 got 0
I20260318 02:51:35.163969 719 leader_election.cc:304] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:35.177587 1172 tablet_bootstrap.cc:492] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:35.177765 2127 raft_consensus.cc:2749] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:35.178865 455 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 1516525b471540288c6cb5d61120d430 (table default.Table_4e770bc308894d9094b88315d9093ba5 [id=433e7aa77412424ebb38784bb073d1fb]). Expected version 6 got 0
I20260318 02:51:35.179575 750 tablet_service.cc:1511] Processing CreateTablet for tablet 09917645d5dc415e8e9ffdb1eab477bd (DEFAULT_TABLE table=default.Table_1e7bd39aa78143a98dbbbb347da75cb9 [id=0dfe217f950742a6be8c8f89d712fea6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.179965 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09917645d5dc415e8e9ffdb1eab477bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.183261 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2348e644fea44517ad92d378481809ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:35.183842 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2348e644fea44517ad92d378481809ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:35.184880 1172 ts_tablet_manager.cc:1403] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.111s user 0.010s sys 0.007s
I20260318 02:51:35.184913 1960 raft_consensus.cc:493] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:35.185024 1960 raft_consensus.cc:515] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.185683 1960 leader_election.cc:290] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:35.185861 1172 raft_consensus.cc:359] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.185962 1176 ts_tablet_manager.cc:1950] T 7c0d87304c41481299f1e2ddfdfcfdec P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:35.186381 1172 raft_consensus.cc:385] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.186343 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27fc03c90b584becb250546100af736c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:35.186443 1172 raft_consensus.cc:740] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.186511 785 raft_consensus.cc:2468] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:35.186637 1172 consensus_queue.cc:260] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.186945 999 leader_election.cc:304] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:35.186997 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 7c0d87304c41481299f1e2ddfdfcfdec (table default.Table_b4f791ee528d46b59428dc367b5be0a8 [id=e3979c7eefe84cd7bb1dd36fa9351b7e]) successfully deleted
I20260318 02:51:35.187115 1172 ts_tablet_manager.cc:1434] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:35.187270 1960 raft_consensus.cc:2804] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:35.187335 1960 raft_consensus.cc:493] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:35.187417 1960 raft_consensus.cc:3060] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:35.189604 757 tablet_service.cc:1511] Processing CreateTablet for tablet db22b17af0874e1289766138ed0d0591 (DEFAULT_TABLE table=default.Table_f88018436952478cb888ea867404843c [id=33412846f2364daf9584573090bafa7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.189664 756 tablet_service.cc:1511] Processing CreateTablet for tablet bb1c0b3d21bf43a4a260f661ae241a9f (DEFAULT_TABLE table=default.Table_fd929d02190f450bb0c5c1f45450ff40 [id=b6f5c02010774c228b0edfb19829ddac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.190080 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb1c0b3d21bf43a4a260f661ae241a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.190217 766 tablet_service.cc:1511] Processing CreateTablet for tablet 9e9de016a5414690999124a0d528b68b (DEFAULT_TABLE table=default.Table_a65f49199efd42e6a69e1765c4723285 [id=45529e6b1ab34748b7c098b9599a5812]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.190511 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e9de016a5414690999124a0d528b68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.192051 1960 raft_consensus.cc:515] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.192863 1960 leader_election.cc:290] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:35.193531 752 tablet_service.cc:1511] Processing CreateTablet for tablet 9b6c390e30f34760aafecc557503ea4d (DEFAULT_TABLE table=default.Table_c291010cdfb64ef7bedaa156ed3338ff [id=8537782080ec4335b90be0b8af661616]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.193913 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6c390e30f34760aafecc557503ea4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.193545 754 tablet_service.cc:1511] Processing CreateTablet for tablet 2926ab20fd3542e69fb3f2f52d5acd0e (DEFAULT_TABLE table=default.Table_b66901f5baad43c5b75f20aa84cb9872 [id=e152cce48208465c9f69ebf0e134c508]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.198226 1184 ts_tablet_manager.cc:1929] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.208596 761 tablet_service.cc:1511] Processing CreateTablet for tablet 2295aef8f25f433ab8248940319fce3e (DEFAULT_TABLE table=default.Table_8a988f7cdf3b4dff9e4bbf98492e7644 [id=7443f5ca00174da882567dc974e614d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.182932 1027 tablet_service.cc:1511] Processing CreateTablet for tablet f933b142c113438d9c958e873769e1d0 (DEFAULT_TABLE table=default.Table_b07527a21cf24b8d92d0e12c0c896452 [id=3f9e445097fb4b7ea6d41b76afb9e933]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.215271 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f933b142c113438d9c958e873769e1d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.215293 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d22d1d6f0ce44b6fba47b797e8d6e18d" } new_table_name: "default.Table_5541a4b1189d4b58ae13086d7ec46def" modify_external_catalogs: true
I20260318 02:51:35.216410 1173 tablet_bootstrap.cc:492] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:35.216548 1173 ts_tablet_manager.cc:1403] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.077s user 0.010s sys 0.006s
I20260318 02:51:35.217221 1174 tablet_bootstrap.cc:492] T 2a7ddc0807d742cea258f889390e2142 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:35.217341 1174 ts_tablet_manager.cc:1403] T 2a7ddc0807d742cea258f889390e2142 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.113s user 0.003s sys 0.007s
I20260318 02:51:35.217293 1172 tablet_bootstrap.cc:492] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:35.218080 1174 raft_consensus.cc:359] T 2a7ddc0807d742cea258f889390e2142 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.218241 1174 raft_consensus.cc:385] T 2a7ddc0807d742cea258f889390e2142 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.218290 1174 raft_consensus.cc:740] T 2a7ddc0807d742cea258f889390e2142 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.218520 1174 consensus_queue.cc:260] T 2a7ddc0807d742cea258f889390e2142 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.219447 1174 ts_tablet_manager.cc:1434] T 2a7ddc0807d742cea258f889390e2142 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:35.220113 1173 raft_consensus.cc:359] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.220304 1173 raft_consensus.cc:385] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.220361 1173 raft_consensus.cc:740] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.220618 1173 consensus_queue.cc:260] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.181593 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet b230018a95a54ababfe5ecf2ca1e2e49 with delete_type TABLET_DATA_DELETED (replaced by tablet 813702e53eee4a54a7d693fd6e03bbbb) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:35.221552 1184 log.cc:1199] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/f04f057571584d31b1821e690ae7c75c
I20260318 02:51:35.221946 1184 ts_tablet_manager.cc:1950] T f04f057571584d31b1821e690ae7c75c P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:35.222855 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 783) took 1482 ms. Trace:
I20260318 02:51:35.224145 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27fc03c90b584becb250546100af736c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:35.224309 785 raft_consensus.cc:3060] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:35.225008 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27fc03c90b584becb250546100af736c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:35.226799 785 raft_consensus.cc:2468] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:35.227274 1173 ts_tablet_manager.cc:1434] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260318 02:51:35.232781 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2926ab20fd3542e69fb3f2f52d5acd0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.232813 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27fc03c90b584becb250546100af736c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:35.234270 1173 tablet_bootstrap.cc:492] T f9bc73d3f85745ecb62d861b6375a987 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:35.237242 1173 tablet_bootstrap.cc:654] T f9bc73d3f85745ecb62d861b6375a987 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.237360 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_52514fef886048238fee929512ba027f" } new_table_name: "default.Table_3890c095727844ee94916b9b8d38781a" modify_external_catalogs: true
I20260318 02:51:35.237481 1176 tablet_replica.cc:333] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:35.237675 1176 raft_consensus.cc:2243] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.237730 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_55d80bc4ac3d4e72b2c5e6a694968f83" } new_table_name: "default.Table_4da517198db54744b96210b1f4438731" modify_external_catalogs: true
I20260318 02:51:35.237835 1176 raft_consensus.cc:2272] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.238090 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0758e83d0e5a415c9ad3564b069691b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:35.238384 1176 ts_tablet_manager.cc:1916] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:35.238682 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0758e83d0e5a415c9ad3564b069691b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:35.239020 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d781b2a57e354cbdbc41df2b3169d3af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:35.239530 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d781b2a57e354cbdbc41df2b3169d3af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:35.239853 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_15febcfb305f45b8be10a1bdb3c9d92c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:35.240274 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15febcfb305f45b8be10a1bdb3c9d92c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:35.244125 1176 ts_tablet_manager.cc:1929] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.244237 1176 log.cc:1199] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/e916c5419e3c457f98a47c6a1c6cdd56
I20260318 02:51:35.244525 1176 ts_tablet_manager.cc:1950] T e916c5419e3c457f98a47c6a1c6cdd56 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:35.245033 1174 tablet_bootstrap.cc:492] T 3dda9bd9befd427fac9dfde6f299a6ab P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:35.246630 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db22b17af0874e1289766138ed0d0591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.251928 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_51ec88321a154803836994b4c5430993" } new_table_name: "default.Table_d1bc10f5a27b4fee93fafa3a93ee9d05" modify_external_catalogs: true
I20260318 02:51:35.246676 1174 tablet_bootstrap.cc:654] T 3dda9bd9befd427fac9dfde6f299a6ab P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.240439 899 tablet_service.cc:1511] Processing CreateTablet for tablet 4ad0eb6882e5404a87db9890b78979d9 (DEFAULT_TABLE table=default.Table_f99f7e505e7444a29d448561083ad659 [id=ca7dafb537f5495b9076bd45faea2cc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.258394 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad0eb6882e5404a87db9890b78979d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.241616 904 tablet_service.cc:1511] Processing CreateTablet for tablet 09917645d5dc415e8e9ffdb1eab477bd (DEFAULT_TABLE table=default.Table_1e7bd39aa78143a98dbbbb347da75cb9 [id=0dfe217f950742a6be8c8f89d712fea6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.261153 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09917645d5dc415e8e9ffdb1eab477bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.245366 901 tablet_service.cc:1511] Processing CreateTablet for tablet 848769c787374a2f83fcf68691da4111 (DEFAULT_TABLE table=default.Table_bf8a4d0fd01741ef9f71f8880663e4e5 [id=2945cc7d20e8471a8ada003d37580bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.265180 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848769c787374a2f83fcf68691da4111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.269806 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2295aef8f25f433ab8248940319fce3e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:35.225811 997 leader_election.cc:343] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.228201 999 leader_election.cc:304] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:35.240882 1172 tablet_bootstrap.cc:654] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:35.272302 997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 46501.6us
W20260318 02:51:35.273106 997 leader_election.cc:343] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.273106 1959 raft_consensus.cc:2804] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:35.273219 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet a20b9dc70b5147ff8798946eda3131ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:35.273278 1959 raft_consensus.cc:697] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:35.273542 1959 consensus_queue.cc:237] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:35.272302 999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.129:46711, user_credentials={real_user=slave}} blocked reactor thread for 44134.8us
I20260318 02:51:35.277345 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet e916c5419e3c457f98a47c6a1c6cdd56 (table default.Table_1ca30903a9ca4d31b9ad481adc6e3016 [id=b22ba2f393644e99b2b74ff6236325c5]) successfully deleted
I20260318 02:51:35.276943 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 848769c787374a2f83fcf68691da4111 (DEFAULT_TABLE table=default.Table_bf8a4d0fd01741ef9f71f8880663e4e5 [id=2945cc7d20e8471a8ada003d37580bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.278574 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fa6bf38381740a1bab1088ede6ede1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:35.278720 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 2295aef8f25f433ab8248940319fce3e (DEFAULT_TABLE table=default.Table_8a988f7cdf3b4dff9e4bbf98492e7644 [id=7443f5ca00174da882567dc974e614d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.278896 1176 tablet_replica.cc:333] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:35.279098 1176 raft_consensus.cc:2243] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.279338 1176 raft_consensus.cc:2272] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.279325 1032 tablet_service.cc:1511] Processing CreateTablet for tablet db22b17af0874e1289766138ed0d0591 (DEFAULT_TABLE table=default.Table_f88018436952478cb888ea867404843c [id=33412846f2364daf9584573090bafa7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.279721 890 tablet_service.cc:1511] Processing CreateTablet for tablet bb1c0b3d21bf43a4a260f661ae241a9f (DEFAULT_TABLE table=default.Table_fd929d02190f450bb0c5c1f45450ff40 [id=b6f5c02010774c228b0edfb19829ddac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.279982 1176 ts_tablet_manager.cc:1916] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.280115 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb1c0b3d21bf43a4a260f661ae241a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.280222 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848769c787374a2f83fcf68691da4111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.280897 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db22b17af0874e1289766138ed0d0591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.284850 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2295aef8f25f433ab8248940319fce3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.285069 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 09917645d5dc415e8e9ffdb1eab477bd (DEFAULT_TABLE table=default.Table_1e7bd39aa78143a98dbbbb347da75cb9 [id=0dfe217f950742a6be8c8f89d712fea6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.285421 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09917645d5dc415e8e9ffdb1eab477bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.285748 903 tablet_service.cc:1511] Processing CreateTablet for tablet 2295aef8f25f433ab8248940319fce3e (DEFAULT_TABLE table=default.Table_8a988f7cdf3b4dff9e4bbf98492e7644 [id=7443f5ca00174da882567dc974e614d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.286151 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2295aef8f25f433ab8248940319fce3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.293644 1173 tablet_bootstrap.cc:492] T f9bc73d3f85745ecb62d861b6375a987 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:35.293889 1173 ts_tablet_manager.cc:1403] T f9bc73d3f85745ecb62d861b6375a987 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.000s
I20260318 02:51:35.293911 904 tablet_service.cc:1511] Processing CreateTablet for tablet db22b17af0874e1289766138ed0d0591 (DEFAULT_TABLE table=default.Table_f88018436952478cb888ea867404843c [id=33412846f2364daf9584573090bafa7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.294350 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db22b17af0874e1289766138ed0d0591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.293841 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 4ad0eb6882e5404a87db9890b78979d9 (DEFAULT_TABLE table=default.Table_f99f7e505e7444a29d448561083ad659 [id=ca7dafb537f5495b9076bd45faea2cc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.294689 1173 raft_consensus.cc:359] T f9bc73d3f85745ecb62d861b6375a987 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.294925 1173 raft_consensus.cc:385] T f9bc73d3f85745ecb62d861b6375a987 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.295023 1173 raft_consensus.cc:740] T f9bc73d3f85745ecb62d861b6375a987 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.295382 1173 consensus_queue.cc:260] T f9bc73d3f85745ecb62d861b6375a987 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.295701 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad0eb6882e5404a87db9890b78979d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.301617 1173 ts_tablet_manager.cc:1434] T f9bc73d3f85745ecb62d861b6375a987 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260318 02:51:35.301992 1173 tablet_bootstrap.cc:492] T 421e5223d6af4da1a8e07534f942d016 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:35.302300 1034 tablet_service.cc:1511] Processing CreateTablet for tablet bb1c0b3d21bf43a4a260f661ae241a9f (DEFAULT_TABLE table=default.Table_fd929d02190f450bb0c5c1f45450ff40 [id=b6f5c02010774c228b0edfb19829ddac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.302968 899 tablet_service.cc:1511] Processing CreateTablet for tablet 9b6c390e30f34760aafecc557503ea4d (DEFAULT_TABLE table=default.Table_c291010cdfb64ef7bedaa156ed3338ff [id=8537782080ec4335b90be0b8af661616]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.303207 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 9b6c390e30f34760aafecc557503ea4d (DEFAULT_TABLE table=default.Table_c291010cdfb64ef7bedaa156ed3338ff [id=8537782080ec4335b90be0b8af661616]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.303334 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6c390e30f34760aafecc557503ea4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.303414 895 tablet_service.cc:1511] Processing CreateTablet for tablet 2926ab20fd3542e69fb3f2f52d5acd0e (DEFAULT_TABLE table=default.Table_b66901f5baad43c5b75f20aa84cb9872 [id=e152cce48208465c9f69ebf0e134c508]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.303560 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b6c390e30f34760aafecc557503ea4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.303781 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2926ab20fd3542e69fb3f2f52d5acd0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.307371 1173 tablet_bootstrap.cc:654] T 421e5223d6af4da1a8e07534f942d016 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.308525 901 tablet_service.cc:1511] Processing CreateTablet for tablet 9e9de016a5414690999124a0d528b68b (DEFAULT_TABLE table=default.Table_a65f49199efd42e6a69e1765c4723285 [id=45529e6b1ab34748b7c098b9599a5812]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.308948 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e9de016a5414690999124a0d528b68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.309867 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb1c0b3d21bf43a4a260f661ae241a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.310272 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 2926ab20fd3542e69fb3f2f52d5acd0e (DEFAULT_TABLE table=default.Table_b66901f5baad43c5b75f20aa84cb9872 [id=e152cce48208465c9f69ebf0e134c508]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.310607 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2926ab20fd3542e69fb3f2f52d5acd0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.314415 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 9e9de016a5414690999124a0d528b68b (DEFAULT_TABLE table=default.Table_a65f49199efd42e6a69e1765c4723285 [id=45529e6b1ab34748b7c098b9599a5812]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.314936 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e9de016a5414690999124a0d528b68b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.317816 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 7883f526d06e442c81f1b66fd89d2cd0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:35.318770 441 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet bfb352bce9cc4e8aa899d691954d28d2 (table default.Table_b1d3f1dcf5d3445a817d681110d65f37 [id=e0b93f047d414aa5bc01df1a1dcb8878], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet bfb352bce9cc4e8aa899d691954d28d2 consensus state has no leader
I20260318 02:51:35.322712 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet b51a15e4303742a999fe9a96d450c827 (table default.Table_c9fa61fd1bdb405f89a32f500da8f182 [id=9aa1a9e376e8459987f5ef2231598bd0]) successfully deleted
W20260318 02:51:35.323428 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet e418df45882c435a8276e46a8abf6bdd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e418df45882c435a8276e46a8abf6bdd already in progress: creating tablet
I20260318 02:51:35.323938 974 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
W20260318 02:51:35.324108 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f7f8240ed325401da6344c8ee033ad43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7f8240ed325401da6344c8ee033ad43 already in progress: creating tablet
I20260318 02:51:35.323378 1184 rpcz_store.cc:276] 0318 02:51:33.740324 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.740354 (+ 30us) service_pool.cc:225] Handling call
0318 02:51:34.842633 (+1102279us) ts_tablet_manager.cc:1151] Deleting tablet f04f057571584d31b1821e690ae7c75c
0318 02:51:34.842642 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.146982 (+304340us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.198124 (+ 51142us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.222834 (+ 24710us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1102156}
I20260318 02:51:35.331487 1176 ts_tablet_manager.cc:1929] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.331610 1176 log.cc:1199] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/42a6983dce4e476cae97b3ecb1133077
I20260318 02:51:35.331873 1176 ts_tablet_manager.cc:1950] T 42a6983dce4e476cae97b3ecb1133077 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:35.333042 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 42a6983dce4e476cae97b3ecb1133077 (table default.Table_c14f375645d84629b54e18e482938be5 [id=a2001813279f4449abf9bceaa75bcf76]) successfully deleted
W20260318 02:51:35.333410 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2a6f56dafead404eb1720276b07ea733 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a6f56dafead404eb1720276b07ea733 already in progress: creating tablet
I20260318 02:51:35.335631 1176 tablet_replica.cc:333] T 503386365f6a49f6b84c64b59b764c10 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:35.336019 1176 raft_consensus.cc:2243] T 503386365f6a49f6b84c64b59b764c10 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.336309 1176 raft_consensus.cc:2272] T 503386365f6a49f6b84c64b59b764c10 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.337136 1176 ts_tablet_manager.cc:1916] T 503386365f6a49f6b84c64b59b764c10 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.353802 1174 tablet_bootstrap.cc:492] T 3dda9bd9befd427fac9dfde6f299a6ab P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:35.353981 1174 ts_tablet_manager.cc:1403] T 3dda9bd9befd427fac9dfde6f299a6ab P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.109s user 0.004s sys 0.001s
I20260318 02:51:35.354796 1174 raft_consensus.cc:359] T 3dda9bd9befd427fac9dfde6f299a6ab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.354979 1174 raft_consensus.cc:385] T 3dda9bd9befd427fac9dfde6f299a6ab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.355036 1174 raft_consensus.cc:740] T 3dda9bd9befd427fac9dfde6f299a6ab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.355250 1174 consensus_queue.cc:260] T 3dda9bd9befd427fac9dfde6f299a6ab P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.355764 1174 ts_tablet_manager.cc:1434] T 3dda9bd9befd427fac9dfde6f299a6ab P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:35.356077 1174 tablet_bootstrap.cc:492] T bf344c2361b7412c87a7c7f9a72a15b6 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:35.357836 1172 tablet_bootstrap.cc:492] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:35.357995 1172 ts_tablet_manager.cc:1403] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.141s user 0.002s sys 0.012s
I20260318 02:51:35.361140 1874 consensus_queue.cc:1048] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:35.365670 1172 raft_consensus.cc:359] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.368578 1172 raft_consensus.cc:385] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.369313 1172 raft_consensus.cc:740] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.371521 1172 consensus_queue.cc:260] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.376070 1175 ts_tablet_manager.cc:1929] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.376461 1175 log.cc:1199] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/3e38dec0d2e9417e8571e202036e7117
I20260318 02:51:35.376197 1172 ts_tablet_manager.cc:1434] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.018s user 0.001s sys 0.002s
I20260318 02:51:35.377574 1175 ts_tablet_manager.cc:1950] T 3e38dec0d2e9417e8571e202036e7117 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:35.378551 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 745) took 1969 ms. Trace:
I20260318 02:51:35.378829 1175 rpcz_store.cc:276] 0318 02:51:33.409500 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.409556 (+ 56us) service_pool.cc:225] Handling call
0318 02:51:35.167668 (+1758112us) ts_tablet_manager.cc:1151] Deleting tablet 3e38dec0d2e9417e8571e202036e7117
0318 02:51:35.167677 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.172015 (+ 4338us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.375893 (+203878us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.378487 (+ 2594us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1757917}
W20260318 02:51:35.380551 441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 55462.9us
I20260318 02:51:35.381011 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 753) took 1818 ms. Trace:
I20260318 02:51:35.381258 1175 rpcz_store.cc:276] 0318 02:51:33.562426 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.563071 (+ 645us) service_pool.cc:225] Handling call
0318 02:51:35.380178 (+1817107us) ts_tablet_manager.cc:1151] Deleting tablet 6a0c53d87ad84eebaa11f5b44dd7c0b5
0318 02:51:35.380236 (+ 58us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.380988 (+ 752us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1816883}
I20260318 02:51:35.381538 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 3e38dec0d2e9417e8571e202036e7117 (table default.Table_f6484117e54a4f2298a8d7365770c153 [id=c06168b4ee024f728f2f11a4cc39fc4e]) successfully deleted
I20260318 02:51:35.382567 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 754) took 1818 ms. Trace:
I20260318 02:51:35.382944 1175 rpcz_store.cc:276] 0318 02:51:33.563615 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.565120 (+ 1505us) service_pool.cc:225] Handling call
0318 02:51:35.382237 (+1817117us) ts_tablet_manager.cc:1151] Deleting tablet 5fec974d146f44aeb72df483fa85b287
0318 02:51:35.382289 (+ 52us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.382513 (+ 224us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1814198}
I20260318 02:51:35.383391 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet f04f057571584d31b1821e690ae7c75c (table default.Table_62dcfd8adef34929a08c11dfcf174ff7 [id=4a0a65332f00440f87102e8ebab708cd]) successfully deleted
I20260318 02:51:35.383450 1173 tablet_bootstrap.cc:492] T 421e5223d6af4da1a8e07534f942d016 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:35.384006 1173 ts_tablet_manager.cc:1403] T 421e5223d6af4da1a8e07534f942d016 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.082s user 0.011s sys 0.023s
W20260318 02:51:35.384222 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 6a0c53d87ad84eebaa11f5b44dd7c0b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a0c53d87ad84eebaa11f5b44dd7c0b5 already in progress: creating tablet
W20260318 02:51:35.384487 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 5fec974d146f44aeb72df483fa85b287 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fec974d146f44aeb72df483fa85b287 already in progress: creating tablet
I20260318 02:51:35.384452 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 755) took 1818 ms. Trace:
I20260318 02:51:35.384756 1175 rpcz_store.cc:276] 0318 02:51:33.565741 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.565788 (+ 47us) service_pool.cc:225] Handling call
0318 02:51:35.383943 (+1818155us) ts_tablet_manager.cc:1151] Deleting tablet cb79f266cdfd498babbc5d1313ef0b72
0318 02:51:35.383995 (+ 52us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.384396 (+ 401us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1815275}
I20260318 02:51:35.349465 1184 tablet_replica.cc:333] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:35.394650 1184 raft_consensus.cc:2243] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:35.395587 1184 raft_consensus.cc:2272] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.400110 1172 tablet_bootstrap.cc:492] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:35.400300 997 consensus_peers.cc:597] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:35.407346 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_321270c2ff8b48e5874e7780fe689a08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:35.408118 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_321270c2ff8b48e5874e7780fe689a08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:35.413414 1184 ts_tablet_manager.cc:1916] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.413887 1959 raft_consensus.cc:493] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:35.416895 1959 raft_consensus.cc:515] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:35.417122 2085 log.cc:927] Time spent T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7: Append to log took a long time: real 0.203s user 0.002s sys 0.000s
I20260318 02:51:35.418157 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5afc5611d3481e9a6d48381dc67e86" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:35.418352 783 raft_consensus.cc:2468] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:35.419086 999 leader_election.cc:304] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:35.419497 2153 raft_consensus.cc:2804] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:35.419656 2153 raft_consensus.cc:493] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:35.419780 2153 raft_consensus.cc:3060] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:35.421635 921 raft_consensus.cc:3060] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:35.422386 2153 raft_consensus.cc:515] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.423547 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5afc5611d3481e9a6d48381dc67e86" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:35.423723 783 raft_consensus.cc:3060] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:35.423352 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 756) took 1804 ms. Trace:
I20260318 02:51:35.424257 1175 rpcz_store.cc:276] 0318 02:51:33.581218 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.581273 (+ 55us) service_pool.cc:225] Handling call
0318 02:51:35.385544 (+1804271us) ts_tablet_manager.cc:1151] Deleting tablet 21e6e89e5a0a4d1bb952e74be1b7e551
0318 02:51:35.385555 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.385753 (+ 198us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1804021}
I20260318 02:51:35.424614 1175 tablet_replica.cc:333] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:35.426328 2153 leader_election.cc:290] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:35.430058 1174 tablet_bootstrap.cc:654] T bf344c2361b7412c87a7c7f9a72a15b6 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.437633 783 raft_consensus.cc:2468] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:35.438227 999 leader_election.cc:304] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:35.440764 1960 raft_consensus.cc:2804] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:35.441103 1960 raft_consensus.cc:697] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:35.441473 1960 consensus_queue.cc:237] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.442435 2127 raft_consensus.cc:493] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:35.442585 2127 raft_consensus.cc:515] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.442081 1959 leader_election.cc:290] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:35.443176 2127 leader_election.cc:290] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:35.426187 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5afc5611d3481e9a6d48381dc67e86" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:35.427263 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5afc5611d3481e9a6d48381dc67e86" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:35.433094 2138 tablet.cc:1723] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:35.444273 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f5e1cad5794c15a0b62e64d9e86417" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:35.444275 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f5e1cad5794c15a0b62e64d9e86417" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:35.444458 1063 raft_consensus.cc:2468] T 86f5e1cad5794c15a0b62e64d9e86417 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 0.
W20260318 02:51:35.444739 719 leader_election.cc:343] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.441447 1173 raft_consensus.cc:359] T 421e5223d6af4da1a8e07534f942d016 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.444949 1173 raft_consensus.cc:385] T 421e5223d6af4da1a8e07534f942d016 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.445020 1173 raft_consensus.cc:740] T 421e5223d6af4da1a8e07534f942d016 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
W20260318 02:51:35.445039 997 leader_election.cc:343] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.445218 1173 consensus_queue.cc:260] T 421e5223d6af4da1a8e07534f942d016 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.445302 719 leader_election.cc:304] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:35.445634 997 leader_election.cc:343] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.445740 2127 raft_consensus.cc:2804] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:35.445817 2127 raft_consensus.cc:493] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:35.445870 2127 raft_consensus.cc:3060] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:35.447125 1173 ts_tablet_manager.cc:1434] T 421e5223d6af4da1a8e07534f942d016 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.063s user 0.000s sys 0.003s
I20260318 02:51:35.448271 2127 raft_consensus.cc:515] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.449041 2127 leader_election.cc:290] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:35.449892 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f5e1cad5794c15a0b62e64d9e86417" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:35.450073 1063 raft_consensus.cc:3060] T 86f5e1cad5794c15a0b62e64d9e86417 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:35.453173 1175 raft_consensus.cc:2243] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.453199 1063 raft_consensus.cc:2468] T 86f5e1cad5794c15a0b62e64d9e86417 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 1.
I20260318 02:51:35.453369 1175 raft_consensus.cc:2272] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.453836 719 leader_election.cc:304] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:35.453900 1175 ts_tablet_manager.cc:1916] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.454216 2127 raft_consensus.cc:2804] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:35.456857 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f5e1cad5794c15a0b62e64d9e86417" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:35.457042 1173 tablet_bootstrap.cc:492] T abfdba1f21e44652b2bce62cd3e6681f P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:35.458720 1173 tablet_bootstrap.cc:654] T abfdba1f21e44652b2bce62cd3e6681f P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:35.459116 719 leader_election.cc:343] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.464308 904 tablet_service.cc:1558] Processing DeleteTablet for tablet f5a829abed0444b79c48ab080d024824 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:22 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:35.467097 904 tablet_service.cc:1558] Processing DeleteTablet for tablet f9bc73d3f85745ecb62d861b6375a987 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:35.468628 1176 ts_tablet_manager.cc:1929] T 503386365f6a49f6b84c64b59b764c10 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.468801 1176 log.cc:1199] T 503386365f6a49f6b84c64b59b764c10 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/503386365f6a49f6b84c64b59b764c10
I20260318 02:51:35.469182 1176 ts_tablet_manager.cc:1950] T 503386365f6a49f6b84c64b59b764c10 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:35.469450 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet e57dbb1276114cd6b7d26f7167b99f25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:35.469650 1172 tablet_bootstrap.cc:654] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.469677 1176 tablet_replica.cc:333] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:35.469890 1176 raft_consensus.cc:2243] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.470059 1176 raft_consensus.cc:2272] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.470598 1176 ts_tablet_manager.cc:1916] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.474120 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a7ddc0807d742cea258f889390e2142 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:35.474691 1175 ts_tablet_manager.cc:1929] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.475363 1175 log.cc:1199] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/d1a884fde2c145518a2cb14b7780b6dd
I20260318 02:51:35.475735 1173 tablet_bootstrap.cc:492] T abfdba1f21e44652b2bce62cd3e6681f P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:35.476980 1173 ts_tablet_manager.cc:1403] T abfdba1f21e44652b2bce62cd3e6681f P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.002s
I20260318 02:51:35.477823 1173 raft_consensus.cc:359] T abfdba1f21e44652b2bce62cd3e6681f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.478067 1173 raft_consensus.cc:385] T abfdba1f21e44652b2bce62cd3e6681f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.478154 1173 raft_consensus.cc:740] T abfdba1f21e44652b2bce62cd3e6681f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.478405 1173 consensus_queue.cc:260] T abfdba1f21e44652b2bce62cd3e6681f P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.478938 1173 ts_tablet_manager.cc:1434] T abfdba1f21e44652b2bce62cd3e6681f P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:35.479326 1175 ts_tablet_manager.cc:1950] T d1a884fde2c145518a2cb14b7780b6dd P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:35.479704 1173 tablet_bootstrap.cc:492] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:35.481428 1173 tablet_bootstrap.cc:654] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.484319 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 757) took 1900 ms. Trace:
I20260318 02:51:35.484488 1175 rpcz_store.cc:276] 0318 02:51:33.583998 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.584135 (+ 137us) service_pool.cc:225] Handling call
0318 02:51:35.424564 (+1840429us) ts_tablet_manager.cc:1151] Deleting tablet d1a884fde2c145518a2cb14b7780b6dd
0318 02:51:35.424575 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.467905 (+ 43330us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.474548 (+ 6643us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.484297 (+ 9749us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8123,"tablet-delete.queue_time_us":1840180}
I20260318 02:51:35.485311 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 758) took 1890 ms. Trace:
I20260318 02:51:35.485524 1175 rpcz_store.cc:276] 0318 02:51:33.595321 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.595372 (+ 51us) service_pool.cc:225] Handling call
0318 02:51:35.485061 (+1889689us) ts_tablet_manager.cc:1151] Deleting tablet d4332d4afb164b35bee3b0146e26b4e1
0318 02:51:35.485072 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.485293 (+ 221us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1889473}
I20260318 02:51:35.487569 1176 ts_tablet_manager.cc:1929] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.487843 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 759) took 1891 ms. Trace:
I20260318 02:51:35.487964 1175 rpcz_store.cc:276] 0318 02:51:33.596896 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.596946 (+ 50us) service_pool.cc:225] Handling call
0318 02:51:35.485972 (+1889026us) ts_tablet_manager.cc:1151] Deleting tablet 565add8c21f343f2b11c12a9bb7ff111
0318 02:51:35.487727 (+ 1755us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.487824 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1888810}
I20260318 02:51:35.488445 1175 tablet_replica.cc:333] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:35.488754 1175 raft_consensus.cc:2243] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.489002 1175 raft_consensus.cc:2272] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.489594 1175 ts_tablet_manager.cc:1916] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.494343 1176 log.cc:1199] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/813702e53eee4a54a7d693fd6e03bbbb
I20260318 02:51:35.494655 2161 raft_consensus.cc:493] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:35.495018 1176 ts_tablet_manager.cc:1950] T 813702e53eee4a54a7d693fd6e03bbbb P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:35.494949 2161 raft_consensus.cc:515] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.496481 1176 tablet_replica.cc:333] T d1a67e637d934c0f99c00d04fb26df0d P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:35.496604 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b39433a5a7f42c39139db0da77ae75f" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:35.496892 1176 raft_consensus.cc:2243] T d1a67e637d934c0f99c00d04fb26df0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.497413 1176 raft_consensus.cc:2272] T d1a67e637d934c0f99c00d04fb26df0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:35.497746 719 leader_election.cc:343] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.498034 2147 raft_consensus.cc:493] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:35.498286 1176 ts_tablet_manager.cc:1916] T d1a67e637d934c0f99c00d04fb26df0d P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.498210 2147 raft_consensus.cc:515] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.499255 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6088f65949e24799973bd1f432b25dc7" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:35.499878 997 leader_election.cc:343] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.500806 2147 leader_election.cc:290] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:35.501782 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b39433a5a7f42c39139db0da77ae75f" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:35.500640 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6088f65949e24799973bd1f432b25dc7" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:35.504488 783 raft_consensus.cc:2468] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:35.501448 2161 leader_election.cc:290] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:35.502492 719 leader_election.cc:343] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.505287 719 leader_election.cc:304] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:35.505568 1172 tablet_bootstrap.cc:492] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:35.505708 1172 ts_tablet_manager.cc:1403] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.106s user 0.004s sys 0.000s
I20260318 02:51:35.506479 2161 raft_consensus.cc:2749] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:35.507004 1172 raft_consensus.cc:359] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.507350 1172 raft_consensus.cc:385] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.507470 1172 raft_consensus.cc:740] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.507800 1172 consensus_queue.cc:260] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.508805 1173 tablet_bootstrap.cc:492] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:35.508987 1173 ts_tablet_manager.cc:1403] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.029s user 0.006s sys 0.000s
I20260318 02:51:35.509744 1173 raft_consensus.cc:359] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.509972 1173 raft_consensus.cc:385] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.510058 1173 raft_consensus.cc:740] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.510368 1173 consensus_queue.cc:260] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.510859 2127 raft_consensus.cc:697] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Becoming Leader. State: Replica: 6a903d876086423b8016d705b98895ad, State: Running, Role: LEADER
I20260318 02:51:35.510951 1173 ts_tablet_manager.cc:1434] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:35.511288 1173 tablet_bootstrap.cc:492] T b5c19bc5e07949088c84cedbf944dfdb P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:35.511198 2127 consensus_queue.cc:237] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.515175 999 leader_election.cc:304] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:35.517889 1175 ts_tablet_manager.cc:1929] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.518087 1175 log.cc:1199] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/2c5038e9e1074f46976a1a5bb4282944
I20260318 02:51:35.518256 1173 tablet_bootstrap.cc:654] T b5c19bc5e07949088c84cedbf944dfdb P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.518442 1175 ts_tablet_manager.cc:1950] T 2c5038e9e1074f46976a1a5bb4282944 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:35.520282 1176 ts_tablet_manager.cc:1929] T d1a67e637d934c0f99c00d04fb26df0d P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.520598 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 765) took 1782 ms. Trace:
I20260318 02:51:35.520771 1175 rpcz_store.cc:276] 0318 02:51:33.737962 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.738013 (+ 51us) service_pool.cc:225] Handling call
0318 02:51:35.488400 (+1750387us) ts_tablet_manager.cc:1151] Deleting tablet 2c5038e9e1074f46976a1a5bb4282944
0318 02:51:35.488409 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.493237 (+ 4828us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.517777 (+ 24540us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.520578 (+ 2801us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1750176}
I20260318 02:51:35.521433 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 766) took 1782 ms. Trace:
I20260318 02:51:35.521569 1175 rpcz_store.cc:276] 0318 02:51:33.738502 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.738547 (+ 45us) service_pool.cc:225] Handling call
0318 02:51:35.521306 (+1782759us) ts_tablet_manager.cc:1151] Deleting tablet ef021185bb774cf3aa3e08d88eaa1923
0318 02:51:35.521316 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.521418 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1782609}
I20260318 02:51:35.522235 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 767) took 1744 ms. Trace:
I20260318 02:51:35.522835 1175 rpcz_store.cc:276] 0318 02:51:33.777936 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.777996 (+ 60us) service_pool.cc:225] Handling call
0318 02:51:35.522127 (+1744131us) ts_tablet_manager.cc:1151] Deleting tablet 41b7d422014d4b2a85b0b97593677e3d
0318 02:51:35.522137 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.522221 (+ 84us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1743845}
I20260318 02:51:35.523061 2151 raft_consensus.cc:2804] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:35.523190 2151 raft_consensus.cc:493] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:35.523285 2151 raft_consensus.cc:3060] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:35.523442 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 768) took 1689 ms. Trace:
I20260318 02:51:35.523566 1175 rpcz_store.cc:276] 0318 02:51:33.833774 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.834129 (+ 355us) service_pool.cc:225] Handling call
0318 02:51:35.523321 (+1689192us) ts_tablet_manager.cc:1151] Deleting tablet defda79dd0f34c37ae16ea808df0754b
0318 02:51:35.523330 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.523428 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1688967}
I20260318 02:51:35.524044 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 769) took 1689 ms. Trace:
I20260318 02:51:35.524164 1175 rpcz_store.cc:276] 0318 02:51:33.834558 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.834828 (+ 270us) service_pool.cc:225] Handling call
0318 02:51:35.523950 (+1689122us) ts_tablet_manager.cc:1151] Deleting tablet da178159cde84dda9546952d9b2bbb63
0318 02:51:35.523958 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.524029 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1688936}
I20260318 02:51:35.524609 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 770) took 1689 ms. Trace:
I20260318 02:51:35.524791 1175 rpcz_store.cc:276] 0318 02:51:33.835328 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.835553 (+ 225us) service_pool.cc:225] Handling call
0318 02:51:35.524519 (+1688966us) ts_tablet_manager.cc:1151] Deleting tablet ebfb14850afa4043848814f01eabf394
0318 02:51:35.524527 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.524596 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1688787}
I20260318 02:51:35.525239 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 771) took 1670 ms. Trace:
I20260318 02:51:35.525625 1176 log.cc:1199] T d1a67e637d934c0f99c00d04fb26df0d P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/d1a67e637d934c0f99c00d04fb26df0d
I20260318 02:51:35.525753 1175 rpcz_store.cc:276] 0318 02:51:33.854349 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.854407 (+ 58us) service_pool.cc:225] Handling call
0318 02:51:35.525149 (+1670742us) ts_tablet_manager.cc:1151] Deleting tablet 52b773c3412c4bc792471096802b3f1a
0318 02:51:35.525157 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.525227 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1670573}
I20260318 02:51:35.526036 2151 raft_consensus.cc:515] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.502985 1174 tablet_bootstrap.cc:492] T bf344c2361b7412c87a7c7f9a72a15b6 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:35.527562 1174 ts_tablet_manager.cc:1403] T bf344c2361b7412c87a7c7f9a72a15b6 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.172s user 0.018s sys 0.002s
I20260318 02:51:35.528456 1174 raft_consensus.cc:359] T bf344c2361b7412c87a7c7f9a72a15b6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.528729 1174 raft_consensus.cc:385] T bf344c2361b7412c87a7c7f9a72a15b6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.528817 1174 raft_consensus.cc:740] T bf344c2361b7412c87a7c7f9a72a15b6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.529022 1174 consensus_queue.cc:260] T bf344c2361b7412c87a7c7f9a72a15b6 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.526491 1175 tablet_replica.cc:333] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:35.529579 1175 raft_consensus.cc:2243] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.529654 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6088f65949e24799973bd1f432b25dc7" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:35.530218 1175 raft_consensus.cc:2272] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.530370 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6088f65949e24799973bd1f432b25dc7" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:35.530543 783 raft_consensus.cc:3060] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:35.530884 1174 ts_tablet_manager.cc:1434] T bf344c2361b7412c87a7c7f9a72a15b6 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260318 02:51:35.530936 1175 ts_tablet_manager.cc:1916] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.531160 1174 tablet_bootstrap.cc:492] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:35.532760 1174 tablet_bootstrap.cc:654] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:35.533175 997 leader_election.cc:343] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.533886 783 raft_consensus.cc:2468] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:35.534420 999 leader_election.cc:304] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:35.534782 2151 leader_election.cc:290] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:35.535115 2151 raft_consensus.cc:2804] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:35.535333 2151 raft_consensus.cc:697] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:35.535674 1173 tablet_bootstrap.cc:492] T b5c19bc5e07949088c84cedbf944dfdb P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:35.535629 2151 consensus_queue.cc:237] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.529711 1176 ts_tablet_manager.cc:1950] T d1a67e637d934c0f99c00d04fb26df0d P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:35.529313 833 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:35.538038 1173 ts_tablet_manager.cc:1403] T b5c19bc5e07949088c84cedbf944dfdb P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.003s
I20260318 02:51:35.538400 1176 tablet_replica.cc:333] T 2a7ddc0807d742cea258f889390e2142 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:35.538594 1176 raft_consensus.cc:2243] T 2a7ddc0807d742cea258f889390e2142 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.538743 1176 raft_consensus.cc:2272] T 2a7ddc0807d742cea258f889390e2142 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.539794 1176 ts_tablet_manager.cc:1916] T 2a7ddc0807d742cea258f889390e2142 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.537842 1175 ts_tablet_manager.cc:1929] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.540906 1175 log.cc:1199] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/547762347d7843e989e55e0449ad9fcb
I20260318 02:51:35.541209 1175 ts_tablet_manager.cc:1950] T 547762347d7843e989e55e0449ad9fcb P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:35.541738 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 772) took 1676 ms. Trace:
I20260318 02:51:35.541823 1175 rpcz_store.cc:276] 0318 02:51:33.865600 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.865650 (+ 50us) service_pool.cc:225] Handling call
0318 02:51:35.526445 (+1660795us) ts_tablet_manager.cc:1151] Deleting tablet 547762347d7843e989e55e0449ad9fcb
0318 02:51:35.526454 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.534475 (+ 8021us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.537735 (+ 3260us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.541719 (+ 3984us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1660617}
I20260318 02:51:35.542467 1173 raft_consensus.cc:359] T b5c19bc5e07949088c84cedbf944dfdb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.542618 1173 raft_consensus.cc:385] T b5c19bc5e07949088c84cedbf944dfdb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.542656 1173 raft_consensus.cc:740] T b5c19bc5e07949088c84cedbf944dfdb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.544127 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 773) took 1646 ms. Trace:
I20260318 02:51:35.544420 1173 consensus_queue.cc:260] T b5c19bc5e07949088c84cedbf944dfdb P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.544219 1175 rpcz_store.cc:276] 0318 02:51:33.897966 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.898022 (+ 56us) service_pool.cc:225] Handling call
0318 02:51:35.543983 (+1645961us) ts_tablet_manager.cc:1151] Deleting tablet 88c0962c84624c3ea5f03c898f5ff348
0318 02:51:35.543995 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.544106 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1644907}
I20260318 02:51:35.545679 2121 raft_consensus.cc:493] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:35.545907 1175 tablet_replica.cc:333] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:35.545832 2121 raft_consensus.cc:515] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.545084 1173 ts_tablet_manager.cc:1434] T b5c19bc5e07949088c84cedbf944dfdb P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260318 02:51:35.546150 1175 raft_consensus.cc:2243] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.546478 2121 leader_election.cc:290] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:35.547050 1175 raft_consensus.cc:2272] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.547361 1173 tablet_bootstrap.cc:492] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:35.548625 860 leader_election.cc:343] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 4fa7c1d6879c40ebb8d989ebae205e9e
W20260318 02:51:35.552394 862 leader_election.cc:343] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 4fa7c1d6879c40ebb8d989ebae205e9e
I20260318 02:51:35.552556 862 leader_election.cc:304] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:35.553040 2121 raft_consensus.cc:2749] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:35.553555 1175 ts_tablet_manager.cc:1916] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:35.554127 997 consensus_peers.cc:597] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:35.554611 1173 tablet_bootstrap.cc:654] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.557845 1174 tablet_bootstrap.cc:492] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:35.558055 1174 ts_tablet_manager.cc:1403] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.002s
I20260318 02:51:35.559617 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ae9aba2a307a4ccbb1c86607f3432233" } new_table_name: "default.Table_20195e4878724c238c3830800130bb6d" modify_external_catalogs: true
I20260318 02:51:35.559728 1111 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
W20260318 02:51:35.562258 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet cb79f266cdfd498babbc5d1313ef0b72 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb79f266cdfd498babbc5d1313ef0b72 already in progress: creating tablet
W20260318 02:51:35.564118 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 21e6e89e5a0a4d1bb952e74be1b7e551 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21e6e89e5a0a4d1bb952e74be1b7e551 already in progress: creating tablet
I20260318 02:51:35.562281 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b1678df9cd524c9982cfff7ad3197cfe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:35.564791 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet d1a884fde2c145518a2cb14b7780b6dd (table default.Table_6372798c3d47435ea80a21ca734ce78f [id=b5127c54241a49309f32bfa4e5f6f2cd]) successfully deleted
W20260318 02:51:35.565856 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet d4332d4afb164b35bee3b0146e26b4e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4332d4afb164b35bee3b0146e26b4e1 already in progress: creating tablet
W20260318 02:51:35.566088 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 565add8c21f343f2b11c12a9bb7ff111 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 565add8c21f343f2b11c12a9bb7ff111 already in progress: creating tablet
I20260318 02:51:35.566385 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 2c5038e9e1074f46976a1a5bb4282944 (table default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]) successfully deleted
W20260318 02:51:35.566592 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet ef021185bb774cf3aa3e08d88eaa1923 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef021185bb774cf3aa3e08d88eaa1923 already in progress: creating tablet
I20260318 02:51:35.568619 1175 ts_tablet_manager.cc:1929] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:35.569093 1184 ts_tablet_manager.cc:1929] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:35.569330 1184 log.cc:1199] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/e3999f53c1cc4cb5a1d91eed23785cc6
W20260318 02:51:35.569708 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 41b7d422014d4b2a85b0b97593677e3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41b7d422014d4b2a85b0b97593677e3d already in progress: creating tablet
W20260318 02:51:35.569994 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet defda79dd0f34c37ae16ea808df0754b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet defda79dd0f34c37ae16ea808df0754b already in progress: creating tablet
I20260318 02:51:35.570024 1184 ts_tablet_manager.cc:1950] T e3999f53c1cc4cb5a1d91eed23785cc6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:35.570295 1173 tablet_bootstrap.cc:492] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:35.570508 1173 ts_tablet_manager.cc:1403] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.002s
I20260318 02:51:35.570497 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 503386365f6a49f6b84c64b59b764c10 (table default.Table_9a44c965ec574cae8cced06f58d02bff [id=f3b5bd76bc0945119db3449ce8ce5998]) successfully deleted
I20260318 02:51:35.570715 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 813702e53eee4a54a7d693fd6e03bbbb (table default.Table_1acdeb444a404cb0b89ac6450e835639 [id=9278db75ac0f4aa59c4af2f13a58e314]) successfully deleted
W20260318 02:51:35.570292 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet da178159cde84dda9546952d9b2bbb63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da178159cde84dda9546952d9b2bbb63 already in progress: creating tablet
I20260318 02:51:35.571259 1173 raft_consensus.cc:359] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.571435 1173 raft_consensus.cc:385] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.571491 1173 raft_consensus.cc:740] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.571698 1173 consensus_queue.cc:260] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.572185 1173 ts_tablet_manager.cc:1434] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:35.572482 1173 tablet_bootstrap.cc:492] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:35.572557 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1678df9cd524c9982cfff7ad3197cfe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:35.574256 1173 tablet_bootstrap.cc:654] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.575603 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet d1a67e637d934c0f99c00d04fb26df0d (table default.Table_d7033fee66fc4e33b922723a18a78236 [id=5d7bac7ca89d4b11ab8a882731f9b858]) successfully deleted
I20260318 02:51:35.584241 1172 ts_tablet_manager.cc:1434] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260318 02:51:35.584653 1172 tablet_bootstrap.cc:492] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:35.586122 1172 tablet_bootstrap.cc:654] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.586918 1175 log.cc:1199] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/e3999f53c1cc4cb5a1d91eed23785cc6
I20260318 02:51:35.589788 1175 ts_tablet_manager.cc:1950] T e3999f53c1cc4cb5a1d91eed23785cc6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:35.593148 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 784) took 1852 ms. Trace:
I20260318 02:51:35.593366 1184 rpcz_store.cc:276] 0318 02:51:33.740537 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.740566 (+ 29us) service_pool.cc:225] Handling call
0318 02:51:35.344357 (+1603791us) ts_tablet_manager.cc:1151] Deleting tablet e3999f53c1cc4cb5a1d91eed23785cc6
0318 02:51:35.345796 (+ 1439us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.490176 (+144380us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.568980 (+ 78804us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.593101 (+ 24121us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1601147}
I20260318 02:51:35.593957 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 774) took 1634 ms. Trace:
I20260318 02:51:35.594094 1175 rpcz_store.cc:276] 0318 02:51:33.959699 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.959758 (+ 59us) service_pool.cc:225] Handling call
0318 02:51:35.545501 (+1585743us) ts_tablet_manager.cc:1151] Deleting tablet e3999f53c1cc4cb5a1d91eed23785cc6
0318 02:51:35.545856 (+ 355us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.557122 (+ 11266us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.568498 (+ 11376us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.593934 (+ 25436us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1585491}
I20260318 02:51:35.594292 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 785) took 1811 ms. Trace:
I20260318 02:51:35.594615 1175 tablet_replica.cc:333] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:35.594470 1184 rpcz_store.cc:276] 0318 02:51:33.782673 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.786130 (+ 3457us) service_pool.cc:225] Handling call
0318 02:51:35.594076 (+1807946us) ts_tablet_manager.cc:1151] Deleting tablet 41b7d422014d4b2a85b0b97593677e3d
0318 02:51:35.594088 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.594274 (+ 186us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1807090}
I20260318 02:51:35.595237 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 787) took 1760 ms. Trace:
I20260318 02:51:35.595966 1174 raft_consensus.cc:359] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.596163 1174 raft_consensus.cc:385] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.596267 1174 raft_consensus.cc:740] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
W20260318 02:51:35.596314 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet ebfb14850afa4043848814f01eabf394 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebfb14850afa4043848814f01eabf394 already in progress: creating tablet
I20260318 02:51:35.596522 1174 consensus_queue.cc:260] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.597030 1174 ts_tablet_manager.cc:1434] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.039s user 0.002s sys 0.000s
I20260318 02:51:35.597287 1174 tablet_bootstrap.cc:492] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:35.598857 1174 tablet_bootstrap.cc:654] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.601675 926 raft_consensus.cc:3060] T b5c19bc5e07949088c84cedbf944dfdb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:35.606391 1175 raft_consensus.cc:2243] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.606714 1175 raft_consensus.cc:2272] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.607117 1172 tablet_bootstrap.cc:492] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:35.607378 1172 ts_tablet_manager.cc:1403] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.002s
I20260318 02:51:35.608008 1175 ts_tablet_manager.cc:1916] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.608803 2121 raft_consensus.cc:493] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:35.608922 2121 raft_consensus.cc:515] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.609480 2121 leader_election.cc:290] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:35.612555 860 leader_election.cc:343] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 65f63eb5e114464988b3b89e3af61b61
W20260318 02:51:35.613221 862 leader_election.cc:343] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 65f63eb5e114464988b3b89e3af61b61
W20260318 02:51:35.613209 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 52b773c3412c4bc792471096802b3f1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52b773c3412c4bc792471096802b3f1a already in progress: creating tablet
I20260318 02:51:35.613322 862 leader_election.cc:304] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:35.613572 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 547762347d7843e989e55e0449ad9fcb (table default.Table_6d3695295b794364b4cdc7849155a559 [id=71965e8878d84c45a022d4438ea04e0e]) successfully deleted
I20260318 02:51:35.613739 2121 raft_consensus.cc:2749] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:35.614295 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 88c0962c84624c3ea5f03c898f5ff348 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88c0962c84624c3ea5f03c898f5ff348 already in progress: creating tablet
I20260318 02:51:35.614516 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet e3999f53c1cc4cb5a1d91eed23785cc6 (table default.Table_7442f04ad30e435b84996fb8990e0a44 [id=40612e2dc3b7447f8f4f753bf5474c22]) successfully deleted
I20260318 02:51:35.616196 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet e3999f53c1cc4cb5a1d91eed23785cc6 (table default.Table_7442f04ad30e435b84996fb8990e0a44 [id=40612e2dc3b7447f8f4f753bf5474c22]) successfully deleted
W20260318 02:51:35.616441 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 41b7d422014d4b2a85b0b97593677e3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41b7d422014d4b2a85b0b97593677e3d already in progress: creating tablet
I20260318 02:51:35.622783 452 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 3868406102b748a5b13420b24bf16485 (table default.Table_ad02fb74a8e54e76ba7370a1d85c60b8 [id=a7ad61d6d9264ec4ac482798b1ea992e]). Expected version 3 got 0
I20260318 02:51:35.624377 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 3dda9bd9befd427fac9dfde6f299a6ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:35.595387 1184 rpcz_store.cc:276] 0318 02:51:33.834764 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.835062 (+ 298us) service_pool.cc:225] Handling call
0318 02:51:35.594966 (+1759904us) ts_tablet_manager.cc:1151] Deleting tablet da178159cde84dda9546952d9b2bbb63
0318 02:51:35.594974 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.595107 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1755327}
I20260318 02:51:35.627091 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 788) took 1791 ms. Trace:
W20260318 02:51:35.627148 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet da178159cde84dda9546952d9b2bbb63 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da178159cde84dda9546952d9b2bbb63 already in progress: creating tablet
I20260318 02:51:35.627187 1184 rpcz_store.cc:276] 0318 02:51:33.835492 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.835816 (+ 324us) service_pool.cc:225] Handling call
0318 02:51:35.626928 (+1791112us) ts_tablet_manager.cc:1151] Deleting tablet ebfb14850afa4043848814f01eabf394
0318 02:51:35.626940 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.627070 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1787221}
W20260318 02:51:35.627612 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet ebfb14850afa4043848814f01eabf394 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebfb14850afa4043848814f01eabf394 already in progress: creating tablet
I20260318 02:51:35.628093 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 786) took 1794 ms. Trace:
I20260318 02:51:35.628225 1184 rpcz_store.cc:276] 0318 02:51:33.834048 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.835961 (+ 1913us) service_pool.cc:225] Handling call
0318 02:51:35.627930 (+1791969us) ts_tablet_manager.cc:1151] Deleting tablet defda79dd0f34c37ae16ea808df0754b
0318 02:51:35.627943 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.628075 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1788164}
I20260318 02:51:35.628604 452 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 104cd36774df4bc0adf1d449224304d5 (table default.Table_c978284529db4de7883f9f0664c4a158 [id=8b5e3535d9e44b1a86dc59211a31deb6]). Expected version 1 got 0
W20260318 02:51:35.628783 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet defda79dd0f34c37ae16ea808df0754b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet defda79dd0f34c37ae16ea808df0754b already in progress: creating tablet
I20260318 02:51:35.629295 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 789) took 1774 ms. Trace:
I20260318 02:51:35.636310 2152 raft_consensus.cc:493] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:35.636615 2152 raft_consensus.cc:515] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.637758 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1350684961f645e089fc3fd9ba3a5b09" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:35.638293 997 leader_election.cc:343] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.640630 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1350684961f645e089fc3fd9ba3a5b09" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:35.640897 785 raft_consensus.cc:2468] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:35.641350 999 leader_election.cc:304] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:35.641669 2147 raft_consensus.cc:2804] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:35.641733 2147 raft_consensus.cc:493] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:35.641793 2147 raft_consensus.cc:3060] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:35.641850 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_69de0fc8d3014dd887249ce81b9485f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:35.642582 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69de0fc8d3014dd887249ce81b9485f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:35.644490 2147 raft_consensus.cc:515] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.645398 2147 leader_election.cc:290] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:35.646093 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1350684961f645e089fc3fd9ba3a5b09" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:35.646281 785 raft_consensus.cc:3060] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:35.649500 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1350684961f645e089fc3fd9ba3a5b09" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:35.629457 1184 rpcz_store.cc:276] 0318 02:51:33.854918 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.854970 (+ 52us) service_pool.cc:225] Handling call
0318 02:51:35.629052 (+1774082us) ts_tablet_manager.cc:1151] Deleting tablet 52b773c3412c4bc792471096802b3f1a
0318 02:51:35.629086 (+ 34us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.629191 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1773914}
W20260318 02:51:35.650111 997 leader_election.cc:343] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.650525 785 raft_consensus.cc:2468] T 1350684961f645e089fc3fd9ba3a5b09 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:35.650954 999 leader_election.cc:304] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:35.651116 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 790) took 1752 ms. Trace:
I20260318 02:51:35.651376 2147 raft_consensus.cc:2804] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:35.651533 2147 raft_consensus.cc:697] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
W20260318 02:51:35.651609 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 52b773c3412c4bc792471096802b3f1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52b773c3412c4bc792471096802b3f1a already in progress: creating tablet
I20260318 02:51:35.651804 2152 leader_election.cc:290] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:35.651790 2147 consensus_queue.cc:237] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.656098 1174 tablet_bootstrap.cc:492] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:35.656316 1174 ts_tablet_manager.cc:1403] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.059s user 0.007s sys 0.004s
I20260318 02:51:35.658514 2149 consensus_queue.cc:1048] T f6794f8a443f41b195fb326d49f56756 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:35.660926 1184 rpcz_store.cc:276] 0318 02:51:33.898428 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.898900 (+ 472us) service_pool.cc:225] Handling call
0318 02:51:35.650571 (+1751671us) ts_tablet_manager.cc:1151] Deleting tablet 88c0962c84624c3ea5f03c898f5ff348
0318 02:51:35.650584 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.651098 (+ 514us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1751388}
W20260318 02:51:35.661648 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 88c0962c84624c3ea5f03c898f5ff348 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88c0962c84624c3ea5f03c898f5ff348 already in progress: creating tablet
I20260318 02:51:35.662283 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 800) took 1248 ms. Trace:
I20260318 02:51:35.668193 1176 ts_tablet_manager.cc:1929] T 2a7ddc0807d742cea258f889390e2142 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.668375 1176 log.cc:1199] T 2a7ddc0807d742cea258f889390e2142 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/2a7ddc0807d742cea258f889390e2142
I20260318 02:51:35.668550 1184 rpcz_store.cc:276] 0318 02:51:34.414068 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:34.414125 (+ 57us) service_pool.cc:225] Handling call
0318 02:51:35.662133 (+1248008us) ts_tablet_manager.cc:1151] Deleting tablet 121659c2b4da4c4f932dea3d0d0ee8cb
0318 02:51:35.662148 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.662262 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1247818}
I20260318 02:51:35.608565 1172 raft_consensus.cc:359] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.668824 1174 raft_consensus.cc:359] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.668941 1172 raft_consensus.cc:385] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.669013 1172 raft_consensus.cc:740] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.669219 1172 consensus_queue.cc:260] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.669735 1172 ts_tablet_manager.cc:1434] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.062s user 0.001s sys 0.001s
I20260318 02:51:35.670018 1172 tablet_bootstrap.cc:492] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:35.670473 2175 tablet.cc:1723] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:35.671249 1174 raft_consensus.cc:385] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.671492 1172 tablet_bootstrap.cc:654] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.670306 2174 tablet.cc:1723] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:35.672184 1174 raft_consensus.cc:740] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.672842 1174 consensus_queue.cc:260] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.679488 2138 tablet.cc:1723] T b5c19bc5e07949088c84cedbf944dfdb P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
W20260318 02:51:35.684087 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 121659c2b4da4c4f932dea3d0d0ee8cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 121659c2b4da4c4f932dea3d0d0ee8cb already in progress: creating tablet
I20260318 02:51:35.684721 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 801) took 1268 ms. Trace:
I20260318 02:51:35.684818 1184 rpcz_store.cc:276] 0318 02:51:34.416482 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:34.416999 (+ 517us) service_pool.cc:225] Handling call
0318 02:51:35.684564 (+1267565us) ts_tablet_manager.cc:1151] Deleting tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a
0318 02:51:35.684576 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.684674 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1259381}
W20260318 02:51:35.685302 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a already in progress: creating tablet
I20260318 02:51:35.685916 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 803) took 1261 ms. Trace:
I20260318 02:51:35.686062 1184 rpcz_store.cc:276] 0318 02:51:34.424869 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:34.424920 (+ 51us) service_pool.cc:225] Handling call
0318 02:51:35.685665 (+1260745us) ts_tablet_manager.cc:1151] Deleting tablet ce82c595e30a4878be25be8eb3d30790
0318 02:51:35.685679 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.685873 (+ 194us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1257105}
W20260318 02:51:35.686666 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet ce82c595e30a4878be25be8eb3d30790 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce82c595e30a4878be25be8eb3d30790 already in progress: creating tablet
I20260318 02:51:35.687453 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 802) took 1262 ms. Trace:
I20260318 02:51:35.687731 1184 rpcz_store.cc:276] 0318 02:51:34.424602 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:34.431031 (+ 6429us) service_pool.cc:225] Handling call
0318 02:51:35.687092 (+1256061us) ts_tablet_manager.cc:1151] Deleting tablet d279b1b52366488f80097eaf52dfb2db
0318 02:51:35.687101 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.687351 (+ 250us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1255865}
W20260318 02:51:35.688446 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet d279b1b52366488f80097eaf52dfb2db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d279b1b52366488f80097eaf52dfb2db already in progress: creating tablet
I20260318 02:51:35.689265 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 807) took 1238 ms. Trace:
I20260318 02:51:35.689543 1184 rpcz_store.cc:276] 0318 02:51:34.450962 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:34.451005 (+ 43us) service_pool.cc:225] Handling call
0318 02:51:35.688889 (+1237884us) ts_tablet_manager.cc:1151] Deleting tablet 9777963ff20c4a799de2870555f6b335
0318 02:51:35.688897 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.689156 (+ 259us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1210542}
W20260318 02:51:35.690418 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 9777963ff20c4a799de2870555f6b335 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9777963ff20c4a799de2870555f6b335 already in progress: creating tablet
I20260318 02:51:35.691061 1184 tablet_replica.cc:333] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:35.691730 1184 raft_consensus.cc:2243] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.692266 1184 raft_consensus.cc:2272] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.695127 1184 ts_tablet_manager.cc:1916] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:35.702188 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 36c3a417e8c04108b22d28674e570b9b consensus state has no leader
W20260318 02:51:35.702889 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7c4eca5e16f84564b31933b8227fd980 consensus state has no leader
W20260318 02:51:35.705889 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b34cc689a9a94f22bd2aa84b7d2eaee9 consensus state has no leader
W20260318 02:51:35.706743 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc96b13affd442eca3b671a3741b6000 consensus state has no leader
I20260318 02:51:35.707000 457 master_service.cc:954] ReplaceTablet: received request to replace tablet f72023f5408f4ef4b628568da0c008d6 from {username='slave'} at 127.0.0.1:47158
W20260318 02:51:35.707392 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2aaac92ff81d4c9bb05cf21e7b4d9979 consensus state has no leader
I20260318 02:51:35.709699 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8e1825ed6ac14c60b72e23cbbce1b677" } modify_external_catalogs: true
I20260318 02:51:35.709918 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8e1825ed6ac14c60b72e23cbbce1b677" } modify_external_catalogs: true
I20260318 02:51:35.710677 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4775eaa0e7e84642aa0a8f8b2885610e" } modify_external_catalogs: true
I20260318 02:51:35.710868 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4775eaa0e7e84642aa0a8f8b2885610e" } modify_external_catalogs: true
I20260318 02:51:35.679188 1176 ts_tablet_manager.cc:1950] T 2a7ddc0807d742cea258f889390e2142 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:35.711153 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_be6fe6ada3fa4705b82768b6862b1de9" } modify_external_catalogs: true
I20260318 02:51:35.711305 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_be6fe6ada3fa4705b82768b6862b1de9" } modify_external_catalogs: true
I20260318 02:51:35.710808 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5c77c8fe4ca64357986c070a9131d61c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:35.711621 1174 ts_tablet_manager.cc:1434] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.055s user 0.002s sys 0.000s
I20260318 02:51:35.711896 1174 tablet_bootstrap.cc:492] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:35.712014 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c77c8fe4ca64357986c070a9131d61c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:35.712074 1176 tablet_replica.cc:333] T 3dda9bd9befd427fac9dfde6f299a6ab P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:35.712256 1176 raft_consensus.cc:2243] T 3dda9bd9befd427fac9dfde6f299a6ab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.712383 1176 raft_consensus.cc:2272] T 3dda9bd9befd427fac9dfde6f299a6ab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.712935 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 2a7ddc0807d742cea258f889390e2142 (table default.Table_23b963651b514aeaa69a42da8e6d2150 [id=ff1dddd3bf73410c816e618a9931c7cf]) successfully deleted
I20260318 02:51:35.713346 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6649f615bb3d4590bb3ff395d88019cb" } modify_external_catalogs: true
I20260318 02:51:35.713517 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6649f615bb3d4590bb3ff395d88019cb" } modify_external_catalogs: true
I20260318 02:51:35.714025 1176 ts_tablet_manager.cc:1916] T 3dda9bd9befd427fac9dfde6f299a6ab P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.714215 1174 tablet_bootstrap.cc:654] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.717417 450 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet b5c19bc5e07949088c84cedbf944dfdb (table default.Table_79bea80cab3d40f5bead32f2fdcf09fa [id=873432f002e14a4fa7065dcfe5caebd5]). Expected version 6 got 0
I20260318 02:51:35.719305 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 421e5223d6af4da1a8e07534f942d016 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:35.719523 904 tablet_service.cc:1558] Processing DeleteTablet for tablet abfdba1f21e44652b2bce62cd3e6681f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:35.719830 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5ceb6bf88c4743ee88d4fe26441e46ec" } modify_external_catalogs: true
I20260318 02:51:35.720016 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5ceb6bf88c4743ee88d4fe26441e46ec" } modify_external_catalogs: true
I20260318 02:51:35.729651 1172 tablet_bootstrap.cc:492] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:35.729867 1172 ts_tablet_manager.cc:1403] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.060s user 0.001s sys 0.002s
I20260318 02:51:35.730640 1172 raft_consensus.cc:359] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.730849 1172 raft_consensus.cc:385] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.730934 1172 raft_consensus.cc:740] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.730983 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fa7c1d6879c40ebb8d989ebae205e9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:35.731192 1172 consensus_queue.cc:260] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.731717 1172 ts_tablet_manager.cc:1434] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:35.732034 1172 tablet_bootstrap.cc:492] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:35.733668 1172 tablet_bootstrap.cc:654] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.734485 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 65f63eb5e114464988b3b89e3af61b61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:35.737991 1175 ts_tablet_manager.cc:1929] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.738113 1175 log.cc:1199] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/bfb352bce9cc4e8aa899d691954d28d2
I20260318 02:51:35.738392 1175 ts_tablet_manager.cc:1950] T bfb352bce9cc4e8aa899d691954d28d2 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:35.739655 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 775) took 1643 ms. Trace:
I20260318 02:51:35.739746 1175 rpcz_store.cc:276] 0318 02:51:34.096240 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:34.096428 (+ 188us) service_pool.cc:225] Handling call
0318 02:51:35.594567 (+1498139us) ts_tablet_manager.cc:1151] Deleting tablet bfb352bce9cc4e8aa899d691954d28d2
0318 02:51:35.594577 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.611739 (+ 17162us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.737889 (+126150us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.739633 (+ 1744us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1497926}
I20260318 02:51:35.740249 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet bfb352bce9cc4e8aa899d691954d28d2 (table default.Table_b1d3f1dcf5d3445a817d681110d65f37 [id=e0b93f047d414aa5bc01df1a1dcb8878]) successfully deleted
I20260318 02:51:35.740702 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 784) took 1263 ms. Trace:
I20260318 02:51:35.740799 1175 rpcz_store.cc:276] 0318 02:51:34.477704 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:34.477755 (+ 51us) service_pool.cc:225] Handling call
0318 02:51:35.740552 (+1262797us) ts_tablet_manager.cc:1151] Deleting tablet 121659c2b4da4c4f932dea3d0d0ee8cb
0318 02:51:35.740564 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.740683 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1255578}
W20260318 02:51:35.741185 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 121659c2b4da4c4f932dea3d0d0ee8cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 121659c2b4da4c4f932dea3d0d0ee8cb already in progress: creating tablet
I20260318 02:51:35.741580 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 785) took 1249 ms. Trace:
I20260318 02:51:35.741694 1175 rpcz_store.cc:276] 0318 02:51:34.491790 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:34.492056 (+ 266us) service_pool.cc:225] Handling call
0318 02:51:35.741470 (+1249414us) ts_tablet_manager.cc:1151] Deleting tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a
0318 02:51:35.741481 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.741564 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1249205}
W20260318 02:51:35.742146 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a already in progress: creating tablet
I20260318 02:51:35.742511 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 787) took 1250 ms. Trace:
I20260318 02:51:35.742645 1175 rpcz_store.cc:276] 0318 02:51:34.491991 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:34.492579 (+ 588us) service_pool.cc:225] Handling call
0318 02:51:35.742407 (+1249828us) ts_tablet_manager.cc:1151] Deleting tablet ce82c595e30a4878be25be8eb3d30790
0318 02:51:35.742418 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.742495 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1249630}
W20260318 02:51:35.743045 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet ce82c595e30a4878be25be8eb3d30790 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce82c595e30a4878be25be8eb3d30790 already in progress: creating tablet
I20260318 02:51:35.743376 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 786) took 1251 ms. Trace:
I20260318 02:51:35.743469 1175 rpcz_store.cc:276] 0318 02:51:34.491908 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:34.530440 (+ 38532us) service_pool.cc:225] Handling call
0318 02:51:35.743275 (+1212835us) ts_tablet_manager.cc:1151] Deleting tablet d279b1b52366488f80097eaf52dfb2db
0318 02:51:35.743285 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.743360 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1212267}
W20260318 02:51:35.744481 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet d279b1b52366488f80097eaf52dfb2db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d279b1b52366488f80097eaf52dfb2db already in progress: creating tablet
I20260318 02:51:35.745061 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 791) took 1167 ms. Trace:
I20260318 02:51:35.744956 1176 ts_tablet_manager.cc:1929] T 3dda9bd9befd427fac9dfde6f299a6ab P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.746266 1176 log.cc:1199] T 3dda9bd9befd427fac9dfde6f299a6ab P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/3dda9bd9befd427fac9dfde6f299a6ab
I20260318 02:51:35.749956 1176 ts_tablet_manager.cc:1950] T 3dda9bd9befd427fac9dfde6f299a6ab P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:35.752771 1175 rpcz_store.cc:276] 0318 02:51:34.577537 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:34.577783 (+ 246us) service_pool.cc:225] Handling call
0318 02:51:35.744936 (+1167153us) ts_tablet_manager.cc:1151] Deleting tablet 9777963ff20c4a799de2870555f6b335
0318 02:51:35.744947 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.745041 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1148906}
W20260318 02:51:35.753453 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 9777963ff20c4a799de2870555f6b335 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9777963ff20c4a799de2870555f6b335 already in progress: creating tablet
I20260318 02:51:35.753582 1172 tablet_bootstrap.cc:492] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:35.745973 1173 tablet_bootstrap.cc:492] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:35.754014 1173 ts_tablet_manager.cc:1403] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.182s user 0.037s sys 0.029s
I20260318 02:51:35.753716 1172 ts_tablet_manager.cc:1403] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260318 02:51:35.754906 1173 raft_consensus.cc:359] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.755124 1173 raft_consensus.cc:385] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.755210 1173 raft_consensus.cc:740] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.755471 1173 consensus_queue.cc:260] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.755960 1173 ts_tablet_manager.cc:1434] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:35.756284 1173 tablet_bootstrap.cc:492] T 3868406102b748a5b13420b24bf16485 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:35.756747 974 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
W20260318 02:51:35.757586 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 1d3eb0cf4190436680ad3265a1c1c31b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d3eb0cf4190436680ad3265a1c1c31b already in progress: creating tablet
I20260318 02:51:35.758608 1174 tablet_bootstrap.cc:492] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:35.758622 1173 tablet_bootstrap.cc:654] T 3868406102b748a5b13420b24bf16485 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.758785 1174 ts_tablet_manager.cc:1403] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.047s user 0.001s sys 0.004s
I20260318 02:51:35.759490 1174 raft_consensus.cc:359] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.759788 1174 raft_consensus.cc:385] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.759867 1174 raft_consensus.cc:740] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
W20260318 02:51:35.760103 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet eaf1477c32ce45329a9a0ac19158d54e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eaf1477c32ce45329a9a0ac19158d54e already in progress: creating tablet
I20260318 02:51:35.760202 1174 consensus_queue.cc:260] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:35.760789 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet d23a51e4c86142ac902fb46598abdd0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d23a51e4c86142ac902fb46598abdd0c already in progress: creating tablet
I20260318 02:51:35.761029 1174 ts_tablet_manager.cc:1434] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:35.761188 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 3dda9bd9befd427fac9dfde6f299a6ab (table default.Table_a5974ba51eec46dfa733c7b066123d8e [id=be8bd5c24eda495abd4c05a866a2c194]) successfully deleted
I20260318 02:51:35.761318 1174 tablet_bootstrap.cc:492] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:35.761355 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet ca4e1eec9a2148488295416cd68ca607 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca4e1eec9a2148488295416cd68ca607 already in progress: creating tablet
W20260318 02:51:35.762049 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2a6f56dafead404eb1720276b07ea733 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a6f56dafead404eb1720276b07ea733 already in progress: creating tablet
I20260318 02:51:35.762332 1175 tablet_replica.cc:333] T 4fa6bf38381740a1bab1088ede6ede1c P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:35.762586 1175 raft_consensus.cc:2243] T 4fa6bf38381740a1bab1088ede6ede1c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.762768 1175 raft_consensus.cc:2272] T 4fa6bf38381740a1bab1088ede6ede1c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.762892 1174 tablet_bootstrap.cc:654] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.763355 1175 ts_tablet_manager.cc:1916] T 4fa6bf38381740a1bab1088ede6ede1c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.767107 1184 ts_tablet_manager.cc:1929] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.768149 1184 log.cc:1199] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/b716c3a80d4a44d190de38f926098efc
I20260318 02:51:35.768435 1173 tablet_bootstrap.cc:492] T 3868406102b748a5b13420b24bf16485 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:35.768594 1173 ts_tablet_manager.cc:1403] T 3868406102b748a5b13420b24bf16485 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260318 02:51:35.769378 1173 raft_consensus.cc:359] T 3868406102b748a5b13420b24bf16485 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.769572 1173 raft_consensus.cc:385] T 3868406102b748a5b13420b24bf16485 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.769644 1173 raft_consensus.cc:740] T 3868406102b748a5b13420b24bf16485 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.755046 1172 raft_consensus.cc:359] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.769894 1173 consensus_queue.cc:260] T 3868406102b748a5b13420b24bf16485 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.770085 1172 raft_consensus.cc:385] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.770371 1173 ts_tablet_manager.cc:1434] T 3868406102b748a5b13420b24bf16485 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260318 02:51:35.770489 1172 raft_consensus.cc:740] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.770156 1184 ts_tablet_manager.cc:1950] T b716c3a80d4a44d190de38f926098efc P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:35.770838 1173 tablet_bootstrap.cc:492] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:35.771013 1172 consensus_queue.cc:260] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.772363 1173 tablet_bootstrap.cc:654] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.772832 1172 ts_tablet_manager.cc:1434] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.018s user 0.001s sys 0.000s
I20260318 02:51:35.776530 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 815) took 1257 ms. Trace:
I20260318 02:51:35.777877 1172 tablet_bootstrap.cc:492] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:35.778095 1174 tablet_bootstrap.cc:492] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:35.777736 1184 rpcz_store.cc:276] 0318 02:51:34.519005 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:34.519065 (+ 60us) service_pool.cc:225] Handling call
0318 02:51:35.690932 (+1171867us) ts_tablet_manager.cc:1151] Deleting tablet b716c3a80d4a44d190de38f926098efc
0318 02:51:35.690939 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.736930 (+ 45991us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.766540 (+ 29610us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.776193 (+ 9653us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1171563}
I20260318 02:51:35.779330 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet b716c3a80d4a44d190de38f926098efc (table default.Table_b173d9dd6cc74a9ea5044ae888a3bd14 [id=08016e8769bf4007bdb2eba7c11fe0f7]) successfully deleted
I20260318 02:51:35.780162 1174 ts_tablet_manager.cc:1403] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260318 02:51:35.780587 1184 tablet_replica.cc:333] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:35.781148 1174 raft_consensus.cc:359] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.780965 1172 tablet_bootstrap.cc:654] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.782078 1184 raft_consensus.cc:2243] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.783279 1184 raft_consensus.cc:2272] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.784474 1174 raft_consensus.cc:385] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.784582 1174 raft_consensus.cc:740] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.784873 1174 consensus_queue.cc:260] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.785633 1174 ts_tablet_manager.cc:1434] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:35.785952 1174 tablet_bootstrap.cc:492] T 2882569524e74a308e9fabf533a8a87c P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:35.787024 1184 ts_tablet_manager.cc:1916] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.774704 1175 ts_tablet_manager.cc:1929] T 4fa6bf38381740a1bab1088ede6ede1c P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.789271 1175 log.cc:1199] T 4fa6bf38381740a1bab1088ede6ede1c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/4fa6bf38381740a1bab1088ede6ede1c
I20260318 02:51:35.789625 1175 ts_tablet_manager.cc:1950] T 4fa6bf38381740a1bab1088ede6ede1c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:35.790670 1175 tablet_replica.cc:333] T 7883f526d06e442c81f1b66fd89d2cd0 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:35.790854 1175 raft_consensus.cc:2243] T 7883f526d06e442c81f1b66fd89d2cd0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.790992 1175 raft_consensus.cc:2272] T 7883f526d06e442c81f1b66fd89d2cd0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.790949 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 4fa6bf38381740a1bab1088ede6ede1c (table default.Table_607d1941968145a6a336b9a5bb85b43e [id=85784a23699343ee80e0adb9e5f82413]) successfully deleted
I20260318 02:51:35.791471 1175 ts_tablet_manager.cc:1916] T 7883f526d06e442c81f1b66fd89d2cd0 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.793385 2121 raft_consensus.cc:493] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:35.793529 2121 raft_consensus.cc:515] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.794122 2121 leader_election.cc:290] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:35.799639 860 leader_election.cc:343] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: f5a829abed0444b79c48ab080d024824
I20260318 02:51:35.800443 1175 ts_tablet_manager.cc:1929] T 7883f526d06e442c81f1b66fd89d2cd0 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.802826 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c8c62b5fb5124c57bde7d7daa0fc61cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:35.803498 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8c62b5fb5124c57bde7d7daa0fc61cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:35.805351 1175 log.cc:1199] T 7883f526d06e442c81f1b66fd89d2cd0 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/7883f526d06e442c81f1b66fd89d2cd0
W20260318 02:51:35.800823 862 leader_election.cc:343] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: f5a829abed0444b79c48ab080d024824
I20260318 02:51:35.802178 1173 tablet_bootstrap.cc:492] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:35.805588 862 leader_election.cc:304] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:35.805687 1173 ts_tablet_manager.cc:1403] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.002s
I20260318 02:51:35.805812 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 8c20810ad3354126bf49bbeeb6edb098
I20260318 02:51:35.806205 2121 raft_consensus.cc:2749] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:35.806420 1173 raft_consensus.cc:359] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.806614 1173 raft_consensus.cc:385] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.806695 1173 raft_consensus.cc:740] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.806638 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_49bc09142ca84ca491d7ce4ed0320149"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:35.806990 1173 consensus_queue.cc:260] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:35.807197 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49bc09142ca84ca491d7ce4ed0320149 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:35.807503 1172 tablet_bootstrap.cc:492] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:35.807521 1173 ts_tablet_manager.cc:1434] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:35.807689 1172 ts_tablet_manager.cc:1403] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.002s
I20260318 02:51:35.807930 1173 tablet_bootstrap.cc:492] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:35.809165 455 master_service.cc:954] ReplaceTablet: received request to replace tablet 480f4438de13453fa84ce8c37388aeb1 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:35.809623 1173 tablet_bootstrap.cc:654] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.810309 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c20810ad3354126bf49bbeeb6edb098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:35.810524 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c20810ad3354126bf49bbeeb6edb098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:35.811074 1172 raft_consensus.cc:359] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.811287 1172 raft_consensus.cc:385] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.811364 1175 ts_tablet_manager.cc:1950] T 7883f526d06e442c81f1b66fd89d2cd0 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:35.811396 1172 raft_consensus.cc:740] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.811604 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c20810ad3354126bf49bbeeb6edb098 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:35.811672 1172 consensus_queue.cc:260] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.812362 1172 ts_tablet_manager.cc:1434] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:35.814626 1172 tablet_bootstrap.cc:492] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:35.814977 1176 tablet_replica.cc:333] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:35.815171 1176 raft_consensus.cc:2243] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.815369 1176 raft_consensus.cc:2272] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.815850 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet bd077319b3c443849de087eb61da6a77
I20260318 02:51:35.815914 1176 ts_tablet_manager.cc:1916] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.818396 454 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 3868406102b748a5b13420b24bf16485 (table default.Table_ad02fb74a8e54e76ba7370a1d85c60b8 [id=a7ad61d6d9264ec4ac482798b1ea992e]). Expected version 3 got 0
I20260318 02:51:35.818670 454 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet d2fb9c8f339444bc8d7c6479e7d87f44 (table default.Table_278b10b38c074522b0e03e24d653346d [id=895bbd90cf47462ab116ee3f37e94982]). Expected version 3 got 0
I20260318 02:51:35.818876 454 catalog_manager.cc:5671] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a903d876086423b8016d705b98895ad (127.0.104.129). New cstate: current_term: 1 leader_uuid: "6a903d876086423b8016d705b98895ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:35.819438 757 tablet_service.cc:1558] Processing DeleteTablet for tablet bd077319b3c443849de087eb61da6a77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:35.819700 451 catalog_manager.cc:5671] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:35.820106 451 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 27fc03c90b584becb250546100af736c (table default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]). Expected version 1 got 0
I20260318 02:51:35.820362 451 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 99e807c8ff5e457fb6c97c6d1b277eab (table default.Table_fd8edd9c8882403f8541f00d0728e3b7 [id=568e88222ca648ce88ee962e91a84588]). Expected version 1 got 0
I20260318 02:51:35.821241 1175 tablet_replica.cc:333] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:35.821422 1175 raft_consensus.cc:2243] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.821632 761 tablet_service.cc:1511] Processing CreateTablet for tablet 9d9cc0f3aef0401c8f072b11d9498a59 (DEFAULT_TABLE table=default.Table_8d234aec26b24c4d8aeca66b6539c362 [id=f0ce51f5fba74028a3442c78e8cee564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.821926 1175 raft_consensus.cc:2272] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.821990 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d9cc0f3aef0401c8f072b11d9498a59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.822415 757 tablet_service.cc:1511] Processing CreateTablet for tablet 2354f5dc569f40c881c0ac5b46393a98 (DEFAULT_TABLE table=default.Table_e0e3edb415604e8f84cacf82541e6112 [id=25f919affb454e0897bd5bf9e41da499]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.822775 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2354f5dc569f40c881c0ac5b46393a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.823019 1175 ts_tablet_manager.cc:1916] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.824966 759 tablet_service.cc:1511] Processing CreateTablet for tablet c4f26dabc5d14215b66659aae1b803da (DEFAULT_TABLE table=default.Table_c2807b5496c14bac97f8e7c9339da762 [id=a753b317f5b6459fb914cac4b36296df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.825273 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f26dabc5d14215b66659aae1b803da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.826249 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 7883f526d06e442c81f1b66fd89d2cd0 (table default.Table_bc4b73281db84d099008d5b137871ff9 [id=32f5b93025f84549a496e5827512aed5]) successfully deleted
I20260318 02:51:35.827289 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 2354f5dc569f40c881c0ac5b46393a98 (DEFAULT_TABLE table=default.Table_e0e3edb415604e8f84cacf82541e6112 [id=25f919affb454e0897bd5bf9e41da499]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.827546 901 tablet_service.cc:1558] Processing DeleteTablet for tablet bd077319b3c443849de087eb61da6a77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:35.827654 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2354f5dc569f40c881c0ac5b46393a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.827994 904 tablet_service.cc:1511] Processing CreateTablet for tablet 2354f5dc569f40c881c0ac5b46393a98 (DEFAULT_TABLE table=default.Table_e0e3edb415604e8f84cacf82541e6112 [id=25f919affb454e0897bd5bf9e41da499]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.827994 901 tablet_service.cc:1511] Processing CreateTablet for tablet c4f26dabc5d14215b66659aae1b803da (DEFAULT_TABLE table=default.Table_c2807b5496c14bac97f8e7c9339da762 [id=a753b317f5b6459fb914cac4b36296df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.828372 890 tablet_service.cc:1511] Processing CreateTablet for tablet 9d9cc0f3aef0401c8f072b11d9498a59 (DEFAULT_TABLE table=default.Table_8d234aec26b24c4d8aeca66b6539c362 [id=f0ce51f5fba74028a3442c78e8cee564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.828697 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2354f5dc569f40c881c0ac5b46393a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.829900 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet bd077319b3c443849de087eb61da6a77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:35.833007 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f26dabc5d14215b66659aae1b803da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.833015 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 9d9cc0f3aef0401c8f072b11d9498a59 (DEFAULT_TABLE table=default.Table_8d234aec26b24c4d8aeca66b6539c362 [id=f0ce51f5fba74028a3442c78e8cee564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.833359 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d9cc0f3aef0401c8f072b11d9498a59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.833710 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d9cc0f3aef0401c8f072b11d9498a59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.836989 1027 tablet_service.cc:1511] Processing CreateTablet for tablet c4f26dabc5d14215b66659aae1b803da (DEFAULT_TABLE table=default.Table_c2807b5496c14bac97f8e7c9339da762 [id=a753b317f5b6459fb914cac4b36296df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.837335 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f26dabc5d14215b66659aae1b803da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.837592 903 tablet_service.cc:1511] Processing CreateTablet for tablet 54ba25c5ad3747bf9845245e29561dc9 (DEFAULT_TABLE table=default.Table_98ca59366b9c4d358295432c55ccbc2b [id=e924bfd8bcec4ee58f1b4d94208e0f80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.837700 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 54ba25c5ad3747bf9845245e29561dc9 (DEFAULT_TABLE table=default.Table_98ca59366b9c4d358295432c55ccbc2b [id=e924bfd8bcec4ee58f1b4d94208e0f80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.837930 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ba25c5ad3747bf9845245e29561dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.837983 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ba25c5ad3747bf9845245e29561dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.841706 2151 raft_consensus.cc:493] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:35.841830 2151 raft_consensus.cc:515] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.842402 2151 leader_election.cc:290] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:35.843442 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b439fa2481a43c78d2c486d8711175f" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:35.844244 999 leader_election.cc:343] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 1b439fa2481a43c78d2c486d8711175f
I20260318 02:51:35.844681 2151 consensus_queue.cc:1048] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260318 02:51:35.844871 997 leader_election.cc:343] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.844983 997 leader_election.cc:304] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:35.845451 1176 ts_tablet_manager.cc:1929] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:35.847666 2151 raft_consensus.cc:2749] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:35.850031 1173 tablet_bootstrap.cc:492] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:35.850210 1173 ts_tablet_manager.cc:1403] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.003s
I20260318 02:51:35.850999 1173 raft_consensus.cc:359] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.851178 1173 raft_consensus.cc:385] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.851245 1173 raft_consensus.cc:740] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.851848 1173 consensus_queue.cc:260] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.852734 1173 ts_tablet_manager.cc:1434] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:35.853021 1173 tablet_bootstrap.cc:492] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:35.854740 449 master_service.cc:954] ReplaceTablet: received request to replace tablet b5c19bc5e07949088c84cedbf944dfdb from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:35.854866 757 tablet_service.cc:1511] Processing CreateTablet for tablet 54ba25c5ad3747bf9845245e29561dc9 (DEFAULT_TABLE table=default.Table_98ca59366b9c4d358295432c55ccbc2b [id=e924bfd8bcec4ee58f1b4d94208e0f80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.855387 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ba25c5ad3747bf9845245e29561dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.858628 1176 log.cc:1199] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/8c20810ad3354126bf49bbeeb6edb098
I20260318 02:51:35.861822 1173 tablet_bootstrap.cc:654] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.862099 1176 ts_tablet_manager.cc:1950] T 8c20810ad3354126bf49bbeeb6edb098 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:35.865832 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 8c20810ad3354126bf49bbeeb6edb098 (table default.Table_4775eaa0e7e84642aa0a8f8b2885610e [id=463a6721eb0d43d09deeb283d1cc4233]) successfully deleted
I20260318 02:51:35.866889 1175 ts_tablet_manager.cc:1929] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.867774 1176 tablet_replica.cc:333] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
W20260318 02:51:35.868330 997 consensus_peers.cc:597] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:35.870199 761 tablet_service.cc:1511] Processing CreateTablet for tablet 0d45c2c6d1314e7db0d54a9659276e73 (DEFAULT_TABLE table=default.Table_41b35eb8bd42409cbe13e96d577de423 [id=4b318b7d30fb4e0cb4b6292ac1232912]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.870646 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d45c2c6d1314e7db0d54a9659276e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.871759 754 tablet_service.cc:1511] Processing CreateTablet for tablet df499767dfee4fbd939d775db9d2577e (DEFAULT_TABLE table=default.Table_0dcf05cd68b046b0a50ee043026b97fa [id=4bab58ca06cc4011b0d6e076476d86ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.872103 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df499767dfee4fbd939d775db9d2577e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.873358 750 tablet_service.cc:1511] Processing CreateTablet for tablet c2453557439844a19cc7b4c8a0696b1e (DEFAULT_TABLE table=default.Table_2fc220fcd0234c5f91b510993149dd37 [id=cdbb3c8fed724d5eba690b0ee8f4dc27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.873677 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2453557439844a19cc7b4c8a0696b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.876966 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 572553569bbe4731b2580f1d22ee4fdd
I20260318 02:51:35.878325 2151 raft_consensus.cc:493] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:35.878468 2151 raft_consensus.cc:515] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.878605 1175 log.cc:1199] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/f5a829abed0444b79c48ab080d024824
I20260318 02:51:35.878906 1175 ts_tablet_manager.cc:1950] T f5a829abed0444b79c48ab080d024824 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:35.878968 1032 tablet_service.cc:1511] Processing CreateTablet for tablet df499767dfee4fbd939d775db9d2577e (DEFAULT_TABLE table=default.Table_0dcf05cd68b046b0a50ee043026b97fa [id=4bab58ca06cc4011b0d6e076476d86ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.879077 2151 leader_election.cc:290] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:35.879442 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df499767dfee4fbd939d775db9d2577e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.869503 904 tablet_service.cc:1511] Processing CreateTablet for tablet 0d45c2c6d1314e7db0d54a9659276e73 (DEFAULT_TABLE table=default.Table_41b35eb8bd42409cbe13e96d577de423 [id=4b318b7d30fb4e0cb4b6292ac1232912]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.879781 1175 tablet_replica.cc:333] T f9bc73d3f85745ecb62d861b6375a987 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
W20260318 02:51:35.879943 999 leader_election.cc:343] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: e57dbb1276114cd6b7d26f7167b99f25
I20260318 02:51:35.872105 901 tablet_service.cc:1511] Processing CreateTablet for tablet c2453557439844a19cc7b4c8a0696b1e (DEFAULT_TABLE table=default.Table_2fc220fcd0234c5f91b510993149dd37 [id=cdbb3c8fed724d5eba690b0ee8f4dc27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.880151 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 572553569bbe4731b2580f1d22ee4fdd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:35.873790 903 tablet_service.cc:1511] Processing CreateTablet for tablet a70a3f0184a54ab6b09b91cceff2531d (DEFAULT_TABLE table=default.Table_f53a203051444a50996e6b2c15103e5b [id=69b3dfef1e7f4cedb30394ee0cb94bf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.877847 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 572553569bbe4731b2580f1d22ee4fdd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:35.879995 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d45c2c6d1314e7db0d54a9659276e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.880471 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57dbb1276114cd6b7d26f7167b99f25" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:35.880611 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2453557439844a19cc7b4c8a0696b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.880657 926 raft_consensus.cc:2468] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:35.881176 997 leader_election.cc:304] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:35.881806 2151 raft_consensus.cc:2804] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:35.881882 2151 raft_consensus.cc:493] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:35.881935 2151 raft_consensus.cc:3060] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:35.871759 890 tablet_service.cc:1511] Processing CreateTablet for tablet df499767dfee4fbd939d775db9d2577e (DEFAULT_TABLE table=default.Table_0dcf05cd68b046b0a50ee043026b97fa [id=4bab58ca06cc4011b0d6e076476d86ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.883301 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df499767dfee4fbd939d775db9d2577e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.884392 2151 raft_consensus.cc:515] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.884819 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a70a3f0184a54ab6b09b91cceff2531d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.884918 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 572553569bbe4731b2580f1d22ee4fdd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:35.886278 999 leader_election.cc:343] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: e57dbb1276114cd6b7d26f7167b99f25
I20260318 02:51:35.886612 2151 leader_election.cc:290] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:35.887236 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e57dbb1276114cd6b7d26f7167b99f25" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:35.887411 926 raft_consensus.cc:3060] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:35.889304 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 0d45c2c6d1314e7db0d54a9659276e73 (DEFAULT_TABLE table=default.Table_41b35eb8bd42409cbe13e96d577de423 [id=4b318b7d30fb4e0cb4b6292ac1232912]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.889696 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d45c2c6d1314e7db0d54a9659276e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.889523 1176 raft_consensus.cc:2243] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.889767 926 raft_consensus.cc:2468] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:35.891047 1176 raft_consensus.cc:2272] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.891518 1175 raft_consensus.cc:2243] T f9bc73d3f85745ecb62d861b6375a987 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.891719 1175 raft_consensus.cc:2272] T f9bc73d3f85745ecb62d861b6375a987 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.891829 997 leader_election.cc:304] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad
I20260318 02:51:35.892246 1175 ts_tablet_manager.cc:1916] T f9bc73d3f85745ecb62d861b6375a987 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.892295 2151 raft_consensus.cc:2804] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:35.892541 2151 raft_consensus.cc:697] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:35.892702 1040 tablet_service.cc:1511] Processing CreateTablet for tablet c2453557439844a19cc7b4c8a0696b1e (DEFAULT_TABLE table=default.Table_2fc220fcd0234c5f91b510993149dd37 [id=cdbb3c8fed724d5eba690b0ee8f4dc27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.893181 2151 consensus_queue.cc:237] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.894170 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2453557439844a19cc7b4c8a0696b1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.894161 1176 ts_tablet_manager.cc:1916] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.896903 1173 tablet_bootstrap.cc:492] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:35.897082 1173 ts_tablet_manager.cc:1403] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.000s
I20260318 02:51:35.897873 1173 raft_consensus.cc:359] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.898067 1173 raft_consensus.cc:385] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.898152 1173 raft_consensus.cc:740] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.898396 1173 consensus_queue.cc:260] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.899734 2121 raft_consensus.cc:493] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:35.899845 2121 raft_consensus.cc:515] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.900434 2121 leader_election.cc:290] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:35.901065 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b230018a95a54ababfe5ecf2ca1e2e49" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:35.901249 1063 raft_consensus.cc:2468] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:35.901659 860 leader_election.cc:304] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:35.901912 2121 raft_consensus.cc:2804] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:35.901976 2121 raft_consensus.cc:493] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260318 02:51:35.901985 862 leader_election.cc:343] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: b230018a95a54ababfe5ecf2ca1e2e49
I20260318 02:51:35.902053 2121 raft_consensus.cc:3060] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:35.903389 1175 ts_tablet_manager.cc:1929] T f9bc73d3f85745ecb62d861b6375a987 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.905682 1175 log.cc:1199] T f9bc73d3f85745ecb62d861b6375a987 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/f9bc73d3f85745ecb62d861b6375a987
I20260318 02:51:35.906116 1175 ts_tablet_manager.cc:1950] T f9bc73d3f85745ecb62d861b6375a987 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:35.908376 1184 ts_tablet_manager.cc:1929] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.908571 1184 log.cc:1199] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/dea25aaad60a4b2483a8832f995d1316
I20260318 02:51:35.913688 1175 tablet_replica.cc:333] T 421e5223d6af4da1a8e07534f942d016 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:35.913951 1175 raft_consensus.cc:2243] T 421e5223d6af4da1a8e07534f942d016 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.914141 1175 raft_consensus.cc:2272] T 421e5223d6af4da1a8e07534f942d016 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.914768 1175 ts_tablet_manager.cc:1916] T 421e5223d6af4da1a8e07534f942d016 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.915179 2121 raft_consensus.cc:515] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.915916 2121 leader_election.cc:290] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:35.916098 2121 raft_consensus.cc:493] T 3868406102b748a5b13420b24bf16485 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:35.916249 2121 raft_consensus.cc:515] T 3868406102b748a5b13420b24bf16485 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.917035 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b230018a95a54ababfe5ecf2ca1e2e49" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:35.917217 1063 raft_consensus.cc:3060] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:35.919716 1174 tablet_bootstrap.cc:654] T 2882569524e74a308e9fabf533a8a87c P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.919816 1063 raft_consensus.cc:2468] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:35.919847 456 master_service.cc:954] ReplaceTablet: received request to replace tablet 49afed40c7aa4f2d913daed8055a098e from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:35.921026 454 master_service.cc:954] ReplaceTablet: received request to replace tablet db22b17af0874e1289766138ed0d0591 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:35.920989 860 leader_election.cc:304] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:35.921264 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet f5a829abed0444b79c48ab080d024824 (table default.Table_b81f87a10bfa4885ba1ad5ed5fdf1828 [id=bdcf510793fa400cb6b8ddd13fd3fe0b]) successfully deleted
I20260318 02:51:35.922104 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868406102b748a5b13420b24bf16485" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:35.922873 2121 leader_election.cc:290] T 3868406102b748a5b13420b24bf16485 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:35.923076 2121 raft_consensus.cc:2804] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:35.923221 2121 raft_consensus.cc:697] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
I20260318 02:51:35.923353 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f72023f5408f4ef4b628568da0c008d6
I20260318 02:51:35.923539 2121 consensus_queue.cc:237] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.923738 448 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 3868406102b748a5b13420b24bf16485 (table default.Table_ad02fb74a8e54e76ba7370a1d85c60b8 [id=a7ad61d6d9264ec4ac482798b1ea992e]). Expected version 3 got 0
I20260318 02:51:35.923838 457 catalog_manager.cc:6741] ReplaceTablet: tablet f72023f5408f4ef4b628568da0c008d6 deleted and replaced by tablet bf54f8603e514f1cad3f53ff1427cabe
W20260318 02:51:35.924620 862 leader_election.cc:343] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: b230018a95a54ababfe5ecf2ca1e2e49
I20260318 02:51:35.925050 759 tablet_service.cc:1558] Processing DeleteTablet for tablet f72023f5408f4ef4b628568da0c008d6 with delete_type TABLET_DATA_DELETED (replaced by tablet bf54f8603e514f1cad3f53ff1427cabe) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:35.925284 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3868406102b748a5b13420b24bf16485" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:35.925527 1027 tablet_service.cc:1511] Processing CreateTablet for tablet a70a3f0184a54ab6b09b91cceff2531d (DEFAULT_TABLE table=default.Table_f53a203051444a50996e6b2c15103e5b [id=69b3dfef1e7f4cedb30394ee0cb94bf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.925948 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a70a3f0184a54ab6b09b91cceff2531d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.926239 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 480f4438de13453fa84ce8c37388aeb1
I20260318 02:51:35.926609 862 leader_election.cc:304] T 3868406102b748a5b13420b24bf16485 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:35.926703 455 catalog_manager.cc:6741] ReplaceTablet: tablet 480f4438de13453fa84ce8c37388aeb1 deleted and replaced by tablet a1f37d4a907249fe82f19779b0ae59a9
I20260318 02:51:35.927413 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7352cff7749a47f4812abe56f2e00e7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:35.928015 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7352cff7749a47f4812abe56f2e00e7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:35.928301 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 480f4438de13453fa84ce8c37388aeb1 with delete_type TABLET_DATA_DELETED (replaced by tablet a1f37d4a907249fe82f19779b0ae59a9) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:35.928598 754 tablet_service.cc:1558] Processing DeleteTablet for tablet bf344c2361b7412c87a7c7f9a72a15b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:35.929791 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 480f4438de13453fa84ce8c37388aeb1 with delete_type TABLET_DATA_DELETED (replaced by tablet a1f37d4a907249fe82f19779b0ae59a9) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:35.930147 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet f72023f5408f4ef4b628568da0c008d6 with delete_type TABLET_DATA_DELETED (replaced by tablet bf54f8603e514f1cad3f53ff1427cabe) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:35.933583 754 tablet_service.cc:1511] Processing CreateTablet for tablet a70a3f0184a54ab6b09b91cceff2531d (DEFAULT_TABLE table=default.Table_f53a203051444a50996e6b2c15103e5b [id=69b3dfef1e7f4cedb30394ee0cb94bf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.933729 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet d8b956e389134a4485434a819a5df2e7
I20260318 02:51:35.934082 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a70a3f0184a54ab6b09b91cceff2531d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.935230 759 tablet_service.cc:1558] Processing DeleteTablet for tablet d8b956e389134a4485434a819a5df2e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:35.935321 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet d8b956e389134a4485434a819a5df2e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:35.936241 2121 raft_consensus.cc:2749] T 3868406102b748a5b13420b24bf16485 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:35.936359 1026 tablet_service.cc:1511] Processing CreateTablet for tablet e96b662de89a48018920544e9abb66c7 (DEFAULT_TABLE table=default.Table_b9a6151bd93c40cc9930c1116c12c1ec [id=ceaf3a133f054491b5ff2874f8b78a8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.936779 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e96b662de89a48018920544e9abb66c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.940526 1175 ts_tablet_manager.cc:1929] T 421e5223d6af4da1a8e07534f942d016 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:35.940665 1175 log.cc:1199] T 421e5223d6af4da1a8e07534f942d016 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/421e5223d6af4da1a8e07534f942d016
I20260318 02:51:35.941830 1175 ts_tablet_manager.cc:1950] T 421e5223d6af4da1a8e07534f942d016 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:35.942831 1175 tablet_replica.cc:333] T abfdba1f21e44652b2bce62cd3e6681f P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:35.943928 1175 raft_consensus.cc:2243] T abfdba1f21e44652b2bce62cd3e6681f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.944358 1175 raft_consensus.cc:2272] T abfdba1f21e44652b2bce62cd3e6681f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.944818 1173 ts_tablet_manager.cc:1434] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.048s user 0.007s sys 0.007s
I20260318 02:51:35.945272 1173 tablet_bootstrap.cc:492] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:35.946903 1173 tablet_bootstrap.cc:654] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.947022 1184 ts_tablet_manager.cc:1950] T dea25aaad60a4b2483a8832f995d1316 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:35.947094 1172 tablet_bootstrap.cc:654] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.947436 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 816) took 1428 ms. Trace:
I20260318 02:51:35.947589 1184 rpcz_store.cc:276] 0318 02:51:34.519532 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:34.519586 (+ 54us) service_pool.cc:225] Handling call
0318 02:51:35.780312 (+1260726us) ts_tablet_manager.cc:1151] Deleting tablet dea25aaad60a4b2483a8832f995d1316
0318 02:51:35.780323 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.892196 (+111873us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.908262 (+ 16066us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:35.947416 (+ 39154us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1260268}
I20260318 02:51:35.948385 1175 ts_tablet_manager.cc:1916] T abfdba1f21e44652b2bce62cd3e6681f P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:35.949800 999 consensus_peers.cc:597] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d -> Peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Couldn't send request to peer 6a903d876086423b8016d705b98895ad. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:35.950158 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 830) took 1033 ms. Trace:
I20260318 02:51:35.950320 1184 rpcz_store.cc:276] 0318 02:51:34.916304 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:34.916368 (+ 64us) service_pool.cc:225] Handling call
0318 02:51:35.948351 (+1031983us) ts_tablet_manager.cc:1151] Deleting tablet 1d3eb0cf4190436680ad3265a1c1c31b
0318 02:51:35.948361 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.950116 (+ 1755us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1031733}
I20260318 02:51:35.951702 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 831) took 1032 ms. Trace:
I20260318 02:51:35.952586 2158 raft_consensus.cc:493] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:35.952746 2158 raft_consensus.cc:515] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.952365 1184 rpcz_store.cc:276] 0318 02:51:34.919059 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:34.919122 (+ 63us) service_pool.cc:225] Handling call
0318 02:51:35.951021 (+1031899us) ts_tablet_manager.cc:1151] Deleting tablet eaf1477c32ce45329a9a0ac19158d54e
0318 02:51:35.951034 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.951520 (+ 486us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1031627}
I20260318 02:51:35.953459 2158 leader_election.cc:290] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:35.953790 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 49afed40c7aa4f2d913daed8055a098e
I20260318 02:51:35.955264 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3e7e9a85c94d7380b96a9373c1f503" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:35.955845 719 leader_election.cc:343] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.956161 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet dea25aaad60a4b2483a8832f995d1316 (table default.Table_cfe05462158449cca7f529d5a37270be [id=feac1e97445140d9bfcb8eb2b9996498]) successfully deleted
I20260318 02:51:35.957623 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 49afed40c7aa4f2d913daed8055a098e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:35.957901 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 832) took 1031 ms. Trace:
I20260318 02:51:35.958554 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_926310d9a26348c189418c2df85654a9" } new_table_name: "default.Table_5ee33d94003f4c92ac54b555ceb84d56" modify_external_catalogs: true
I20260318 02:51:35.956190 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0c162c9f3baa4ac6ae56ef095498c61b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:35.959017 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3e7e9a85c94d7380b96a9373c1f503" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:35.958328 1184 rpcz_store.cc:276] 0318 02:51:34.923198 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:34.923256 (+ 58us) service_pool.cc:225] Handling call
0318 02:51:35.954448 (+1031192us) ts_tablet_manager.cc:1151] Deleting tablet d23a51e4c86142ac902fb46598abdd0c
0318 02:51:35.954463 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.955053 (+ 590us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1030812}
W20260318 02:51:35.959580 719 leader_election.cc:343] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.959702 719 leader_election.cc:304] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:35.960039 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 1d3eb0cf4190436680ad3265a1c1c31b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d3eb0cf4190436680ad3265a1c1c31b already in progress: creating tablet
I20260318 02:51:35.960093 2158 raft_consensus.cc:2749] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:35.960345 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet eaf1477c32ce45329a9a0ac19158d54e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eaf1477c32ce45329a9a0ac19158d54e already in progress: creating tablet
I20260318 02:51:35.961056 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6028370af35b46788e9e169af0e6eaf0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:35.961033 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 833) took 1029 ms. Trace:
W20260318 02:51:35.962224 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6028370af35b46788e9e169af0e6eaf0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:35.961550 1184 rpcz_store.cc:276] 0318 02:51:34.931780 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:34.931843 (+ 63us) service_pool.cc:225] Handling call
0318 02:51:35.960417 (+1028574us) ts_tablet_manager.cc:1151] Deleting tablet ca4e1eec9a2148488295416cd68ca607
0318 02:51:35.960430 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:35.961012 (+ 582us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1028272}
I20260318 02:51:35.964416 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 49afed40c7aa4f2d913daed8055a098e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:35.964424 999 consensus_peers.cc:597] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d -> Peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Couldn't send request to peer 6a903d876086423b8016d705b98895ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c20810ad3354126bf49bbeeb6edb098. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:35.965160 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ecb178c859b44205b0a17b387c6f42c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:35.965723 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_66f554b45dc74955b3c5b3b8594dbc62" } new_table_name: "default.Table_1f63e265720049248a1631343941050b" modify_external_catalogs: true
I20260318 02:51:35.966725 1172 tablet_bootstrap.cc:492] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
W20260318 02:51:35.966912 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet d23a51e4c86142ac902fb46598abdd0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d23a51e4c86142ac902fb46598abdd0c already in progress: creating tablet
I20260318 02:51:35.966998 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3096d9a574d24640a9efe555f7b58d4f" } new_table_name: "default.Table_fed9534e8e3d410ab1775c885744cc2a" modify_external_catalogs: true
I20260318 02:51:35.967160 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b5c19bc5e07949088c84cedbf944dfdb
W20260318 02:51:35.967509 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet ca4e1eec9a2148488295416cd68ca607 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca4e1eec9a2148488295416cd68ca607 already in progress: creating tablet
I20260318 02:51:35.967929 1172 ts_tablet_manager.cc:1403] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.153s user 0.002s sys 0.002s
I20260318 02:51:35.968822 1172 raft_consensus.cc:359] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.969125 1172 raft_consensus.cc:385] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:35.969131 761 tablet_service.cc:1511] Processing CreateTablet for tablet e96b662de89a48018920544e9abb66c7 (DEFAULT_TABLE table=default.Table_b9a6151bd93c40cc9930c1116c12c1ec [id=ceaf3a133f054491b5ff2874f8b78a8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.969245 1172 raft_consensus.cc:740] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:35.966751 1184 tablet_replica.cc:333] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:35.969412 757 tablet_service.cc:1558] Processing DeleteTablet for tablet b5c19bc5e07949088c84cedbf944dfdb with delete_type TABLET_DATA_DELETED (replaced by tablet 5b1527c9ce014e819d03330486e8ef3b) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:35.969131 759 tablet_service.cc:1511] Processing CreateTablet for tablet 31ac876d59554349b897a9d2cb7c2c41 (DEFAULT_TABLE table=default.Table_93eea9d4589e4d98bb49be9fa2cdaac6 [id=7e0b352a86a04bf2a390d4829a700a48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:35.970165 1184 raft_consensus.cc:2243] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:35.970427 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ac876d59554349b897a9d2cb7c2c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.971062 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e96b662de89a48018920544e9abb66c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:35.971258 1184 raft_consensus.cc:2272] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:35.971868 1184 ts_tablet_manager.cc:1916] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:35.972244 449 catalog_manager.cc:6741] ReplaceTablet: tablet b5c19bc5e07949088c84cedbf944dfdb deleted and replaced by tablet 5b1527c9ce014e819d03330486e8ef3b
W20260318 02:51:35.972805 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2a6f56dafead404eb1720276b07ea733 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a6f56dafead404eb1720276b07ea733 already in progress: creating tablet
W20260318 02:51:35.975665 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecb178c859b44205b0a17b387c6f42c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:35.975807 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1251c4e2807e4e858b0c190d50b7aab0" } new_table_name: "default.Table_ff28a5f6be7743ff92181ad445d72c65" modify_external_catalogs: true
W20260318 02:51:35.976514 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c162c9f3baa4ac6ae56ef095498c61b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:35.980568 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet b5c19bc5e07949088c84cedbf944dfdb with delete_type TABLET_DATA_DELETED (replaced by tablet 5b1527c9ce014e819d03330486e8ef3b) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:35.969545 1172 consensus_queue.cc:260] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:35.981328 1172 ts_tablet_manager.cc:1434] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20260318 02:51:35.982069 1172 tablet_bootstrap.cc:492] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:35.984107 1172 tablet_bootstrap.cc:654] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:35.985972 2158 raft_consensus.cc:493] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:35.986122 2158 raft_consensus.cc:515] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:35.986757 2158 leader_election.cc:290] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:35.987404 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56335a4a2c294f67a22206e6a59e29a8" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:35.989452 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56335a4a2c294f67a22206e6a59e29a8" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:35.995342 719 leader_election.cc:343] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:35.995564 719 leader_election.cc:343] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:35.995633 719 leader_election.cc:304] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:35.995615 455 catalog_manager.cc:5671] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:35.996093 2158 raft_consensus.cc:2749] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:35.997561 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet f9bc73d3f85745ecb62d861b6375a987 (table default.Table_5e18692d41ef4f6b9ac36936944042f7 [id=dfd0c35772ae4d71a6679f3bdaec5068]) successfully deleted
I20260318 02:51:35.997449 455 catalog_manager.cc:5671] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:35.998070 455 catalog_manager.cc:5671] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:35.998361 890 tablet_service.cc:1558] Processing DeleteTablet for tablet f72023f5408f4ef4b628568da0c008d6 with delete_type TABLET_DATA_DELETED (replaced by tablet bf54f8603e514f1cad3f53ff1427cabe) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:35.998081 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 421e5223d6af4da1a8e07534f942d016 (table default.Table_8dfcbdb7d773436fb70053d0d4a1d9e8 [id=7979bbf5d6744b6eb56acde8ec69ba5d]) successfully deleted
I20260318 02:51:35.998687 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 480f4438de13453fa84ce8c37388aeb1 with delete_type TABLET_DATA_DELETED (replaced by tablet a1f37d4a907249fe82f19779b0ae59a9) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:35.999178 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 29541950221544e396ada303fbbb5002 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:35.999838 904 tablet_service.cc:1511] Processing CreateTablet for tablet e96b662de89a48018920544e9abb66c7 (DEFAULT_TABLE table=default.Table_b9a6151bd93c40cc9930c1116c12c1ec [id=ceaf3a133f054491b5ff2874f8b78a8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.000383 890 tablet_service.cc:1558] Processing DeleteTablet for tablet d8b956e389134a4485434a819a5df2e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.000495 1175 ts_tablet_manager.cc:1929] T abfdba1f21e44652b2bce62cd3e6681f P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:36.000613 1175 log.cc:1199] T abfdba1f21e44652b2bce62cd3e6681f P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/abfdba1f21e44652b2bce62cd3e6681f
I20260318 02:51:36.000895 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 49afed40c7aa4f2d913daed8055a098e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.000932 1175 ts_tablet_manager.cc:1950] T abfdba1f21e44652b2bce62cd3e6681f P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:36.001566 890 tablet_service.cc:1511] Processing CreateTablet for tablet 31ac876d59554349b897a9d2cb7c2c41 (DEFAULT_TABLE table=default.Table_93eea9d4589e4d98bb49be9fa2cdaac6 [id=7e0b352a86a04bf2a390d4829a700a48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.001848 1173 tablet_bootstrap.cc:492] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:36.002017 1173 ts_tablet_manager.cc:1403] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.057s user 0.005s sys 0.005s
I20260318 02:51:36.002305 901 tablet_service.cc:1558] Processing DeleteTablet for tablet b5c19bc5e07949088c84cedbf944dfdb with delete_type TABLET_DATA_DELETED (replaced by tablet 5b1527c9ce014e819d03330486e8ef3b) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.002882 1173 raft_consensus.cc:359] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.003083 1173 raft_consensus.cc:385] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.003165 1173 raft_consensus.cc:740] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.003417 1173 consensus_queue.cc:260] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.003993 1173 ts_tablet_manager.cc:1434] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:36.006119 1184 ts_tablet_manager.cc:1929] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:36.009142 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 31ac876d59554349b897a9d2cb7c2c41 (DEFAULT_TABLE table=default.Table_93eea9d4589e4d98bb49be9fa2cdaac6 [id=7e0b352a86a04bf2a390d4829a700a48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.011174 1176 ts_tablet_manager.cc:1929] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:36.011353 1176 log.cc:1199] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/bd077319b3c443849de087eb61da6a77
I20260318 02:51:36.011736 1176 ts_tablet_manager.cc:1950] T bd077319b3c443849de087eb61da6a77 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:36.014071 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ac876d59554349b897a9d2cb7c2c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.017473 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet bd077319b3c443849de087eb61da6a77 (table default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]) successfully deleted
I20260318 02:51:36.017765 1176 tablet_replica.cc:333] T bf344c2361b7412c87a7c7f9a72a15b6 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:36.017973 1176 raft_consensus.cc:2243] T bf344c2361b7412c87a7c7f9a72a15b6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.018119 1176 raft_consensus.cc:2272] T bf344c2361b7412c87a7c7f9a72a15b6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:36.018086 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 572553569bbe4731b2580f1d22ee4fdd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 572553569bbe4731b2580f1d22ee4fdd already in progress: creating tablet
W20260318 02:51:36.018322 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f72023f5408f4ef4b628568da0c008d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f72023f5408f4ef4b628568da0c008d6 already in progress: creating tablet
W20260318 02:51:36.018529 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 480f4438de13453fa84ce8c37388aeb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 480f4438de13453fa84ce8c37388aeb1 already in progress: creating tablet
I20260318 02:51:36.018652 1176 ts_tablet_manager.cc:1916] T bf344c2361b7412c87a7c7f9a72a15b6 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.011735 1172 tablet_bootstrap.cc:492] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:36.020560 1172 ts_tablet_manager.cc:1403] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.002s
I20260318 02:51:36.021447 1172 raft_consensus.cc:359] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.021611 1172 raft_consensus.cc:385] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.021660 1172 raft_consensus.cc:740] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.021868 1172 consensus_queue.cc:260] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.022353 1172 ts_tablet_manager.cc:1434] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:36.023303 1172 tablet_bootstrap.cc:492] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:36.006223 1184 log.cc:1199] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/cc1543d0e1b1431baf6d2ab6a0484ca6
I20260318 02:51:36.025055 1184 ts_tablet_manager.cc:1950] T cc1543d0e1b1431baf6d2ab6a0484ca6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:36.025906 1184 tablet_replica.cc:333] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:36.026067 1184 raft_consensus.cc:2243] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.026191 1184 raft_consensus.cc:2272] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.026652 1184 ts_tablet_manager.cc:1916] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.027237 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet cc1543d0e1b1431baf6d2ab6a0484ca6 (table default.Table_d9fd8f01d59b47d9bc3053e485415619 [id=e7c0679f0795485db510de58088251a3]) successfully deleted
I20260318 02:51:36.030375 1172 tablet_bootstrap.cc:654] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.032536 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e96b662de89a48018920544e9abb66c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.033408 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet db22b17af0874e1289766138ed0d0591
I20260318 02:51:36.033824 454 catalog_manager.cc:6741] ReplaceTablet: tablet db22b17af0874e1289766138ed0d0591 deleted and replaced by tablet 1814c903ba4f456098f862e9490aa05e
I20260318 02:51:36.037355 1176 ts_tablet_manager.cc:1929] T bf344c2361b7412c87a7c7f9a72a15b6 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:36.037402 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ac876d59554349b897a9d2cb7c2c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.037523 1173 tablet_bootstrap.cc:492] T 6088f65949e24799973bd1f432b25dc7 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:36.037660 1176 log.cc:1199] T bf344c2361b7412c87a7c7f9a72a15b6 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/bf344c2361b7412c87a7c7f9a72a15b6
I20260318 02:51:36.038009 1176 ts_tablet_manager.cc:1950] T bf344c2361b7412c87a7c7f9a72a15b6 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:36.038889 1173 tablet_bootstrap.cc:654] T 6088f65949e24799973bd1f432b25dc7 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.039258 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet bf344c2361b7412c87a7c7f9a72a15b6 (table default.Table_67969be821524f06922e86b98527c45b [id=d22d61a1d07149c3bf62dd9412aaa9c6]) successfully deleted
W20260318 02:51:36.040169 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet d8b956e389134a4485434a819a5df2e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d8b956e389134a4485434a819a5df2e7 already in progress: creating tablet
I20260318 02:51:36.039427 1184 ts_tablet_manager.cc:1929] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:36.040524 1184 log.cc:1199] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/65c50b0813b04f30896568ab2b680ba8
W20260318 02:51:36.040989 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 49afed40c7aa4f2d913daed8055a098e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49afed40c7aa4f2d913daed8055a098e already in progress: creating tablet
I20260318 02:51:36.041028 1184 ts_tablet_manager.cc:1950] T 65c50b0813b04f30896568ab2b680ba8 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:36.043795 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 65c50b0813b04f30896568ab2b680ba8 (table default.Table_d2f73355578d4f4391b25e72718cfa1e [id=0bd115a0960941ff9d49b4566fe1c666]) successfully deleted
I20260318 02:51:36.044894 1184 tablet_replica.cc:333] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:36.045095 833 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:36.046277 890 tablet_service.cc:1558] Processing DeleteTablet for tablet db22b17af0874e1289766138ed0d0591 with delete_type TABLET_DATA_DELETED (replaced by tablet 1814c903ba4f456098f862e9490aa05e) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.046665 1184 raft_consensus.cc:2243] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.048043 1184 raft_consensus.cc:2272] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.048892 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet db22b17af0874e1289766138ed0d0591 with delete_type TABLET_DATA_DELETED (replaced by tablet 1814c903ba4f456098f862e9490aa05e) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:36.049113 2085 log.cc:927] Time spent T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7: Append to log took a long time: real 0.083s user 0.001s sys 0.000s
I20260318 02:51:36.052578 1184 ts_tablet_manager.cc:1916] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.053200 754 tablet_service.cc:1558] Processing DeleteTablet for tablet db22b17af0874e1289766138ed0d0591 with delete_type TABLET_DATA_DELETED (replaced by tablet 1814c903ba4f456098f862e9490aa05e) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:36.056931 1176 tablet_replica.cc:333] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:36.060295 1174 tablet_bootstrap.cc:492] T 2882569524e74a308e9fabf533a8a87c P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:36.060576 1174 ts_tablet_manager.cc:1403] T 2882569524e74a308e9fabf533a8a87c P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.275s user 0.001s sys 0.004s
I20260318 02:51:36.060819 1176 raft_consensus.cc:2243] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.061156 1176 raft_consensus.cc:2272] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.061411 1174 raft_consensus.cc:359] T 2882569524e74a308e9fabf533a8a87c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.061662 1174 raft_consensus.cc:385] T 2882569524e74a308e9fabf533a8a87c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.061760 1174 raft_consensus.cc:740] T 2882569524e74a308e9fabf533a8a87c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.062027 1174 consensus_queue.cc:260] T 2882569524e74a308e9fabf533a8a87c P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.062238 1176 ts_tablet_manager.cc:1916] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.065197 1174 ts_tablet_manager.cc:1434] T 2882569524e74a308e9fabf533a8a87c P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260318 02:51:36.065285 1172 tablet_bootstrap.cc:492] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:36.065500 1172 ts_tablet_manager.cc:1403] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.042s user 0.006s sys 0.001s
I20260318 02:51:36.065538 1174 tablet_bootstrap.cc:492] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:36.066653 1172 raft_consensus.cc:359] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.066896 1172 raft_consensus.cc:385] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.066983 1172 raft_consensus.cc:740] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.067224 1172 consensus_queue.cc:260] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.067375 1174 tablet_bootstrap.cc:654] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.067803 1172 ts_tablet_manager.cc:1434] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:36.068701 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet abfdba1f21e44652b2bce62cd3e6681f (table default.Table_fc98457cd89d4e7386e8668c917c0db5 [id=832c20ba6970431893816d86c1ee374b]) successfully deleted
I20260318 02:51:36.069362 1173 tablet_bootstrap.cc:492] T 6088f65949e24799973bd1f432b25dc7 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:36.069550 1173 ts_tablet_manager.cc:1403] T 6088f65949e24799973bd1f432b25dc7 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.032s user 0.006s sys 0.002s
I20260318 02:51:36.070299 1173 raft_consensus.cc:359] T 6088f65949e24799973bd1f432b25dc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.070729 1173 raft_consensus.cc:385] T 6088f65949e24799973bd1f432b25dc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.070823 1173 raft_consensus.cc:740] T 6088f65949e24799973bd1f432b25dc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.071056 1173 consensus_queue.cc:260] T 6088f65949e24799973bd1f432b25dc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.071626 1173 ts_tablet_manager.cc:1434] T 6088f65949e24799973bd1f432b25dc7 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:36.071933 1173 tablet_bootstrap.cc:492] T f6794f8a443f41b195fb326d49f56756 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:36.073652 1172 tablet_bootstrap.cc:492] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:36.074337 1173 tablet_bootstrap.cc:654] T f6794f8a443f41b195fb326d49f56756 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.075349 1172 tablet_bootstrap.cc:654] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.075666 2147 raft_consensus.cc:493] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.075800 2147 raft_consensus.cc:515] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.076411 2147 leader_election.cc:290] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:36.077546 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fec974d146f44aeb72df483fa85b287" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:36.078224 997 leader_election.cc:343] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:36.078887 999 leader_election.cc:343] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 5fec974d146f44aeb72df483fa85b287
I20260318 02:51:36.078985 999 leader_election.cc:304] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:36.079474 2147 raft_consensus.cc:2749] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:36.083917 1176 ts_tablet_manager.cc:1929] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:36.084136 1176 log.cc:1199] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/b5c19bc5e07949088c84cedbf944dfdb
I20260318 02:51:36.084535 1176 ts_tablet_manager.cc:1950] T b5c19bc5e07949088c84cedbf944dfdb P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:36.085920 1174 tablet_bootstrap.cc:492] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:36.086064 1174 ts_tablet_manager.cc:1403] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.001s
I20260318 02:51:36.086826 1174 raft_consensus.cc:359] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.086995 1174 raft_consensus.cc:385] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.087054 1174 raft_consensus.cc:740] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.087692 1175 tablet_replica.cc:333] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:36.087893 1175 raft_consensus.cc:2243] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.088032 1175 raft_consensus.cc:2272] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.088527 1175 ts_tablet_manager.cc:1916] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.091566 1174 consensus_queue.cc:260] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.093760 1173 tablet_bootstrap.cc:492] T f6794f8a443f41b195fb326d49f56756 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:36.093894 1174 ts_tablet_manager.cc:1434] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260318 02:51:36.093952 1173 ts_tablet_manager.cc:1403] T f6794f8a443f41b195fb326d49f56756 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260318 02:51:36.094585 1173 raft_consensus.cc:359] T f6794f8a443f41b195fb326d49f56756 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.094826 1173 raft_consensus.cc:385] T f6794f8a443f41b195fb326d49f56756 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.094911 1173 raft_consensus.cc:740] T f6794f8a443f41b195fb326d49f56756 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.095176 1173 consensus_queue.cc:260] T f6794f8a443f41b195fb326d49f56756 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.095839 1173 ts_tablet_manager.cc:1434] T f6794f8a443f41b195fb326d49f56756 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:36.096180 1173 tablet_bootstrap.cc:492] T ce0ab476b9a54cc586a4c28e23382bfc P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:36.097628 1173 tablet_bootstrap.cc:654] T ce0ab476b9a54cc586a4c28e23382bfc P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.098042 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet b5c19bc5e07949088c84cedbf944dfdb (table default.Table_79bea80cab3d40f5bead32f2fdcf09fa [id=873432f002e14a4fa7065dcfe5caebd5]) successfully deleted
I20260318 02:51:36.102540 2175 tablet.cc:1723] T 99e807c8ff5e457fb6c97c6d1b277eab P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260318 02:51:36.102957 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet db22b17af0874e1289766138ed0d0591 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db22b17af0874e1289766138ed0d0591 already in progress: creating tablet
I20260318 02:51:36.103403 1174 tablet_bootstrap.cc:492] T 41646d513e834600a209761392ac7fb1 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:36.104348 2174 tablet.cc:1723] T 99e807c8ff5e457fb6c97c6d1b277eab P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:36.105252 1174 tablet_bootstrap.cc:654] T 41646d513e834600a209761392ac7fb1 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.108644 1175 ts_tablet_manager.cc:1929] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:36.108789 1175 log.cc:1199] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/4fa7c1d6879c40ebb8d989ebae205e9e
I20260318 02:51:36.109046 1175 ts_tablet_manager.cc:1950] T 4fa7c1d6879c40ebb8d989ebae205e9e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:36.114665 1173 tablet_bootstrap.cc:492] T ce0ab476b9a54cc586a4c28e23382bfc P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:36.114960 1173 ts_tablet_manager.cc:1403] T ce0ab476b9a54cc586a4c28e23382bfc P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260318 02:51:36.115684 1173 raft_consensus.cc:359] T ce0ab476b9a54cc586a4c28e23382bfc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.115944 1173 raft_consensus.cc:385] T ce0ab476b9a54cc586a4c28e23382bfc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.116039 1173 raft_consensus.cc:740] T ce0ab476b9a54cc586a4c28e23382bfc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.116127 2138 tablet.cc:1723] T 99e807c8ff5e457fb6c97c6d1b277eab P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:36.116339 1173 consensus_queue.cc:260] T ce0ab476b9a54cc586a4c28e23382bfc P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.117040 1173 ts_tablet_manager.cc:1434] T ce0ab476b9a54cc586a4c28e23382bfc P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:36.118094 1111 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:36.121582 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 4fa7c1d6879c40ebb8d989ebae205e9e (table default.Table_d6ad068d690949058bd4fdeea68e31a3 [id=3557006319a041e69cf884ccd2ddd5dc]) successfully deleted
I20260318 02:51:36.121852 2158 raft_consensus.cc:493] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.121989 2158 raft_consensus.cc:515] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.122586 2158 leader_election.cc:290] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:36.127835 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9c1f15738a1a4bec83ebfdc1f93a9131" } new_table_name: "default.Table_1068ed12c0774560af59c6eb9d2f292c" modify_external_catalogs: true
I20260318 02:51:36.128201 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2fb9c8f339444bc8d7c6479e7d87f44" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:36.129830 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ee8d3cf2be29490e882954710a91f9a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.130345 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee8d3cf2be29490e882954710a91f9a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.131814 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d99a88deb49440b59eab19e13498ca6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.132328 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d99a88deb49440b59eab19e13498ca6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:36.133582 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9c05f7a75527410e9c5cde0dbc6bc10e consensus state has no leader
I20260318 02:51:36.133968 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3747269973ec485caeed2bb52bde1307"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.135016 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3747269973ec485caeed2bb52bde1307 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:36.136251 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a6d2dd53085848d6bd7237b07a5f81d0 consensus state has no leader
I20260318 02:51:36.136557 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9e6e77bf748f460894d85c701ccfad5b" } modify_external_catalogs: true
I20260318 02:51:36.136763 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9e6e77bf748f460894d85c701ccfad5b" } modify_external_catalogs: true
W20260318 02:51:36.137676 719 leader_election.cc:343] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:36.138226 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5ff3ee3ae21470a9bb636f03399d223 consensus state has no leader
I20260318 02:51:36.138656 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2372b7a037ea4bf3a0d6a18f73dbe959"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.139176 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2372b7a037ea4bf3a0d6a18f73dbe959 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:36.140407 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 71ea229381d540fdae9b2d7bf3eac2b6 consensus state has no leader
I20260318 02:51:36.140764 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_60d9a93bf8e343458e1eb745b39ea7e5" } modify_external_catalogs: true
I20260318 02:51:36.140837 1172 tablet_bootstrap.cc:492] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:36.140930 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_60d9a93bf8e343458e1eb745b39ea7e5" } modify_external_catalogs: true
I20260318 02:51:36.140975 1172 ts_tablet_manager.cc:1403] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.067s user 0.004s sys 0.003s
I20260318 02:51:36.142107 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2fb9c8f339444bc8d7c6479e7d87f44" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:36.143062 719 leader_election.cc:343] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.143185 719 leader_election.cc:304] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:36.143278 1172 raft_consensus.cc:359] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.143457 1172 raft_consensus.cc:385] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.143510 1172 raft_consensus.cc:740] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.143585 2158 raft_consensus.cc:2749] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:36.143705 1172 consensus_queue.cc:260] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.144496 1172 ts_tablet_manager.cc:1434] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:36.147224 454 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet d0652735b8c24c23ade92913c1c7ad0f (table default.Table_20867faf86da4889b7995990926923a7 [id=5bc787aad96b4abd82ab3e033020ea9c]). Expected version 1 got 0
I20260318 02:51:36.147480 454 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet b383fd49049c4c1daba3f1ed60899f3e (table default.Table_5ed9c43cfcf94d058b59ec604059817b [id=fc9e568fb3884c3ca8575e591393560e]). Expected version 2 got 0
I20260318 02:51:36.149513 890 tablet_service.cc:1558] Processing DeleteTablet for tablet b230018a95a54ababfe5ecf2ca1e2e49 with delete_type TABLET_DATA_DELETED (replaced by tablet 813702e53eee4a54a7d693fd6e03bbbb) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.149734 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 2789a1195e7344c18dd226e196e2f302 with delete_type TABLET_DATA_DELETED (replaced by tablet f37ab96f13444fcbb5cfc3ad92d53c35) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.149888 901 tablet_service.cc:1558] Processing DeleteTablet for tablet e57dbb1276114cd6b7d26f7167b99f25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.154812 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3ce17f77cb5e4ecdba2110059be25eaf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.155411 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ce17f77cb5e4ecdba2110059be25eaf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.160367 1175 tablet_replica.cc:333] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:36.160584 1175 raft_consensus.cc:2243] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.160776 1175 raft_consensus.cc:2272] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.161286 1175 ts_tablet_manager.cc:1916] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.162086 1172 tablet_bootstrap.cc:492] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:36.163129 1173 tablet_bootstrap.cc:492] T 86f5e1cad5794c15a0b62e64d9e86417 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:36.163727 926 raft_consensus.cc:3060] T ce0ab476b9a54cc586a4c28e23382bfc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:36.167884 1172 tablet_bootstrap.cc:654] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:36.169006 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 68b0f0cd89234e72a052f3f9f964aa35 consensus state has no leader
I20260318 02:51:36.170981 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_fb4d36f8e2cf4fab8b4e072b67797e98" } modify_external_catalogs: true
I20260318 02:51:36.171185 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_fb4d36f8e2cf4fab8b4e072b67797e98" } modify_external_catalogs: true
I20260318 02:51:36.171454 457 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet ce0ab476b9a54cc586a4c28e23382bfc (table default.Table_51fd1fd451544782b3785014979adeba [id=94288205d88b4c6ca1f94de1b201a349]). Expected version 1 got 0
I20260318 02:51:36.172991 455 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_ad02fb74a8e54e76ba7370a1d85c60b8 [id=a7ad61d6d9264ec4ac482798b1ea992e] alter complete (version 3)
I20260318 02:51:36.173202 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6c6385d211234b01b123afe1213bc9fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.173800 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c6385d211234b01b123afe1213bc9fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.175179 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet e1d804f5e9564f6d83efb77e6c18724b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.175272 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b439fa2481a43c78d2c486d8711175f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.175417 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 083493ab9d26493a924025fbd96ab1d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.175434 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 065ebc3c000a4ad3873ee031ecf9986b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.175752 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fec974d146f44aeb72df483fa85b287 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.174962 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2f3393db9c104844995b512bb2ecc2ca" } modify_external_catalogs: true
I20260318 02:51:36.179482 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2f3393db9c104844995b512bb2ecc2ca" } modify_external_catalogs: true
W20260318 02:51:36.180994 997 consensus_peers.cc:597] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:36.188145 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 56335a4a2c294f67a22206e6a59e29a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:36.188467 1175 ts_tablet_manager.cc:1929] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:36.188613 1175 log.cc:1199] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/65f63eb5e114464988b3b89e3af61b61
I20260318 02:51:36.190375 1173 tablet_bootstrap.cc:654] T 86f5e1cad5794c15a0b62e64d9e86417 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.190659 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 98101333a294447aa6df09c7fa62b565
I20260318 02:51:36.191341 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 98101333a294447aa6df09c7fa62b565 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.192039 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 98101333a294447aa6df09c7fa62b565 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.193291 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 98101333a294447aa6df09c7fa62b565 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:36.193761 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_10187817db2d460889de2a6e1b646b2d" } modify_external_catalogs: true
I20260318 02:51:36.193977 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_10187817db2d460889de2a6e1b646b2d" } modify_external_catalogs: true
I20260318 02:51:36.194456 2197 raft_consensus.cc:493] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.194574 2197 raft_consensus.cc:515] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.195168 2197 leader_election.cc:290] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:36.195946 860 leader_election.cc:343] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: f04f057571584d31b1821e690ae7c75c
I20260318 02:51:36.196333 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2f04e5699531479d8b76edb0e2d2873c
I20260318 02:51:36.196992 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f04e5699531479d8b76edb0e2d2873c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.197162 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_aea729f62f024663ab23b6ad341a68fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:36.197598 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f04e5699531479d8b76edb0e2d2873c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.197762 1175 ts_tablet_manager.cc:1950] T 65f63eb5e114464988b3b89e3af61b61 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
W20260318 02:51:36.197754 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aea729f62f024663ab23b6ad341a68fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.198299 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 65f63eb5e114464988b3b89e3af61b61 (table default.Table_e285c48a68a04ddca6c3da148d0f43f1 [id=d7a2b53e58414b9b878a51724594ceda]) successfully deleted
I20260318 02:51:36.199234 761 tablet_service.cc:1558] Processing DeleteTablet for tablet ba3e7e9a85c94d7380b96a9373c1f503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:36.200405 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f04e5699531479d8b76edb0e2d2873c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:36.201632 451 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet d0652735b8c24c23ade92913c1c7ad0f (table default.Table_20867faf86da4889b7995990926923a7 [id=5bc787aad96b4abd82ab3e033020ea9c]). Expected version 1 got 0
I20260318 02:51:36.201959 451 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet a9c60ef260d049bea4ce729316a0d09f (table default.Table_d5ddb641ef9245ca92ab35d8ac25b157 [id=fb45f238426142faa79cbe89242c7418]). Expected version 1 got 0
I20260318 02:51:36.203028 454 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 3348b200e5ca4f6ebecb2c25ddbe27bf (table default.Table_a0e5cf2757bf4ff0a3232115f92e2def [id=a1ea27c3f8534259bceaa1300242640a]). Expected version 1 got 0
I20260318 02:51:36.203312 454 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet d0652735b8c24c23ade92913c1c7ad0f (table default.Table_20867faf86da4889b7995990926923a7 [id=5bc787aad96b4abd82ab3e033020ea9c]). Expected version 1 got 0
I20260318 02:51:36.203737 454 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 1516525b471540288c6cb5d61120d430 (table default.Table_4e770bc308894d9094b88315d9093ba5 [id=433e7aa77412424ebb38784bb073d1fb]). Expected version 6 got 0
I20260318 02:51:36.203946 454 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 3fccf1f2bc3547e9ba8cc5fe9419f70b (table default.Table_3406e803538541a5b564a3ae03dfedd6 [id=f282f0ee83114539bad2c36e8311e05e]). Expected version 1 got 0
I20260318 02:51:36.206941 1172 tablet_bootstrap.cc:492] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:36.207165 1172 ts_tablet_manager.cc:1403] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.045s user 0.006s sys 0.004s
I20260318 02:51:36.208015 1172 raft_consensus.cc:359] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.208254 1172 raft_consensus.cc:385] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.208357 1172 raft_consensus.cc:740] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.208595 1172 consensus_queue.cc:260] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.209286 1172 ts_tablet_manager.cc:1434] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260318 02:51:36.209383 862 leader_election.cc:343] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: f04f057571584d31b1821e690ae7c75c
I20260318 02:51:36.209520 862 leader_election.cc:304] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:36.209751 2197 raft_consensus.cc:2749] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:36.210078 1172 tablet_bootstrap.cc:492] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:36.211810 1172 tablet_bootstrap.cc:654] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.212916 1176 tablet_replica.cc:333] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:36.213133 1176 raft_consensus.cc:2243] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.213286 1176 raft_consensus.cc:2272] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.213841 1176 ts_tablet_manager.cc:1916] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.220075 1175 tablet_replica.cc:333] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:36.220140 1176 ts_tablet_manager.cc:1929] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:36.220307 1175 raft_consensus.cc:2243] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.220466 1176 log.cc:1199] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/56335a4a2c294f67a22206e6a59e29a8
I20260318 02:51:36.220510 1175 raft_consensus.cc:2272] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.220912 1176 ts_tablet_manager.cc:1950] T 56335a4a2c294f67a22206e6a59e29a8 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:36.221182 1175 ts_tablet_manager.cc:1916] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.221647 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 56335a4a2c294f67a22206e6a59e29a8 (table default.Table_98ff851e3ed0463cb3ef7f1907fa7711 [id=3da3ae03107e44518a289e073abc0998]) successfully deleted
W20260318 02:51:36.222406 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 98101333a294447aa6df09c7fa62b565 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98101333a294447aa6df09c7fa62b565 already in progress: creating tablet
I20260318 02:51:36.222770 1176 tablet_replica.cc:333] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:36.223006 1176 raft_consensus.cc:2243] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.223209 1176 raft_consensus.cc:2272] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.224001 1176 ts_tablet_manager.cc:1916] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.225183 1174 tablet_bootstrap.cc:492] T 41646d513e834600a209761392ac7fb1 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:36.225383 1174 ts_tablet_manager.cc:1403] T 41646d513e834600a209761392ac7fb1 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.122s user 0.003s sys 0.001s
I20260318 02:51:36.226157 1174 raft_consensus.cc:359] T 41646d513e834600a209761392ac7fb1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.228257 1174 raft_consensus.cc:385] T 41646d513e834600a209761392ac7fb1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.228402 1174 raft_consensus.cc:740] T 41646d513e834600a209761392ac7fb1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.228860 1174 consensus_queue.cc:260] T 41646d513e834600a209761392ac7fb1 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.229712 1174 ts_tablet_manager.cc:1434] T 41646d513e834600a209761392ac7fb1 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260318 02:51:36.230197 1174 tablet_bootstrap.cc:492] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:36.235000 997 consensus_peers.cc:597] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:36.241775 1172 tablet_bootstrap.cc:492] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:36.241988 1172 ts_tablet_manager.cc:1403] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.001s
I20260318 02:51:36.242772 1172 raft_consensus.cc:359] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.242986 1172 raft_consensus.cc:385] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.243067 1172 raft_consensus.cc:740] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.243327 1172 consensus_queue.cc:260] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.243978 1172 ts_tablet_manager.cc:1434] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:36.241793 1184 ts_tablet_manager.cc:1929] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:36.244246 1184 log.cc:1199] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/b230018a95a54ababfe5ecf2ca1e2e49
I20260318 02:51:36.244558 1184 ts_tablet_manager.cc:1950] T b230018a95a54ababfe5ecf2ca1e2e49 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:36.244488 1174 tablet_bootstrap.cc:654] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.245548 1176 ts_tablet_manager.cc:1929] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:36.245249 1172 tablet_bootstrap.cc:492] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:36.248376 1172 tablet_bootstrap.cc:654] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.249359 1176 log.cc:1199] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/ba3e7e9a85c94d7380b96a9373c1f503
I20260318 02:51:36.249758 1176 ts_tablet_manager.cc:1950] T ba3e7e9a85c94d7380b96a9373c1f503 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:36.251402 2197 raft_consensus.cc:493] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.251541 2197 raft_consensus.cc:515] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.252143 2197 leader_election.cc:290] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:36.253152 860 leader_election.cc:343] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 29541950221544e396ada303fbbb5002
W20260318 02:51:36.253473 862 leader_election.cc:343] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 29541950221544e396ada303fbbb5002
I20260318 02:51:36.253580 862 leader_election.cc:304] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:36.253901 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 845) took 1079 ms. Trace:
I20260318 02:51:36.254204 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet ba3e7e9a85c94d7380b96a9373c1f503 (table default.Table_51d490345e9f497ca6b3076edf95c90f [id=fbbe8921ed4344c18e2276270fcaf24f]) successfully deleted
I20260318 02:51:36.254070 1184 rpcz_store.cc:276] 0318 02:51:35.174505 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:35.181516 (+ 7011us) service_pool.cc:225] Handling call
0318 02:51:36.044589 (+863073us) ts_tablet_manager.cc:1151] Deleting tablet b230018a95a54ababfe5ecf2ca1e2e49
0318 02:51:36.044821 (+ 232us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:36.115540 (+ 70719us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:36.241689 (+126149us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:36.253881 (+ 12192us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":822936}
I20260318 02:51:36.254662 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet b230018a95a54ababfe5ecf2ca1e2e49 (table default.Table_1acdeb444a404cb0b89ac6450e835639 [id=9278db75ac0f4aa59c4af2f13a58e314]) successfully deleted
W20260318 02:51:36.255052 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2f04e5699531479d8b76edb0e2d2873c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f04e5699531479d8b76edb0e2d2873c already in progress: creating tablet
I20260318 02:51:36.258857 1184 tablet_replica.cc:333] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:36.259219 2158 raft_consensus.cc:493] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.259366 2158 raft_consensus.cc:515] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.260030 2158 leader_election.cc:290] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:36.261272 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b383fd49049c4c1daba3f1ed60899f3e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:36.262177 719 leader_election.cc:343] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.263036 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b383fd49049c4c1daba3f1ed60899f3e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:36.263283 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet eb1a59d1153b41eb9d95b931ffafdd16
I20260318 02:51:36.264129 901 tablet_service.cc:1558] Processing DeleteTablet for tablet eb1a59d1153b41eb9d95b931ffafdd16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.264297 2197 raft_consensus.cc:2749] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:36.264421 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet ec96b885e9604bba9d425c3e3e3f61e6
I20260318 02:51:36.264410 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet eb1a59d1153b41eb9d95b931ffafdd16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:36.264736 719 leader_election.cc:343] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.264845 719 leader_election.cc:304] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:36.265101 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 91eba790375e4806a3f5766b6240d595
I20260318 02:51:36.265427 2158 raft_consensus.cc:2749] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:36.265945 457 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_fd8edd9c8882403f8541f00d0728e3b7 [id=568e88222ca648ce88ee962e91a84588] alter complete (version 1)
I20260318 02:51:36.265930 1184 raft_consensus.cc:2243] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.266203 1184 raft_consensus.cc:2272] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.267951 1184 ts_tablet_manager.cc:1916] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.272691 761 tablet_service.cc:1558] Processing DeleteTablet for tablet eb1a59d1153b41eb9d95b931ffafdd16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:36.272943 754 tablet_service.cc:1558] Processing DeleteTablet for tablet ec96b885e9604bba9d425c3e3e3f61e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:36.273078 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 91eba790375e4806a3f5766b6240d595 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:36.273212 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 2882569524e74a308e9fabf533a8a87c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:36.273967 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet eb1a59d1153b41eb9d95b931ffafdd16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb1a59d1153b41eb9d95b931ffafdd16 already in progress: creating tablet
I20260318 02:51:36.275100 901 tablet_service.cc:1558] Processing DeleteTablet for tablet ec96b885e9604bba9d425c3e3e3f61e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.275285 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 91eba790375e4806a3f5766b6240d595 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.275470 890 tablet_service.cc:1558] Processing DeleteTablet for tablet f04f057571584d31b1821e690ae7c75c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.275740 1176 tablet_replica.cc:333] T 2882569524e74a308e9fabf533a8a87c P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:36.276050 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 91eba790375e4806a3f5766b6240d595 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.276125 1176 raft_consensus.cc:2243] T 2882569524e74a308e9fabf533a8a87c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.276244 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet ec96b885e9604bba9d425c3e3e3f61e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.276290 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet b8a46b4db30a48c99addf763f7edfb16 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e9a5b965cb141e1a5dd1c96f590ad5a) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.276415 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 900c6ef2dc634a788239dd5b77c4bde0 with delete_type TABLET_DATA_DELETED (replaced by tablet 20ecb11db30e409b9090ebfc4a4f0785) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.276428 1176 raft_consensus.cc:2272] T 2882569524e74a308e9fabf533a8a87c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.277273 2151 raft_consensus.cc:493] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.277412 2151 raft_consensus.cc:515] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.278041 2151 leader_election.cc:290] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:36.279090 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d804f5e9564f6d83efb77e6c18724b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:36.279422 1176 ts_tablet_manager.cc:1916] T 2882569524e74a308e9fabf533a8a87c P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.279589 2151 consensus_queue.cc:1048] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260318 02:51:36.279704 997 leader_election.cc:343] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.279944 2197 raft_consensus.cc:493] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.280068 2197 raft_consensus.cc:515] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.280609 2197 leader_election.cc:290] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:36.281668 860 leader_election.cc:343] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 2789a1195e7344c18dd226e196e2f302
I20260318 02:51:36.281870 451 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet ce0ab476b9a54cc586a4c28e23382bfc (table default.Table_51fd1fd451544782b3785014979adeba [id=94288205d88b4c6ca1f94de1b201a349]). Expected version 1 got 0
W20260318 02:51:36.281970 862 leader_election.cc:343] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2789a1195e7344c18dd226e196e2f302
I20260318 02:51:36.282081 862 leader_election.cc:304] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:36.282522 2197 raft_consensus.cc:2749] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:36.274758 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet ec96b885e9604bba9d425c3e3e3f61e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec96b885e9604bba9d425c3e3e3f61e6 already in progress: creating tablet
W20260318 02:51:36.283926 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 91eba790375e4806a3f5766b6240d595 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91eba790375e4806a3f5766b6240d595 already in progress: creating tablet
W20260318 02:51:36.284173 999 leader_election.cc:343] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: e1d804f5e9564f6d83efb77e6c18724b
I20260318 02:51:36.284307 999 leader_election.cc:304] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:36.284668 2151 raft_consensus.cc:2749] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:36.284919 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 41646d513e834600a209761392ac7fb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:36.290408 2151 raft_consensus.cc:493] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.290580 2151 raft_consensus.cc:515] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.291193 2151 leader_election.cc:290] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:36.291636 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "900c6ef2dc634a788239dd5b77c4bde0" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:36.292235 997 leader_election.cc:343] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.292352 1175 ts_tablet_manager.cc:1929] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260318 02:51:36.292380 999 leader_election.cc:343] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 900c6ef2dc634a788239dd5b77c4bde0
I20260318 02:51:36.292474 1175 log.cc:1199] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/8c20810ad3354126bf49bbeeb6edb098
I20260318 02:51:36.292472 999 leader_election.cc:304] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:36.292834 1175 ts_tablet_manager.cc:1950] T 8c20810ad3354126bf49bbeeb6edb098 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:36.292907 2151 raft_consensus.cc:2749] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:36.300035 1173 tablet_bootstrap.cc:492] T 86f5e1cad5794c15a0b62e64d9e86417 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:36.300268 1173 ts_tablet_manager.cc:1403] T 86f5e1cad5794c15a0b62e64d9e86417 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.137s user 0.012s sys 0.000s
I20260318 02:51:36.301064 1173 raft_consensus.cc:359] T 86f5e1cad5794c15a0b62e64d9e86417 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.301220 1176 ts_tablet_manager.cc:1929] T 2882569524e74a308e9fabf533a8a87c P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:36.301348 1176 log.cc:1199] T 2882569524e74a308e9fabf533a8a87c P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/2882569524e74a308e9fabf533a8a87c
I20260318 02:51:36.301347 1173 raft_consensus.cc:385] T 86f5e1cad5794c15a0b62e64d9e86417 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.301507 1173 raft_consensus.cc:740] T 86f5e1cad5794c15a0b62e64d9e86417 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.301628 1176 ts_tablet_manager.cc:1950] T 2882569524e74a308e9fabf533a8a87c P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:36.301944 1172 tablet_bootstrap.cc:492] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:36.301975 1173 consensus_queue.cc:260] T 86f5e1cad5794c15a0b62e64d9e86417 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.302130 1172 ts_tablet_manager.cc:1403] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.057s user 0.003s sys 0.007s
I20260318 02:51:36.302865 1172 raft_consensus.cc:359] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.303081 1172 raft_consensus.cc:385] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.303182 1172 raft_consensus.cc:740] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.303450 1172 consensus_queue.cc:260] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.303978 1172 ts_tablet_manager.cc:1434] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:36.304268 1172 tablet_bootstrap.cc:492] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:36.305878 1172 tablet_bootstrap.cc:654] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.310068 1174 tablet_bootstrap.cc:492] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:36.310292 1174 ts_tablet_manager.cc:1403] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.080s user 0.004s sys 0.001s
I20260318 02:51:36.310426 2197 raft_consensus.cc:493] T 86f5e1cad5794c15a0b62e64d9e86417 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.310570 2197 raft_consensus.cc:515] T 86f5e1cad5794c15a0b62e64d9e86417 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.310782 1173 ts_tablet_manager.cc:1434] T 86f5e1cad5794c15a0b62e64d9e86417 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260318 02:51:36.311064 1174 raft_consensus.cc:359] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.311165 2197 leader_election.cc:290] T 86f5e1cad5794c15a0b62e64d9e86417 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:36.311213 1174 raft_consensus.cc:385] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.311252 1174 raft_consensus.cc:740] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.311425 1174 consensus_queue.cc:260] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.312290 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f5e1cad5794c15a0b62e64d9e86417" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:36.313341 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86f5e1cad5794c15a0b62e64d9e86417" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:36.313578 1063 raft_consensus.cc:2393] T 86f5e1cad5794c15a0b62e64d9e86417 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b25f4f05e0c94c8db825d5afa0b8bf18 in current term 1: Already voted for candidate 6a903d876086423b8016d705b98895ad in this term.
I20260318 02:51:36.314361 860 leader_election.cc:304] T 86f5e1cad5794c15a0b62e64d9e86417 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:36.314668 1174 ts_tablet_manager.cc:1434] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260318 02:51:36.314944 2197 raft_consensus.cc:3060] T 86f5e1cad5794c15a0b62e64d9e86417 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:36.317862 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 2882569524e74a308e9fabf533a8a87c (table default.Table_28a12ac7769744d1ba2c07c2b335e41e [id=a2aa1e87cbae4de99a4d6ba96b5ec04d]) successfully deleted
I20260318 02:51:36.318457 1176 tablet_replica.cc:333] T 41646d513e834600a209761392ac7fb1 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:36.318650 1176 raft_consensus.cc:2243] T 41646d513e834600a209761392ac7fb1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.318792 1176 raft_consensus.cc:2272] T 41646d513e834600a209761392ac7fb1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.318815 2197 raft_consensus.cc:2749] T 86f5e1cad5794c15a0b62e64d9e86417 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:36.321727 1176 ts_tablet_manager.cc:1916] T 41646d513e834600a209761392ac7fb1 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.322489 1172 tablet_bootstrap.cc:492] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:36.322779 1172 ts_tablet_manager.cc:1403] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260318 02:51:36.323524 1960 raft_consensus.cc:493] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.323820 1960 raft_consensus.cc:515] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.324431 1960 leader_election.cc:290] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:36.325917 999 leader_election.cc:343] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 083493ab9d26493a924025fbd96ab1d7
I20260318 02:51:36.327009 1172 raft_consensus.cc:359] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.327394 1172 raft_consensus.cc:385] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.327601 1172 raft_consensus.cc:740] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.328045 1172 consensus_queue.cc:260] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.330515 1172 ts_tablet_manager.cc:1434] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
W20260318 02:51:36.331471 441 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 36c3a417e8c04108b22d28674e570b9b (table default.Table_3890c095727844ee94916b9b8d38781a [id=7710786a2b6a406da91136a06a45a35d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 36c3a417e8c04108b22d28674e570b9b consensus state has no leader
I20260318 02:51:36.332263 1172 tablet_bootstrap.cc:492] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:36.336637 1174 tablet_bootstrap.cc:492] T 8a0af3aecf4f485ebc54e1955eca8c92 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:36.339061 1174 tablet_bootstrap.cc:654] T 8a0af3aecf4f485ebc54e1955eca8c92 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.339622 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083493ab9d26493a924025fbd96ab1d7" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:36.340188 997 leader_election.cc:343] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.340299 997 leader_election.cc:304] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:36.340662 1960 raft_consensus.cc:2749] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:36.341216 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 8c20810ad3354126bf49bbeeb6edb098 (table default.Table_4775eaa0e7e84642aa0a8f8b2885610e [id=463a6721eb0d43d09deeb283d1cc4233]) successfully deleted
I20260318 02:51:36.341266 1175 tablet_replica.cc:333] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:36.341455 1175 raft_consensus.cc:2243] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.341666 1175 raft_consensus.cc:2272] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.342226 1175 ts_tablet_manager.cc:1916] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.342235 2197 raft_consensus.cc:493] T 6088f65949e24799973bd1f432b25dc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.342410 2197 raft_consensus.cc:515] T 6088f65949e24799973bd1f432b25dc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.342988 2197 leader_election.cc:290] T 6088f65949e24799973bd1f432b25dc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:36.343827 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6088f65949e24799973bd1f432b25dc7" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:36.344386 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6088f65949e24799973bd1f432b25dc7" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:36.344604 783 raft_consensus.cc:2393] T 6088f65949e24799973bd1f432b25dc7 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b25f4f05e0c94c8db825d5afa0b8bf18 in current term 1: Already voted for candidate 9422bb7011f342b08be0b073a88c4c4d in this term.
I20260318 02:51:36.345578 860 leader_election.cc:304] T 6088f65949e24799973bd1f432b25dc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:36.346047 2197 raft_consensus.cc:3060] T 6088f65949e24799973bd1f432b25dc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:36.348074 1173 tablet_bootstrap.cc:492] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:36.348547 2197 raft_consensus.cc:2749] T 6088f65949e24799973bd1f432b25dc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:36.351501 1176 ts_tablet_manager.cc:1929] T 41646d513e834600a209761392ac7fb1 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:36.351635 1176 log.cc:1199] T 41646d513e834600a209761392ac7fb1 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/41646d513e834600a209761392ac7fb1
I20260318 02:51:36.351652 1960 raft_consensus.cc:493] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.351775 1960 raft_consensus.cc:515] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.351902 1176 ts_tablet_manager.cc:1950] T 41646d513e834600a209761392ac7fb1 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:36.352407 1960 leader_election.cc:290] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:36.352536 1960 raft_consensus.cc:493] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.352632 1960 raft_consensus.cc:515] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.352933 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 41646d513e834600a209761392ac7fb1 (table default.Table_8a612850d1784dda9f09b14b7e12b28c [id=717896f5560d483e94054f017eaa9a6f]) successfully deleted
I20260318 02:51:36.353081 1960 leader_election.cc:290] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:36.354516 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "065ebc3c000a4ad3873ee031ecf9986b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:36.354920 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a46b4db30a48c99addf763f7edfb16" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:36.355552 2151 raft_consensus.cc:493] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.355675 2151 raft_consensus.cc:515] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:36.355991 999 leader_election.cc:343] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 065ebc3c000a4ad3873ee031ecf9986b
I20260318 02:51:36.356200 2151 leader_election.cc:290] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:36.356422 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8eaa937ff8a34d2f993657d2ff6046b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.357072 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8eaa937ff8a34d2f993657d2ff6046b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.357180 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4c142ec468934e08bfc73a90761bb104" } new_table_name: "default.Table_944521fea0294e3381643693804fd723" modify_external_catalogs: true
I20260318 02:51:36.357239 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ceedcaff18544b0e986386e5a8194d87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.357807 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ceedcaff18544b0e986386e5a8194d87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.358362 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_19a5548e4a984ddab615ff21b6a12b4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.358850 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19a5548e4a984ddab615ff21b6a12b4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.358958 450 master_service.cc:954] ReplaceTablet: received request to replace tablet 4ff090fadc6b47d6ba551dc59d4dad2c from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:36.359584 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fccf1f2bc3547e9ba8cc5fe9419f70b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:36.359898 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_537505805e734d2d82693fe1b781bab6" } new_table_name: "default.Table_c23476aaa5224533bf16b1c8010326b8" modify_external_catalogs: true
W20260318 02:51:36.359966 997 leader_election.cc:343] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.360088 997 leader_election.cc:304] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:36.360481 997 leader_election.cc:343] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.360910 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6d2066ba32d84690be4eacdc5313a0d5" } new_table_name: "default.Table_5d59b3f280d345a3937fff6df372fcff" modify_external_catalogs: true
I20260318 02:51:36.361128 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fccf1f2bc3547e9ba8cc5fe9419f70b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:36.361287 783 raft_consensus.cc:2468] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
W20260318 02:51:36.361577 999 leader_election.cc:343] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: b8a46b4db30a48c99addf763f7edfb16
I20260318 02:51:36.361678 999 leader_election.cc:304] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:36.362147 2149 raft_consensus.cc:2749] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:36.362255 2147 raft_consensus.cc:2749] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:36.363811 999 leader_election.cc:304] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:36.364156 2151 raft_consensus.cc:2804] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:36.364245 2151 raft_consensus.cc:493] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:36.364887 2151 raft_consensus.cc:3060] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:36.367419 2151 raft_consensus.cc:515] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.369634 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_713e6cda2b4749cd8bdb238845c39be0" } new_table_name: "default.Table_2999327e014d4062a8e1aef2ba9ee277" modify_external_catalogs: true
I20260318 02:51:36.370958 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fccf1f2bc3547e9ba8cc5fe9419f70b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:36.371156 783 raft_consensus.cc:3060] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:36.373907 783 raft_consensus.cc:2468] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
W20260318 02:51:36.374720 997 leader_election.cc:343] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.375273 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 785f6728f94d41f3997961e3d1ebee34 with delete_type TABLET_DATA_DELETED (replaced by tablet ca4e1eec9a2148488295416cd68ca607) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.376432 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fccf1f2bc3547e9ba8cc5fe9419f70b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:36.377180 999 leader_election.cc:304] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:36.377599 1960 raft_consensus.cc:2804] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:36.377766 1960 raft_consensus.cc:697] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:36.377753 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3b585ecfc5b445f58bd17b27c4ffcd8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:36.378033 1960 consensus_queue.cc:237] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:36.378382 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b585ecfc5b445f58bd17b27c4ffcd8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.379802 2151 leader_election.cc:290] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:36.380228 997 leader_election.cc:343] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.383244 890 tablet_service.cc:1511] Processing CreateTablet for tablet 64df878a137b470e9383be7f458999b3 (DEFAULT_TABLE table=default.Table_c8c62b5fb5124c57bde7d7daa0fc61cf [id=1616784ba04e44a2817e92fe4f8d5810]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:36.383922 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c58290c2d1c742d3b45dfb5caf52c75b consensus state has no leader
I20260318 02:51:36.385030 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a5569b02165b42ca97657d6dfa34433a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.385615 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5569b02165b42ca97657d6dfa34433a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.387063 1184 ts_tablet_manager.cc:1929] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:36.389060 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a6d1808417419dac0d2b2e80c5ca22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.389429 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 305cc777ed0c46e497c80f15b8e6ead1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.389750 1184 log.cc:1199] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/a20b9dc70b5147ff8798946eda3131ca
I20260318 02:51:36.389698 1172 tablet_bootstrap.cc:654] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.392376 757 tablet_service.cc:1511] Processing CreateTablet for tablet 64df878a137b470e9383be7f458999b3 (DEFAULT_TABLE table=default.Table_c8c62b5fb5124c57bde7d7daa0fc61cf [id=1616784ba04e44a2817e92fe4f8d5810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.392638 1184 ts_tablet_manager.cc:1950] T a20b9dc70b5147ff8798946eda3131ca P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:36.392812 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64df878a137b470e9383be7f458999b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.393573 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1d010d3bbddc4061b497aaeb03506d39" } modify_external_catalogs: true
I20260318 02:51:36.393774 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1d010d3bbddc4061b497aaeb03506d39" } modify_external_catalogs: true
I20260318 02:51:36.396242 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 64df878a137b470e9383be7f458999b3 (DEFAULT_TABLE table=default.Table_c8c62b5fb5124c57bde7d7daa0fc61cf [id=1616784ba04e44a2817e92fe4f8d5810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.396600 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64df878a137b470e9383be7f458999b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.396394 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_74c5ce654ad549c29bb6da72f895dfc4" } new_table_name: "default.Table_7b569f5e5ddc404eaa3dbc3acc278b11" modify_external_catalogs: true
I20260318 02:51:36.402207 904 tablet_service.cc:1511] Processing CreateTablet for tablet 78aba0a60d494da9ac3b8b4fd3d5dc68 (DEFAULT_TABLE table=default.Table_69de0fc8d3014dd887249ce81b9485f2 [id=bbdefc734e174485a99fc32b6601eea9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.403023 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 4ff090fadc6b47d6ba551dc59d4dad2c
I20260318 02:51:36.403488 450 catalog_manager.cc:6741] ReplaceTablet: tablet 4ff090fadc6b47d6ba551dc59d4dad2c deleted and replaced by tablet c6ee486fe6b84fe6b1e8a482bccea157
W20260318 02:51:36.404338 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e998e290291c443394f478c4ac1cfbd2 consensus state has no leader
W20260318 02:51:36.404947 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 24947904568c4bbf93e544c0e22d0054 consensus state has no leader
I20260318 02:51:36.405095 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0296a9348c2245a78f1fdc38ec8c9319"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:36.405223 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ff090fadc6b47d6ba551dc59d4dad2c with delete_type TABLET_DATA_DELETED (replaced by tablet c6ee486fe6b84fe6b1e8a482bccea157) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:36.405637 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0296a9348c2245a78f1fdc38ec8c9319 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.405853 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ff090fadc6b47d6ba551dc59d4dad2c with delete_type TABLET_DATA_DELETED (replaced by tablet c6ee486fe6b84fe6b1e8a482bccea157) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:36.406111 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c6fc7d9146f54c5eb9fe35be2b75eeba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.406662 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6fc7d9146f54c5eb9fe35be2b75eeba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:36.406720 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 4ff090fadc6b47d6ba551dc59d4dad2c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ff090fadc6b47d6ba551dc59d4dad2c already in progress: creating tablet
I20260318 02:51:36.407389 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ff090fadc6b47d6ba551dc59d4dad2c with delete_type TABLET_DATA_DELETED (replaced by tablet c6ee486fe6b84fe6b1e8a482bccea157) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.407725 757 tablet_service.cc:1511] Processing CreateTablet for tablet 78aba0a60d494da9ac3b8b4fd3d5dc68 (DEFAULT_TABLE table=default.Table_69de0fc8d3014dd887249ce81b9485f2 [id=bbdefc734e174485a99fc32b6601eea9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.408005 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9972d91768fa4b3c9bc308d6a07475e2" } modify_external_catalogs: true
I20260318 02:51:36.408155 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78aba0a60d494da9ac3b8b4fd3d5dc68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.408176 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9972d91768fa4b3c9bc308d6a07475e2" } modify_external_catalogs: true
I20260318 02:51:36.409564 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f3b493164ec64405848518f3a11acab6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.410022 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3b493164ec64405848518f3a11acab6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.412735 1174 tablet_bootstrap.cc:492] T 8a0af3aecf4f485ebc54e1955eca8c92 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:36.412874 1174 ts_tablet_manager.cc:1403] T 8a0af3aecf4f485ebc54e1955eca8c92 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.076s user 0.005s sys 0.004s
W20260318 02:51:36.413017 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3d7b339a29ef456997d74a7a95d4c03a consensus state has no leader
I20260318 02:51:36.413619 1174 raft_consensus.cc:359] T 8a0af3aecf4f485ebc54e1955eca8c92 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.413777 1174 raft_consensus.cc:385] T 8a0af3aecf4f485ebc54e1955eca8c92 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.413831 1174 raft_consensus.cc:740] T 8a0af3aecf4f485ebc54e1955eca8c92 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.414016 1174 consensus_queue.cc:260] T 8a0af3aecf4f485ebc54e1955eca8c92 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.414469 1174 ts_tablet_manager.cc:1434] T 8a0af3aecf4f485ebc54e1955eca8c92 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:36.414767 1174 tablet_bootstrap.cc:492] T a6f42462ed9c49c797f5115b3ca6c423 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:36.416441 1174 tablet_bootstrap.cc:654] T a6f42462ed9c49c797f5115b3ca6c423 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.418527 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 851) took 1145 ms. Trace:
I20260318 02:51:36.419422 1184 rpcz_store.cc:276] 0318 02:51:35.272997 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:35.273141 (+ 144us) service_pool.cc:225] Handling call
0318 02:51:36.255345 (+982204us) ts_tablet_manager.cc:1151] Deleting tablet a20b9dc70b5147ff8798946eda3131ca
0318 02:51:36.258732 (+ 3387us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:36.300903 (+ 42171us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:36.386096 (+ 85193us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:36.418272 (+ 32176us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":981763}
I20260318 02:51:36.421586 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet a20b9dc70b5147ff8798946eda3131ca (table default.Table_1852ce7593344cc790f3c957fb56cd32 [id=7f9afbebeec541b9a89c049f168e87b7]) successfully deleted
I20260318 02:51:36.422865 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a0af3aecf4f485ebc54e1955eca8c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:36.423132 1176 tablet_replica.cc:333] T 8a0af3aecf4f485ebc54e1955eca8c92 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:36.423342 1176 raft_consensus.cc:2243] T 8a0af3aecf4f485ebc54e1955eca8c92 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.423501 1176 raft_consensus.cc:2272] T 8a0af3aecf4f485ebc54e1955eca8c92 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.424743 457 catalog_manager.cc:5671] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:36.425753 457 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 3fccf1f2bc3547e9ba8cc5fe9419f70b (table default.Table_3406e803538541a5b564a3ae03dfedd6 [id=f282f0ee83114539bad2c36e8311e05e]). Expected version 1 got 0
I20260318 02:51:36.428890 1172 tablet_bootstrap.cc:492] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:36.428843 1184 tablet_replica.cc:333] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:36.433815 1172 ts_tablet_manager.cc:1403] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.102s user 0.005s sys 0.001s
I20260318 02:51:36.434026 1184 raft_consensus.cc:2243] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:36.435384 1184 pending_rounds.cc:70] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d: Trying to abort 1 pending ops.
I20260318 02:51:36.435781 1184 pending_rounds.cc:77] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494203983097856 op_type: NO_OP noop_request { }
I20260318 02:51:36.436416 1184 raft_consensus.cc:2889] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:36.437093 1184 raft_consensus.cc:2272] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.438407 1174 tablet_bootstrap.cc:492] T a6f42462ed9c49c797f5115b3ca6c423 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:36.438614 1174 ts_tablet_manager.cc:1403] T a6f42462ed9c49c797f5115b3ca6c423 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.005s
I20260318 02:51:36.439437 1174 raft_consensus.cc:359] T a6f42462ed9c49c797f5115b3ca6c423 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.439658 1174 raft_consensus.cc:385] T a6f42462ed9c49c797f5115b3ca6c423 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.439752 1174 raft_consensus.cc:740] T a6f42462ed9c49c797f5115b3ca6c423 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.439051 1172 raft_consensus.cc:359] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.440024 1174 consensus_queue.cc:260] T a6f42462ed9c49c797f5115b3ca6c423 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.440243 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78aba0a60d494da9ac3b8b4fd3d5dc68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.442823 1173 tablet_bootstrap.cc:654] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.443842 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64df878a137b470e9383be7f458999b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.446954 1172 raft_consensus.cc:385] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.447247 1184 ts_tablet_manager.cc:1916] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.447450 1172 raft_consensus.cc:740] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.448210 1175 ts_tablet_manager.cc:1929] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:36.448324 1175 log.cc:1199] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/bd077319b3c443849de087eb61da6a77
I20260318 02:51:36.448853 1172 consensus_queue.cc:260] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.450703 1960 raft_consensus.cc:493] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.450850 1960 raft_consensus.cc:515] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.451491 1960 leader_election.cc:290] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:36.452589 1174 ts_tablet_manager.cc:1434] T a6f42462ed9c49c797f5115b3ca6c423 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
W20260318 02:51:36.453132 999 leader_election.cc:343] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 785f6728f94d41f3997961e3d1ebee34
I20260318 02:51:36.456051 1960 raft_consensus.cc:493] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.456290 1960 raft_consensus.cc:515] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.458392 2158 raft_consensus.cc:493] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.458518 2158 raft_consensus.cc:515] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.459043 2158 leader_election.cc:290] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:36.459198 1174 tablet_bootstrap.cc:492] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:36.459409 999 leader_election.cc:343] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 305cc777ed0c46e497c80f15b8e6ead1
I20260318 02:51:36.460816 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c60ef260d049bea4ce729316a0d09f" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:36.461334 719 leader_election.cc:343] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.462057 1174 tablet_bootstrap.cc:654] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.462989 1960 leader_election.cc:290] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:36.465410 2151 consensus_queue.cc:1048] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:36.465857 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ac2dafcc68eb412da14e17b420c2bf92" } modify_external_catalogs: true
I20260318 02:51:36.466153 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ac2dafcc68eb412da14e17b420c2bf92" } modify_external_catalogs: true
I20260318 02:51:36.468346 757 tablet_service.cc:1558] Processing DeleteTablet for tablet a6f42462ed9c49c797f5115b3ca6c423 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:36.466049 1172 ts_tablet_manager.cc:1434] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.032s user 0.001s sys 0.002s
I20260318 02:51:36.469781 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f2421bd3bf1a44a6adefc3b0931dfcc0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:36.469988 1960 consensus_queue.cc:1048] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260318 02:51:36.470563 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2421bd3bf1a44a6adefc3b0931dfcc0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.472409 1172 tablet_bootstrap.cc:492] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:36.474466 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_39aee165029f47559776d7610e509b6a" } modify_external_catalogs: true
I20260318 02:51:36.474715 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_39aee165029f47559776d7610e509b6a" } modify_external_catalogs: true
I20260318 02:51:36.478999 1960 consensus_queue.cc:1048] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:36.482975 1174 tablet_bootstrap.cc:492] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:36.483194 1174 ts_tablet_manager.cc:1403] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.001s
I20260318 02:51:36.484220 1174 raft_consensus.cc:359] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.484498 1174 raft_consensus.cc:385] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.484609 1174 raft_consensus.cc:740] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.484905 1174 consensus_queue.cc:260] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.485467 1174 ts_tablet_manager.cc:1434] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:36.485838 1174 tablet_bootstrap.cc:492] T c7c4257a54d3487aa520531a64fc721c P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:36.487548 1174 tablet_bootstrap.cc:654] T c7c4257a54d3487aa520531a64fc721c P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.491984 1172 tablet_bootstrap.cc:654] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.496084 1176 ts_tablet_manager.cc:1916] T 8a0af3aecf4f485ebc54e1955eca8c92 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.500350 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 78aba0a60d494da9ac3b8b4fd3d5dc68 (DEFAULT_TABLE table=default.Table_69de0fc8d3014dd887249ce81b9485f2 [id=bbdefc734e174485a99fc32b6601eea9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.500831 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78aba0a60d494da9ac3b8b4fd3d5dc68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.502288 757 tablet_service.cc:1511] Processing CreateTablet for tablet 5148fd282f894ab19d9ce77841f4fdc1 (DEFAULT_TABLE table=default.Table_b1678df9cd524c9982cfff7ad3197cfe [id=b58619b0066a42699b268859379e0b10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.502743 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5148fd282f894ab19d9ce77841f4fdc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.504680 1176 ts_tablet_manager.cc:1929] T 8a0af3aecf4f485ebc54e1955eca8c92 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:36.504900 1176 log.cc:1199] T 8a0af3aecf4f485ebc54e1955eca8c92 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/8a0af3aecf4f485ebc54e1955eca8c92
I20260318 02:51:36.505244 1176 ts_tablet_manager.cc:1950] T 8a0af3aecf4f485ebc54e1955eca8c92 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:36.505847 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 8a0af3aecf4f485ebc54e1955eca8c92 (table default.Table_7671b3be1e0c4259a325679c394aae2c [id=688586df74e84dc0a4fc5dc50ef48f32]) successfully deleted
I20260318 02:51:36.506325 1176 tablet_replica.cc:333] T a6f42462ed9c49c797f5115b3ca6c423 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:36.506572 1176 raft_consensus.cc:2243] T a6f42462ed9c49c797f5115b3ca6c423 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.506767 1176 raft_consensus.cc:2272] T a6f42462ed9c49c797f5115b3ca6c423 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.507525 1176 ts_tablet_manager.cc:1916] T a6f42462ed9c49c797f5115b3ca6c423 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:36.512116 997 consensus_peers.cc:597] T 1350684961f645e089fc3fd9ba3a5b09 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:36.518743 455 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet c6ee486fe6b84fe6b1e8a482bccea157
I20260318 02:51:36.519269 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4579d5ae750244f7a9eea47094f30eb7" } modify_external_catalogs: true
I20260318 02:51:36.519479 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4579d5ae750244f7a9eea47094f30eb7" } modify_external_catalogs: true
I20260318 02:51:36.519903 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1c9b1342c54f4840be96c19cc2aa6127"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.520517 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f7d7767fa514821981f7086ef152091 consensus state has no leader
I20260318 02:51:36.520748 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet e5641e430b0a4ddf9e1111f834246755
W20260318 02:51:36.520541 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c9b1342c54f4840be96c19cc2aa6127 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.521705 759 tablet_service.cc:1558] Processing DeleteTablet for tablet e5641e430b0a4ddf9e1111f834246755 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:36.523703 1174 tablet_bootstrap.cc:492] T c7c4257a54d3487aa520531a64fc721c P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:36.523838 1174 ts_tablet_manager.cc:1403] T c7c4257a54d3487aa520531a64fc721c P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.002s
I20260318 02:51:36.524595 1174 raft_consensus.cc:359] T c7c4257a54d3487aa520531a64fc721c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.524684 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet e5641e430b0a4ddf9e1111f834246755 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.524796 1174 raft_consensus.cc:385] T c7c4257a54d3487aa520531a64fc721c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.524843 1174 raft_consensus.cc:740] T c7c4257a54d3487aa520531a64fc721c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.525033 1174 consensus_queue.cc:260] T c7c4257a54d3487aa520531a64fc721c P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.525498 1174 ts_tablet_manager.cc:1434] T c7c4257a54d3487aa520531a64fc721c P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:36.525787 1174 tablet_bootstrap.cc:492] T a0a6f4b34ff14714892ed9e9b3604dc9 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:36.530150 997 consensus_peers.cc:597] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:36.448666 1175 ts_tablet_manager.cc:1950] T bd077319b3c443849de087eb61da6a77 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:36.452749 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "785f6728f94d41f3997961e3d1ebee34" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:36.457360 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "305cc777ed0c46e497c80f15b8e6ead1" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:36.460094 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c60ef260d049bea4ce729316a0d09f" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:36.531702 719 leader_election.cc:343] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.531843 719 leader_election.cc:304] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:36.531968 997 leader_election.cc:343] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.532084 997 leader_election.cc:304] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:36.532224 2158 raft_consensus.cc:2749] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:36.532392 1175 tablet_replica.cc:333] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
W20260318 02:51:36.532508 997 leader_election.cc:343] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.532590 1175 raft_consensus.cc:2243] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.532598 997 leader_election.cc:304] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:36.532788 1175 raft_consensus.cc:2272] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.532943 1960 raft_consensus.cc:2749] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:36.533083 1960 raft_consensus.cc:2749] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:36.533349 1175 ts_tablet_manager.cc:1916] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.533790 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet bd077319b3c443849de087eb61da6a77 (table default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]) successfully deleted
W20260318 02:51:36.534068 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 572553569bbe4731b2580f1d22ee4fdd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 572553569bbe4731b2580f1d22ee4fdd already in progress: creating tablet
W20260318 02:51:36.534276 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f72023f5408f4ef4b628568da0c008d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f72023f5408f4ef4b628568da0c008d6 already in progress: creating tablet
W20260318 02:51:36.534471 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 480f4438de13453fa84ce8c37388aeb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 480f4438de13453fa84ce8c37388aeb1 already in progress: creating tablet
I20260318 02:51:36.480767 974 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:36.537086 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 5148fd282f894ab19d9ce77841f4fdc1 (DEFAULT_TABLE table=default.Table_b1678df9cd524c9982cfff7ad3197cfe [id=b58619b0066a42699b268859379e0b10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.537484 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5148fd282f894ab19d9ce77841f4fdc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.537592 1184 ts_tablet_manager.cc:1929] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:36.537973 1184 log.cc:1199] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/e57dbb1276114cd6b7d26f7167b99f25
I20260318 02:51:36.539112 1184 ts_tablet_manager.cc:1950] T e57dbb1276114cd6b7d26f7167b99f25 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:36.541064 453 master_service.cc:954] ReplaceTablet: received request to replace tablet 52b773c3412c4bc792471096802b3f1a from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:36.543829 1176 ts_tablet_manager.cc:1929] T a6f42462ed9c49c797f5115b3ca6c423 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:36.543955 1176 log.cc:1199] T a6f42462ed9c49c797f5115b3ca6c423 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/a6f42462ed9c49c797f5115b3ca6c423
I20260318 02:51:36.544222 1176 ts_tablet_manager.cc:1950] T a6f42462ed9c49c797f5115b3ca6c423 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:36.544814 2158 raft_consensus.cc:493] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.544585 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 860) took 1080 ms. Trace:
I20260318 02:51:36.544935 2158 raft_consensus.cc:515] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.544943 1184 rpcz_store.cc:276] 0318 02:51:35.464164 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:35.469374 (+ 5210us) service_pool.cc:225] Handling call
0318 02:51:36.422596 (+953222us) ts_tablet_manager.cc:1151] Deleting tablet e57dbb1276114cd6b7d26f7167b99f25
0318 02:51:36.428233 (+ 5637us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:36.491917 (+ 63684us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:36.537148 (+ 45231us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:36.544557 (+ 7409us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":195,"tablet-delete.queue_time_us":952763}
I20260318 02:51:36.545529 2158 leader_election.cc:290] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:36.546000 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet e57dbb1276114cd6b7d26f7167b99f25 (table default.Table_9c0322ee5c694253958b5d9583c3708e [id=34553220f38c4ffd99cf61e1679bdb81]) successfully deleted
I20260318 02:51:36.546352 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 24c66e2cc96f458fb3279827cea4ca9e
I20260318 02:51:36.547117 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3348b200e5ca4f6ebecb2c25ddbe27bf" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:36.547389 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b317cc133346412fb981b1c8e5b99c4d
I20260318 02:51:36.547477 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 24c66e2cc96f458fb3279827cea4ca9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:36.547873 719 leader_election.cc:343] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.548369 901 tablet_service.cc:1558] Processing DeleteTablet for tablet b317cc133346412fb981b1c8e5b99c4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.548810 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet b317cc133346412fb981b1c8e5b99c4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.549124 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3348b200e5ca4f6ebecb2c25ddbe27bf" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:36.549320 1063 raft_consensus.cc:2468] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 0.
I20260318 02:51:36.549662 1184 tablet_replica.cc:333] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:36.549731 719 leader_election.cc:304] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:36.550141 2158 raft_consensus.cc:2804] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:36.550213 2158 raft_consensus.cc:493] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:36.550269 2158 raft_consensus.cc:3060] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:36.550302 1184 raft_consensus.cc:2243] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:36.551209 1184 raft_consensus.cc:2272] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.552773 1034 tablet_service.cc:1511] Processing CreateTablet for tablet e5f91dfe1a6e4777bb0ae530255191d2 (DEFAULT_TABLE table=default.Table_0758e83d0e5a415c9ad3564b069691b4 [id=60d0677c46554f14a33fc16c485069ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.552984 901 tablet_service.cc:1511] Processing CreateTablet for tablet e5f91dfe1a6e4777bb0ae530255191d2 (DEFAULT_TABLE table=default.Table_0758e83d0e5a415c9ad3564b069691b4 [id=60d0677c46554f14a33fc16c485069ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.553005 1184 ts_tablet_manager.cc:1916] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.553135 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f91dfe1a6e4777bb0ae530255191d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.553342 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f91dfe1a6e4777bb0ae530255191d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.554064 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 24c66e2cc96f458fb3279827cea4ca9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:36.554525 759 tablet_service.cc:1558] Processing DeleteTablet for tablet b317cc133346412fb981b1c8e5b99c4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:36.557000 2158 raft_consensus.cc:515] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.557637 759 tablet_service.cc:1511] Processing CreateTablet for tablet e5f91dfe1a6e4777bb0ae530255191d2 (DEFAULT_TABLE table=default.Table_0758e83d0e5a415c9ad3564b069691b4 [id=60d0677c46554f14a33fc16c485069ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.557994 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5f91dfe1a6e4777bb0ae530255191d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.557935 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3348b200e5ca4f6ebecb2c25ddbe27bf" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:36.558519 2158 leader_election.cc:290] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:36.558800 719 leader_election.cc:343] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.559250 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3348b200e5ca4f6ebecb2c25ddbe27bf" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:36.559423 1063 raft_consensus.cc:3060] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:36.561807 1063 raft_consensus.cc:2468] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 1.
I20260318 02:51:36.562206 719 leader_election.cc:304] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:36.562654 2158 raft_consensus.cc:2804] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:36.564976 1172 tablet_bootstrap.cc:492] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:36.565068 1173 tablet_bootstrap.cc:492] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:36.565222 1173 ts_tablet_manager.cc:1403] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.217s user 0.009s sys 0.006s
I20260318 02:51:36.565935 1172 ts_tablet_manager.cc:1403] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.096s user 0.003s sys 0.005s
I20260318 02:51:36.565860 1176 tablet_replica.cc:333] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:36.566322 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet a4918d7f2f2645e88b7f3e1d52926fb1
I20260318 02:51:36.566362 1173 raft_consensus.cc:359] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.566514 1173 raft_consensus.cc:385] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.566560 1173 raft_consensus.cc:740] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.566787 1172 raft_consensus.cc:359] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.567103 1176 raft_consensus.cc:2243] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:36.567461 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet a6f42462ed9c49c797f5115b3ca6c423 (table default.Table_9573754c7e3b4c0b8200f0cc47b2182d [id=01cdfd48166b4ea79e00c77b1deb5eca]) successfully deleted
I20260318 02:51:36.567555 901 tablet_service.cc:1558] Processing DeleteTablet for tablet a4918d7f2f2645e88b7f3e1d52926fb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:36.567991 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet e5641e430b0a4ddf9e1111f834246755 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5641e430b0a4ddf9e1111f834246755 already in progress: creating tablet
I20260318 02:51:36.568405 1172 raft_consensus.cc:385] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.568586 1173 consensus_queue.cc:260] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.568737 1172 raft_consensus.cc:740] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.568413 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet a4918d7f2f2645e88b7f3e1d52926fb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.569270 1172 consensus_queue.cc:260] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.569299 1176 raft_consensus.cc:2272] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.570035 1172 ts_tablet_manager.cc:1434] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260318 02:51:36.570776 1172 tablet_bootstrap.cc:492] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:36.572034 452 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 27fc03c90b584becb250546100af736c (table default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]). Expected version 1 got 0
I20260318 02:51:36.572495 1172 tablet_bootstrap.cc:654] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.572445 1176 ts_tablet_manager.cc:1916] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.572769 1173 ts_tablet_manager.cc:1434] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260318 02:51:36.576812 901 tablet_service.cc:1558] Processing DeleteTablet for tablet a20b9dc70b5147ff8798946eda3131ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.577283 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cdd554113bf4a7092da876365a89456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.577569 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 24c66e2cc96f458fb3279827cea4ca9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.578285 2158 raft_consensus.cc:697] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Becoming Leader. State: Replica: 6a903d876086423b8016d705b98895ad, State: Running, Role: LEADER
I20260318 02:51:36.578706 901 tablet_service.cc:1511] Processing CreateTablet for tablet 384d84fedf6d4c13b8a4eb06d8aa5ffa (DEFAULT_TABLE table=default.Table_2348e644fea44517ad92d378481809ce [id=262002f961594bf6aae8bf9f0aceff9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.579088 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 384d84fedf6d4c13b8a4eb06d8aa5ffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.580160 903 tablet_service.cc:1511] Processing CreateTablet for tablet b7e13eff5aa847deb5a0a693f32f99ac (DEFAULT_TABLE table=default.Table_321270c2ff8b48e5874e7780fe689a08 [id=7bd83050e15c4933ac06b7b837cb2aa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.582271 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e13eff5aa847deb5a0a693f32f99ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.583518 2158 consensus_queue.cc:237] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.583674 759 tablet_service.cc:1511] Processing CreateTablet for tablet 384d84fedf6d4c13b8a4eb06d8aa5ffa (DEFAULT_TABLE table=default.Table_2348e644fea44517ad92d378481809ce [id=262002f961594bf6aae8bf9f0aceff9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.584064 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 384d84fedf6d4c13b8a4eb06d8aa5ffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.586874 2151 consensus_queue.cc:1048] T 6088f65949e24799973bd1f432b25dc7 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:36.505087 890 tablet_service.cc:1511] Processing CreateTablet for tablet 5148fd282f894ab19d9ce77841f4fdc1 (DEFAULT_TABLE table=default.Table_b1678df9cd524c9982cfff7ad3197cfe [id=b58619b0066a42699b268859379e0b10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.596343 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8d04605804fd4064a17415134bd69937"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.597036 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d04605804fd4064a17415134bd69937 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.598307 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0da8901cfbff4305a6b9dd4ead654bcc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:36.598258 757 tablet_service.cc:1558] Processing DeleteTablet for tablet a4918d7f2f2645e88b7f3e1d52926fb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:36.598843 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0da8901cfbff4305a6b9dd4ead654bcc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.522842 904 tablet_service.cc:1558] Processing DeleteTablet for tablet e5641e430b0a4ddf9e1111f834246755 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.603853 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet ed697b98352c4f65931c154b1f160991 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.604254 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e837cc5b10674aed8a2ae1d5e66583ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.607142 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e837cc5b10674aed8a2ae1d5e66583ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.607631 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_49bc09142ca84ca491d7ce4ed0320149" } new_table_name: "default.Table_0ff88b3a70da42c0bf69b7a88fa5d032" modify_external_catalogs: true
I20260318 02:51:36.611019 921 raft_consensus.cc:3060] T 3868406102b748a5b13420b24bf16485 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:36.614271 451 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 27fc03c90b584becb250546100af736c (table default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]). Expected version 1 got 0
I20260318 02:51:36.615077 1184 ts_tablet_manager.cc:1929] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:36.616540 1184 log.cc:1199] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/8c20810ad3354126bf49bbeeb6edb098
I20260318 02:51:36.616892 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1073a99862de49db9d6523e2ab3c6b51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:36.617060 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a0e5cf2757bf4ff0a3232115f92e2def" } new_table_name: "default.Table_10d43fa780ea41f68847fc2ef753c3ef" modify_external_catalogs: true
W20260318 02:51:36.617479 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1073a99862de49db9d6523e2ab3c6b51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.619494 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1a61666d86db47ffad7bafd4a07f0439"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:36.619810 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2fc220fcd0234c5f91b510993149dd37" } new_table_name: "default.Table_5e458201b5e746e1ab3e18cfc8d6734a" modify_external_catalogs: true
W20260318 02:51:36.620030 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a61666d86db47ffad7bafd4a07f0439 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.621136 1184 ts_tablet_manager.cc:1950] T 8c20810ad3354126bf49bbeeb6edb098 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:36.623735 2152 raft_consensus.cc:493] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.623878 2152 raft_consensus.cc:515] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.624478 2152 leader_election.cc:290] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:36.625051 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffcfc0784d947419fc9b22aa636521c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:36.625232 785 raft_consensus.cc:2468] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:36.625559 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffcfc0784d947419fc9b22aa636521c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:36.625650 999 leader_election.cc:304] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:36.625887 2152 raft_consensus.cc:2804] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:36.625955 2152 raft_consensus.cc:493] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:36.626008 2152 raft_consensus.cc:3060] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:36.626075 2158 consensus_queue.cc:1048] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:36.628974 2152 raft_consensus.cc:515] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.630218 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffcfc0784d947419fc9b22aa636521c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:36.630431 785 raft_consensus.cc:3060] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:36.631959 1184 tablet_replica.cc:333] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:36.633402 2152 leader_election.cc:290] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:36.633512 455 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 27fc03c90b584becb250546100af736c (table default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]). Expected version 1 got 0
I20260318 02:51:36.634212 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffcfc0784d947419fc9b22aa636521c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:36.634348 997 leader_election.cc:343] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.633819 1184 raft_consensus.cc:2243] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
W20260318 02:51:36.634675 997 leader_election.cc:343] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.634621 455 catalog_manager.cc:5671] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a903d876086423b8016d705b98895ad (127.0.104.129). New cstate: current_term: 1 leader_uuid: "6a903d876086423b8016d705b98895ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:36.635020 455 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 3348b200e5ca4f6ebecb2c25ddbe27bf (table default.Table_a0e5cf2757bf4ff0a3232115f92e2def [id=a1ea27c3f8534259bceaa1300242640a]). Expected version 1 got 0
I20260318 02:51:36.635260 785 raft_consensus.cc:2468] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:36.635469 1172 tablet_bootstrap.cc:492] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:36.636402 1172 ts_tablet_manager.cc:1403] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.066s user 0.004s sys 0.000s
I20260318 02:51:36.635833 999 leader_election.cc:304] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:36.636878 999 consensus_peers.cc:597] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d -> Peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Couldn't send request to peer 6a903d876086423b8016d705b98895ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5c19bc5e07949088c84cedbf944dfdb. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:36.637262 2152 raft_consensus.cc:2804] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:36.637495 2152 raft_consensus.cc:697] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:36.637748 2152 consensus_queue.cc:237] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.637802 1184 raft_consensus.cc:2272] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.637115 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 8c20810ad3354126bf49bbeeb6edb098 (table default.Table_4775eaa0e7e84642aa0a8f8b2885610e [id=463a6721eb0d43d09deeb283d1cc4233]) successfully deleted
I20260318 02:51:36.639464 1172 raft_consensus.cc:359] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:36.641569 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ccbe2acf3be0434385d3caae31399f4c consensus state has no leader
I20260318 02:51:36.640802 1172 raft_consensus.cc:385] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.636264 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5148fd282f894ab19d9ce77841f4fdc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.642930 1172 raft_consensus.cc:740] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.643419 1172 consensus_queue.cc:260] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.643481 1184 ts_tablet_manager.cc:1916] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.644326 1172 ts_tablet_manager.cc:1434] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260318 02:51:36.637192 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_321270c2ff8b48e5874e7780fe689a08" } new_table_name: "default.Table_4078c90789e5429b8803a275c822b56a" modify_external_catalogs: true
I20260318 02:51:36.644974 1172 tablet_bootstrap.cc:492] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:36.647212 1176 ts_tablet_manager.cc:1929] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:36.648005 1176 log.cc:1199] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/24c66e2cc96f458fb3279827cea4ca9e
I20260318 02:51:36.650023 1176 ts_tablet_manager.cc:1950] T 24c66e2cc96f458fb3279827cea4ca9e P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:36.651247 1172 tablet_bootstrap.cc:654] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.652613 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 24c66e2cc96f458fb3279827cea4ca9e (table default.Table_ac2dafcc68eb412da14e17b420c2bf92 [id=ade423581b18488699c64d3b107d0b07]) successfully deleted
W20260318 02:51:36.654944 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet b317cc133346412fb981b1c8e5b99c4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b317cc133346412fb981b1c8e5b99c4d already in progress: creating tablet
W20260318 02:51:36.660146 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet a4918d7f2f2645e88b7f3e1d52926fb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4918d7f2f2645e88b7f3e1d52926fb1 already in progress: creating tablet
I20260318 02:51:36.661522 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 384d84fedf6d4c13b8a4eb06d8aa5ffa (DEFAULT_TABLE table=default.Table_2348e644fea44517ad92d378481809ce [id=262002f961594bf6aae8bf9f0aceff9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.662561 757 tablet_service.cc:1511] Processing CreateTablet for tablet b7e13eff5aa847deb5a0a693f32f99ac (DEFAULT_TABLE table=default.Table_321270c2ff8b48e5874e7780fe689a08 [id=7bd83050e15c4933ac06b7b837cb2aa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.663110 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e13eff5aa847deb5a0a693f32f99ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.669893 2245 tablet.cc:1723] T 3868406102b748a5b13420b24bf16485 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:36.670032 1174 tablet_bootstrap.cc:654] T a0a6f4b34ff14714892ed9e9b3604dc9 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.671756 457 catalog_manager.cc:5671] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:36.676132 449 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 3868406102b748a5b13420b24bf16485 (table default.Table_ad02fb74a8e54e76ba7370a1d85c60b8 [id=a7ad61d6d9264ec4ac482798b1ea992e]). Expected version 3 got 0
I20260318 02:51:36.686079 901 tablet_service.cc:1511] Processing CreateTablet for tablet 2a90be200678468eaa8c57b843521440 (DEFAULT_TABLE table=default.Table_d781b2a57e354cbdbc41df2b3169d3af [id=dd16c4c244d94be89e2efb673058f49c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.686528 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a90be200678468eaa8c57b843521440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.687001 757 tablet_service.cc:1511] Processing CreateTablet for tablet 2a90be200678468eaa8c57b843521440 (DEFAULT_TABLE table=default.Table_d781b2a57e354cbdbc41df2b3169d3af [id=dd16c4c244d94be89e2efb673058f49c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.687395 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a90be200678468eaa8c57b843521440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.689203 903 tablet_service.cc:1511] Processing CreateTablet for tablet a1f37d4a907249fe82f19779b0ae59a9 (DEFAULT_TABLE table=default.Table_85adec1c70d14a57bfcf04d35aaeb2ee [id=454158c183e24babbfb913541d927ccf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.689558 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1f37d4a907249fe82f19779b0ae59a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.689846 754 tablet_service.cc:1511] Processing CreateTablet for tablet a1f37d4a907249fe82f19779b0ae59a9 (DEFAULT_TABLE table=default.Table_85adec1c70d14a57bfcf04d35aaeb2ee [id=454158c183e24babbfb913541d927ccf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.690204 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1f37d4a907249fe82f19779b0ae59a9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:36.702457 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c2453557439844a19cc7b4c8a0696b1e consensus state has no leader
W20260318 02:51:36.703015 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3348b200e5ca4f6ebecb2c25ddbe27bf consensus state has no leader
W20260318 02:51:36.719746 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b7e13eff5aa847deb5a0a693f32f99ac consensus state has no leader
I20260318 02:51:36.721544 754 tablet_service.cc:1558] Processing DeleteTablet for tablet c7c4257a54d3487aa520531a64fc721c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:36.721544 2238 consensus_queue.cc:1048] T 86f5e1cad5794c15a0b62e64d9e86417 P 6a903d876086423b8016d705b98895ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:36.722416 1176 tablet_replica.cc:333] T c7c4257a54d3487aa520531a64fc721c P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:36.722606 1176 raft_consensus.cc:2243] T c7c4257a54d3487aa520531a64fc721c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.722738 1176 raft_consensus.cc:2272] T c7c4257a54d3487aa520531a64fc721c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.723654 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ef3181adc0542229897369591a30465 with delete_type TABLET_DATA_DELETED (replaced by tablet defda79dd0f34c37ae16ea808df0754b) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.681538 1172 tablet_bootstrap.cc:492] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:36.724228 1172 ts_tablet_manager.cc:1403] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.079s user 0.005s sys 0.000s
I20260318 02:51:36.724959 1172 raft_consensus.cc:359] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.725121 1172 raft_consensus.cc:385] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.725167 1172 raft_consensus.cc:740] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.725363 1172 consensus_queue.cc:260] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.725566 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0296a9348c2245a78f1fdc38ec8c9319" } modify_external_catalogs: true
I20260318 02:51:36.725859 1172 ts_tablet_manager.cc:1434] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:36.725790 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0370c121d1a84b84b0876f6419cdc0d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:36.725997 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1f63e265720049248a1631343941050b" } new_table_name: "default.Table_8a472ed29e5d4e3e9b7dd34b7596d317" modify_external_catalogs: true
I20260318 02:51:36.685214 1034 tablet_service.cc:1511] Processing CreateTablet for tablet b7e13eff5aa847deb5a0a693f32f99ac (DEFAULT_TABLE table=default.Table_321270c2ff8b48e5874e7780fe689a08 [id=7bd83050e15c4933ac06b7b837cb2aa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.687228 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 2a90be200678468eaa8c57b843521440 (DEFAULT_TABLE table=default.Table_d781b2a57e354cbdbc41df2b3169d3af [id=dd16c4c244d94be89e2efb673058f49c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.700891 1184 ts_tablet_manager.cc:1929] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260318 02:51:36.726483 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0370c121d1a84b84b0876f6419cdc0d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.726529 1184 log.cc:1199] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/bd077319b3c443849de087eb61da6a77
I20260318 02:51:36.726873 1184 ts_tablet_manager.cc:1950] T bd077319b3c443849de087eb61da6a77 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:36.726974 1176 ts_tablet_manager.cc:1916] T c7c4257a54d3487aa520531a64fc721c P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.725811 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0296a9348c2245a78f1fdc38ec8c9319" } modify_external_catalogs: true
I20260318 02:51:36.729112 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f141890f83124edb914868a35fc73df2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.730048 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f141890f83124edb914868a35fc73df2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.736235 1176 ts_tablet_manager.cc:1929] T c7c4257a54d3487aa520531a64fc721c P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:36.736424 1176 log.cc:1199] T c7c4257a54d3487aa520531a64fc721c P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/c7c4257a54d3487aa520531a64fc721c
I20260318 02:51:36.736809 1176 ts_tablet_manager.cc:1950] T c7c4257a54d3487aa520531a64fc721c P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
W20260318 02:51:36.741041 719 consensus_peers.cc:597] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:36.741606 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet c7c4257a54d3487aa520531a64fc721c (table default.Table_ebd103e5fbf4484597076b02ffd82044 [id=4067c18ce85f44d7993786a3e9bda883]) successfully deleted
W20260318 02:51:36.742733 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5ff3ee3ae21470a9bb636f03399d223 consensus state has no leader
I20260318 02:51:36.748339 451 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 454ad8e8a5e344e1bb3ec0f8acfc0b3a
I20260318 02:51:36.748580 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6b7904942dc9449cbe5e72949e06d2ee" } modify_external_catalogs: true
I20260318 02:51:36.749963 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f0c81012ed0143bbbeee1d0e6af9594d" } modify_external_catalogs: true
I20260318 02:51:36.750332 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f0c81012ed0143bbbeee1d0e6af9594d" } modify_external_catalogs: true
I20260318 02:51:36.751695 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6b7904942dc9449cbe5e72949e06d2ee" } modify_external_catalogs: true
I20260318 02:51:36.749943 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_eea6a27dda544c4288859e25ca97caef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:36.750028 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d717ffddc62d4afaad80d7420e46be69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.754878 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d717ffddc62d4afaad80d7420e46be69 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.755036 1062 raft_consensus.cc:1275] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Refusing update from remote peer 6a903d876086423b8016d705b98895ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:36.755091 1172 tablet_bootstrap.cc:492] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:36.756819 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eea6a27dda544c4288859e25ca97caef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.756989 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e13eff5aa847deb5a0a693f32f99ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.760957 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a90be200678468eaa8c57b843521440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.765307 2238 consensus_queue.cc:1048] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:36.766188 1184 tablet_replica.cc:333] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:36.766383 1184 raft_consensus.cc:2243] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:36.766707 1184 raft_consensus.cc:2272] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.767226 1184 ts_tablet_manager.cc:1916] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.767441 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f7e51d065520474d8d059d64c4693451" } modify_external_catalogs: true
I20260318 02:51:36.769410 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet bd077319b3c443849de087eb61da6a77 (table default.Table_6649f615bb3d4590bb3ff395d88019cb [id=8f33c67bc47e42b3a800cdd0590d4e9e]) successfully deleted
W20260318 02:51:36.769702 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 572553569bbe4731b2580f1d22ee4fdd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 572553569bbe4731b2580f1d22ee4fdd already in progress: creating tablet
W20260318 02:51:36.769899 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 480f4438de13453fa84ce8c37388aeb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 480f4438de13453fa84ce8c37388aeb1 already in progress: creating tablet
W20260318 02:51:36.770062 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f72023f5408f4ef4b628568da0c008d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f72023f5408f4ef4b628568da0c008d6 already in progress: creating tablet
I20260318 02:51:36.770494 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2fab8241144b4ef39c7a088f8829bb80" } modify_external_catalogs: true
I20260318 02:51:36.770679 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2fab8241144b4ef39c7a088f8829bb80" } modify_external_catalogs: true
I20260318 02:51:36.769251 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f7e51d065520474d8d059d64c4693451" } modify_external_catalogs: true
I20260318 02:51:36.772104 1172 tablet_bootstrap.cc:654] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:36.770231 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet d8b956e389134a4485434a819a5df2e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d8b956e389134a4485434a819a5df2e7 already in progress: creating tablet
W20260318 02:51:36.773334 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 49afed40c7aa4f2d913daed8055a098e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49afed40c7aa4f2d913daed8055a098e already in progress: creating tablet
I20260318 02:51:36.775660 921 raft_consensus.cc:3060] T f6794f8a443f41b195fb326d49f56756 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:36.779484 1172 tablet_bootstrap.cc:492] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:36.779620 1172 ts_tablet_manager.cc:1403] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20260318 02:51:36.780390 1172 raft_consensus.cc:359] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.780553 1172 raft_consensus.cc:385] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.780597 1172 raft_consensus.cc:740] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.781093 1172 consensus_queue.cc:260] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.781800 1172 ts_tablet_manager.cc:1434] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:36.782119 1172 tablet_bootstrap.cc:492] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:36.783725 1184 ts_tablet_manager.cc:1929] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:36.783864 1184 log.cc:1199] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/b5c19bc5e07949088c84cedbf944dfdb
I20260318 02:51:36.784193 1184 ts_tablet_manager.cc:1950] T b5c19bc5e07949088c84cedbf944dfdb P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:36.784689 1172 tablet_bootstrap.cc:654] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.784886 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet b5c19bc5e07949088c84cedbf944dfdb (table default.Table_79bea80cab3d40f5bead32f2fdcf09fa [id=873432f002e14a4fa7065dcfe5caebd5]) successfully deleted
I20260318 02:51:36.786005 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a88efa1088f340949c151592c569491c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.786770 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a88efa1088f340949c151592c569491c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.794451 1172 tablet_bootstrap.cc:492] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:36.794677 1172 ts_tablet_manager.cc:1403] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.005s
I20260318 02:51:36.794996 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet e85d612871014dc2bd9139adcbe639d2
I20260318 02:51:36.795776 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f95ebc89fd2545b1835a1bc10414248d
I20260318 02:51:36.795763 901 tablet_service.cc:1558] Processing DeleteTablet for tablet e85d612871014dc2bd9139adcbe639d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.796658 901 tablet_service.cc:1558] Processing DeleteTablet for tablet f95ebc89fd2545b1835a1bc10414248d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.795565 1172 raft_consensus.cc:359] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.796887 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet fcbaf43f3ccc48a2b7f09d04c2da060d
I20260318 02:51:36.796993 1172 raft_consensus.cc:385] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.797410 901 tablet_service.cc:1558] Processing DeleteTablet for tablet fcbaf43f3ccc48a2b7f09d04c2da060d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.797587 1172 raft_consensus.cc:740] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.797709 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet fcbaf43f3ccc48a2b7f09d04c2da060d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.797423 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet f95ebc89fd2545b1835a1bc10414248d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.797842 1172 consensus_queue.cc:260] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:36.797938 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet db22b17af0874e1289766138ed0d0591 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db22b17af0874e1289766138ed0d0591 already in progress: creating tablet
I20260318 02:51:36.798022 1184 tablet_replica.cc:333] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:36.798195 1184 raft_consensus.cc:2243] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.798364 1184 raft_consensus.cc:2272] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.798943 1184 ts_tablet_manager.cc:1916] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.798996 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet e85d612871014dc2bd9139adcbe639d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.799542 2238 raft_consensus.cc:493] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.799710 2238 raft_consensus.cc:515] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.799793 1172 ts_tablet_manager.cc:1434] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260318 02:51:36.800045 1172 tablet_bootstrap.cc:492] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:36.800300 2238 leader_election.cc:290] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:36.800585 754 tablet_service.cc:1558] Processing DeleteTablet for tablet e85d612871014dc2bd9139adcbe639d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:36.801362 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8b5120633e4e0d8964f17d6d5f316d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:36.801450 754 tablet_service.cc:1558] Processing DeleteTablet for tablet f95ebc89fd2545b1835a1bc10414248d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:36.801872 719 leader_election.cc:343] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.802129 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8b5120633e4e0d8964f17d6d5f316d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:36.802336 1172 tablet_bootstrap.cc:654] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:36.802608 719 leader_election.cc:343] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:36.802712 719 leader_election.cc:304] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:36.803058 2238 raft_consensus.cc:2749] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:36.804140 754 tablet_service.cc:1558] Processing DeleteTablet for tablet fcbaf43f3ccc48a2b7f09d04c2da060d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:36.804971 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet e85d612871014dc2bd9139adcbe639d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e85d612871014dc2bd9139adcbe639d2 already in progress: creating tablet
I20260318 02:51:36.807243 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 384d84fedf6d4c13b8a4eb06d8aa5ffa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:36.809639 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f95ebc89fd2545b1835a1bc10414248d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f95ebc89fd2545b1835a1bc10414248d already in progress: creating tablet
W20260318 02:51:36.809954 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet fcbaf43f3ccc48a2b7f09d04c2da060d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fcbaf43f3ccc48a2b7f09d04c2da060d already in progress: creating tablet
I20260318 02:51:36.819249 1172 tablet_bootstrap.cc:492] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:36.819425 1172 ts_tablet_manager.cc:1403] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.005s
I20260318 02:51:36.820338 1172 raft_consensus.cc:359] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.820515 1172 raft_consensus.cc:385] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.820578 1172 raft_consensus.cc:740] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.821632 1172 consensus_queue.cc:260] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.822176 1172 ts_tablet_manager.cc:1434] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260318 02:51:36.822459 1172 tablet_bootstrap.cc:492] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:36.829807 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b2ff027f70e44671ab6c7e8b30d4d755"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:36.824273 1172 tablet_bootstrap.cc:654] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:36.832237 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2ff027f70e44671ab6c7e8b30d4d755 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.843950 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_30d193096882439e98bf7220e7a3931c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.844640 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30d193096882439e98bf7220e7a3931c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.853410 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_cbaf13713d824c0499eb869fe995c520"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.854192 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cbaf13713d824c0499eb869fe995c520 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.857010 1173 tablet_bootstrap.cc:492] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:36.862210 1027 tablet_service.cc:1511] Processing CreateTablet for tablet a1f37d4a907249fe82f19779b0ae59a9 (DEFAULT_TABLE table=default.Table_85adec1c70d14a57bfcf04d35aaeb2ee [id=454158c183e24babbfb913541d927ccf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.862742 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8a472ed29e5d4e3e9b7dd34b7596d317" } new_table_name: "default.Table_a9ccd1d76a764f96bb5055b3cf7d5873" modify_external_catalogs: true
I20260318 02:51:36.863255 901 tablet_service.cc:1511] Processing CreateTablet for tablet 5b1527c9ce014e819d03330486e8ef3b (DEFAULT_TABLE table=default.Table_79bea80cab3d40f5bead32f2fdcf09fa [id=873432f002e14a4fa7065dcfe5caebd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.863669 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b1527c9ce014e819d03330486e8ef3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.864440 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 8c1ba16db9d040708f8fd75c852bdbb1
I20260318 02:51:36.865443 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c1ba16db9d040708f8fd75c852bdbb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:36.865484 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c1ba16db9d040708f8fd75c852bdbb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:36.865674 443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.188:41593, user_credentials={real_user=slave}} blocked reactor thread for 51567.9us
I20260318 02:51:36.866595 754 tablet_service.cc:1511] Processing CreateTablet for tablet 5b1527c9ce014e819d03330486e8ef3b (DEFAULT_TABLE table=default.Table_79bea80cab3d40f5bead32f2fdcf09fa [id=873432f002e14a4fa7065dcfe5caebd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.867002 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b1527c9ce014e819d03330486e8ef3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.869936 2254 tablet.cc:1723] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:36.870741 2253 tablet.cc:1723] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:36.881174 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c1ba16db9d040708f8fd75c852bdbb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:36.882196 1174 tablet_bootstrap.cc:492] T a0a6f4b34ff14714892ed9e9b3604dc9 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:36.882395 1174 ts_tablet_manager.cc:1403] T a0a6f4b34ff14714892ed9e9b3604dc9 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.357s user 0.005s sys 0.004s
I20260318 02:51:36.883257 1174 raft_consensus.cc:359] T a0a6f4b34ff14714892ed9e9b3604dc9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.883503 1174 raft_consensus.cc:385] T a0a6f4b34ff14714892ed9e9b3604dc9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.883596 1174 raft_consensus.cc:740] T a0a6f4b34ff14714892ed9e9b3604dc9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.883852 1174 consensus_queue.cc:260] T a0a6f4b34ff14714892ed9e9b3604dc9 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.884497 1174 ts_tablet_manager.cc:1434] T a0a6f4b34ff14714892ed9e9b3604dc9 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260318 02:51:36.897349 862 consensus_peers.cc:597] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 -> Peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Couldn't send request to peer 6a903d876086423b8016d705b98895ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b230018a95a54ababfe5ecf2ca1e2e49. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:36.902456 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1cb89d002f144726af0a65edb1c8dd5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.903060 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cb89d002f144726af0a65edb1c8dd5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.904088 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_dc3bf04a6859483e999dc1bcb8462e7e" } new_table_name: "default.Table_c466f3337bd64897b0087a42bec37a0c" modify_external_catalogs: true
I20260318 02:51:36.904330 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5f8d8d7adcdc49db92fa83977b6be5ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:36.905411 833 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:36.906965 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_098e49ac0c274f5fbb960f0e5aff1892" } new_table_name: "default.Table_8c3927a237184aad84d0b87da876f5e4" modify_external_catalogs: true
W20260318 02:51:36.908608 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f8d8d7adcdc49db92fa83977b6be5ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.914304 1175 ts_tablet_manager.cc:1929] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:36.914441 1175 log.cc:1199] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/29541950221544e396ada303fbbb5002
I20260318 02:51:36.914727 1175 ts_tablet_manager.cc:1950] T 29541950221544e396ada303fbbb5002 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:36.919334 901 tablet_service.cc:1511] Processing CreateTablet for tablet ccbe2acf3be0434385d3caae31399f4c (DEFAULT_TABLE table=default.Table_0ff88b3a70da42c0bf69b7a88fa5d032 [id=46370f845bc94093a717627bcd2540d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.919786 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbe2acf3be0434385d3caae31399f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.921527 1173 tablet_bootstrap.cc:654] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.923532 1175 tablet_replica.cc:333] T b5c19bc5e07949088c84cedbf944dfdb P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:36.923735 1175 raft_consensus.cc:2243] T b5c19bc5e07949088c84cedbf944dfdb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:36.923915 1175 raft_consensus.cc:2272] T b5c19bc5e07949088c84cedbf944dfdb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:36.924391 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 29541950221544e396ada303fbbb5002 (table default.Table_f6489e5e0d7f47cb889864d493a7b77c [id=85cf06ab49054e56859af17f79130d0a]) successfully deleted
I20260318 02:51:36.924427 1175 ts_tablet_manager.cc:1916] T b5c19bc5e07949088c84cedbf944dfdb P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:36.925619 1032 tablet_service.cc:1511] Processing CreateTablet for tablet ccbe2acf3be0434385d3caae31399f4c (DEFAULT_TABLE table=default.Table_0ff88b3a70da42c0bf69b7a88fa5d032 [id=46370f845bc94093a717627bcd2540d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.926141 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 7d87f47b8ebc4968b712c0824c8542fb (DEFAULT_TABLE table=default.Table_5c77c8fe4ca64357986c070a9131d61c [id=f106d6fff9374261bcd572d977526e10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.926889 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e8896d6ba495415ea6b0bfbe2479e0f8" } new_table_name: "default.Table_bb359a5484674dacada2299bab0af560" modify_external_catalogs: true
I20260318 02:51:36.926993 903 tablet_service.cc:1511] Processing CreateTablet for tablet 7d87f47b8ebc4968b712c0824c8542fb (DEFAULT_TABLE table=default.Table_5c77c8fe4ca64357986c070a9131d61c [id=f106d6fff9374261bcd572d977526e10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.927002 904 tablet_service.cc:1511] Processing CreateTablet for tablet bf54f8603e514f1cad3f53ff1427cabe (DEFAULT_TABLE table=default.Table_f4faa0e71fbe408f9bc811fe2a9c62e4 [id=50010510ab9a432a9861d13efaaa9e6d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:36.927367 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet d8b956e389134a4485434a819a5df2e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d8b956e389134a4485434a819a5df2e7 already in progress: creating tablet
I20260318 02:51:36.927496 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d87f47b8ebc4968b712c0824c8542fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:36.927675 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 49afed40c7aa4f2d913daed8055a098e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 49afed40c7aa4f2d913daed8055a098e already in progress: creating tablet
I20260318 02:51:36.927912 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbe2acf3be0434385d3caae31399f4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.928081 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 5b1527c9ce014e819d03330486e8ef3b (DEFAULT_TABLE table=default.Table_79bea80cab3d40f5bead32f2fdcf09fa [id=873432f002e14a4fa7065dcfe5caebd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.928478 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d87f47b8ebc4968b712c0824c8542fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.928858 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1f37d4a907249fe82f19779b0ae59a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.929841 1174 tablet_bootstrap.cc:492] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:36.931417 1174 tablet_bootstrap.cc:654] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:36.933420 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf54f8603e514f1cad3f53ff1427cabe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.940889 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b1527c9ce014e819d03330486e8ef3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:36.941388 2197 raft_consensus.cc:493] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:36.941530 2197 raft_consensus.cc:515] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.942027 754 tablet_service.cc:1511] Processing CreateTablet for tablet 7d87f47b8ebc4968b712c0824c8542fb (DEFAULT_TABLE table=default.Table_5c77c8fe4ca64357986c070a9131d61c [id=f106d6fff9374261bcd572d977526e10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.942170 2197 leader_election.cc:290] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:36.942409 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d87f47b8ebc4968b712c0824c8542fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:36.943783 862 leader_election.cc:343] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: a20b9dc70b5147ff8798946eda3131ca
I20260318 02:51:36.944259 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d8f270f8efef44899f943d0160c9579b" } new_table_name: "default.Table_ce996d68b1144b3aa44ab9618af7d43e" modify_external_catalogs: true
W20260318 02:51:36.945871 860 leader_election.cc:343] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: a20b9dc70b5147ff8798946eda3131ca
I20260318 02:51:36.945999 860 leader_election.cc:304] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:36.946435 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a88d7cf1e136439093308e8ba6a02904"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:36.946653 2197 raft_consensus.cc:2749] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:36.947006 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a88d7cf1e136439093308e8ba6a02904 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:36.954864 757 tablet_service.cc:1511] Processing CreateTablet for tablet bf54f8603e514f1cad3f53ff1427cabe (DEFAULT_TABLE table=default.Table_f4faa0e71fbe408f9bc811fe2a9c62e4 [id=50010510ab9a432a9861d13efaaa9e6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.955314 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf54f8603e514f1cad3f53ff1427cabe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:36.961431 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 8c1ba16db9d040708f8fd75c852bdbb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c1ba16db9d040708f8fd75c852bdbb1 already in progress: creating tablet
I20260318 02:51:36.961800 759 tablet_service.cc:1511] Processing CreateTablet for tablet ccbe2acf3be0434385d3caae31399f4c (DEFAULT_TABLE table=default.Table_0ff88b3a70da42c0bf69b7a88fa5d032 [id=46370f845bc94093a717627bcd2540d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:36.962350 452 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 3348b200e5ca4f6ebecb2c25ddbe27bf (table default.Table_10d43fa780ea41f68847fc2ef753c3ef [id=a1ea27c3f8534259bceaa1300242640a]). Expected version 2 got 0
W20260318 02:51:36.962867 860 consensus_peers.cc:597] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 -> Peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Couldn't send request to peer 9422bb7011f342b08be0b073a88c4c4d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b230018a95a54ababfe5ecf2ca1e2e49. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:36.967983 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbe2acf3be0434385d3caae31399f4c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:36.964622 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 793a87e8bcb442c1b6fb0ecfcbc71480 consensus state has no leader
I20260318 02:51:36.969542 452 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 7c4eca5e16f84564b31933b8227fd980 (table default.Table_4da517198db54744b96210b1f4438731 [id=541170c7c4bf49deb86cd4c15ffdd04f]). Expected version 1 got 0
W20260318 02:51:36.965827 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 14a7e8753094406baa5a0c32a81e2af4 consensus state has no leader
I20260318 02:51:36.966744 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_28ea1894a58c438785ae9e4b8b414447" } modify_external_catalogs: true
I20260318 02:51:36.970674 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_28ea1894a58c438785ae9e4b8b414447" } modify_external_catalogs: true
W20260318 02:51:36.968597 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5ff3ee3ae21470a9bb636f03399d223 consensus state has no leader
I20260318 02:51:36.972908 452 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet ca23d4d0d3734fceb14966a4f2ad9c35 (table default.Table_10f6937d0016448caceef24711896b5f [id=61241ff920584692bba476799b6a60e7]). Expected version 2 got 0
I20260318 02:51:36.976959 454 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_10d43fa780ea41f68847fc2ef753c3ef [id=a1ea27c3f8534259bceaa1300242640a] alter complete (version 2)
I20260318 02:51:36.986382 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 20c6f1790ed34581b7507ec63ec66718 with delete_type TABLET_DATA_DELETED (replaced by tablet ce82c595e30a4878be25be8eb3d30790) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.986805 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 9451d57fad72413c81443623c7995d4e with delete_type TABLET_DATA_DELETED (replaced by tablet 535ff4839c9646a594db820dd5308d70) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:36.988339 1174 tablet_bootstrap.cc:492] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:36.988672 1174 ts_tablet_manager.cc:1403] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.002s
I20260318 02:51:36.990180 1174 raft_consensus.cc:359] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.990571 1174 raft_consensus.cc:385] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.990716 1174 raft_consensus.cc:740] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.991156 1174 consensus_queue.cc:260] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:36.992156 1174 ts_tablet_manager.cc:1434] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260318 02:51:36.992867 1174 tablet_bootstrap.cc:492] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:36.993606 1173 tablet_bootstrap.cc:492] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:36.993755 1173 ts_tablet_manager.cc:1403] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.137s user 0.003s sys 0.000s
I20260318 02:51:36.994525 1173 raft_consensus.cc:359] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.994684 1173 raft_consensus.cc:385] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:36.994725 1173 raft_consensus.cc:740] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:36.994882 1173 consensus_queue.cc:260] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:36.997159 1173 ts_tablet_manager.cc:1434] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:36.997486 1173 tablet_bootstrap.cc:492] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:36.998818 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_fd2aa32d34794918a4ee7b6ece38a34c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:36.999450 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd2aa32d34794918a4ee7b6ece38a34c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.000064 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3122f85862b74242a50f9d08dc75e6cf" } modify_external_catalogs: true
I20260318 02:51:37.000259 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ecb178c859b44205b0a17b387c6f42c0" } modify_external_catalogs: true
I20260318 02:51:37.000458 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ecb178c859b44205b0a17b387c6f42c0" } modify_external_catalogs: true
I20260318 02:51:37.000885 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c978284529db4de7883f9f0664c4a158" } modify_external_catalogs: true
I20260318 02:51:37.001047 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c978284529db4de7883f9f0664c4a158" } modify_external_catalogs: true
I20260318 02:51:37.000259 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3122f85862b74242a50f9d08dc75e6cf" } modify_external_catalogs: true
I20260318 02:51:37.002657 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2421f558555545da81fa056cdb11cbf0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.003206 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2421f558555545da81fa056cdb11cbf0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.006204 2257 raft_consensus.cc:493] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.006368 2257 raft_consensus.cc:515] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.007083 2257 leader_election.cc:290] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:37.007792 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b8722e7ff4ccabc6d16f04daf85aa" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:37.008427 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b8722e7ff4ccabc6d16f04daf85aa" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:37.009192 719 leader_election.cc:343] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:37.009618 719 leader_election.cc:343] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.009721 719 leader_election.cc:304] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:37.010939 2257 raft_consensus.cc:2749] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:37.014496 757 tablet_service.cc:1558] Processing DeleteTablet for tablet a0a6f4b34ff14714892ed9e9b3604dc9 with delete_type TABLET_DATA_DELETED (replaced by tablet fb5d1d828899472e8f48723b35e94d62) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.014804 1176 tablet_replica.cc:333] T a0a6f4b34ff14714892ed9e9b3604dc9 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:37.014997 1176 raft_consensus.cc:2243] T a0a6f4b34ff14714892ed9e9b3604dc9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:37.015161 1176 raft_consensus.cc:2272] T a0a6f4b34ff14714892ed9e9b3604dc9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:37.016652 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 54260f32672147f6bbd30f3981e9f61c consensus state has no leader
I20260318 02:51:37.019119 890 tablet_service.cc:1558] Processing DeleteTablet for tablet b716c3a80d4a44d190de38f926098efc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:23 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:37.019574 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2120492f0763427e980bbe20f96ed2c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:37.019872 1176 ts_tablet_manager.cc:1916] T a0a6f4b34ff14714892ed9e9b3604dc9 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:37.020743 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2120492f0763427e980bbe20f96ed2c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:37.021245 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 consensus state has no leader
I20260318 02:51:37.024909 2254 tablet.cc:1723] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:37.029289 2253 tablet.cc:1723] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:37.034960 1172 tablet_bootstrap.cc:492] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:37.035181 1172 ts_tablet_manager.cc:1403] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.213s user 0.032s sys 0.052s
I20260318 02:51:37.035429 1027 tablet_service.cc:1511] Processing CreateTablet for tablet bf54f8603e514f1cad3f53ff1427cabe (DEFAULT_TABLE table=default.Table_f4faa0e71fbe408f9bc811fe2a9c62e4 [id=50010510ab9a432a9861d13efaaa9e6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.036031 1172 raft_consensus.cc:359] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.036216 1172 raft_consensus.cc:385] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.036265 1172 raft_consensus.cc:740] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.036466 1172 consensus_queue.cc:260] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.036774 890 tablet_service.cc:1511] Processing CreateTablet for tablet ad73d6ebd7294f9cb0f60c153944cc94 (DEFAULT_TABLE table=default.Table_15febcfb305f45b8be10a1bdb3c9d92c [id=6d71d5bb3d4d4171a0390640e51103a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.036975 1172 ts_tablet_manager.cc:1434] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:37.037379 1172 tablet_bootstrap.cc:492] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:37.037468 1040 tablet_service.cc:1511] Processing CreateTablet for tablet ad73d6ebd7294f9cb0f60c153944cc94 (DEFAULT_TABLE table=default.Table_15febcfb305f45b8be10a1bdb3c9d92c [id=6d71d5bb3d4d4171a0390640e51103a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.037622 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad73d6ebd7294f9cb0f60c153944cc94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.039155 1172 tablet_bootstrap.cc:654] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.046995 453 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet ce0ab476b9a54cc586a4c28e23382bfc (table default.Table_51fd1fd451544782b3785014979adeba [id=94288205d88b4c6ca1f94de1b201a349]). Expected version 1 got 0
I20260318 02:51:37.047133 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf54f8603e514f1cad3f53ff1427cabe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.048393 757 tablet_service.cc:1511] Processing CreateTablet for tablet ad73d6ebd7294f9cb0f60c153944cc94 (DEFAULT_TABLE table=default.Table_15febcfb305f45b8be10a1bdb3c9d92c [id=6d71d5bb3d4d4171a0390640e51103a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.048827 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad73d6ebd7294f9cb0f60c153944cc94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.048941 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad73d6ebd7294f9cb0f60c153944cc94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.057714 1172 tablet_bootstrap.cc:492] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:37.057932 1172 ts_tablet_manager.cc:1403] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.002s
I20260318 02:51:37.058753 1172 raft_consensus.cc:359] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.058952 1172 raft_consensus.cc:385] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.059023 1172 raft_consensus.cc:740] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.059235 1172 consensus_queue.cc:260] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.059760 1172 ts_tablet_manager.cc:1434] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:37.060187 1172 tablet_bootstrap.cc:492] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:37.061923 1172 tablet_bootstrap.cc:654] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.062774 1184 ts_tablet_manager.cc:1929] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:37.063315 1184 log.cc:1199] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/e1d804f5e9564f6d83efb77e6c18724b
I20260318 02:51:37.064832 1184 ts_tablet_manager.cc:1950] T e1d804f5e9564f6d83efb77e6c18724b P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:37.065181 2151 raft_consensus.cc:493] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.065295 2151 raft_consensus.cc:515] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.065874 2151 leader_election.cc:290] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:37.066553 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4eca5e16f84564b31933b8227fd980" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:37.067699 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a61ad75d19d84c0abf5f3633bfe1dde3" } modify_external_catalogs: true
W20260318 02:51:37.067782 997 leader_election.cc:343] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.068647 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4eca5e16f84564b31933b8227fd980" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:37.068913 783 raft_consensus.cc:2468] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:37.069730 999 leader_election.cc:304] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:37.069772 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet e1d804f5e9564f6d83efb77e6c18724b (table default.Table_017276a514464042a76dbff62faa6f82 [id=61b10b92b10b48a4a139b129f8797ea3]) successfully deleted
I20260318 02:51:37.070127 2151 raft_consensus.cc:2804] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:37.070250 2151 raft_consensus.cc:493] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:37.070313 2151 raft_consensus.cc:3060] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:37.098539 2151 raft_consensus.cc:515] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.099903 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4eca5e16f84564b31933b8227fd980" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:37.100100 1173 tablet_bootstrap.cc:654] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:37.100651 997 leader_election.cc:343] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.101652 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4eca5e16f84564b31933b8227fd980" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:37.101842 783 raft_consensus.cc:3060] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:37.107828 1174 tablet_bootstrap.cc:654] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.109690 2151 leader_election.cc:290] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:37.111021 1172 tablet_bootstrap.cc:492] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:37.111197 1172 ts_tablet_manager.cc:1403] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.051s user 0.009s sys 0.009s
I20260318 02:51:37.112075 1172 raft_consensus.cc:359] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.112275 1172 raft_consensus.cc:385] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.112358 1172 raft_consensus.cc:740] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.112598 1172 consensus_queue.cc:260] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.113189 1172 ts_tablet_manager.cc:1434] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:37.119081 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet de2bc2f79e8b49248de3e7eca1a600cf
I20260318 02:51:37.119504 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_28d17f0ce0ec43f6848c9672433b33ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.120123 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28d17f0ce0ec43f6848c9672433b33ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.120229 457 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 0e0efca20eaa438ab0fb74764020a024
I20260318 02:51:37.120388 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet de2bc2f79e8b49248de3e7eca1a600cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:37.120536 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 0652fc250fa04565b069bb767530d747
I20260318 02:51:37.121556 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 0652fc250fa04565b069bb767530d747 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:37.121837 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 0652fc250fa04565b069bb767530d747 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:37.122283 890 tablet_service.cc:1558] Processing DeleteTablet for tablet de2bc2f79e8b49248de3e7eca1a600cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:37.123320 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 104cd36774df4bc0adf1d449224304d5
I20260318 02:51:37.123404 1174 tablet_bootstrap.cc:492] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:37.124068 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a61ad75d19d84c0abf5f3633bfe1dde3" } modify_external_catalogs: true
I20260318 02:51:37.124678 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 104cd36774df4bc0adf1d449224304d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:37.125039 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 104cd36774df4bc0adf1d449224304d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:37.125294 1174 ts_tablet_manager.cc:1403] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.133s user 0.009s sys 0.003s
I20260318 02:51:37.126664 1174 raft_consensus.cc:359] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.127015 1174 raft_consensus.cc:385] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.127159 1174 raft_consensus.cc:740] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.127593 1174 consensus_queue.cc:260] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.132350 1174 ts_tablet_manager.cc:1434] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260318 02:51:37.135057 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0bcd699c81914d4abeece81e1348f239"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:37.135346 1174 tablet_bootstrap.cc:492] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:37.135725 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0bcd699c81914d4abeece81e1348f239 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.136969 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_4e016593707b40a8ae356583b104d313"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.137552 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e016593707b40a8ae356583b104d313 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.137857 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 104cd36774df4bc0adf1d449224304d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.138474 1174 tablet_bootstrap.cc:654] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.138975 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 0652fc250fa04565b069bb767530d747 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.139570 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e50bd5f5933849f5a43d064f39581f70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:37.139710 2151 raft_consensus.cc:493] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.139869 2151 raft_consensus.cc:515] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:37.140138 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e50bd5f5933849f5a43d064f39581f70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.140609 2151 leader_election.cc:290] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:37.141469 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca23d4d0d3734fceb14966a4f2ad9c35" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:37.141666 784 raft_consensus.cc:2468] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:37.141832 759 tablet_service.cc:1558] Processing DeleteTablet for tablet de2bc2f79e8b49248de3e7eca1a600cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.142071 1184 tablet_replica.cc:333] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:37.142351 1184 raft_consensus.cc:2243] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:37.142617 1184 raft_consensus.cc:2272] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:37.143270 1184 ts_tablet_manager.cc:1916] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:37.146253 1172 tablet_bootstrap.cc:492] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:37.146729 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca23d4d0d3734fceb14966a4f2ad9c35" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:37.148180 1172 tablet_bootstrap.cc:654] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.150134 2257 raft_consensus.cc:493] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.150285 2257 raft_consensus.cc:515] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.150919 2257 leader_election.cc:290] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:37.151978 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c33cfa1c194a65bfc64d0e1e9434ff" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:37.152384 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c33cfa1c194a65bfc64d0e1e9434ff" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:37.153049 719 leader_election.cc:343] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.151974 999 leader_election.cc:304] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
W20260318 02:51:37.154498 719 leader_election.cc:343] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.154614 719 leader_election.cc:304] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:37.155380 997 leader_election.cc:343] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.158763 1173 tablet_bootstrap.cc:492] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:37.159193 2257 raft_consensus.cc:2749] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:37.159615 2151 raft_consensus.cc:2804] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:37.159710 2151 raft_consensus.cc:493] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:37.159778 2151 raft_consensus.cc:3060] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:37.160982 448 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c] alter complete (version 1)
I20260318 02:51:37.161710 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 9f274ae7a6834ca98f01575fcf8b161e
I20260318 02:51:37.162895 1173 ts_tablet_manager.cc:1403] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.165s user 0.001s sys 0.003s
I20260318 02:51:37.163651 1173 raft_consensus.cc:359] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:37.163817 1173 raft_consensus.cc:385] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.163866 1173 raft_consensus.cc:740] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.164047 1173 consensus_queue.cc:260] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:37.164798 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f274ae7a6834ca98f01575fcf8b161e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.165493 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f274ae7a6834ca98f01575fcf8b161e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:37.167613 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:37.167973 441 catalog_manager.cc:5075] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): alter failed for tablet b5c19bc5e07949088c84cedbf944dfdb (table default.Table_79bea80cab3d40f5bead32f2fdcf09fa [id=873432f002e14a4fa7065dcfe5caebd5]),no further retry: Not found: Tablet not found: b5c19bc5e07949088c84cedbf944dfdb
I20260318 02:51:37.168792 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f274ae7a6834ca98f01575fcf8b161e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:37.169835 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_516dad30e58e4579af1579c35cdf7b89"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.170442 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_516dad30e58e4579af1579c35cdf7b89 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.170485 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ca056f93d2b34add91c12aaf8b2ba513"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:37.170743 2149 consensus_queue.cc:1048] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260318 02:51:37.170982 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca056f93d2b34add91c12aaf8b2ba513 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.172986 759 tablet_service.cc:1558] Processing DeleteTablet for tablet c0c33cfa1c194a65bfc64d0e1e9434ff with delete_type TABLET_DATA_DELETED (replaced by tablet e918bb008e0743a9bf7ada170812146e) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.173215 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_51fd1fd451544782b3785014979adeba" } new_table_name: "default.Table_f6725dfd5edf467e82dec254bb01d656" modify_external_catalogs: true
I20260318 02:51:37.174453 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b4f791ee528d46b59428dc367b5be0a8" } new_table_name: "default.Table_b735de7cc516403da40f10ec36cf25f1" modify_external_catalogs: true
W20260318 02:51:37.174188 997 consensus_peers.cc:597] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:37.176807 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8d04605804fd4064a17415134bd69937" } new_table_name: "default.Table_8e643e6901d747af9e38d1d8ec07d60d" modify_external_catalogs: true
I20260318 02:51:37.185185 783 raft_consensus.cc:2468] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:37.185734 1176 ts_tablet_manager.cc:1929] T a0a6f4b34ff14714892ed9e9b3604dc9 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:37.185825 1176 log.cc:1199] T a0a6f4b34ff14714892ed9e9b3604dc9 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/a0a6f4b34ff14714892ed9e9b3604dc9
I20260318 02:51:37.186115 1176 ts_tablet_manager.cc:1950] T a0a6f4b34ff14714892ed9e9b3604dc9 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:37.187700 999 leader_election.cc:304] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:37.190788 1173 ts_tablet_manager.cc:1434] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.028s user 0.000s sys 0.001s
I20260318 02:51:37.191485 1172 tablet_bootstrap.cc:492] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:37.191633 1172 ts_tablet_manager.cc:1403] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.006s
I20260318 02:51:37.191881 2149 raft_consensus.cc:2804] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:37.192026 2149 raft_consensus.cc:697] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:37.192286 2149 consensus_queue.cc:237] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.192456 1172 raft_consensus.cc:359] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.192625 1172 raft_consensus.cc:385] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.192690 1172 raft_consensus.cc:740] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.192953 1172 consensus_queue.cc:260] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.193511 1172 ts_tablet_manager.cc:1434] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:37.193812 1172 tablet_bootstrap.cc:492] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:37.195284 455 master_service.cc:954] ReplaceTablet: received request to replace tablet 868605c58c1d4744ab8930313e7dcaa9 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:37.195487 1172 tablet_bootstrap.cc:654] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.195794 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 65c50b0813b04f30896568ab2b680ba8 with delete_type TABLET_DATA_DELETED (replaced by tablet 20a492fdea6c44ba8439614b0dcc2ba6) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:37.205161 450 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 3fccf1f2bc3547e9ba8cc5fe9419f70b (table default.Table_3406e803538541a5b564a3ae03dfedd6 [id=f282f0ee83114539bad2c36e8311e05e]). Expected version 1 got 0
I20260318 02:51:37.209215 2151 raft_consensus.cc:515] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.212249 2151 leader_election.cc:290] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:37.212570 2152 raft_consensus.cc:493] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.212761 2152 raft_consensus.cc:515] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.213264 2152 leader_election.cc:290] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:37.215325 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca23d4d0d3734fceb14966a4f2ad9c35" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:37.215505 784 raft_consensus.cc:3060] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:37.216048 1173 tablet_bootstrap.cc:492] T d0652735b8c24c23ade92913c1c7ad0f P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:37.217809 1173 tablet_bootstrap.cc:654] T d0652735b8c24c23ade92913c1c7ad0f P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.223394 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2bde24aa44a6414f88f99376914827d7" } new_table_name: "default.Table_c94a38b528114f8bb0e4f599698906f2" modify_external_catalogs: true
I20260318 02:51:37.223531 974 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:37.224918 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5ee33d94003f4c92ac54b555ceb84d56" } new_table_name: "default.Table_6390106122c8419595c87048c42ff574" modify_external_catalogs: true
W20260318 02:51:37.225138 999 leader_election.cc:343] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 96a6d1808417419dac0d2b2e80c5ca22
I20260318 02:51:37.226328 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ee5a037155c842a692c67296f75031ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.226886 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee5a037155c842a692c67296f75031ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.227490 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca23d4d0d3734fceb14966a4f2ad9c35" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:37.227998 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a6d1808417419dac0d2b2e80c5ca22" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:37.228163 997 leader_election.cc:343] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:37.228969 997 leader_election.cc:343] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.229094 997 leader_election.cc:304] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:37.229489 2152 raft_consensus.cc:2749] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:37.239012 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 036c17d033b145a681843d14f67ab575 consensus state has no leader
W20260318 02:51:37.239406 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c72625cd6634c4187d6792a85a8e421 has no consensus state
I20260318 02:51:37.240126 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 868605c58c1d4744ab8930313e7dcaa9
I20260318 02:51:37.240563 455 catalog_manager.cc:6741] ReplaceTablet: tablet 868605c58c1d4744ab8930313e7dcaa9 deleted and replaced by tablet ca765bc27f564ab9ab419bcf2aeda59f
I20260318 02:51:37.242192 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 868605c58c1d4744ab8930313e7dcaa9 with delete_type TABLET_DATA_DELETED (replaced by tablet ca765bc27f564ab9ab419bcf2aeda59f) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.244323 455 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 3fccf1f2bc3547e9ba8cc5fe9419f70b (table default.Table_3406e803538541a5b564a3ae03dfedd6 [id=f282f0ee83114539bad2c36e8311e05e]). Expected version 1 got 0
I20260318 02:51:37.244791 448 master_service.cc:954] ReplaceTablet: received request to replace tablet b894f0772a754196a3e651b38c46f001 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:37.245375 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 868605c58c1d4744ab8930313e7dcaa9 with delete_type TABLET_DATA_DELETED (replaced by tablet ca765bc27f564ab9ab419bcf2aeda59f) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:37.246027 2149 raft_consensus.cc:493] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.247023 2149 raft_consensus.cc:515] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.247721 2149 leader_election.cc:290] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:37.251206 999 leader_election.cc:343] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: ed697b98352c4f65931c154b1f160991
W20260318 02:51:37.251580 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c93e05eb5c9e4d5da1b688a03312ad8e consensus state has no leader
W20260318 02:51:37.251991 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 71ea229381d540fdae9b2d7bf3eac2b6 consensus state has no leader
I20260318 02:51:37.254428 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed697b98352c4f65931c154b1f160991" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:37.255245 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 868605c58c1d4744ab8930313e7dcaa9 with delete_type TABLET_DATA_DELETED (replaced by tablet ca765bc27f564ab9ab419bcf2aeda59f) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:37.255981 997 leader_election.cc:343] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.256757 997 leader_election.cc:304] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:37.257861 2151 raft_consensus.cc:2749] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:37.266274 1173 tablet_bootstrap.cc:492] T d0652735b8c24c23ade92913c1c7ad0f P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:37.266287 1172 tablet_bootstrap.cc:492] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:37.266465 1172 ts_tablet_manager.cc:1403] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.073s user 0.002s sys 0.001s
I20260318 02:51:37.267112 1173 ts_tablet_manager.cc:1403] T d0652735b8c24c23ade92913c1c7ad0f P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.000s
I20260318 02:51:37.267396 1172 raft_consensus.cc:359] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.267674 1172 raft_consensus.cc:385] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.267817 1172 raft_consensus.cc:740] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.268069 1173 raft_consensus.cc:359] T d0652735b8c24c23ade92913c1c7ad0f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:37.268090 1172 consensus_queue.cc:260] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.268430 2254 tablet.cc:1723] T ce0ab476b9a54cc586a4c28e23382bfc P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:37.268702 1172 ts_tablet_manager.cc:1434] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:37.269196 2253 tablet.cc:1723] T ce0ab476b9a54cc586a4c28e23382bfc P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:37.269799 1173 raft_consensus.cc:385] T d0652735b8c24c23ade92913c1c7ad0f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.269879 1173 raft_consensus.cc:740] T d0652735b8c24c23ade92913c1c7ad0f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.270098 1173 consensus_queue.cc:260] T d0652735b8c24c23ade92913c1c7ad0f P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:37.273559 449 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet d0652735b8c24c23ade92913c1c7ad0f (table default.Table_20867faf86da4889b7995990926923a7 [id=5bc787aad96b4abd82ab3e033020ea9c]). Expected version 1 got 0
I20260318 02:51:37.274798 1175 ts_tablet_manager.cc:1929] T b5c19bc5e07949088c84cedbf944dfdb P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:37.274989 1175 log.cc:1199] T b5c19bc5e07949088c84cedbf944dfdb P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/b5c19bc5e07949088c84cedbf944dfdb
I20260318 02:51:37.275393 1175 ts_tablet_manager.cc:1950] T b5c19bc5e07949088c84cedbf944dfdb P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:37.276800 1184 ts_tablet_manager.cc:1929] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:37.276980 1184 log.cc:1199] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/1b439fa2481a43c78d2c486d8711175f
I20260318 02:51:37.276989 1173 ts_tablet_manager.cc:1434] T d0652735b8c24c23ade92913c1c7ad0f P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20260318 02:51:37.277415 1184 ts_tablet_manager.cc:1950] T 1b439fa2481a43c78d2c486d8711175f P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:37.279794 1176 tablet_replica.cc:333] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:37.280011 1176 raft_consensus.cc:2243] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:37.280205 1176 raft_consensus.cc:2272] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:37.280793 1176 ts_tablet_manager.cc:1916] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:37.281327 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet a0a6f4b34ff14714892ed9e9b3604dc9 (table default.Table_7692f02c62f94771bc39331507161bb2 [id=60f0afdd0f9f4c5196ea491b90991241]) successfully deleted
I20260318 02:51:37.282277 449 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet d0652735b8c24c23ade92913c1c7ad0f (table default.Table_20867faf86da4889b7995990926923a7 [id=5bc787aad96b4abd82ab3e033020ea9c]). Expected version 1 got 0
I20260318 02:51:37.283245 784 raft_consensus.cc:2468] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:37.283660 1173 tablet_bootstrap.cc:492] T dea25aaad60a4b2483a8832f995d1316 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:37.289062 1173 tablet_bootstrap.cc:654] T dea25aaad60a4b2483a8832f995d1316 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.295137 999 leader_election.cc:304] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:37.296383 2152 raft_consensus.cc:493] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.296871 2149 raft_consensus.cc:2804] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:37.297129 2149 raft_consensus.cc:697] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:37.297465 2149 consensus_queue.cc:237] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.296643 2152 raft_consensus.cc:515] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.299384 2152 leader_election.cc:290] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:37.300679 2151 raft_consensus.cc:493] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.300887 2151 raft_consensus.cc:515] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.301481 2151 leader_election.cc:290] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
W20260318 02:51:37.302091 999 leader_election.cc:343] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 7cdd554113bf4a7092da876365a89456
I20260318 02:51:37.302448 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ebb62f4c54a2a8c24b90ec15402d3" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:37.302680 784 raft_consensus.cc:2468] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:37.303179 999 leader_election.cc:304] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:37.303594 2151 raft_consensus.cc:2804] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:37.303738 2151 raft_consensus.cc:493] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:37.303865 2151 raft_consensus.cc:3060] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:37.313549 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cdd554113bf4a7092da876365a89456" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:37.319805 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 863) took 1317 ms. Trace:
I20260318 02:51:37.319921 1175 rpcz_store.cc:276] 0318 02:51:36.002088 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.002264 (+ 176us) service_pool.cc:225] Handling call
0318 02:51:36.923492 (+921228us) ts_tablet_manager.cc:1151] Deleting tablet b5c19bc5e07949088c84cedbf944dfdb
0318 02:51:36.923499 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.177952 (+254453us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:37.274699 (+ 96747us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:37.319769 (+ 45070us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":921082}
I20260318 02:51:37.320390 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 864) took 1274 ms. Trace:
I20260318 02:51:37.320470 1175 rpcz_store.cc:276] 0318 02:51:36.046106 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.046215 (+ 109us) service_pool.cc:225] Handling call
0318 02:51:37.320237 (+1274022us) ts_tablet_manager.cc:1151] Deleting tablet db22b17af0874e1289766138ed0d0591
0318 02:51:37.320248 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.320371 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1273693}
I20260318 02:51:37.320749 1175 tablet_replica.cc:333] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:37.320967 1175 raft_consensus.cc:2243] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:37.321256 1175 pending_rounds.cc:70] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18: Trying to abort 1 pending ops.
I20260318 02:51:37.321307 1175 pending_rounds.cc:77] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494204112621568 op_type: NO_OP noop_request { }
I20260318 02:51:37.321426 1175 raft_consensus.cc:2889] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:37.321513 1175 raft_consensus.cc:2272] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:37.321455 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_666699f265dc4783bc3c8315e742e806"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:37.322110 1175 ts_tablet_manager.cc:1916] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:37.322176 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_666699f265dc4783bc3c8315e742e806 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.326529 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a9ca2b8e5b9042279576e9b9c6701069" } modify_external_catalogs: true
I20260318 02:51:37.326771 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a9ca2b8e5b9042279576e9b9c6701069" } modify_external_catalogs: true
I20260318 02:51:37.327322 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_db8a1a6484c54822ad31ad887f108929" } modify_external_catalogs: true
I20260318 02:51:37.327497 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_db8a1a6484c54822ad31ad887f108929" } modify_external_catalogs: true
I20260318 02:51:37.328083 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e71e4d565bad48f38753cfdd6891cbb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.328670 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e71e4d565bad48f38753cfdd6891cbb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:37.329731 997 leader_election.cc:343] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.329880 997 leader_election.cc:304] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:37.330458 1960 raft_consensus.cc:2749] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:37.331739 443 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 5c72625cd6634c4187d6792a85a8e421 (table default.Table_8e643e6901d747af9e38d1d8ec07d60d [id=4b88704ac247460eb4c4e45e37f2ef9a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5c72625cd6634c4187d6792a85a8e421 has no consensus state
I20260318 02:51:37.333940 1172 tablet_bootstrap.cc:492] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:37.335620 1172 tablet_bootstrap.cc:654] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.337354 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 883) took 1162 ms. Trace:
I20260318 02:51:37.337734 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9b00b191fd624f53bcbb0ad0f48c4de5" } modify_external_catalogs: true
I20260318 02:51:37.337931 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9b00b191fd624f53bcbb0ad0f48c4de5" } modify_external_catalogs: true
I20260318 02:51:37.338506 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_efb2704a3a7246fd94c799eba891c6de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.339030 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_efb2704a3a7246fd94c799eba891c6de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.344086 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6a96af2ea8f04b2a8b13896020fb7bf0" } modify_external_catalogs: true
I20260318 02:51:37.344295 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6a96af2ea8f04b2a8b13896020fb7bf0" } modify_external_catalogs: true
I20260318 02:51:37.351212 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet b5c19bc5e07949088c84cedbf944dfdb (table default.Table_79bea80cab3d40f5bead32f2fdcf09fa [id=873432f002e14a4fa7065dcfe5caebd5]) successfully deleted
W20260318 02:51:37.352106 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet db22b17af0874e1289766138ed0d0591 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db22b17af0874e1289766138ed0d0591 already in progress: creating tablet
I20260318 02:51:37.352502 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ebb62f4c54a2a8c24b90ec15402d3" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:37.352774 1184 rpcz_store.cc:276] 0318 02:51:36.174837 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.175232 (+ 395us) service_pool.cc:225] Handling call
0318 02:51:37.070468 (+895236us) ts_tablet_manager.cc:1151] Deleting tablet 1b439fa2481a43c78d2c486d8711175f
0318 02:51:37.070549 (+ 81us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.271846 (+201297us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:37.276622 (+ 4776us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:37.337310 (+ 60688us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":894943}
I20260318 02:51:37.353209 1184 tablet_replica.cc:333] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:37.353463 1184 raft_consensus.cc:2243] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:37.353662 1184 raft_consensus.cc:2272] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:37.354296 1184 ts_tablet_manager.cc:1916] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:37.361362 1174 tablet_bootstrap.cc:492] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:37.361608 1174 ts_tablet_manager.cc:1403] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.226s user 0.000s sys 0.004s
I20260318 02:51:37.362403 1174 raft_consensus.cc:359] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.362677 1174 raft_consensus.cc:385] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.362775 1174 raft_consensus.cc:740] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.363669 1174 consensus_queue.cc:260] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.364236 1174 ts_tablet_manager.cc:1434] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:37.364174 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1cb17f7b14bb4c1e8282b948e7a26c74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:37.364784 1174 tablet_bootstrap.cc:492] T f72023f5408f4ef4b628568da0c008d6 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:37.365438 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cb17f7b14bb4c1e8282b948e7a26c74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.366593 1174 tablet_bootstrap.cc:654] T f72023f5408f4ef4b628568da0c008d6 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.369171 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a3a36a7fd4742c9827b334ce31d4a7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.371592 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b76c4b353fbe45c8a866d4cd2c4e264c" } modify_external_catalogs: true
I20260318 02:51:37.371815 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b76c4b353fbe45c8a866d4cd2c4e264c" } modify_external_catalogs: true
I20260318 02:51:37.375460 1184 ts_tablet_manager.cc:1929] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:37.375633 1184 log.cc:1199] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/083493ab9d26493a924025fbd96ab1d7
I20260318 02:51:37.375948 1184 ts_tablet_manager.cc:1950] T 083493ab9d26493a924025fbd96ab1d7 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:37.381837 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 1b439fa2481a43c78d2c486d8711175f (table default.Table_46d782df1eb242b081563aeb0ae51278 [id=2cc63f24c25a4fc396e6d026ce1ba876]) successfully deleted
W20260318 02:51:37.382939 997 leader_election.cc:343] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.387748 2151 raft_consensus.cc:515] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.388602 2151 leader_election.cc:290] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:37.389456 1174 tablet_bootstrap.cc:492] T f72023f5408f4ef4b628568da0c008d6 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:37.389617 1174 ts_tablet_manager.cc:1403] T f72023f5408f4ef4b628568da0c008d6 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20260318 02:51:37.389700 2276 tablet.cc:1723] T ce0ab476b9a54cc586a4c28e23382bfc P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:37.389464 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ebb62f4c54a2a8c24b90ec15402d3" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:37.390342 784 raft_consensus.cc:3060] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:37.390363 1174 raft_consensus.cc:359] T f72023f5408f4ef4b628568da0c008d6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.390506 1174 raft_consensus.cc:385] T f72023f5408f4ef4b628568da0c008d6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.390568 1174 raft_consensus.cc:740] T f72023f5408f4ef4b628568da0c008d6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.390762 1174 consensus_queue.cc:260] T f72023f5408f4ef4b628568da0c008d6 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.391208 1174 ts_tablet_manager.cc:1434] T f72023f5408f4ef4b628568da0c008d6 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:37.391461 1174 tablet_bootstrap.cc:492] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:37.393437 784 raft_consensus.cc:2468] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:37.393996 999 leader_election.cc:304] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:37.397881 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3cef154980284ef0aa821a72c630d4cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:37.397979 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3bf4ed9b878547bc8d219b080a39c2fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.398504 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3bf4ed9b878547bc8d219b080a39c2fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:37.398597 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3cef154980284ef0aa821a72c630d4cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.398890 1174 tablet_bootstrap.cc:654] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.408543 2151 raft_consensus.cc:2804] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:37.409246 2151 raft_consensus.cc:697] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:37.409909 2151 consensus_queue.cc:237] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.410392 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet ab158343adb14eab85c595fa5405145d
I20260318 02:51:37.411262 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0d3f85f7408a4890b0cd314f1dfe1507"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:37.411437 759 tablet_service.cc:1558] Processing DeleteTablet for tablet ab158343adb14eab85c595fa5405145d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:37.411826 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d3f85f7408a4890b0cd314f1dfe1507 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.413791 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_57dde8299a394890acd2aeff8a69cdc0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.414345 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57dde8299a394890acd2aeff8a69cdc0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.416486 890 tablet_service.cc:1558] Processing DeleteTablet for tablet ab158343adb14eab85c595fa5405145d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:37.416837 1172 tablet_bootstrap.cc:492] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:37.417003 1172 ts_tablet_manager.cc:1403] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.083s user 0.009s sys 0.004s
I20260318 02:51:37.417958 1172 raft_consensus.cc:359] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.418152 1172 raft_consensus.cc:385] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.418223 1172 raft_consensus.cc:740] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.418469 1172 consensus_queue.cc:260] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.418967 1172 ts_tablet_manager.cc:1434] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:37.419284 1172 tablet_bootstrap.cc:492] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:37.422314 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_66fe286f603f49b8ad7f7146182503c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.422953 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66fe286f603f49b8ad7f7146182503c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.425323 450 master_service.cc:954] ReplaceTablet: received request to replace tablet 1d3eb0cf4190436680ad3265a1c1c31b from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:37.428135 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ebb62f4c54a2a8c24b90ec15402d3" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:37.429687 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet ab158343adb14eab85c595fa5405145d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:37.429713 456 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_f6725dfd5edf467e82dec254bb01d656 [id=94288205d88b4c6ca1f94de1b201a349] alter complete (version 2)
I20260318 02:51:37.430325 1176 ts_tablet_manager.cc:1929] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:37.430354 1175 ts_tablet_manager.cc:1929] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:37.430451 1176 log.cc:1199] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/104cd36774df4bc0adf1d449224304d5
I20260318 02:51:37.430464 1175 log.cc:1199] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/b230018a95a54ababfe5ecf2ca1e2e49
I20260318 02:51:37.430804 1176 ts_tablet_manager.cc:1950] T 104cd36774df4bc0adf1d449224304d5 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:37.430860 1175 ts_tablet_manager.cc:1950] T b230018a95a54ababfe5ecf2ca1e2e49 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:37.431174 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 865) took 1282 ms. Trace:
I20260318 02:51:37.431246 1175 rpcz_store.cc:276] 0318 02:51:36.149177 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.149457 (+ 280us) service_pool.cc:225] Handling call
0318 02:51:37.320685 (+1171228us) ts_tablet_manager.cc:1151] Deleting tablet b230018a95a54ababfe5ecf2ca1e2e49
0318 02:51:37.320693 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.374611 (+ 53918us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:37.430221 (+ 55610us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:37.431160 (+ 939us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1171028}
I20260318 02:51:37.431571 1175 tablet_replica.cc:333] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:37.431730 1175 raft_consensus.cc:2243] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:37.431718 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet b230018a95a54ababfe5ecf2ca1e2e49 (table default.Table_1acdeb444a404cb0b89ac6450e835639 [id=9278db75ac0f4aa59c4af2f13a58e314]) successfully deleted
I20260318 02:51:37.431864 1175 raft_consensus.cc:2272] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:37.432431 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 104cd36774df4bc0adf1d449224304d5 (table default.Table_c978284529db4de7883f9f0664c4a158 [id=8b5e3535d9e44b1a86dc59211a31deb6]) successfully deleted
I20260318 02:51:37.432618 1175 ts_tablet_manager.cc:1916] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:37.432873 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 0652fc250fa04565b069bb767530d747 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0652fc250fa04565b069bb767530d747 already in progress: creating tablet
W20260318 02:51:37.433182 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet de2bc2f79e8b49248de3e7eca1a600cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de2bc2f79e8b49248de3e7eca1a600cf already in progress: creating tablet
W20260318 02:51:37.433495 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 9f274ae7a6834ca98f01575fcf8b161e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f274ae7a6834ca98f01575fcf8b161e already in progress: creating tablet
I20260318 02:51:37.433533 1176 tablet_replica.cc:333] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:37.433701 1176 raft_consensus.cc:2243] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:37.433825 1176 raft_consensus.cc:2272] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:37.434605 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 886) took 1259 ms. Trace:
I20260318 02:51:37.434767 1176 ts_tablet_manager.cc:1916] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:37.434773 1184 rpcz_store.cc:276] 0318 02:51:36.175183 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.175370 (+ 187us) service_pool.cc:225] Handling call
0318 02:51:37.353129 (+1177759us) ts_tablet_manager.cc:1151] Deleting tablet 083493ab9d26493a924025fbd96ab1d7
0318 02:51:37.353143 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.369217 (+ 16074us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:37.375313 (+ 6096us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:37.434539 (+ 59226us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1177608}
I20260318 02:51:37.435281 1184 tablet_replica.cc:333] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:37.436065 453 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 3d7b339a29ef456997d74a7a95d4c03a (table default.Table_2999327e014d4062a8e1aef2ba9ee277 [id=545ec19ee7a34ceb8e7adb93b6eaecf8]). Expected version 2 got 0
I20260318 02:51:37.439221 759 tablet_service.cc:1558] Processing DeleteTablet for tablet f72023f5408f4ef4b628568da0c008d6 with delete_type TABLET_DATA_DELETED (replaced by tablet bf54f8603e514f1cad3f53ff1427cabe) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.440557 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8a3ee564e57c44ceafe096c878900896" } new_table_name: "default.Table_5ccfbbc3ac234ae1a1219ac5bef14e95" modify_external_catalogs: true
I20260318 02:51:37.445642 1173 tablet_bootstrap.cc:492] T dea25aaad60a4b2483a8832f995d1316 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:37.445873 1173 ts_tablet_manager.cc:1403] T dea25aaad60a4b2483a8832f995d1316 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.162s user 0.015s sys 0.003s
I20260318 02:51:37.446766 1173 raft_consensus.cc:359] T dea25aaad60a4b2483a8832f995d1316 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:37.446894 890 tablet_service.cc:1511] Processing CreateTablet for tablet 1b6fa9c5afc045368223aefa962baca5 (DEFAULT_TABLE table=default.Table_5f8d8d7adcdc49db92fa83977b6be5ec [id=5f72a8e76b9d42a3af92eee39670e1bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.447816 759 tablet_service.cc:1511] Processing CreateTablet for tablet 1b6fa9c5afc045368223aefa962baca5 (DEFAULT_TABLE table=default.Table_5f8d8d7adcdc49db92fa83977b6be5ec [id=5f72a8e76b9d42a3af92eee39670e1bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.448195 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b6fa9c5afc045368223aefa962baca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.451208 1174 tablet_bootstrap.cc:492] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:37.451333 1174 ts_tablet_manager.cc:1403] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.010s
I20260318 02:51:37.452009 1174 raft_consensus.cc:359] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.452153 1174 raft_consensus.cc:385] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.452199 1174 raft_consensus.cc:740] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.452373 1174 consensus_queue.cc:260] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.452845 1174 ts_tablet_manager.cc:1434] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260318 02:51:37.453105 1172 tablet_bootstrap.cc:654] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.453832 1174 tablet_bootstrap.cc:492] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:37.455262 1174 tablet_bootstrap.cc:654] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.459797 904 tablet_service.cc:1511] Processing CreateTablet for tablet 5433e0aebdd34666a655c21a77fe2654 (DEFAULT_TABLE table=default.Table_f141890f83124edb914868a35fc73df2 [id=58b8369a23414b1f9dd77cd73be50714]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.450524 449 catalog_manager.cc:5671] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:37.463160 449 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet ca23d4d0d3734fceb14966a4f2ad9c35 (table default.Table_10f6937d0016448caceef24711896b5f [id=61241ff920584692bba476799b6a60e7]). Expected version 2 got 0
I20260318 02:51:37.460770 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_55141c44691c4ea0a2b3df6a456db916" } new_table_name: "default.Table_644343460f93471fb77dd0fc3e40e27e" modify_external_catalogs: true
I20260318 02:51:37.465291 449 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 3fccf1f2bc3547e9ba8cc5fe9419f70b (table default.Table_3406e803538541a5b564a3ae03dfedd6 [id=f282f0ee83114539bad2c36e8311e05e]). Expected version 1 got 0
I20260318 02:51:37.465889 449 catalog_manager.cc:5671] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:37.466850 449 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 7c4eca5e16f84564b31933b8227fd980 (table default.Table_4da517198db54744b96210b1f4438731 [id=541170c7c4bf49deb86cd4c15ffdd04f]). Expected version 1 got 0
I20260318 02:51:37.467470 449 catalog_manager.cc:5671] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:37.468557 449 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 061ebb62f4c54a2a8c24b90ec15402d3 (table default.Table_88caf570ec6a4dfea94952fb5718c9c6 [id=5a3571f0765948588578d8e5185807a8]). Expected version 1 got 0
I20260318 02:51:37.469329 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b6fa9c5afc045368223aefa962baca5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:37.472939 997 leader_election.cc:343] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.473065 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5433e0aebdd34666a655c21a77fe2654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.473379 1111 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:37.481686 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 083493ab9d26493a924025fbd96ab1d7 (table default.Table_0bc143d5f9bf42be85f911249422e04d [id=607d58701fef4551addddb65e64f7dcd]) successfully deleted
I20260318 02:51:37.485664 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 42a6983dce4e476cae97b3ecb1133077 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:37.486971 759 tablet_service.cc:1558] Processing DeleteTablet for tablet b8973d8930ef4b65be7b4ff990bf9d72 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c89f413a26a43ef95c850d7c44f85b2) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.487622 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 1b6fa9c5afc045368223aefa962baca5 (DEFAULT_TABLE table=default.Table_5f8d8d7adcdc49db92fa83977b6be5ec [id=5f72a8e76b9d42a3af92eee39670e1bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.488112 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b6fa9c5afc045368223aefa962baca5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.493076 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e71e4d565bad48f38753cfdd6891cbb1" } new_table_name: "default.Table_4f845969128d421bb81de4850d6f2f0c" modify_external_catalogs: true
I20260318 02:51:37.446945 1173 raft_consensus.cc:385] T dea25aaad60a4b2483a8832f995d1316 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.495577 1173 raft_consensus.cc:740] T dea25aaad60a4b2483a8832f995d1316 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.495823 1173 consensus_queue.cc:260] T dea25aaad60a4b2483a8832f995d1316 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:37.496503 1173 ts_tablet_manager.cc:1434] T dea25aaad60a4b2483a8832f995d1316 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.051s user 0.001s sys 0.001s
I20260318 02:51:37.498476 1173 tablet_bootstrap.cc:492] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:37.500208 1173 tablet_bootstrap.cc:654] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.501298 1184 raft_consensus.cc:2243] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:37.501592 1184 raft_consensus.cc:2272] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:37.502245 1184 ts_tablet_manager.cc:1916] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:37.512817 2151 raft_consensus.cc:493] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.513022 2151 raft_consensus.cc:515] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.514031 2151 leader_election.cc:290] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:37.515628 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3406e803538541a5b564a3ae03dfedd6" } new_table_name: "default.Table_8afbb1eafd5f4977bfffdfd764689b39" modify_external_catalogs: true
I20260318 02:51:37.519289 2257 raft_consensus.cc:493] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.519452 2257 raft_consensus.cc:515] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.520031 2257 leader_election.cc:290] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:37.520632 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8973d8930ef4b65be7b4ff990bf9d72" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:37.520915 999 leader_election.cc:343] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 503386365f6a49f6b84c64b59b764c10
W20260318 02:51:37.521296 719 leader_election.cc:343] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.521826 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8973d8930ef4b65be7b4ff990bf9d72" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:37.522569 719 leader_election.cc:343] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.522687 719 leader_election.cc:304] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:37.523041 2257 raft_consensus.cc:2749] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:37.523737 2257 raft_consensus.cc:493] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.523871 2257 raft_consensus.cc:515] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.524502 2257 leader_election.cc:290] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:37.525470 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a36a7fd4742c9827b334ce31d4a7c" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:37.526057 719 leader_election.cc:343] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.526262 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a36a7fd4742c9827b334ce31d4a7c" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:37.527032 719 leader_election.cc:343] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.527139 719 leader_election.cc:304] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:37.527482 2257 raft_consensus.cc:2749] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:37.529603 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_571feb453416404b8733d890a9336fc4" } new_table_name: "default.Table_9f269c4844cc473580c4743dd9be3dea" modify_external_catalogs: true
I20260318 02:51:37.531106 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "503386365f6a49f6b84c64b59b764c10" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:37.531369 1174 tablet_bootstrap.cc:492] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:37.531502 1174 ts_tablet_manager.cc:1403] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.078s user 0.006s sys 0.007s
I20260318 02:51:37.532270 1174 raft_consensus.cc:359] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.532431 1174 raft_consensus.cc:385] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.532482 1174 raft_consensus.cc:740] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.532694 1174 consensus_queue.cc:260] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.533178 1174 ts_tablet_manager.cc:1434] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260318 02:51:37.533432 1174 tablet_bootstrap.cc:492] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:37.534435 890 tablet_service.cc:1511] Processing CreateTablet for tablet b719a0e31e384e568852d5344214ef8c (DEFAULT_TABLE table=default.Table_0370c121d1a84b84b0876f6419cdc0d3 [id=888fe2dffe234527bc854d505d70df86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.534837 1174 tablet_bootstrap.cc:654] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.539093 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b719a0e31e384e568852d5344214ef8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.540109 1175 ts_tablet_manager.cc:1929] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:37.540297 1175 log.cc:1199] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/2789a1195e7344c18dd226e196e2f302
I20260318 02:51:37.540344 759 tablet_service.cc:1511] Processing CreateTablet for tablet 5433e0aebdd34666a655c21a77fe2654 (DEFAULT_TABLE table=default.Table_f141890f83124edb914868a35fc73df2 [id=58b8369a23414b1f9dd77cd73be50714]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.540838 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5433e0aebdd34666a655c21a77fe2654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.542806 904 tablet_service.cc:1511] Processing CreateTablet for tablet 7253dcb3d73c4297bf444defd3ef6e74 (DEFAULT_TABLE table=default.Table_1a61666d86db47ffad7bafd4a07f0439 [id=1ceadac3c48c460586733b78bded3328]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.543192 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7253dcb3d73c4297bf444defd3ef6e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.544297 757 tablet_service.cc:1511] Processing CreateTablet for tablet b719a0e31e384e568852d5344214ef8c (DEFAULT_TABLE table=default.Table_0370c121d1a84b84b0876f6419cdc0d3 [id=888fe2dffe234527bc854d505d70df86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.544692 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b719a0e31e384e568852d5344214ef8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.551720 1174 tablet_bootstrap.cc:492] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:37.551944 1174 ts_tablet_manager.cc:1403] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.005s
I20260318 02:51:37.552860 1174 raft_consensus.cc:359] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.553097 1174 raft_consensus.cc:385] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.553179 1174 raft_consensus.cc:740] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.553409 1174 consensus_queue.cc:260] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.553951 1174 ts_tablet_manager.cc:1434] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:37.556432 2197 raft_consensus.cc:493] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.556591 2197 raft_consensus.cc:515] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:37.557180 2197 leader_election.cc:290] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:37.557359 1184 ts_tablet_manager.cc:1929] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:37.557494 1184 log.cc:1199] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/065ebc3c000a4ad3873ee031ecf9986b
W20260318 02:51:37.559125 860 leader_election.cc:343] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 65c50b0813b04f30896568ab2b680ba8
W20260318 02:51:37.559608 862 leader_election.cc:343] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 65c50b0813b04f30896568ab2b680ba8
I20260318 02:51:37.559715 862 leader_election.cc:304] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:37.560177 2197 raft_consensus.cc:2749] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:37.568102 754 tablet_service.cc:1511] Processing CreateTablet for tablet 7253dcb3d73c4297bf444defd3ef6e74 (DEFAULT_TABLE table=default.Table_1a61666d86db47ffad7bafd4a07f0439 [id=1ceadac3c48c460586733b78bded3328]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.569082 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7253dcb3d73c4297bf444defd3ef6e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.569820 890 tablet_service.cc:1511] Processing CreateTablet for tablet 0d2c9a52052140ae884cbdce0889da0a (DEFAULT_TABLE table=default.Table_0da8901cfbff4305a6b9dd4ead654bcc [id=faf85a1b969a43bfb5a768fcac74e5e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.570220 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2c9a52052140ae884cbdce0889da0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.570549 1184 ts_tablet_manager.cc:1950] T 065ebc3c000a4ad3873ee031ecf9986b P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:37.570886 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 884) took 1395 ms. Trace:
I20260318 02:51:37.570993 1184 rpcz_store.cc:276] 0318 02:51:36.174951 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.175407 (+ 456us) service_pool.cc:225] Handling call
0318 02:51:37.435197 (+1259790us) ts_tablet_manager.cc:1151] Deleting tablet 065ebc3c000a4ad3873ee031ecf9986b
0318 02:51:37.435208 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.505703 (+ 70495us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:37.557182 (+ 51479us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:37.570855 (+ 13673us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1259555}
I20260318 02:51:37.571412 1184 tablet_replica.cc:333] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:37.571635 1184 raft_consensus.cc:2243] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:37.571798 1184 raft_consensus.cc:2272] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:37.572398 1184 ts_tablet_manager.cc:1916] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:37.573163 1174 tablet_bootstrap.cc:492] T 5ff188f25ff146fab121ebfab1af8467 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:37.573267 1175 ts_tablet_manager.cc:1950] T 2789a1195e7344c18dd226e196e2f302 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:37.573596 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 866) took 1424 ms. Trace:
I20260318 02:51:37.573670 1175 rpcz_store.cc:276] 0318 02:51:36.149312 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.149695 (+ 383us) service_pool.cc:225] Handling call
0318 02:51:37.431513 (+1281818us) ts_tablet_manager.cc:1151] Deleting tablet 2789a1195e7344c18dd226e196e2f302
0318 02:51:37.431523 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.481989 (+ 50466us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:37.540004 (+ 58015us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:37.573576 (+ 33572us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1281682}
I20260318 02:51:37.574116 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 2789a1195e7344c18dd226e196e2f302 (table default.Table_a9ca2b8e5b9042279576e9b9c6701069 [id=3066ad66b0914b759c32fe9296ca90bc]) successfully deleted
I20260318 02:51:37.574446 1175 tablet_replica.cc:333] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:37.574611 1174 tablet_bootstrap.cc:654] T 5ff188f25ff146fab121ebfab1af8467 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.574661 1175 raft_consensus.cc:2243] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:37.574815 1175 raft_consensus.cc:2272] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:37.575318 1175 ts_tablet_manager.cc:1916] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:37.575414 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 1d2c64dc7c0b479494ca474dad51a528
I20260318 02:51:37.576313 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d2c64dc7c0b479494ca474dad51a528 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.577486 457 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 68b0f0cd89234e72a052f3f9f964aa35 (table default.Table_1068ed12c0774560af59c6eb9d2f292c [id=9a52b01ffd5b4f7e8a7a20a817aa842f]). Expected version 2 got 0
I20260318 02:51:37.578258 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3486ecde3c9249d4b6daa9a5c8334cf2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.578835 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3486ecde3c9249d4b6daa9a5c8334cf2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.580035 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 243a2f81711f4712ab21c8ae5bdc94a8
I20260318 02:51:37.580935 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 98ac6bdd852d468ba6821af6c85bfd19
I20260318 02:51:37.581538 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_22ce3d4b35a8423bba8f74a6be3a551c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.582051 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22ce3d4b35a8423bba8f74a6be3a551c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.582825 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 98ac6bdd852d468ba6821af6c85bfd19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.583065 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 243a2f81711f4712ab21c8ae5bdc94a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:37.583298 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 89b8448f18cb4d7c8c14edd76fd86c60 consensus state has no leader
I20260318 02:51:37.583689 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ea731c793b734bc5b818de21c6e70f8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:37.584048 757 tablet_service.cc:1511] Processing CreateTablet for tablet 0d2c9a52052140ae884cbdce0889da0a (DEFAULT_TABLE table=default.Table_0da8901cfbff4305a6b9dd4ead654bcc [id=faf85a1b969a43bfb5a768fcac74e5e6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:37.584168 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea731c793b734bc5b818de21c6e70f8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.584434 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2c9a52052140ae884cbdce0889da0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.580657 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1710ee85bd4547d297a56b4dcf3d7192"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.586079 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1710ee85bd4547d297a56b4dcf3d7192 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.586891 1176 ts_tablet_manager.cc:1929] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:37.586988 1176 log.cc:1199] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/c0c33cfa1c194a65bfc64d0e1e9434ff
I20260318 02:51:37.587291 1176 ts_tablet_manager.cc:1950] T c0c33cfa1c194a65bfc64d0e1e9434ff P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:37.589392 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 243a2f81711f4712ab21c8ae5bdc94a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:37.589983 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 98ac6bdd852d468ba6821af6c85bfd19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:37.591310 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 065ebc3c000a4ad3873ee031ecf9986b (table default.Table_a1fc9d74bf8b4be5a48c0480aa55d189 [id=62eb3b210f764eaaa081488904cf8aa7]) successfully deleted
I20260318 02:51:37.592456 2151 raft_consensus.cc:493] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.592607 2151 raft_consensus.cc:515] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.593246 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d2c64dc7c0b479494ca474dad51a528 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:37.593943 999 leader_election.cc:343] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 20c6f1790ed34581b7507ec63ec66718
I20260318 02:51:37.594300 2151 leader_election.cc:290] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:37.594620 1172 tablet_bootstrap.cc:492] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:37.594798 1172 ts_tablet_manager.cc:1403] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.176s user 0.003s sys 0.001s
I20260318 02:51:37.595292 2151 raft_consensus.cc:493] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.595453 2151 raft_consensus.cc:515] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.595665 1172 raft_consensus.cc:359] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:37.595844 1172 raft_consensus.cc:385] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.596026 1172 raft_consensus.cc:740] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.596288 1172 consensus_queue.cc:260] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:37.596839 1172 ts_tablet_manager.cc:1434] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260318 02:51:37.597141 1172 tablet_bootstrap.cc:492] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:37.597097 999 leader_election.cc:343] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 9451d57fad72413c81443623c7995d4e
I20260318 02:51:37.597293 2151 leader_election.cc:290] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:37.598826 1172 tablet_bootstrap.cc:654] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.599118 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 5433e0aebdd34666a655c21a77fe2654 (DEFAULT_TABLE table=default.Table_f141890f83124edb914868a35fc73df2 [id=58b8369a23414b1f9dd77cd73be50714]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.599618 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5433e0aebdd34666a655c21a77fe2654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.600669 1173 tablet_bootstrap.cc:492] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:37.600834 1173 ts_tablet_manager.cc:1403] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.102s user 0.005s sys 0.000s
I20260318 02:51:37.601799 1173 raft_consensus.cc:359] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:37.601963 1173 raft_consensus.cc:385] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.602017 1173 raft_consensus.cc:740] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.602253 1173 consensus_queue.cc:260] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:37.603718 1174 tablet_bootstrap.cc:492] T 5ff188f25ff146fab121ebfab1af8467 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:37.603856 1174 ts_tablet_manager.cc:1403] T 5ff188f25ff146fab121ebfab1af8467 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.001s
I20260318 02:51:37.604238 754 tablet_service.cc:1511] Processing CreateTablet for tablet 0abb9045d6394fd4a9e294269387dfc9 (DEFAULT_TABLE table=default.Table_a5569b02165b42ca97657d6dfa34433a [id=98303c8e876e4a0796335bc86cc3999d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.604630 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0abb9045d6394fd4a9e294269387dfc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.604564 1174 raft_consensus.cc:359] T 5ff188f25ff146fab121ebfab1af8467 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.604732 1174 raft_consensus.cc:385] T 5ff188f25ff146fab121ebfab1af8467 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.604779 1174 raft_consensus.cc:740] T 5ff188f25ff146fab121ebfab1af8467 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.604951 1174 consensus_queue.cc:260] T 5ff188f25ff146fab121ebfab1af8467 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.605475 1174 ts_tablet_manager.cc:1434] T 5ff188f25ff146fab121ebfab1af8467 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:37.605720 1174 tablet_bootstrap.cc:492] T 9aeb492564a94a569f70506712dad4ed P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:37.607723 1174 tablet_bootstrap.cc:654] T 9aeb492564a94a569f70506712dad4ed P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.609032 2197 raft_consensus.cc:493] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.609174 2197 raft_consensus.cc:515] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:37.609789 2197 leader_election.cc:290] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:37.611039 757 tablet_service.cc:1511] Processing CreateTablet for tablet 5c72625cd6634c4187d6792a85a8e421 (DEFAULT_TABLE table=default.Table_8e643e6901d747af9e38d1d8ec07d60d [id=4b88704ac247460eb4c4e45e37f2ef9a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:37.611307 860 leader_election.cc:343] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: b716c3a80d4a44d190de38f926098efc
I20260318 02:51:37.611517 1173 ts_tablet_manager.cc:1434] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260318 02:51:37.612636 1173 tablet_bootstrap.cc:492] T 9a5afc5611d3481e9a6d48381dc67e86 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:37.613775 901 tablet_service.cc:1511] Processing CreateTablet for tablet 0abb9045d6394fd4a9e294269387dfc9 (DEFAULT_TABLE table=default.Table_a5569b02165b42ca97657d6dfa34433a [id=98303c8e876e4a0796335bc86cc3999d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.613903 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c72625cd6634c4187d6792a85a8e421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.614121 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0abb9045d6394fd4a9e294269387dfc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.612257 904 tablet_service.cc:1511] Processing CreateTablet for tablet 5c72625cd6634c4187d6792a85a8e421 (DEFAULT_TABLE table=default.Table_8e643e6901d747af9e38d1d8ec07d60d [id=4b88704ac247460eb4c4e45e37f2ef9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.613351 903 tablet_service.cc:1511] Processing CreateTablet for tablet 8d100b0cd0e04596a14982a094a6471f (DEFAULT_TABLE table=default.Table_f2421bd3bf1a44a6adefc3b0931dfcc0 [id=5af3432e9e6848919e848bd0eb2d3f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.616684 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d100b0cd0e04596a14982a094a6471f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.618728 759 tablet_service.cc:1511] Processing CreateTablet for tablet 8d100b0cd0e04596a14982a094a6471f (DEFAULT_TABLE table=default.Table_f2421bd3bf1a44a6adefc3b0931dfcc0 [id=5af3432e9e6848919e848bd0eb2d3f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.619073 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d100b0cd0e04596a14982a094a6471f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.621721 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c72625cd6634c4187d6792a85a8e421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.625455 754 tablet_service.cc:1511] Processing CreateTablet for tablet e566cc653bd341feaadea09394b4ef94 (DEFAULT_TABLE table=default.Table_3b585ecfc5b445f58bd17b27c4ffcd8c [id=ec39d60d85cc4cd59983e95dc9f0d5c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.625922 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e566cc653bd341feaadea09394b4ef94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.626190 1040 tablet_service.cc:1511] Processing CreateTablet for tablet b719a0e31e384e568852d5344214ef8c (DEFAULT_TABLE table=default.Table_0370c121d1a84b84b0876f6419cdc0d3 [id=888fe2dffe234527bc854d505d70df86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.626642 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b719a0e31e384e568852d5344214ef8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.629071 903 tablet_service.cc:1511] Processing CreateTablet for tablet e566cc653bd341feaadea09394b4ef94 (DEFAULT_TABLE table=default.Table_3b585ecfc5b445f58bd17b27c4ffcd8c [id=ec39d60d85cc4cd59983e95dc9f0d5c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.629455 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e566cc653bd341feaadea09394b4ef94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.636974 1173 tablet_bootstrap.cc:654] T 9a5afc5611d3481e9a6d48381dc67e86 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.638480 2151 raft_consensus.cc:493] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.638751 2151 raft_consensus.cc:515] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:37.640618 999 leader_election.cc:343] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 1ef3181adc0542229897369591a30465
I20260318 02:51:37.640921 2151 leader_election.cc:290] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:37.641284 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c89f413a26a43ef95c850d7c44f85b2 consensus state has no leader
W20260318 02:51:37.642781 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 71b45ec1da6440b98c796e61d3551424 has no consensus state
I20260318 02:51:37.643031 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 7253dcb3d73c4297bf444defd3ef6e74 (DEFAULT_TABLE table=default.Table_1a61666d86db47ffad7bafd4a07f0439 [id=1ceadac3c48c460586733b78bded3328]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.644889 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7253dcb3d73c4297bf444defd3ef6e74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.645229 450 master_service.cc:954] ReplaceTablet: received request to replace tablet 597a9271dedf4e789926e7e65fd79dfc from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:37.645393 761 tablet_service.cc:1558] Processing DeleteTablet for tablet de2bc2f79e8b49248de3e7eca1a600cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.645816 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c8066725c1a94b1f9e3a030be08a461d" } modify_external_catalogs: true
I20260318 02:51:37.645984 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c8066725c1a94b1f9e3a030be08a461d" } modify_external_catalogs: true
W20260318 02:51:37.646482 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c58d9d141c364802a3f597b5925f4806 consensus state has no leader
I20260318 02:51:37.646414 761 tablet_service.cc:1511] Processing CreateTablet for tablet 2e269493009b435f9d576c0db09a94ea (DEFAULT_TABLE table=default.Table_8eaa937ff8a34d2f993657d2ff6046b1 [id=db9b1897492a40d1897397f9ba450195]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.646858 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e269493009b435f9d576c0db09a94ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.646801 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_fc39d2b3197a4db2876be7bf3d972045"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.647351 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc39d2b3197a4db2876be7bf3d972045 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.648597 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f37ab96f13444fcbb5cfc3ad92d53c35
I20260318 02:51:37.649354 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d2c64dc7c0b479494ca474dad51a528 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:37.651392 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a341f29b76c14ece8878ebaebff80142"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.651945 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a341f29b76c14ece8878ebaebff80142 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.653035 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2adcf914f85541f0ad00e19d929d28d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:37.653155 750 tablet_service.cc:1558] Processing DeleteTablet for tablet f37ab96f13444fcbb5cfc3ad92d53c35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.653352 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ff188f25ff146fab121ebfab1af8467 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:37.653575 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2adcf914f85541f0ad00e19d929d28d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.654043 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 243a2f81711f4712ab21c8ae5bdc94a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:37.655146 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_daf5a8ed81964828a87c8b2dda0c4a6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.655699 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_daf5a8ed81964828a87c8b2dda0c4a6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:37.655810 862 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.129:46711, user_credentials={real_user=slave}} blocked reactor thread for 96205.1us
W20260318 02:51:37.657040 862 leader_election.cc:343] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: b716c3a80d4a44d190de38f926098efc
I20260318 02:51:37.657157 862 leader_election.cc:304] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:37.657183 761 tablet_service.cc:1511] Processing CreateTablet for tablet 1fa6e24943d54a3ea40fd34980ba2b27 (DEFAULT_TABLE table=default.Table_ceedcaff18544b0e986386e5a8194d87 [id=877c931b34144091aaf438555326c4db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.657569 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa6e24943d54a3ea40fd34980ba2b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.657773 2197 raft_consensus.cc:2749] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:37.658627 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 98ac6bdd852d468ba6821af6c85bfd19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:37.659339 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 0d2c9a52052140ae884cbdce0889da0a (DEFAULT_TABLE table=default.Table_0da8901cfbff4305a6b9dd4ead654bcc [id=faf85a1b969a43bfb5a768fcac74e5e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.660549 901 tablet_service.cc:1511] Processing CreateTablet for tablet 2e269493009b435f9d576c0db09a94ea (DEFAULT_TABLE table=default.Table_8eaa937ff8a34d2f993657d2ff6046b1 [id=db9b1897492a40d1897397f9ba450195]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.660941 1038 tablet_service.cc:1511] Processing CreateTablet for tablet e566cc653bd341feaadea09394b4ef94 (DEFAULT_TABLE table=default.Table_3b585ecfc5b445f58bd17b27c4ffcd8c [id=ec39d60d85cc4cd59983e95dc9f0d5c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.660985 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 8d100b0cd0e04596a14982a094a6471f (DEFAULT_TABLE table=default.Table_f2421bd3bf1a44a6adefc3b0931dfcc0 [id=5af3432e9e6848919e848bd0eb2d3f6c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:37.661141 997 leader_election.cc:343] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.661346 997 leader_election.cc:304] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:37.661392 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 0abb9045d6394fd4a9e294269387dfc9 (DEFAULT_TABLE table=default.Table_a5569b02165b42ca97657d6dfa34433a [id=98303c8e876e4a0796335bc86cc3999d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.661499 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 2e269493009b435f9d576c0db09a94ea (DEFAULT_TABLE table=default.Table_8eaa937ff8a34d2f993657d2ff6046b1 [id=db9b1897492a40d1897397f9ba450195]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.661592 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 5c72625cd6634c4187d6792a85a8e421 (DEFAULT_TABLE table=default.Table_8e643e6901d747af9e38d1d8ec07d60d [id=4b88704ac247460eb4c4e45e37f2ef9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.661712 2151 raft_consensus.cc:2749] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:37.661741 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet f37ab96f13444fcbb5cfc3ad92d53c35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:37.662146 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e269493009b435f9d576c0db09a94ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.666136 899 tablet_service.cc:1511] Processing CreateTablet for tablet 1fa6e24943d54a3ea40fd34980ba2b27 (DEFAULT_TABLE table=default.Table_ceedcaff18544b0e986386e5a8194d87 [id=877c931b34144091aaf438555326c4db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.666612 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa6e24943d54a3ea40fd34980ba2b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.668479 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_83b3ae4889bc4e68970d8c091f4c55a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.669099 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83b3ae4889bc4e68970d8c091f4c55a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.687655 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d100b0cd0e04596a14982a094a6471f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.689904 453 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet d2fb9c8f339444bc8d7c6479e7d87f44 (table default.Table_278b10b38c074522b0e03e24d653346d [id=895bbd90cf47462ab116ee3f37e94982]). Expected version 3 got 0
I20260318 02:51:37.691133 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0abb9045d6394fd4a9e294269387dfc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.692880 2253 tablet.cc:1723] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:37.687675 2254 tablet.cc:1723] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:37.697247 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e269493009b435f9d576c0db09a94ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.701023 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e566cc653bd341feaadea09394b4ef94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.707118 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c72625cd6634c4187d6792a85a8e421. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.712997 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2c9a52052140ae884cbdce0889da0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.718730 752 tablet_service.cc:1511] Processing CreateTablet for tablet 255979f9bbe74dd583798ea5da2ae4c4 (DEFAULT_TABLE table=default.Table_0c162c9f3baa4ac6ae56ef095498c61b [id=bbfb9db9c4ba4a2a8d463c460f8b18c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.719151 751 tablet_service.cc:1511] Processing CreateTablet for tablet a1ea3329a317495792d26bd31fcd3b43 (DEFAULT_TABLE table=default.Table_f3b493164ec64405848518f3a11acab6 [id=5f9ae4603bb34490a7cbd19f86d3df4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.719376 756 tablet_service.cc:1511] Processing CreateTablet for tablet f8bf3de42fd247bf8b44b1fbd67ce005 (DEFAULT_TABLE table=default.Table_6c6385d211234b01b123afe1213bc9fe [id=516491cb978a467d80f665e8adbd8c1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.719585 755 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4b6f64c20e4e2e86a1e2f4ff628319 (DEFAULT_TABLE table=default.Table_3747269973ec485caeed2bb52bde1307 [id=5bf383bf9d3e47758b9dac8641d84fb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.719641 762 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9ef5733bb5474693efe42d6004fa8c (DEFAULT_TABLE table=default.Table_c6fc7d9146f54c5eb9fe35be2b75eeba [id=e13fc1dfed1f43a9b19117ad1941f2d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.719854 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet c0c33cfa1c194a65bfc64d0e1e9434ff (table default.Table_c8ea19bed9e54eaf91af95c365e46851 [id=551f7031c6b84904836a915c07704492]) successfully deleted
I20260318 02:51:37.719884 748 tablet_service.cc:1511] Processing CreateTablet for tablet 504a8ead5ba24f51bd26df90feb92d96 (DEFAULT_TABLE table=default.Table_b2ff027f70e44671ab6c7e8b30d4d755 [id=9f922836544348e381b4f225285dd954]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.719980 753 tablet_service.cc:1511] Processing CreateTablet for tablet 73f7d8f42e8a4e4c9794a2805fc57b30 (DEFAULT_TABLE table=default.Table_d99a88deb49440b59eab19e13498ca6e [id=8be004f1cf21440588630972df39095e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.720309 766 tablet_service.cc:1511] Processing CreateTablet for tablet b9a6d8d743a742a4b2d19b85e59101cb (DEFAULT_TABLE table=default.Table_1c9b1342c54f4840be96c19cc2aa6127 [id=1e824dba0ffd4970ad5d24b70c1e5a1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.719376 750 tablet_service.cc:1511] Processing CreateTablet for tablet 1ab336fd3649495a97b48e7cd913b05c (DEFAULT_TABLE table=default.Table_7352cff7749a47f4812abe56f2e00e7f [id=4c22ff6bfa284aab9a4ed00e9a31d6e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.719174 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255979f9bbe74dd583798ea5da2ae4c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.721002 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f7d8f42e8a4e4c9794a2805fc57b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.721161 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ea3329a317495792d26bd31fcd3b43. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:37.722824 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 868605c58c1d4744ab8930313e7dcaa9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 868605c58c1d4744ab8930313e7dcaa9 already in progress: creating tablet
I20260318 02:51:37.723250 1176 tablet_replica.cc:333] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:37.723551 1176 raft_consensus.cc:2243] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:37.723778 1176 raft_consensus.cc:2272] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:37.724108 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a6d8d743a742a4b2d19b85e59101cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.724808 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4b6f64c20e4e2e86a1e2f4ff628319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.725092 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9ef5733bb5474693efe42d6004fa8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.728825 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ab336fd3649495a97b48e7cd913b05c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:37.730997 997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 69876.8us
I20260318 02:51:37.732913 1176 ts_tablet_manager.cc:1916] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:37.732900 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c6f1790ed34581b7507ec63ec66718" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:37.733125 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 504a8ead5ba24f51bd26df90feb92d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.734027 1174 tablet_bootstrap.cc:492] T 9aeb492564a94a569f70506712dad4ed P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:37.734135 1174 ts_tablet_manager.cc:1403] T 9aeb492564a94a569f70506712dad4ed P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.128s user 0.011s sys 0.008s
I20260318 02:51:37.734849 1174 raft_consensus.cc:359] T 9aeb492564a94a569f70506712dad4ed P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.734993 1174 raft_consensus.cc:385] T 9aeb492564a94a569f70506712dad4ed P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.735038 1174 raft_consensus.cc:740] T 9aeb492564a94a569f70506712dad4ed P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.735283 1174 consensus_queue.cc:260] T 9aeb492564a94a569f70506712dad4ed P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.736579 833 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:37.738639 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8bf3de42fd247bf8b44b1fbd67ce005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.738847 1176 ts_tablet_manager.cc:1929] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:37.738935 1176 log.cc:1199] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/2a3a36a7fd4742c9827b334ce31d4a7c
I20260318 02:51:37.739187 1176 ts_tablet_manager.cc:1950] T 2a3a36a7fd4742c9827b334ce31d4a7c P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:37.740044 1174 ts_tablet_manager.cc:1434] T 9aeb492564a94a569f70506712dad4ed P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260318 02:51:37.740309 1174 tablet_bootstrap.cc:492] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:37.741994 1174 tablet_bootstrap.cc:654] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.743929 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9451d57fad72413c81443623c7995d4e" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:37.744830 761 tablet_service.cc:1511] Processing CreateTablet for tablet fcbc0bda5fe94ee1bdee330aa09ea1b9 (DEFAULT_TABLE table=default.Table_2372b7a037ea4bf3a0d6a18f73dbe959 [id=f9e6e0e7bc6d4a5a8095fa0bac064a79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.745177 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbc0bda5fe94ee1bdee330aa09ea1b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.746928 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ef3181adc0542229897369591a30465" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:37.749462 757 tablet_service.cc:1511] Processing CreateTablet for tablet af15310cab014dbe8a50dab55c72837a (DEFAULT_TABLE table=default.Table_aea729f62f024663ab23b6ad341a68fd [id=1387382d86404088afece201bcc214c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.752691 754 tablet_service.cc:1511] Processing CreateTablet for tablet 8b2a7424736e4cd38ccfa9522c6bcfa8 (DEFAULT_TABLE table=default.Table_19a5548e4a984ddab615ff21b6a12b4c [id=b4afd754d84241f69ff6302ee28c11c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.753409 901 tablet_service.cc:1511] Processing CreateTablet for tablet 8b2a7424736e4cd38ccfa9522c6bcfa8 (DEFAULT_TABLE table=default.Table_19a5548e4a984ddab615ff21b6a12b4c [id=b4afd754d84241f69ff6302ee28c11c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.753837 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2a7424736e4cd38ccfa9522c6bcfa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.753887 895 tablet_service.cc:1511] Processing CreateTablet for tablet fcbc0bda5fe94ee1bdee330aa09ea1b9 (DEFAULT_TABLE table=default.Table_2372b7a037ea4bf3a0d6a18f73dbe959 [id=f9e6e0e7bc6d4a5a8095fa0bac064a79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.754207 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbc0bda5fe94ee1bdee330aa09ea1b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.755962 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2a7424736e4cd38ccfa9522c6bcfa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.759423 1172 tablet_bootstrap.cc:492] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:37.760649 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af15310cab014dbe8a50dab55c72837a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.761937 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 2a3a36a7fd4742c9827b334ce31d4a7c (table default.Table_607fac50cf4a4239bff8616d7176493d [id=f84167772dc74b15a01306e41817f3d1]) successfully deleted
I20260318 02:51:37.761821 1172 ts_tablet_manager.cc:1403] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.165s user 0.008s sys 0.001s
I20260318 02:51:37.763211 1176 tablet_replica.cc:333] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:37.763468 1176 raft_consensus.cc:2243] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:37.763378 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 1fa6e24943d54a3ea40fd34980ba2b27 (DEFAULT_TABLE table=default.Table_ceedcaff18544b0e986386e5a8194d87 [id=877c931b34144091aaf438555326c4db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.763724 1176 raft_consensus.cc:2272] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:37.763926 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa6e24943d54a3ea40fd34980ba2b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.764318 1176 ts_tablet_manager.cc:1916] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:37.764735 1027 tablet_service.cc:1511] Processing CreateTablet for tablet fcbc0bda5fe94ee1bdee330aa09ea1b9 (DEFAULT_TABLE table=default.Table_2372b7a037ea4bf3a0d6a18f73dbe959 [id=f9e6e0e7bc6d4a5a8095fa0bac064a79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.765043 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcbc0bda5fe94ee1bdee330aa09ea1b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.768100 1038 tablet_service.cc:1511] Processing CreateTablet for tablet af15310cab014dbe8a50dab55c72837a (DEFAULT_TABLE table=default.Table_aea729f62f024663ab23b6ad341a68fd [id=1387382d86404088afece201bcc214c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.768471 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af15310cab014dbe8a50dab55c72837a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.771811 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 503386365f6a49f6b84c64b59b764c10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:37.772089 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c0d87304c41481299f1e2ddfdfcfdec with delete_type TABLET_DATA_DELETED (replaced by tablet 565add8c21f343f2b11c12a9bb7ff111) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:37.773032 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 8b2a7424736e4cd38ccfa9522c6bcfa8 (DEFAULT_TABLE table=default.Table_19a5548e4a984ddab615ff21b6a12b4c [id=b4afd754d84241f69ff6302ee28c11c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.773422 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2a7424736e4cd38ccfa9522c6bcfa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.780203 2197 raft_consensus.cc:493] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.780354 2197 raft_consensus.cc:515] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:37.780894 1026 tablet_service.cc:1511] Processing CreateTablet for tablet f8bf3de42fd247bf8b44b1fbd67ce005 (DEFAULT_TABLE table=default.Table_6c6385d211234b01b123afe1213bc9fe [id=516491cb978a467d80f665e8adbd8c1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.780972 2197 leader_election.cc:290] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:37.781248 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8bf3de42fd247bf8b44b1fbd67ce005. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:37.781888 862 leader_election.cc:343] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: cc1543d0e1b1431baf6d2ab6a0484ca6
W20260318 02:51:37.782603 860 leader_election.cc:343] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: cc1543d0e1b1431baf6d2ab6a0484ca6
I20260318 02:51:37.782711 860 leader_election.cc:304] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:37.783041 2197 raft_consensus.cc:2749] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:37.783586 1176 ts_tablet_manager.cc:1929] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:37.786935 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 1ab336fd3649495a97b48e7cd913b05c (DEFAULT_TABLE table=default.Table_7352cff7749a47f4812abe56f2e00e7f [id=4c22ff6bfa284aab9a4ed00e9a31d6e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.787171 1176 log.cc:1199] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/ab158343adb14eab85c595fa5405145d
I20260318 02:51:37.787297 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ab336fd3649495a97b48e7cd913b05c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.756675 904 tablet_service.cc:1558] Processing DeleteTablet for tablet f37ab96f13444fcbb5cfc3ad92d53c35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:37.787688 1176 ts_tablet_manager.cc:1950] T ab158343adb14eab85c595fa5405145d P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:37.793426 1176 tablet_replica.cc:333] T f72023f5408f4ef4b628568da0c008d6 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:37.793624 1176 raft_consensus.cc:2243] T f72023f5408f4ef4b628568da0c008d6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:37.793814 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 255979f9bbe74dd583798ea5da2ae4c4 (DEFAULT_TABLE table=default.Table_0c162c9f3baa4ac6ae56ef095498c61b [id=bbfb9db9c4ba4a2a8d463c460f8b18c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.794133 1176 raft_consensus.cc:2272] T f72023f5408f4ef4b628568da0c008d6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:37.794188 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255979f9bbe74dd583798ea5da2ae4c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.794127 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet ab158343adb14eab85c595fa5405145d (table default.Table_b76c4b353fbe45c8a866d4cd2c4e264c [id=d20f8f1bd66d4dceab3b7bc72608da2a]) successfully deleted
I20260318 02:51:37.794480 754 tablet_service.cc:1511] Processing CreateTablet for tablet 7110ce4a03724c16b32d3ba1a128aa5b (DEFAULT_TABLE table=default.Table_1073a99862de49db9d6523e2ab3c6b51 [id=38614342ec9845ceab6688383104c326]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.794874 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7110ce4a03724c16b32d3ba1a128aa5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.795161 1176 ts_tablet_manager.cc:1916] T f72023f5408f4ef4b628568da0c008d6 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:37.797791 1026 tablet_service.cc:1511] Processing CreateTablet for tablet b9a6d8d743a742a4b2d19b85e59101cb (DEFAULT_TABLE table=default.Table_1c9b1342c54f4840be96c19cc2aa6127 [id=1e824dba0ffd4970ad5d24b70c1e5a1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.798224 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a6d8d743a742a4b2d19b85e59101cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.801101 899 tablet_service.cc:1511] Processing CreateTablet for tablet af15310cab014dbe8a50dab55c72837a (DEFAULT_TABLE table=default.Table_aea729f62f024663ab23b6ad341a68fd [id=1387382d86404088afece201bcc214c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.801232 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9ef5733bb5474693efe42d6004fa8c (DEFAULT_TABLE table=default.Table_c6fc7d9146f54c5eb9fe35be2b75eeba [id=e13fc1dfed1f43a9b19117ad1941f2d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.801504 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af15310cab014dbe8a50dab55c72837a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.801517 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9ef5733bb5474693efe42d6004fa8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.805362 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 254b8722e7ff4ccabc6d16f04daf85aa
I20260318 02:51:37.806092 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 254b8722e7ff4ccabc6d16f04daf85aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.806380 901 tablet_service.cc:1511] Processing CreateTablet for tablet 255979f9bbe74dd583798ea5da2ae4c4 (DEFAULT_TABLE table=default.Table_0c162c9f3baa4ac6ae56ef095498c61b [id=bbfb9db9c4ba4a2a8d463c460f8b18c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.806735 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255979f9bbe74dd583798ea5da2ae4c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.807071 890 tablet_service.cc:1511] Processing CreateTablet for tablet f8bf3de42fd247bf8b44b1fbd67ce005 (DEFAULT_TABLE table=default.Table_6c6385d211234b01b123afe1213bc9fe [id=516491cb978a467d80f665e8adbd8c1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.807413 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8bf3de42fd247bf8b44b1fbd67ce005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.808239 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4b6f64c20e4e2e86a1e2f4ff628319 (DEFAULT_TABLE table=default.Table_3747269973ec485caeed2bb52bde1307 [id=5bf383bf9d3e47758b9dac8641d84fb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.808579 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4b6f64c20e4e2e86a1e2f4ff628319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.809100 898 tablet_service.cc:1511] Processing CreateTablet for tablet b9a6d8d743a742a4b2d19b85e59101cb (DEFAULT_TABLE table=default.Table_1c9b1342c54f4840be96c19cc2aa6127 [id=1e824dba0ffd4970ad5d24b70c1e5a1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.809417 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a6d8d743a742a4b2d19b85e59101cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.810425 1174 tablet_bootstrap.cc:492] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:37.810565 1174 ts_tablet_manager.cc:1403] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.070s user 0.000s sys 0.003s
I20260318 02:51:37.811460 906 tablet_service.cc:1511] Processing CreateTablet for tablet a1ea3329a317495792d26bd31fcd3b43 (DEFAULT_TABLE table=default.Table_f3b493164ec64405848518f3a11acab6 [id=5f9ae4603bb34490a7cbd19f86d3df4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.811508 1174 raft_consensus.cc:359] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.811668 1174 raft_consensus.cc:385] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.811717 1174 raft_consensus.cc:740] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.811787 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ea3329a317495792d26bd31fcd3b43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.811748 1043 tablet_service.cc:1511] Processing CreateTablet for tablet a1ea3329a317495792d26bd31fcd3b43 (DEFAULT_TABLE table=default.Table_f3b493164ec64405848518f3a11acab6 [id=5f9ae4603bb34490a7cbd19f86d3df4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.811894 1174 consensus_queue.cc:260] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.812068 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ea3329a317495792d26bd31fcd3b43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.813383 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 254b8722e7ff4ccabc6d16f04daf85aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:37.814334 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 7110ce4a03724c16b32d3ba1a128aa5b (DEFAULT_TABLE table=default.Table_1073a99862de49db9d6523e2ab3c6b51 [id=38614342ec9845ceab6688383104c326]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.814671 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7110ce4a03724c16b32d3ba1a128aa5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.816128 891 tablet_service.cc:1511] Processing CreateTablet for tablet 9c9ef5733bb5474693efe42d6004fa8c (DEFAULT_TABLE table=default.Table_c6fc7d9146f54c5eb9fe35be2b75eeba [id=e13fc1dfed1f43a9b19117ad1941f2d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.816489 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c9ef5733bb5474693efe42d6004fa8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.817123 892 tablet_service.cc:1511] Processing CreateTablet for tablet 73f7d8f42e8a4e4c9794a2805fc57b30 (DEFAULT_TABLE table=default.Table_d99a88deb49440b59eab19e13498ca6e [id=8be004f1cf21440588630972df39095e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.817436 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f7d8f42e8a4e4c9794a2805fc57b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.818125 889 tablet_service.cc:1511] Processing CreateTablet for tablet 7c4b6f64c20e4e2e86a1e2f4ff628319 (DEFAULT_TABLE table=default.Table_3747269973ec485caeed2bb52bde1307 [id=5bf383bf9d3e47758b9dac8641d84fb2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.818951 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 254b8722e7ff4ccabc6d16f04daf85aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:37.822332 904 tablet_service.cc:1511] Processing CreateTablet for tablet 1ab336fd3649495a97b48e7cd913b05c (DEFAULT_TABLE table=default.Table_7352cff7749a47f4812abe56f2e00e7f [id=4c22ff6bfa284aab9a4ed00e9a31d6e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.822767 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ab336fd3649495a97b48e7cd913b05c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.773273 1172 raft_consensus.cc:359] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.822975 1172 raft_consensus.cc:385] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.823057 1172 raft_consensus.cc:740] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.823391 1172 consensus_queue.cc:260] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.824355 1172 ts_tablet_manager.cc:1434] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.052s user 0.002s sys 0.000s
I20260318 02:51:37.824760 903 tablet_service.cc:1511] Processing CreateTablet for tablet 504a8ead5ba24f51bd26df90feb92d96 (DEFAULT_TABLE table=default.Table_b2ff027f70e44671ab6c7e8b30d4d755 [id=9f922836544348e381b4f225285dd954]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.824898 1174 ts_tablet_manager.cc:1434] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20260318 02:51:37.825129 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 504a8ead5ba24f51bd26df90feb92d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.826612 1172 tablet_bootstrap.cc:492] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:37.830173 1172 tablet_bootstrap.cc:654] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.836536 1172 tablet_bootstrap.cc:492] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:37.836443 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d1d7f165d03741de8da1ad12a2e5994b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:37.836928 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c4b6f64c20e4e2e86a1e2f4ff628319. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:37.837174 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1d7f165d03741de8da1ad12a2e5994b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.837787 894 tablet_service.cc:1511] Processing CreateTablet for tablet 6e72f04c08fe44fdabce1c5b102ca61a (DEFAULT_TABLE table=default.Table_d717ffddc62d4afaad80d7420e46be69 [id=082f59eac407447582cfc8ee5ec329a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.838145 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e72f04c08fe44fdabce1c5b102ca61a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.839551 902 tablet_service.cc:1511] Processing CreateTablet for tablet 7110ce4a03724c16b32d3ba1a128aa5b (DEFAULT_TABLE table=default.Table_1073a99862de49db9d6523e2ab3c6b51 [id=38614342ec9845ceab6688383104c326]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.839882 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7110ce4a03724c16b32d3ba1a128aa5b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:37.841462 997 leader_election.cc:343] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.841602 997 leader_election.cc:304] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:37.841881 2152 raft_consensus.cc:2749] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:37.842387 997 leader_election.cc:343] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.842535 997 leader_election.cc:304] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:37.842851 2152 raft_consensus.cc:2749] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:37.843593 907 tablet_service.cc:1511] Processing CreateTablet for tablet c9d09130cded4b2b9478a85066379e25 (DEFAULT_TABLE table=default.Table_ee8d3cf2be29490e882954710a91f9a6 [id=4f93af3a1fa0443b80a46a93e182950c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:37.843845 997 leader_election.cc:343] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.843964 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d09130cded4b2b9478a85066379e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.843984 997 leader_election.cc:304] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:37.844240 2152 raft_consensus.cc:2749] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:37.846383 926 raft_consensus.cc:3060] T d0652735b8c24c23ade92913c1c7ad0f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:37.847326 888 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce1bf41b33842ab9ade884ae84daf96 (DEFAULT_TABLE table=default.Table_eea6a27dda544c4288859e25ca97caef [id=61f0d92a9a6943588561fffb842cf408]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.847688 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce1bf41b33842ab9ade884ae84daf96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.849315 754 tablet_service.cc:1511] Processing CreateTablet for tablet 6e72f04c08fe44fdabce1c5b102ca61a (DEFAULT_TABLE table=default.Table_d717ffddc62d4afaad80d7420e46be69 [id=082f59eac407447582cfc8ee5ec329a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.849704 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e72f04c08fe44fdabce1c5b102ca61a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.850875 1030 tablet_service.cc:1511] Processing CreateTablet for tablet c9d09130cded4b2b9478a85066379e25 (DEFAULT_TABLE table=default.Table_ee8d3cf2be29490e882954710a91f9a6 [id=4f93af3a1fa0443b80a46a93e182950c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.851218 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d09130cded4b2b9478a85066379e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.852794 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 504a8ead5ba24f51bd26df90feb92d96 (DEFAULT_TABLE table=default.Table_b2ff027f70e44671ab6c7e8b30d4d755 [id=9f922836544348e381b4f225285dd954]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.853000 757 tablet_service.cc:1511] Processing CreateTablet for tablet 407b6b2f451e43aaaba4f6cebb80fac7 (DEFAULT_TABLE table=default.Table_a88d7cf1e136439093308e8ba6a02904 [id=78544c8efe9648caaf61f3d91675b5a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.853140 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 504a8ead5ba24f51bd26df90feb92d96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.853338 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 407b6b2f451e43aaaba4f6cebb80fac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.855683 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1c9b1342c54f4840be96c19cc2aa6127" } modify_external_catalogs: true
I20260318 02:51:37.855901 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5652594c1782460c99b7ca166eafb347" } modify_external_catalogs: true
I20260318 02:51:37.856022 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5652594c1782460c99b7ca166eafb347" } modify_external_catalogs: true
I20260318 02:51:37.858047 761 tablet_service.cc:1511] Processing CreateTablet for tablet c9d09130cded4b2b9478a85066379e25 (DEFAULT_TABLE table=default.Table_ee8d3cf2be29490e882954710a91f9a6 [id=4f93af3a1fa0443b80a46a93e182950c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.858089 766 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce1bf41b33842ab9ade884ae84daf96 (DEFAULT_TABLE table=default.Table_eea6a27dda544c4288859e25ca97caef [id=61f0d92a9a6943588561fffb842cf408]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.858214 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 6e72f04c08fe44fdabce1c5b102ca61a (DEFAULT_TABLE table=default.Table_d717ffddc62d4afaad80d7420e46be69 [id=082f59eac407447582cfc8ee5ec329a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.858409 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d09130cded4b2b9478a85066379e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.858465 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1c9b1342c54f4840be96c19cc2aa6127" } modify_external_catalogs: true
I20260318 02:51:37.858791 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e72f04c08fe44fdabce1c5b102ca61a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.861037 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce1bf41b33842ab9ade884ae84daf96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.861404 750 tablet_service.cc:1511] Processing CreateTablet for tablet 1814c903ba4f456098f862e9490aa05e (DEFAULT_TABLE table=default.Table_f88018436952478cb888ea867404843c [id=33412846f2364daf9584573090bafa7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.861745 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1814c903ba4f456098f862e9490aa05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.861913 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 407b6b2f451e43aaaba4f6cebb80fac7 (DEFAULT_TABLE table=default.Table_a88d7cf1e136439093308e8ba6a02904 [id=78544c8efe9648caaf61f3d91675b5a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.862241 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 407b6b2f451e43aaaba4f6cebb80fac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.863095 895 tablet_service.cc:1511] Processing CreateTablet for tablet 407b6b2f451e43aaaba4f6cebb80fac7 (DEFAULT_TABLE table=default.Table_a88d7cf1e136439093308e8ba6a02904 [id=78544c8efe9648caaf61f3d91675b5a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.863449 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 407b6b2f451e43aaaba4f6cebb80fac7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.865978 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 73f7d8f42e8a4e4c9794a2805fc57b30 (DEFAULT_TABLE table=default.Table_d99a88deb49440b59eab19e13498ca6e [id=8be004f1cf21440588630972df39095e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.866567 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f7d8f42e8a4e4c9794a2805fc57b30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.871351 1176 ts_tablet_manager.cc:1929] T f72023f5408f4ef4b628568da0c008d6 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:37.871482 1176 log.cc:1199] T f72023f5408f4ef4b628568da0c008d6 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/f72023f5408f4ef4b628568da0c008d6
I20260318 02:51:37.871775 1176 ts_tablet_manager.cc:1950] T f72023f5408f4ef4b628568da0c008d6 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:37.872632 1176 tablet_replica.cc:333] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:37.872906 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet f72023f5408f4ef4b628568da0c008d6 (table default.Table_f4faa0e71fbe408f9bc811fe2a9c62e4 [id=50010510ab9a432a9861d13efaaa9e6d]) successfully deleted
I20260318 02:51:37.872961 1176 raft_consensus.cc:2243] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:37.873181 1176 raft_consensus.cc:2272] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:37.760226 1184 ts_tablet_manager.cc:1929] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:37.873543 1184 log.cc:1199] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/5fec974d146f44aeb72df483fa85b287
I20260318 02:51:37.873844 1184 ts_tablet_manager.cc:1950] T 5fec974d146f44aeb72df483fa85b287 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:37.874672 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 887) took 1699 ms. Trace:
I20260318 02:51:37.874766 1184 rpcz_store.cc:276] 0318 02:51:36.175680 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.175722 (+ 42us) service_pool.cc:225] Handling call
0318 02:51:37.571250 (+1395528us) ts_tablet_manager.cc:1151] Deleting tablet 5fec974d146f44aeb72df483fa85b287
0318 02:51:37.571259 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.756999 (+185740us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:37.760115 (+ 3116us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:37.874647 (+114532us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1395404}
I20260318 02:51:37.875169 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 888) took 1683 ms. Trace:
I20260318 02:51:37.875250 1184 rpcz_store.cc:276] 0318 02:51:36.191921 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.191983 (+ 62us) service_pool.cc:225] Handling call
0318 02:51:37.875043 (+1683060us) ts_tablet_manager.cc:1151] Deleting tablet 98101333a294447aa6df09c7fa62b565
0318 02:51:37.875052 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.875151 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1682878}
I20260318 02:51:37.875581 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 889) took 1678 ms. Trace:
I20260318 02:51:37.875658 1184 rpcz_store.cc:276] 0318 02:51:36.196877 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.196927 (+ 50us) service_pool.cc:225] Handling call
0318 02:51:37.875465 (+1678538us) ts_tablet_manager.cc:1151] Deleting tablet 2f04e5699531479d8b76edb0e2d2873c
0318 02:51:37.875473 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.875564 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1678351}
I20260318 02:51:37.875933 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 890) took 1611 ms. Trace:
I20260318 02:51:37.876008 1184 rpcz_store.cc:276] 0318 02:51:36.264234 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.264347 (+ 113us) service_pool.cc:225] Handling call
0318 02:51:37.875843 (+1611496us) ts_tablet_manager.cc:1151] Deleting tablet eb1a59d1153b41eb9d95b931ffafdd16
0318 02:51:37.875851 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.875918 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1611311}
I20260318 02:51:37.876313 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 892) took 1600 ms. Trace:
I20260318 02:51:37.876387 1184 rpcz_store.cc:276] 0318 02:51:36.275929 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.275995 (+ 66us) service_pool.cc:225] Handling call
0318 02:51:37.876226 (+1600231us) ts_tablet_manager.cc:1151] Deleting tablet 91eba790375e4806a3f5766b6240d595
0318 02:51:37.876234 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.876298 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1600010}
I20260318 02:51:37.877363 752 tablet_service.cc:1511] Processing CreateTablet for tablet d6d25966360941b0bda4f56bc997eb41 (DEFAULT_TABLE table=default.Table_e837cc5b10674aed8a2ae1d5e66583ea [id=9ac6135aa75747d4a004cc742e579f09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.877559 759 tablet_service.cc:1511] Processing CreateTablet for tablet 033338a607b145e5bc34fc9281f13067 (DEFAULT_TABLE table=default.Table_3ce17f77cb5e4ecdba2110059be25eaf [id=15259430b1044aecb0f8a53847872709]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.877753 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d25966360941b0bda4f56bc997eb41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.878018 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 033338a607b145e5bc34fc9281f13067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.883397 748 tablet_service.cc:1511] Processing CreateTablet for tablet c44a07e379844d99be5edfcfa72c6e40 (DEFAULT_TABLE table=default.Table_30d193096882439e98bf7220e7a3931c [id=49a588ce2d0b48ed8a484787700303bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.884820 750 tablet_service.cc:1511] Processing CreateTablet for tablet bfdb59b3a53a447eab72947d1bbdb5bb (DEFAULT_TABLE table=default.Table_a88efa1088f340949c151592c569491c [id=2c35f5aa50e04fb0b8f9934479c119e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.884975 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 5fec974d146f44aeb72df483fa85b287 (table default.Table_167a79354e7844aabe2ae725df4f536c [id=095e4b55b1544007a032a984ba934743]) successfully deleted
I20260318 02:51:37.885234 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44a07e379844d99be5edfcfa72c6e40. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:37.888912 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 98101333a294447aa6df09c7fa62b565 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98101333a294447aa6df09c7fa62b565 already in progress: creating tablet
W20260318 02:51:37.889258 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2f04e5699531479d8b76edb0e2d2873c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f04e5699531479d8b76edb0e2d2873c already in progress: creating tablet
I20260318 02:51:37.889473 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_374dfe5a11944231bc786a2cb0c66a84" } modify_external_catalogs: true
I20260318 02:51:37.889482 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 1814c903ba4f456098f862e9490aa05e (DEFAULT_TABLE table=default.Table_f88018436952478cb888ea867404843c [id=33412846f2364daf9584573090bafa7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.889689 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_374dfe5a11944231bc786a2cb0c66a84" } modify_external_catalogs: true
I20260318 02:51:37.889899 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1814c903ba4f456098f862e9490aa05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.891068 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_21b4c184cd9f4bf4adc9c8ffa1d00c6c" } new_table_name: "default.Table_496f16dbb28a4f2d947c6f7d15d8ad9f" modify_external_catalogs: true
I20260318 02:51:37.892022 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdb59b3a53a447eab72947d1bbdb5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.892374 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5a24eb0c55044d40ae13fa4fcb40bfd7" } new_table_name: "default.Table_691a1be9c3854061ba5b3ce5ec5c6241" modify_external_catalogs: true
W20260318 02:51:37.889475 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet eb1a59d1153b41eb9d95b931ffafdd16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb1a59d1153b41eb9d95b931ffafdd16 already in progress: creating tablet
I20260318 02:51:37.893451 1038 tablet_service.cc:1511] Processing CreateTablet for tablet bfdb59b3a53a447eab72947d1bbdb5bb (DEFAULT_TABLE table=default.Table_a88efa1088f340949c151592c569491c [id=2c35f5aa50e04fb0b8f9934479c119e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.893704 1037 tablet_service.cc:1511] Processing CreateTablet for tablet d6d25966360941b0bda4f56bc997eb41 (DEFAULT_TABLE table=default.Table_e837cc5b10674aed8a2ae1d5e66583ea [id=9ac6135aa75747d4a004cc742e579f09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.893996 1042 tablet_service.cc:1511] Processing CreateTablet for tablet c44a07e379844d99be5edfcfa72c6e40 (DEFAULT_TABLE table=default.Table_30d193096882439e98bf7220e7a3931c [id=49a588ce2d0b48ed8a484787700303bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.894152 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 033338a607b145e5bc34fc9281f13067 (DEFAULT_TABLE table=default.Table_3ce17f77cb5e4ecdba2110059be25eaf [id=15259430b1044aecb0f8a53847872709]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:37.893749 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 91eba790375e4806a3f5766b6240d595 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91eba790375e4806a3f5766b6240d595 already in progress: creating tablet
I20260318 02:51:37.896170 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d781b2a57e354cbdbc41df2b3169d3af" } new_table_name: "default.Table_8960a5cf6bf54d6d8dd7cd71fd131e04" modify_external_catalogs: true
I20260318 02:51:37.896656 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce1bf41b33842ab9ade884ae84daf96 (DEFAULT_TABLE table=default.Table_eea6a27dda544c4288859e25ca97caef [id=61f0d92a9a6943588561fffb842cf408]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.897168 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdb59b3a53a447eab72947d1bbdb5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.897332 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44a07e379844d99be5edfcfa72c6e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.897491 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 033338a607b145e5bc34fc9281f13067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.898113 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d25966360941b0bda4f56bc997eb41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.902199 2257 raft_consensus.cc:493] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.902348 2257 raft_consensus.cc:515] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.902926 2257 leader_election.cc:290] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:37.905114 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bca965fb1ef843d4a883221da8fb427b" } modify_external_catalogs: true
I20260318 02:51:37.905329 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bca965fb1ef843d4a883221da8fb427b" } modify_external_catalogs: true
I20260318 02:51:37.909219 1172 ts_tablet_manager.cc:1403] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.082s user 0.003s sys 0.001s
I20260318 02:51:37.909866 1175 ts_tablet_manager.cc:1929] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:37.909973 1175 log.cc:1199] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/e57dbb1276114cd6b7d26f7167b99f25
I20260318 02:51:37.910009 1172 raft_consensus.cc:359] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.910156 1172 raft_consensus.cc:385] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:37.910203 1172 raft_consensus.cc:740] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:37.910243 1175 ts_tablet_manager.cc:1950] T e57dbb1276114cd6b7d26f7167b99f25 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:37.911425 891 tablet_service.cc:1511] Processing CreateTablet for tablet bfdb59b3a53a447eab72947d1bbdb5bb (DEFAULT_TABLE table=default.Table_a88efa1088f340949c151592c569491c [id=2c35f5aa50e04fb0b8f9934479c119e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.911783 453 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_8afbb1eafd5f4977bfffdfd764689b39 [id=f282f0ee83114539bad2c36e8311e05e] alter complete (version 2)
I20260318 02:51:37.912261 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_10f6937d0016448caceef24711896b5f" } new_table_name: "default.Table_1960d955ce3f45458d16f7f892da82fc" modify_external_catalogs: true
I20260318 02:51:37.903432 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49b066f27b43829c8f922649744303" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:37.913214 719 leader_election.cc:343] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.914148 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_505f7e2e2efb42adbd4093b77505b13c" } new_table_name: "default.Table_7a2639fca231445ab4c600a8b49ccc7c" modify_external_catalogs: true
I20260318 02:51:37.916337 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce1bf41b33842ab9ade884ae84daf96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.917603 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 60a4e38c14f84e6ba9d0402b62f7432c
I20260318 02:51:37.917752 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49b066f27b43829c8f922649744303" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:37.918352 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ad2b47d8b3d545b4ae86fb931e29cb85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.918929 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad2b47d8b3d545b4ae86fb931e29cb85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.920118 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdb59b3a53a447eab72947d1bbdb5bb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:37.920285 719 leader_election.cc:343] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.920408 719 leader_election.cc:304] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:37.920802 2257 raft_consensus.cc:2749] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:37.921070 903 tablet_service.cc:1511] Processing CreateTablet for tablet 1814c903ba4f456098f862e9490aa05e (DEFAULT_TABLE table=default.Table_f88018436952478cb888ea867404843c [id=33412846f2364daf9584573090bafa7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.921516 1172 consensus_queue.cc:260] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.922834 457 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet cf73a9f8f67b42d9baf1396d70a1a3a9 (table default.Table_c0889091422144f8af318ab6f38afd05 [id=75621b04db1d4c67bd2d2f5fe76c8a25]). Expected version 4 got 0
I20260318 02:51:37.924393 1172 ts_tablet_manager.cc:1434] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260318 02:51:37.925336 1172 tablet_bootstrap.cc:492] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:37.927317 897 tablet_service.cc:1511] Processing CreateTablet for tablet 033338a607b145e5bc34fc9281f13067 (DEFAULT_TABLE table=default.Table_3ce17f77cb5e4ecdba2110059be25eaf [id=15259430b1044aecb0f8a53847872709]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.927405 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 60a4e38c14f84e6ba9d0402b62f7432c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.927659 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 9aeb492564a94a569f70506712dad4ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.928232 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 033338a607b145e5bc34fc9281f13067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.928630 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1814c903ba4f456098f862e9490aa05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.928630 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 867) took 1779 ms. Trace:
I20260318 02:51:37.929348 1175 rpcz_store.cc:276] 0318 02:51:36.149400 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.149855 (+ 455us) service_pool.cc:225] Handling call
0318 02:51:37.574397 (+1424542us) ts_tablet_manager.cc:1151] Deleting tablet e57dbb1276114cd6b7d26f7167b99f25
0318 02:51:37.574407 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.651041 (+ 76634us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:37.909769 (+258728us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:37.928614 (+ 18845us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1424426}
I20260318 02:51:37.929741 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 868) took 1738 ms. Trace:
I20260318 02:51:37.926668 2152 raft_consensus.cc:493] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.929812 1175 rpcz_store.cc:276] 0318 02:51:36.191235 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.191290 (+ 55us) service_pool.cc:225] Handling call
0318 02:51:37.929621 (+1738331us) ts_tablet_manager.cc:1151] Deleting tablet 98101333a294447aa6df09c7fa62b565
0318 02:51:37.929630 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.929728 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1738157}
I20260318 02:51:37.929986 2152 raft_consensus.cc:515] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.930091 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 869) took 1732 ms. Trace:
I20260318 02:51:37.930151 1175 rpcz_store.cc:276] 0318 02:51:36.197502 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.197554 (+ 52us) service_pool.cc:225] Handling call
0318 02:51:37.930008 (+1732454us) ts_tablet_manager.cc:1151] Deleting tablet 2f04e5699531479d8b76edb0e2d2873c
0318 02:51:37.930015 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.930079 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1732289}
I20260318 02:51:37.930416 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 870) took 1666 ms. Trace:
I20260318 02:51:37.930480 1175 rpcz_store.cc:276] 0318 02:51:36.264021 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.264073 (+ 52us) service_pool.cc:225] Handling call
0318 02:51:37.930334 (+1666261us) ts_tablet_manager.cc:1151] Deleting tablet eb1a59d1153b41eb9d95b931ffafdd16
0318 02:51:37.930342 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.930406 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1666051}
I20260318 02:51:37.930608 2152 leader_election.cc:290] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:37.930743 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 871) took 1655 ms. Trace:
I20260318 02:51:37.930809 1175 rpcz_store.cc:276] 0318 02:51:36.274981 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.275036 (+ 55us) service_pool.cc:225] Handling call
0318 02:51:37.930665 (+1655629us) ts_tablet_manager.cc:1151] Deleting tablet ec96b885e9604bba9d425c3e3e3f61e6
0318 02:51:37.930672 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.930730 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1655435}
I20260318 02:51:37.931046 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 872) took 1655 ms. Trace:
I20260318 02:51:37.931094 1175 rpcz_store.cc:276] 0318 02:51:36.275081 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.275245 (+ 164us) service_pool.cc:225] Handling call
0318 02:51:37.930972 (+1655727us) ts_tablet_manager.cc:1151] Deleting tablet 91eba790375e4806a3f5766b6240d595
0318 02:51:37.930979 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.931036 (+ 57us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1655579}
I20260318 02:51:37.931270 1175 tablet_replica.cc:333] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:37.931205 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7b339a29ef456997d74a7a95d4c03a" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:37.931382 784 raft_consensus.cc:2468] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:37.931421 1175 raft_consensus.cc:2243] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:37.931553 1175 raft_consensus.cc:2272] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:37.931780 999 leader_election.cc:304] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:37.932013 2152 raft_consensus.cc:2804] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:37.932058 1175 ts_tablet_manager.cc:1916] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:37.932073 2152 raft_consensus.cc:493] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:37.932128 2152 raft_consensus.cc:3060] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:37.933917 1172 tablet_bootstrap.cc:654] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:37.936456 1176 ts_tablet_manager.cc:1916] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:37.937623 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6749e2f6c9fe469eb76b07916189d7f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.938302 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6749e2f6c9fe469eb76b07916189d7f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.940235 899 tablet_service.cc:1511] Processing CreateTablet for tablet d6d25966360941b0bda4f56bc997eb41 (DEFAULT_TABLE table=default.Table_e837cc5b10674aed8a2ae1d5e66583ea [id=9ac6135aa75747d4a004cc742e579f09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.942116 2257 raft_consensus.cc:493] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:37.942260 2257 raft_consensus.cc:515] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.942952 2257 leader_election.cc:290] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:37.943589 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2bc2f79e8b49248de3e7eca1a600cf" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:37.944087 719 leader_election.cc:343] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:37.948876 761 tablet_service.cc:1511] Processing CreateTablet for tablet b7b90c22ebd147cb830241c19efc970b (DEFAULT_TABLE table=default.Table_6028370af35b46788e9e169af0e6eaf0 [id=38d26430ad99420d8ec0d922cceeea19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.949288 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7b90c22ebd147cb830241c19efc970b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.953909 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7b339a29ef456997d74a7a95d4c03a" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:37.955323 907 tablet_service.cc:1511] Processing CreateTablet for tablet c44a07e379844d99be5edfcfa72c6e40 (DEFAULT_TABLE table=default.Table_30d193096882439e98bf7220e7a3931c [id=49a588ce2d0b48ed8a484787700303bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.956379 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d25966360941b0bda4f56bc997eb41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.958119 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet e57dbb1276114cd6b7d26f7167b99f25 (table default.Table_9c0322ee5c694253958b5d9583c3708e [id=34553220f38c4ffd99cf61e1679bdb81]) successfully deleted
I20260318 02:51:37.958143 904 tablet_service.cc:1511] Processing CreateTablet for tablet b7b90c22ebd147cb830241c19efc970b (DEFAULT_TABLE table=default.Table_6028370af35b46788e9e169af0e6eaf0 [id=38d26430ad99420d8ec0d922cceeea19]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:37.958639 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 98101333a294447aa6df09c7fa62b565 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98101333a294447aa6df09c7fa62b565 already in progress: creating tablet
W20260318 02:51:37.958923 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2f04e5699531479d8b76edb0e2d2873c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f04e5699531479d8b76edb0e2d2873c already in progress: creating tablet
W20260318 02:51:37.959157 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet eb1a59d1153b41eb9d95b931ffafdd16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb1a59d1153b41eb9d95b931ffafdd16 already in progress: creating tablet
W20260318 02:51:37.959398 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet ec96b885e9604bba9d425c3e3e3f61e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec96b885e9604bba9d425c3e3e3f61e6 already in progress: creating tablet
W20260318 02:51:37.959630 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 91eba790375e4806a3f5766b6240d595 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91eba790375e4806a3f5766b6240d595 already in progress: creating tablet
I20260318 02:51:37.962800 1175 ts_tablet_manager.cc:1929] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:37.963975 1175 log.cc:1199] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/f04f057571584d31b1821e690ae7c75c
I20260318 02:51:37.964548 1175 ts_tablet_manager.cc:1950] T f04f057571584d31b1821e690ae7c75c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:37.968355 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 60a4e38c14f84e6ba9d0402b62f7432c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:37.970089 892 tablet_service.cc:1558] Processing DeleteTablet for tablet dea25aaad60a4b2483a8832f995d1316 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:37.971575 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b9a6d8d743a742a4b2d19b85e59101cb
I20260318 02:51:37.973278 750 tablet_service.cc:1558] Processing DeleteTablet for tablet b9a6d8d743a742a4b2d19b85e59101cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.977618 750 tablet_service.cc:1511] Processing CreateTablet for tablet 1f7cf608f75e43fea8a677ebd3513d3a (DEFAULT_TABLE table=default.Table_1cb89d002f144726af0a65edb1c8dd5f [id=173de5871eb84d0ea1c99438ead957b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.978080 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f7cf608f75e43fea8a677ebd3513d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.978694 748 tablet_service.cc:1511] Processing CreateTablet for tablet 6db7c0af51e5456aab670c482776032e (DEFAULT_TABLE table=default.Table_cbaf13713d824c0499eb869fe995c520 [id=7a203c4956ab453498d64a0da2c132a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:37.979075 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6db7c0af51e5456aab670c482776032e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.979509 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0e9f3984919d46a99af1eb866bcb9394"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:37.980135 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e9f3984919d46a99af1eb866bcb9394 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:37.985006 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7b90c22ebd147cb830241c19efc970b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.986490 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c44a07e379844d99be5edfcfa72c6e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:37.987406 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 60dedba077d34435b30061bfba737412
I20260318 02:51:37.988049 456 master_service.cc:954] ReplaceTablet: received request to replace tablet 9d9cc0f3aef0401c8f072b11d9498a59 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:37.989377 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 60dedba077d34435b30061bfba737412 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:37.991789 1174 tablet_bootstrap.cc:492] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:37.992673 1173 tablet_bootstrap.cc:492] T 9a5afc5611d3481e9a6d48381dc67e86 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:37.992841 1173 ts_tablet_manager.cc:1403] T 9a5afc5611d3481e9a6d48381dc67e86 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.380s user 0.009s sys 0.003s
I20260318 02:51:37.993727 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 873) took 1718 ms. Trace:
I20260318 02:51:37.993845 1175 rpcz_store.cc:276] 0318 02:51:36.275195 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.275434 (+ 239us) service_pool.cc:225] Handling call
0318 02:51:37.931238 (+1655804us) ts_tablet_manager.cc:1151] Deleting tablet f04f057571584d31b1821e690ae7c75c
0318 02:51:37.931244 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.934991 (+ 3747us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:37.962694 (+ 27703us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:37.993713 (+ 31019us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1655675}
I20260318 02:51:37.994367 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 876) took 1589 ms. Trace:
I20260318 02:51:37.994458 1175 rpcz_store.cc:276] 0318 02:51:36.405082 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.405162 (+ 80us) service_pool.cc:225] Handling call
0318 02:51:37.994249 (+1589087us) ts_tablet_manager.cc:1151] Deleting tablet 4ff090fadc6b47d6ba551dc59d4dad2c
0318 02:51:37.994259 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.994353 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1588894}
I20260318 02:51:37.994834 1175 tablet_replica.cc:333] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:37.995050 1175 raft_consensus.cc:2243] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:37.995244 1175 raft_consensus.cc:2272] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:37.995795 1175 ts_tablet_manager.cc:1916] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:38.000550 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cb29fd9d6fc845b2aaffe34c290fd5ca consensus state has no leader
I20260318 02:51:38.003219 1173 raft_consensus.cc:359] T 9a5afc5611d3481e9a6d48381dc67e86 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.003477 1173 raft_consensus.cc:385] T 9a5afc5611d3481e9a6d48381dc67e86 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.003549 1173 raft_consensus.cc:740] T 9a5afc5611d3481e9a6d48381dc67e86 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.004055 891 tablet_service.cc:1558] Processing DeleteTablet for tablet b9a6d8d743a742a4b2d19b85e59101cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:38.005115 1173 consensus_queue.cc:260] T 9a5afc5611d3481e9a6d48381dc67e86 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.005803 1173 ts_tablet_manager.cc:1434] T 9a5afc5611d3481e9a6d48381dc67e86 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260318 02:51:38.006143 1173 tablet_bootstrap.cc:492] T 27fc03c90b584becb250546100af736c P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:38.009943 1174 tablet_bootstrap.cc:654] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.014714 891 tablet_service.cc:1511] Processing CreateTablet for tablet 1f7cf608f75e43fea8a677ebd3513d3a (DEFAULT_TABLE table=default.Table_1cb89d002f144726af0a65edb1c8dd5f [id=173de5871eb84d0ea1c99438ead957b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.015098 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f7cf608f75e43fea8a677ebd3513d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.019224 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet f04f057571584d31b1821e690ae7c75c (table default.Table_62dcfd8adef34929a08c11dfcf174ff7 [id=4a0a65332f00440f87102e8ebab708cd]) successfully deleted
I20260318 02:51:38.020205 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5df5e722b3b94721baa220f851b91d81" } modify_external_catalogs: true
I20260318 02:51:38.020421 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5df5e722b3b94721baa220f851b91d81" } modify_external_catalogs: true
I20260318 02:51:38.021216 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 60dedba077d34435b30061bfba737412 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:38.021693 1173 tablet_bootstrap.cc:654] T 27fc03c90b584becb250546100af736c P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.022153 907 tablet_service.cc:1511] Processing CreateTablet for tablet 6db7c0af51e5456aab670c482776032e (DEFAULT_TABLE table=default.Table_cbaf13713d824c0499eb869fe995c520 [id=7a203c4956ab453498d64a0da2c132a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.022619 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6db7c0af51e5456aab670c482776032e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.022961 1175 ts_tablet_manager.cc:1929] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:37.934876 2152 raft_consensus.cc:515] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:37.876665 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 891) took 1600 ms. Trace:
I20260318 02:51:37.944568 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2bc2f79e8b49248de3e7eca1a600cf" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:37.946461 2151 consensus_queue.cc:1048] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:37.948315 2149 raft_consensus.cc:493] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:38.029650 2149 raft_consensus.cc:515] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.030258 2149 leader_election.cc:290] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:38.029058 1184 rpcz_store.cc:276] 0318 02:51:36.275803 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.276202 (+ 399us) service_pool.cc:225] Handling call
0318 02:51:37.876572 (+1600370us) ts_tablet_manager.cc:1151] Deleting tablet ec96b885e9604bba9d425c3e3e3f61e6
0318 02:51:37.876580 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:37.876651 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1600229}
I20260318 02:51:38.039193 1175 log.cc:1199] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/24c66e2cc96f458fb3279827cea4ca9e
I20260318 02:51:38.039688 1175 ts_tablet_manager.cc:1950] T 24c66e2cc96f458fb3279827cea4ca9e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:38.040207 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 879) took 1493 ms. Trace:
I20260318 02:51:38.041913 1184 tablet_replica.cc:333] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:38.042124 1184 raft_consensus.cc:2243] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.042263 1175 rpcz_store.cc:276] 0318 02:51:36.546993 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.547424 (+ 431us) service_pool.cc:225] Handling call
0318 02:51:37.994790 (+1447366us) ts_tablet_manager.cc:1151] Deleting tablet 24c66e2cc96f458fb3279827cea4ca9e
0318 02:51:37.994799 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.016298 (+ 21499us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.022856 (+ 6558us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.040190 (+ 17334us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1447186}
I20260318 02:51:38.042443 1184 raft_consensus.cc:2272] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.042994 1184 ts_tablet_manager.cc:1916] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.044895 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 880) took 1496 ms. Trace:
I20260318 02:51:38.045092 1175 rpcz_store.cc:276] 0318 02:51:36.548271 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.548323 (+ 52us) service_pool.cc:225] Handling call
0318 02:51:38.043013 (+1494690us) ts_tablet_manager.cc:1151] Deleting tablet b317cc133346412fb981b1c8e5b99c4d
0318 02:51:38.043025 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.044866 (+ 1841us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1494519}
I20260318 02:51:38.045547 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 882) took 1478 ms. Trace:
I20260318 02:51:38.045719 1175 rpcz_store.cc:276] 0318 02:51:36.567433 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.567493 (+ 60us) service_pool.cc:225] Handling call
0318 02:51:38.045426 (+1477933us) ts_tablet_manager.cc:1151] Deleting tablet a4918d7f2f2645e88b7f3e1d52926fb1
0318 02:51:38.045437 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.045532 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1477663}
I20260318 02:51:38.046011 1175 tablet_replica.cc:333] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:38.046224 1175 raft_consensus.cc:2243] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.046407 1175 raft_consensus.cc:2272] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.047456 1175 ts_tablet_manager.cc:1916] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.048668 1172 tablet_bootstrap.cc:492] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:38.052865 1172 ts_tablet_manager.cc:1403] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.128s user 0.002s sys 0.002s
I20260318 02:51:38.053627 1172 raft_consensus.cc:359] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.054644 1172 raft_consensus.cc:385] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.055599 1172 raft_consensus.cc:740] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.055862 1172 consensus_queue.cc:260] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:38.057112 997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 101472us
W20260318 02:51:38.057605 997 leader_election.cc:343] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:38.058437 997 consensus_peers.cc:597] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:38.058555 1172 ts_tablet_manager.cc:1434] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260318 02:51:38.062934 1172 tablet_bootstrap.cc:492] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:38.063059 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7b339a29ef456997d74a7a95d4c03a" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:38.064652 1172 tablet_bootstrap.cc:654] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.067473 1175 ts_tablet_manager.cc:1929] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.060173 2152 leader_election.cc:290] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:38.059437 1184 ts_tablet_manager.cc:1929] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.067845 1184 log.cc:1199] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/b8a46b4db30a48c99addf763f7edfb16
I20260318 02:51:38.068176 1184 ts_tablet_manager.cc:1950] T b8a46b4db30a48c99addf763f7edfb16 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:38.069572 2151 raft_consensus.cc:493] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260318 02:51:38.069640 719 leader_election.cc:343] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.069765 719 leader_election.cc:304] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:38.069697 2151 raft_consensus.cc:515] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.069825 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 894) took 1793 ms. Trace:
I20260318 02:51:38.069891 1184 rpcz_store.cc:276] 0318 02:51:36.276128 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.276253 (+ 125us) service_pool.cc:225] Handling call
0318 02:51:38.031660 (+1755407us) ts_tablet_manager.cc:1151] Deleting tablet b8a46b4db30a48c99addf763f7edfb16
0318 02:51:38.041859 (+ 10199us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.046102 (+ 4243us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.059264 (+ 13162us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.069807 (+ 10543us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1755265}
I20260318 02:51:38.070119 2257 raft_consensus.cc:2749] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:38.070174 1184 tablet_replica.cc:333] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:38.070223 2151 leader_election.cc:290] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:38.070370 1184 raft_consensus.cc:2243] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.070493 1184 raft_consensus.cc:2272] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:38.071838 997 leader_election.cc:343] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.072467 1027 tablet_service.cc:1511] Processing CreateTablet for tablet b7b90c22ebd147cb830241c19efc970b (DEFAULT_TABLE table=default.Table_6028370af35b46788e9e169af0e6eaf0 [id=38d26430ad99420d8ec0d922cceeea19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.072597 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet b9a6d8d743a742a4b2d19b85e59101cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.072949 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7b90c22ebd147cb830241c19efc970b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.073644 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 60a4e38c14f84e6ba9d0402b62f7432c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.072130 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 60dedba077d34435b30061bfba737412 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.077437 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 6db7c0af51e5456aab670c482776032e (DEFAULT_TABLE table=default.Table_cbaf13713d824c0499eb869fe995c520 [id=7a203c4956ab453498d64a0da2c132a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.078065 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6db7c0af51e5456aab670c482776032e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.082758 1184 ts_tablet_manager.cc:1916] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.083248 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 1f7cf608f75e43fea8a677ebd3513d3a (DEFAULT_TABLE table=default.Table_1cb89d002f144726af0a65edb1c8dd5f [id=173de5871eb84d0ea1c99438ead957b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.083673 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f7cf608f75e43fea8a677ebd3513d3a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:38.086318 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet ec96b885e9604bba9d425c3e3e3f61e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec96b885e9604bba9d425c3e3e3f61e6 already in progress: creating tablet
I20260318 02:51:38.088488 2152 raft_consensus.cc:493] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:38.072402 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet e916c5419e3c457f98a47c6a1c6cdd56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.088649 2152 raft_consensus.cc:515] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.089207 2152 leader_election.cc:290] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:38.081339 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4ed28b9a7f2471aa4ed7cd2e1efda1a" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:38.089659 1175 log.cc:1199] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/a20b9dc70b5147ff8798946eda3131ca
I20260318 02:51:38.081648 927 raft_consensus.cc:3060] T 9a5afc5611d3481e9a6d48381dc67e86 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:38.090066 1175 ts_tablet_manager.cc:1950] T a20b9dc70b5147ff8798946eda3131ca P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:38.090448 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 883) took 1513 ms. Trace:
I20260318 02:51:38.090572 1175 rpcz_store.cc:276] 0318 02:51:36.576672 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.576753 (+ 81us) service_pool.cc:225] Handling call
0318 02:51:38.045964 (+1469211us) ts_tablet_manager.cc:1151] Deleting tablet a20b9dc70b5147ff8798946eda3131ca
0318 02:51:38.045974 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.059793 (+ 13819us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.067359 (+ 7566us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.090431 (+ 23072us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1469014}
I20260318 02:51:38.091004 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 878) took 1568 ms. Trace:
I20260318 02:51:38.091097 1175 rpcz_store.cc:276] 0318 02:51:36.522414 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.522775 (+ 361us) service_pool.cc:225] Handling call
0318 02:51:38.090895 (+1568120us) ts_tablet_manager.cc:1151] Deleting tablet e5641e430b0a4ddf9e1111f834246755
0318 02:51:38.090903 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.090990 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1487204}
I20260318 02:51:38.091425 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 888) took 1295 ms. Trace:
I20260318 02:51:38.091575 1175 rpcz_store.cc:276] 0318 02:51:36.795646 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.795701 (+ 55us) service_pool.cc:225] Handling call
0318 02:51:38.091335 (+1295634us) ts_tablet_manager.cc:1151] Deleting tablet e85d612871014dc2bd9139adcbe639d2
0318 02:51:38.091344 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.091414 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1295443}
I20260318 02:51:38.092378 1172 tablet_bootstrap.cc:492] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:38.092561 1172 ts_tablet_manager.cc:1403] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.000s
I20260318 02:51:38.093305 1172 raft_consensus.cc:359] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.093497 1172 raft_consensus.cc:385] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.093565 1172 raft_consensus.cc:740] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.093791 1172 consensus_queue.cc:260] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.094503 1172 ts_tablet_manager.cc:1434] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260318 02:51:38.094924 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 889) took 1298 ms. Trace:
I20260318 02:51:38.095036 1175 rpcz_store.cc:276] 0318 02:51:36.796548 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.796598 (+ 50us) service_pool.cc:225] Handling call
0318 02:51:38.094764 (+1298166us) ts_tablet_manager.cc:1151] Deleting tablet f95ebc89fd2545b1835a1bc10414248d
0318 02:51:38.094777 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.094902 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1297943}
I20260318 02:51:38.095373 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 890) took 1298 ms. Trace:
I20260318 02:51:38.095510 1175 rpcz_store.cc:276] 0318 02:51:36.797326 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.797371 (+ 45us) service_pool.cc:225] Handling call
0318 02:51:38.095285 (+1297914us) ts_tablet_manager.cc:1151] Deleting tablet fcbaf43f3ccc48a2b7f09d04c2da060d
0318 02:51:38.095292 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.095361 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1297767}
I20260318 02:51:38.099058 1184 ts_tablet_manager.cc:1929] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.099500 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 892) took 1234 ms. Trace:
I20260318 02:51:38.099622 1175 rpcz_store.cc:276] 0318 02:51:36.865341 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.865396 (+ 55us) service_pool.cc:225] Handling call
0318 02:51:38.099359 (+1233963us) ts_tablet_manager.cc:1151] Deleting tablet 8c1ba16db9d040708f8fd75c852bdbb1
0318 02:51:38.099370 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.099477 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1233790}
I20260318 02:51:38.099924 1175 tablet_replica.cc:333] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:38.100139 1175 raft_consensus.cc:2243] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.100317 1175 raft_consensus.cc:2272] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.100924 1175 ts_tablet_manager.cc:1916] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.101300 1176 ts_tablet_manager.cc:1929] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.101532 1176 log.cc:1199] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/b8973d8930ef4b65be7b4ff990bf9d72
I20260318 02:51:38.102111 1176 ts_tablet_manager.cc:1950] T b8973d8930ef4b65be7b4ff990bf9d72 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:38.103049 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet b8973d8930ef4b65be7b4ff990bf9d72 (table default.Table_9f269c4844cc473580c4743dd9be3dea [id=997461446ec8473382964afdb61aafb3]) successfully deleted
W20260318 02:51:38.103734 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 1d2c64dc7c0b479494ca474dad51a528 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d2c64dc7c0b479494ca474dad51a528 already in progress: creating tablet
W20260318 02:51:38.104261 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 98ac6bdd852d468ba6821af6c85bfd19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98ac6bdd852d468ba6821af6c85bfd19 already in progress: creating tablet
I20260318 02:51:38.104696 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7b339a29ef456997d74a7a95d4c03a" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:38.104923 783 raft_consensus.cc:3060] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:38.105294 1184 log.cc:1199] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/900c6ef2dc634a788239dd5b77c4bde0
I20260318 02:51:38.105628 1184 ts_tablet_manager.cc:1950] T 900c6ef2dc634a788239dd5b77c4bde0 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:38.107527 783 raft_consensus.cc:2468] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:38.108153 1175 ts_tablet_manager.cc:1929] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.108289 1175 log.cc:1199] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/b716c3a80d4a44d190de38f926098efc
I20260318 02:51:38.108553 1175 ts_tablet_manager.cc:1950] T b716c3a80d4a44d190de38f926098efc P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:38.108985 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 896) took 1090 ms. Trace:
I20260318 02:51:38.109077 1175 rpcz_store.cc:276] 0318 02:51:37.018996 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.019061 (+ 65us) service_pool.cc:225] Handling call
0318 02:51:38.099876 (+1080815us) ts_tablet_manager.cc:1151] Deleting tablet b716c3a80d4a44d190de38f926098efc
0318 02:51:38.099885 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.104001 (+ 4116us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.107923 (+ 3922us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.108965 (+ 1042us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1080610}
I20260318 02:51:38.109745 1175 tablet_replica.cc:333] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:38.109880 783 raft_consensus.cc:1275] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Refusing update from remote peer 9422bb7011f342b08be0b073a88c4c4d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:38.109952 1175 raft_consensus.cc:2243] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.110150 1175 raft_consensus.cc:2272] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.110761 1175 ts_tablet_manager.cc:1916] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.115077 1172 tablet_bootstrap.cc:492] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:38.116110 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 893) took 1840 ms. Trace:
I20260318 02:51:38.116225 1184 rpcz_store.cc:276] 0318 02:51:36.276020 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.276383 (+ 363us) service_pool.cc:225] Handling call
0318 02:51:38.070129 (+1793746us) ts_tablet_manager.cc:1151] Deleting tablet 900c6ef2dc634a788239dd5b77c4bde0
0318 02:51:38.070139 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.095967 (+ 25828us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.098949 (+ 2982us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.116086 (+ 17137us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1793619}
I20260318 02:51:38.116565 1184 tablet_replica.cc:333] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:38.116782 1184 raft_consensus.cc:2243] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.117074 1184 raft_consensus.cc:2272] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.117136 1172 tablet_bootstrap.cc:654] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.120007 1176 tablet_replica.cc:333] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:38.120229 1176 raft_consensus.cc:2243] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.120405 1176 raft_consensus.cc:2272] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:38.121834 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 243a2f81711f4712ab21c8ae5bdc94a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 243a2f81711f4712ab21c8ae5bdc94a8 already in progress: creating tablet
I20260318 02:51:38.122761 1184 ts_tablet_manager.cc:1916] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.126613 1176 ts_tablet_manager.cc:1916] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.130259 2257 raft_consensus.cc:493] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:38.130432 2257 raft_consensus.cc:515] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:38.130940 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 373a94164167431c87025ce82c9b88d9 consensus state has no leader
I20260318 02:51:38.131105 2257 leader_election.cc:290] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:38.131946 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf73a9f8f67b42d9baf1396d70a1a3a9" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:38.132527 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet ecb2289a6bcd4b8ca6c3810b7d615bce
W20260318 02:51:38.132858 719 leader_election.cc:343] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:38.133292 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a90be200678468eaa8c57b843521440 consensus state has no leader
I20260318 02:51:38.133738 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_233c7a1c8f824e23a0e1e965241fb7c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:38.134663 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_233c7a1c8f824e23a0e1e965241fb7c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:38.136195 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0a8ce5b5e5574dd0953d8cfb836bc898"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:38.137120 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a8ce5b5e5574dd0953d8cfb836bc898 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:38.138782 761 tablet_service.cc:1558] Processing DeleteTablet for tablet ecb2289a6bcd4b8ca6c3810b7d615bce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:38.139353 441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.104.131:37025, user_credentials={real_user=slave}} blocked reactor thread for 48676.6us
I20260318 02:51:38.143754 1174 tablet_bootstrap.cc:492] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:38.146239 1174 ts_tablet_manager.cc:1403] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.155s user 0.004s sys 0.001s
I20260318 02:51:38.148334 1174 raft_consensus.cc:359] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.148636 1184 ts_tablet_manager.cc:1929] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.148777 1184 log.cc:1199] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/785f6728f94d41f3997961e3d1ebee34
I20260318 02:51:38.148814 1174 raft_consensus.cc:385] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.149044 1174 raft_consensus.cc:740] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.149379 2257 raft_consensus.cc:493] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:38.149487 2257 raft_consensus.cc:515] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.150059 2257 leader_election.cc:290] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:38.150712 1176 ts_tablet_manager.cc:1929] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.150738 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0f0cd89234e72a052f3f9f964aa35" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:38.151293 719 leader_election.cc:343] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:38.118177 999 leader_election.cc:343] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: b4ed28b9a7f2471aa4ed7cd2e1efda1a
I20260318 02:51:38.149492 1174 consensus_queue.cc:260] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:38.153676 999 consensus_peers.cc:597] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d -> Peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Couldn't send request to peer 6a903d876086423b8016d705b98895ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab158343adb14eab85c595fa5405145d. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:38.155167 999 leader_election.cc:304] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:38.155534 452 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet b383fd49049c4c1daba3f1ed60899f3e (table default.Table_5ed9c43cfcf94d058b59ec604059817b [id=fc9e568fb3884c3ca8575e591393560e]). Expected version 2 got 0
I20260318 02:51:38.154315 1184 ts_tablet_manager.cc:1950] T 785f6728f94d41f3997961e3d1ebee34 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:38.158628 2297 raft_consensus.cc:2804] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:38.158849 2297 raft_consensus.cc:697] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:38.159092 2297 consensus_queue.cc:237] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.165079 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c0d87304c41481299f1e2ddfdfcfdec" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:38.166550 997 leader_election.cc:343] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.166667 997 leader_election.cc:304] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:38.167088 2296 raft_consensus.cc:2749] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:38.167145 997 consensus_peers.cc:597] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:38.158675 1174 ts_tablet_manager.cc:1434] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
W20260318 02:51:38.167358 997 consensus_peers.cc:597] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:38.167285 1176 log.cc:1199] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/de2bc2f79e8b49248de3e7eca1a600cf
W20260318 02:51:38.167507 997 leader_election.cc:343] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.167757 1176 ts_tablet_manager.cc:1950] T de2bc2f79e8b49248de3e7eca1a600cf P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
W20260318 02:51:38.168143 999 leader_election.cc:343] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 7c0d87304c41481299f1e2ddfdfcfdec
I20260318 02:51:38.168746 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a6983dce4e476cae97b3ecb1133077" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:38.168844 999 leader_election.cc:304] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:38.172124 2296 raft_consensus.cc:2749] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:38.168744 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 895) took 1793 ms. Trace:
I20260318 02:51:38.172744 1184 rpcz_store.cc:276] 0318 02:51:36.375158 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.375217 (+ 59us) service_pool.cc:225] Handling call
0318 02:51:38.116513 (+1741296us) ts_tablet_manager.cc:1151] Deleting tablet 785f6728f94d41f3997961e3d1ebee34
0318 02:51:38.116524 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.127993 (+ 11469us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.148514 (+ 20521us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.168694 (+ 20180us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9874,"tablet-delete.queue_time_us":1741115}
I20260318 02:51:38.173341 2296 consensus_queue.cc:1048] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:38.174198 1184 tablet_replica.cc:333] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:38.175341 1184 raft_consensus.cc:2243] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.175588 1184 raft_consensus.cc:2272] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.177627 1174 tablet_bootstrap.cc:492] T 46ce65cca47f48db94e70226494cfbae P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:38.178369 1184 ts_tablet_manager.cc:1916] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:38.173569 999 leader_election.cc:343] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 42a6983dce4e476cae97b3ecb1133077
W20260318 02:51:38.182758 997 leader_election.cc:343] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.182983 997 leader_election.cc:304] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:38.183472 2296 raft_consensus.cc:2749] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:38.177810 1172 tablet_bootstrap.cc:492] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:38.183907 1172 ts_tablet_manager.cc:1403] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.008s
I20260318 02:51:38.184665 1172 raft_consensus.cc:359] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.184954 1172 raft_consensus.cc:385] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.185050 1172 raft_consensus.cc:740] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.185333 1172 consensus_queue.cc:260] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.185555 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet de2bc2f79e8b49248de3e7eca1a600cf (table default.Table_28ea1894a58c438785ae9e4b8b414447 [id=b71fc31bca0a449296c3e0a0b8ceb6e6]) successfully deleted
I20260318 02:51:38.186040 1172 ts_tablet_manager.cc:1434] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:38.188937 1172 tablet_bootstrap.cc:492] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:38.190068 1175 ts_tablet_manager.cc:1929] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:38.190256 1175 log.cc:1199] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/104cd36774df4bc0adf1d449224304d5
I20260318 02:51:38.190626 1175 ts_tablet_manager.cc:1950] T 104cd36774df4bc0adf1d449224304d5 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:38.190963 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 900) took 1066 ms. Trace:
I20260318 02:51:38.191040 1172 tablet_bootstrap.cc:654] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.191097 1175 rpcz_store.cc:276] 0318 02:51:37.124451 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.124973 (+ 522us) service_pool.cc:225] Handling call
0318 02:51:38.109706 (+984733us) ts_tablet_manager.cc:1151] Deleting tablet 104cd36774df4bc0adf1d449224304d5
0318 02:51:38.109712 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.162627 (+ 52915us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.189953 (+ 27326us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.190944 (+ 991us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":984497}
I20260318 02:51:38.191841 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 901) took 1026 ms. Trace:
I20260318 02:51:38.191968 1175 rpcz_store.cc:276] 0318 02:51:37.165354 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.165424 (+ 70us) service_pool.cc:225] Handling call
0318 02:51:38.191720 (+1026296us) ts_tablet_manager.cc:1151] Deleting tablet 9f274ae7a6834ca98f01575fcf8b161e
0318 02:51:38.191730 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.191825 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1026038}
I20260318 02:51:38.192451 1175 tablet_replica.cc:333] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:38.192678 1175 raft_consensus.cc:2243] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.192924 1175 raft_consensus.cc:2272] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.193509 1175 ts_tablet_manager.cc:1916] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.194211 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet b8a46b4db30a48c99addf763f7edfb16 (table default.Table_25494285095147fa885f1aa79e2f1722 [id=6f9a87f338414f20bb3969d3c3cdfa64]) successfully deleted
I20260318 02:51:38.194901 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 900c6ef2dc634a788239dd5b77c4bde0 (table default.Table_c2d16f88924544cbaf4ed64b9c5bc7a6 [id=8749d9c9086f43a99348c9bfe995e6e6]) successfully deleted
I20260318 02:51:38.197216 1176 tablet_replica.cc:333] T 5ff188f25ff146fab121ebfab1af8467 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:38.197484 1176 raft_consensus.cc:2243] T 5ff188f25ff146fab121ebfab1af8467 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:38.189354 999 consensus_peers.cc:597] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d -> Peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Couldn't send request to peer 6a903d876086423b8016d705b98895ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 104cd36774df4bc0adf1d449224304d5. This is attempt 1: this message will repeat every 5th retry.
W20260318 02:51:38.198887 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f37ab96f13444fcbb5cfc3ad92d53c35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f37ab96f13444fcbb5cfc3ad92d53c35 already in progress: creating tablet
I20260318 02:51:38.200106 453 catalog_manager.cc:5671] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:38.201826 1176 raft_consensus.cc:2272] T 5ff188f25ff146fab121ebfab1af8467 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.202440 1176 ts_tablet_manager.cc:1916] T 5ff188f25ff146fab121ebfab1af8467 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.206007 1173 tablet_bootstrap.cc:492] T 27fc03c90b584becb250546100af736c P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:38.206171 1173 ts_tablet_manager.cc:1403] T 27fc03c90b584becb250546100af736c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.200s user 0.011s sys 0.003s
I20260318 02:51:38.206970 1173 raft_consensus.cc:359] T 27fc03c90b584becb250546100af736c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.207126 1173 raft_consensus.cc:385] T 27fc03c90b584becb250546100af736c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.207175 1173 raft_consensus.cc:740] T 27fc03c90b584becb250546100af736c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.214252 1175 ts_tablet_manager.cc:1929] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260318 02:51:38.220232 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d26c7c573c40412f88b9c6cc71a3c648 consensus state has no leader
I20260318 02:51:38.220115 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 785f6728f94d41f3997961e3d1ebee34 (table default.Table_496e7d616c09464a884078334d256839 [id=f6fae39c375b41e096459fe397b69b72]) successfully deleted
I20260318 02:51:38.220511 1175 log.cc:1199] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/65c50b0813b04f30896568ab2b680ba8
I20260318 02:51:38.221297 453 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 3d7b339a29ef456997d74a7a95d4c03a (table default.Table_2999327e014d4062a8e1aef2ba9ee277 [id=545ec19ee7a34ceb8e7adb93b6eaecf8]). Expected version 2 got 0
I20260318 02:51:38.222076 1175 ts_tablet_manager.cc:1950] T 65c50b0813b04f30896568ab2b680ba8 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:38.222496 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 902) took 1027 ms. Trace:
I20260318 02:51:38.224102 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e34ab505a4f642708008eb59ce02b5b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:38.224458 1175 rpcz_store.cc:276] 0318 02:51:37.195670 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.195731 (+ 61us) service_pool.cc:225] Handling call
0318 02:51:38.192404 (+996673us) ts_tablet_manager.cc:1151] Deleting tablet 65c50b0813b04f30896568ab2b680ba8
0318 02:51:38.192414 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.199129 (+ 6715us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.214101 (+ 14972us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.222479 (+ 8378us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":996470}
W20260318 02:51:38.224843 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e34ab505a4f642708008eb59ce02b5b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:38.227183 1175 tablet_replica.cc:333] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:38.227157 2297 raft_consensus.cc:493] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:38.227308 2297 raft_consensus.cc:515] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.227449 1175 raft_consensus.cc:2243] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.227691 1175 raft_consensus.cc:2272] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.228319 1175 ts_tablet_manager.cc:1916] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.229471 2297 leader_election.cc:290] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:38.229842 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2fb9c8f339444bc8d7c6479e7d87f44" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:38.230361 997 leader_election.cc:343] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.230623 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf73a9f8f67b42d9baf1396d70a1a3a9" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:38.230993 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0f0cd89234e72a052f3f9f964aa35" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:38.230960 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2fb9c8f339444bc8d7c6479e7d87f44" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:38.231156 785 raft_consensus.cc:2468] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:38.231539 1176 ts_tablet_manager.cc:1929] T 5ff188f25ff146fab121ebfab1af8467 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.233239 999 leader_election.cc:304] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:38.222895 1173 consensus_queue.cc:260] T 27fc03c90b584becb250546100af736c P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.233628 1176 log.cc:1199] T 5ff188f25ff146fab121ebfab1af8467 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/5ff188f25ff146fab121ebfab1af8467
I20260318 02:51:38.233807 2296 raft_consensus.cc:2804] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:38.233888 2296 raft_consensus.cc:493] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:38.233943 2296 raft_consensus.cc:3060] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:38.234169 1173 ts_tablet_manager.cc:1434] T 27fc03c90b584becb250546100af736c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260318 02:51:38.234630 1176 ts_tablet_manager.cc:1950] T 5ff188f25ff146fab121ebfab1af8467 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:38.235611 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 5ff188f25ff146fab121ebfab1af8467 (table default.Table_33930f6668f341159c318db9160c142a [id=a5613244ee434bc88b23181c7bf23e0c]) successfully deleted
I20260318 02:51:38.236433 2296 raft_consensus.cc:515] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.237128 1173 tablet_bootstrap.cc:492] T 1350684961f645e089fc3fd9ba3a5b09 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:38.237520 2296 leader_election.cc:290] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:38.237927 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2fb9c8f339444bc8d7c6479e7d87f44" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:38.238351 997 leader_election.cc:343] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.239918 1174 tablet_bootstrap.cc:654] T 46ce65cca47f48db94e70226494cfbae P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.241855 452 master_service.cc:954] ReplaceTablet: received request to replace tablet 27fc03c90b584becb250546100af736c from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:38.241935 1173 tablet_bootstrap.cc:654] T 1350684961f645e089fc3fd9ba3a5b09 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:38.242734 719 leader_election.cc:343] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.242869 719 leader_election.cc:304] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:38.243261 2257 raft_consensus.cc:2749] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:38.242898 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c47734ae213a40a28d7866266dd02b6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:38.243382 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_138374c056b841499f29fc539894ad68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:38.243636 719 leader_election.cc:343] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.243733 719 leader_election.cc:304] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:38.243940 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c47734ae213a40a28d7866266dd02b6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:38.244052 2257 raft_consensus.cc:2749] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:38.245661 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2fb9c8f339444bc8d7c6479e7d87f44" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:38.245820 785 raft_consensus.cc:3060] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:38.245977 1176 tablet_replica.cc:333] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad: stopping tablet replica
W20260318 02:51:38.246025 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_138374c056b841499f29fc539894ad68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:38.246305 1176 raft_consensus.cc:2243] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.248445 785 raft_consensus.cc:2468] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:38.249078 1176 raft_consensus.cc:2272] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.249696 1176 ts_tablet_manager.cc:1916] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.251766 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 24c66e2cc96f458fb3279827cea4ca9e (table default.Table_ac2dafcc68eb412da14e17b420c2bf92 [id=ade423581b18488699c64d3b107d0b07]) successfully deleted
W20260318 02:51:38.252326 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet b317cc133346412fb981b1c8e5b99c4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b317cc133346412fb981b1c8e5b99c4d already in progress: creating tablet
I20260318 02:51:38.252753 2197 raft_consensus.cc:493] T d0652735b8c24c23ade92913c1c7ad0f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9422bb7011f342b08be0b073a88c4c4d)
W20260318 02:51:38.252867 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet a4918d7f2f2645e88b7f3e1d52926fb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4918d7f2f2645e88b7f3e1d52926fb1 already in progress: creating tablet
I20260318 02:51:38.252909 2197 raft_consensus.cc:515] T d0652735b8c24c23ade92913c1c7ad0f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.253383 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet a20b9dc70b5147ff8798946eda3131ca (table default.Table_1852ce7593344cc790f3c957fb56cd32 [id=7f9afbebeec541b9a89c049f168e87b7]) successfully deleted
I20260318 02:51:38.253643 2197 leader_election.cc:290] T d0652735b8c24c23ade92913c1c7ad0f P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:38.253676 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet e5641e430b0a4ddf9e1111f834246755 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5641e430b0a4ddf9e1111f834246755 already in progress: creating tablet
W20260318 02:51:38.253991 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet e85d612871014dc2bd9139adcbe639d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e85d612871014dc2bd9139adcbe639d2 already in progress: creating tablet
W20260318 02:51:38.254259 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f95ebc89fd2545b1835a1bc10414248d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f95ebc89fd2545b1835a1bc10414248d already in progress: creating tablet
W20260318 02:51:38.254577 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet fcbaf43f3ccc48a2b7f09d04c2da060d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fcbaf43f3ccc48a2b7f09d04c2da060d already in progress: creating tablet
W20260318 02:51:38.254849 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 8c1ba16db9d040708f8fd75c852bdbb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c1ba16db9d040708f8fd75c852bdbb1 already in progress: creating tablet
I20260318 02:51:38.255016 2297 consensus_queue.cc:1048] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:38.255656 999 leader_election.cc:304] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:38.255890 2297 raft_consensus.cc:2804] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:38.255990 2297 raft_consensus.cc:697] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:38.256242 2297 consensus_queue.cc:237] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.261292 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0652735b8c24c23ade92913c1c7ad0f" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:38.261754 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0652735b8c24c23ade92913c1c7ad0f" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:38.262449 862 leader_election.cc:304] T d0652735b8c24c23ade92913c1c7ad0f P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:38.262924 2197 raft_consensus.cc:2749] T d0652735b8c24c23ade92913c1c7ad0f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260318 02:51:38.266814 1174 tablet_bootstrap.cc:492] T 46ce65cca47f48db94e70226494cfbae P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:38.266968 1174 ts_tablet_manager.cc:1403] T 46ce65cca47f48db94e70226494cfbae P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.089s user 0.003s sys 0.001s
I20260318 02:51:38.267755 1174 raft_consensus.cc:359] T 46ce65cca47f48db94e70226494cfbae P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.267927 1174 raft_consensus.cc:385] T 46ce65cca47f48db94e70226494cfbae P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.267978 1174 raft_consensus.cc:740] T 46ce65cca47f48db94e70226494cfbae P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.268218 1174 consensus_queue.cc:260] T 46ce65cca47f48db94e70226494cfbae P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.268851 1174 ts_tablet_manager.cc:1434] T 46ce65cca47f48db94e70226494cfbae P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:38.269392 1174 tablet_bootstrap.cc:492] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:38.272831 1174 tablet_bootstrap.cc:654] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.281286 1184 ts_tablet_manager.cc:1929] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.281437 1184 log.cc:1199] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/96a6d1808417419dac0d2b2e80c5ca22
I20260318 02:51:38.281741 1184 ts_tablet_manager.cc:1950] T 96a6d1808417419dac0d2b2e80c5ca22 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:38.284773 1175 ts_tablet_manager.cc:1929] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:38.285001 1175 log.cc:1199] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/ab158343adb14eab85c595fa5405145d
I20260318 02:51:38.285445 1175 ts_tablet_manager.cc:1950] T ab158343adb14eab85c595fa5405145d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:38.285737 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 897) took 1896 ms. Trace:
I20260318 02:51:38.285840 1184 rpcz_store.cc:276] 0318 02:51:36.388933 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.388996 (+ 63us) service_pool.cc:225] Handling call
0318 02:51:38.174148 (+1785152us) ts_tablet_manager.cc:1151] Deleting tablet 96a6d1808417419dac0d2b2e80c5ca22
0318 02:51:38.174160 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.181394 (+ 7234us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.281156 (+ 99762us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.285710 (+ 4554us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1784919}
I20260318 02:51:38.286518 1184 tablet_replica.cc:333] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:38.286492 1173 tablet_bootstrap.cc:492] T 1350684961f645e089fc3fd9ba3a5b09 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:38.286710 1184 raft_consensus.cc:2243] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.286831 1173 ts_tablet_manager.cc:1403] T 1350684961f645e089fc3fd9ba3a5b09 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.002s
I20260318 02:51:38.286856 1184 raft_consensus.cc:2272] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.287640 1173 raft_consensus.cc:359] T 1350684961f645e089fc3fd9ba3a5b09 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.287880 1173 raft_consensus.cc:385] T 1350684961f645e089fc3fd9ba3a5b09 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.287972 1173 raft_consensus.cc:740] T 1350684961f645e089fc3fd9ba3a5b09 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.288231 923 raft_consensus.cc:3060] T 27fc03c90b584becb250546100af736c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:38.288254 1173 consensus_queue.cc:260] T 1350684961f645e089fc3fd9ba3a5b09 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.288893 1173 ts_tablet_manager.cc:1434] T 1350684961f645e089fc3fd9ba3a5b09 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:38.288995 1184 ts_tablet_manager.cc:1916] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.255133 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet b716c3a80d4a44d190de38f926098efc (table default.Table_b173d9dd6cc74a9ea5044ae888a3bd14 [id=08016e8769bf4007bdb2eba7c11fe0f7]) successfully deleted
I20260318 02:51:38.259181 448 master_service.cc:954] ReplaceTablet: received request to replace tablet defda79dd0f34c37ae16ea808df0754b from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:38.289445 1173 tablet_bootstrap.cc:492] T 1b439fa2481a43c78d2c486d8711175f P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:38.289505 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 0652fc250fa04565b069bb767530d747 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0652fc250fa04565b069bb767530d747 already in progress: creating tablet
W20260318 02:51:38.289911 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet de2bc2f79e8b49248de3e7eca1a600cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de2bc2f79e8b49248de3e7eca1a600cf already in progress: creating tablet
I20260318 02:51:38.290354 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 104cd36774df4bc0adf1d449224304d5 (table default.Table_c978284529db4de7883f9f0664c4a158 [id=8b5e3535d9e44b1a86dc59211a31deb6]) successfully deleted
W20260318 02:51:38.290702 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 9f274ae7a6834ca98f01575fcf8b161e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f274ae7a6834ca98f01575fcf8b161e already in progress: creating tablet
I20260318 02:51:38.290958 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 65c50b0813b04f30896568ab2b680ba8 (table default.Table_d2f73355578d4f4391b25e72718cfa1e [id=0bd115a0960941ff9d49b4566fe1c666]) successfully deleted
W20260318 02:51:38.291229 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 868605c58c1d4744ab8930313e7dcaa9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 868605c58c1d4744ab8930313e7dcaa9 already in progress: creating tablet
I20260318 02:51:38.291610 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet ab158343adb14eab85c595fa5405145d (table default.Table_b76c4b353fbe45c8a866d4cd2c4e264c [id=d20f8f1bd66d4dceab3b7bc72608da2a]) successfully deleted
I20260318 02:51:38.291884 1173 tablet_bootstrap.cc:654] T 1b439fa2481a43c78d2c486d8711175f P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:38.292151 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 243a2f81711f4712ab21c8ae5bdc94a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 243a2f81711f4712ab21c8ae5bdc94a8 already in progress: creating tablet
I20260318 02:51:38.294906 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet ecb2289a6bcd4b8ca6c3810b7d615bce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.294744 907 tablet_service.cc:1558] Processing DeleteTablet for tablet ecb2289a6bcd4b8ca6c3810b7d615bce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:38.298105 1175 tablet_replica.cc:333] T dea25aaad60a4b2483a8832f995d1316 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:38.298630 1176 ts_tablet_manager.cc:1929] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.298920 1175 raft_consensus.cc:2243] T dea25aaad60a4b2483a8832f995d1316 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.299103 1175 raft_consensus.cc:2272] T dea25aaad60a4b2483a8832f995d1316 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.304823 1176 log.cc:1199] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/254b8722e7ff4ccabc6d16f04daf85aa
I20260318 02:51:38.305281 1176 ts_tablet_manager.cc:1950] T 254b8722e7ff4ccabc6d16f04daf85aa P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:38.307579 974 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:38.309257 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 254b8722e7ff4ccabc6d16f04daf85aa (table default.Table_c8066725c1a94b1f9e3a030be08a461d [id=d9f99876511c4cf294e3edbbfae441c0]) successfully deleted
I20260318 02:51:38.309721 1176 tablet_replica.cc:333] T 9aeb492564a94a569f70506712dad4ed P 6a903d876086423b8016d705b98895ad: stopping tablet replica
W20260318 02:51:38.309728 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 60a4e38c14f84e6ba9d0402b62f7432c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60a4e38c14f84e6ba9d0402b62f7432c already in progress: creating tablet
I20260318 02:51:38.310029 1176 raft_consensus.cc:2243] T 9aeb492564a94a569f70506712dad4ed P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.312861 1176 raft_consensus.cc:2272] T 9aeb492564a94a569f70506712dad4ed P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.313481 1176 ts_tablet_manager.cc:1916] T 9aeb492564a94a569f70506712dad4ed P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.317427 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 813702e53eee4a54a7d693fd6e03bbbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.318795 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet bf344c2361b7412c87a7c7f9a72a15b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.319653 2320 tablet.cc:1723] T 7c4eca5e16f84564b31933b8227fd980 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:38.320415 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 96a6d1808417419dac0d2b2e80c5ca22 (table default.Table_8b0935ef185c46f8ba4fe96e60fad278 [id=a401bb840c9a4dddb1619805a406f8aa]) successfully deleted
W20260318 02:51:38.323765 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 98ac6bdd852d468ba6821af6c85bfd19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98ac6bdd852d468ba6821af6c85bfd19 already in progress: creating tablet
W20260318 02:51:38.324389 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 1d2c64dc7c0b479494ca474dad51a528 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d2c64dc7c0b479494ca474dad51a528 already in progress: creating tablet
W20260318 02:51:38.324960 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f37ab96f13444fcbb5cfc3ad92d53c35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f37ab96f13444fcbb5cfc3ad92d53c35 already in progress: creating tablet
W20260318 02:51:38.325343 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 254b8722e7ff4ccabc6d16f04daf85aa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 254b8722e7ff4ccabc6d16f04daf85aa already in progress: creating tablet
W20260318 02:51:38.325950 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 60a4e38c14f84e6ba9d0402b62f7432c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60a4e38c14f84e6ba9d0402b62f7432c already in progress: creating tablet
W20260318 02:51:38.326366 997 consensus_peers.cc:597] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:38.330436 1111 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:38.333197 1174 tablet_bootstrap.cc:492] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:38.333524 1174 ts_tablet_manager.cc:1403] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.064s user 0.006s sys 0.000s
I20260318 02:51:38.334429 1174 raft_consensus.cc:359] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.334698 1174 raft_consensus.cc:385] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.334888 1174 raft_consensus.cc:740] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.335338 1174 consensus_queue.cc:260] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:38.335932 441 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet a6d2dd53085848d6bd7237b07a5f81d0 (table default.Table_ff28a5f6be7743ff92181ad445d72c65 [id=74aaf5efafc14e5faae1d6a0d60d0bb8], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet a6d2dd53085848d6bd7237b07a5f81d0 consensus state has no leader
I20260318 02:51:38.337064 1172 tablet_bootstrap.cc:492] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:38.337206 1172 ts_tablet_manager.cc:1403] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.148s user 0.003s sys 0.000s
I20260318 02:51:38.337239 1174 ts_tablet_manager.cc:1434] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:38.337935 785 raft_consensus.cc:1275] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Refusing update from remote peer 9422bb7011f342b08be0b073a88c4c4d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:38.337910 1172 raft_consensus.cc:359] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.338073 1172 raft_consensus.cc:385] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.338126 1172 raft_consensus.cc:740] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.338330 1172 consensus_queue.cc:260] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.338475 2297 consensus_queue.cc:1048] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:38.338945 1172 ts_tablet_manager.cc:1434] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:38.338907 1174 tablet_bootstrap.cc:492] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:38.343513 2322 tablet.cc:1723] T 7c4eca5e16f84564b31933b8227fd980 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:38.345432 2324 tablet.cc:1723] T 27fc03c90b584becb250546100af736c P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:38.349304 1174 tablet_bootstrap.cc:654] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.350039 2152 raft_consensus.cc:493] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:38.350252 2152 raft_consensus.cc:515] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.351805 2152 leader_election.cc:290] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:38.352065 1184 ts_tablet_manager.cc:1929] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.352185 1184 log.cc:1199] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/305cc777ed0c46e497c80f15b8e6ead1
I20260318 02:51:38.352100 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813702e53eee4a54a7d693fd6e03bbbb" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:38.352849 997 leader_election.cc:343] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.353701 1172 tablet_bootstrap.cc:492] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:38.355576 1172 tablet_bootstrap.cc:654] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.355752 1184 ts_tablet_manager.cc:1950] T 305cc777ed0c46e497c80f15b8e6ead1 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
W20260318 02:51:38.359299 999 leader_election.cc:343] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 813702e53eee4a54a7d693fd6e03bbbb
I20260318 02:51:38.359766 999 leader_election.cc:304] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:38.362298 2152 raft_consensus.cc:2749] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:38.367729 2328 tablet.cc:1723] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:38.361205 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 896) took 1972 ms. Trace:
I20260318 02:51:38.368847 1184 rpcz_store.cc:276] 0318 02:51:36.388779 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.389300 (+ 521us) service_pool.cc:225] Handling call
0318 02:51:38.286466 (+1897166us) ts_tablet_manager.cc:1151] Deleting tablet 305cc777ed0c46e497c80f15b8e6ead1
0318 02:51:38.286477 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.300702 (+ 14225us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.351946 (+ 51244us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.361185 (+ 9239us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1896918}
I20260318 02:51:38.370494 2326 tablet.cc:1723] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:38.374938 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 305cc777ed0c46e497c80f15b8e6ead1 (table default.Table_dbd509def99c4f02a35097ecbd42c1f1 [id=74932ba5f5794283833a97ff4ea61734]) successfully deleted
I20260318 02:51:38.375837 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 899) took 1968 ms. Trace:
I20260318 02:51:38.375995 1184 rpcz_store.cc:276] 0318 02:51:36.407272 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.407332 (+ 60us) service_pool.cc:225] Handling call
0318 02:51:38.375367 (+1968035us) ts_tablet_manager.cc:1151] Deleting tablet 4ff090fadc6b47d6ba551dc59d4dad2c
0318 02:51:38.375380 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.375816 (+ 436us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1967846}
I20260318 02:51:38.376886 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 901) took 1854 ms. Trace:
I20260318 02:51:38.377351 1184 rpcz_store.cc:276] 0318 02:51:36.522698 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.524614 (+ 1916us) service_pool.cc:225] Handling call
0318 02:51:38.376762 (+1852148us) ts_tablet_manager.cc:1151] Deleting tablet e5641e430b0a4ddf9e1111f834246755
0318 02:51:38.376772 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.376866 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1851926}
W20260318 02:51:38.377888 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet e5641e430b0a4ddf9e1111f834246755 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e5641e430b0a4ddf9e1111f834246755 already in progress: creating tablet
W20260318 02:51:38.382570 997 consensus_peers.cc:597] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:38.383240 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 904) took 1834 ms. Trace:
I20260318 02:51:38.383435 2257 raft_consensus.cc:493] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:38.383394 1184 rpcz_store.cc:276] 0318 02:51:36.548686 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.548758 (+ 72us) service_pool.cc:225] Handling call
0318 02:51:38.378300 (+1829542us) ts_tablet_manager.cc:1151] Deleting tablet b317cc133346412fb981b1c8e5b99c4d
0318 02:51:38.378311 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.383218 (+ 4907us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1829351}
I20260318 02:51:38.383572 2257 raft_consensus.cc:515] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.383811 1172 tablet_bootstrap.cc:492] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
W20260318 02:51:38.383890 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet b317cc133346412fb981b1c8e5b99c4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b317cc133346412fb981b1c8e5b99c4d already in progress: creating tablet
I20260318 02:51:38.383942 1172 ts_tablet_manager.cc:1403] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.002s
I20260318 02:51:38.384152 2257 leader_election.cc:290] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:38.384785 1172 raft_consensus.cc:359] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.384951 1172 raft_consensus.cc:385] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.384999 1172 raft_consensus.cc:740] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.385110 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461adcc8bbd94d30b9b84d1010430829" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:38.385181 1172 consensus_queue.cc:260] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.385442 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461adcc8bbd94d30b9b84d1010430829" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:38.385759 719 leader_election.cc:343] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:38.385965 719 leader_election.cc:343] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.386040 719 leader_election.cc:304] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:38.386521 2257 raft_consensus.cc:2749] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:38.389704 448 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet d0652735b8c24c23ade92913c1c7ad0f (table default.Table_20867faf86da4889b7995990926923a7 [id=5bc787aad96b4abd82ab3e033020ea9c]). Expected version 1 got 0
I20260318 02:51:38.391489 907 tablet_service.cc:1558] Processing DeleteTablet for tablet cc1543d0e1b1431baf6d2ab6a0484ca6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:38.394953 1173 tablet_bootstrap.cc:492] T 1b439fa2481a43c78d2c486d8711175f P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:38.395213 1173 ts_tablet_manager.cc:1403] T 1b439fa2481a43c78d2c486d8711175f P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.106s user 0.003s sys 0.007s
I20260318 02:51:38.396157 1173 raft_consensus.cc:359] T 1b439fa2481a43c78d2c486d8711175f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.396322 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 3d28aa6525184246a71ad198cf1df763
I20260318 02:51:38.396437 1173 raft_consensus.cc:385] T 1b439fa2481a43c78d2c486d8711175f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.396498 1173 raft_consensus.cc:740] T 1b439fa2481a43c78d2c486d8711175f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.396752 1173 consensus_queue.cc:260] T 1b439fa2481a43c78d2c486d8711175f P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.397195 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d28aa6525184246a71ad198cf1df763 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:38.399115 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 9d9cc0f3aef0401c8f072b11d9498a59
I20260318 02:51:38.399894 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d9cc0f3aef0401c8f072b11d9498a59 with delete_type TABLET_DATA_DELETED (replaced by tablet 8845dbc4ad3a499bb77aa9b6e24b554d) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:38.401827 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d28aa6525184246a71ad198cf1df763 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.402701 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d9cc0f3aef0401c8f072b11d9498a59 with delete_type TABLET_DATA_DELETED (replaced by tablet 8845dbc4ad3a499bb77aa9b6e24b554d) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.402737 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d28aa6525184246a71ad198cf1df763 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:38.402889 456 catalog_manager.cc:6741] ReplaceTablet: tablet 9d9cc0f3aef0401c8f072b11d9498a59 deleted and replaced by tablet 8845dbc4ad3a499bb77aa9b6e24b554d
I20260318 02:51:38.403692 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d9cc0f3aef0401c8f072b11d9498a59 with delete_type TABLET_DATA_DELETED (replaced by tablet 8845dbc4ad3a499bb77aa9b6e24b554d) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:38.404946 448 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 7c4eca5e16f84564b31933b8227fd980 (table default.Table_4da517198db54744b96210b1f4438731 [id=541170c7c4bf49deb86cd4c15ffdd04f]). Expected version 1 got 0
I20260318 02:51:38.405550 1172 ts_tablet_manager.cc:1434] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
I20260318 02:51:38.408226 1176 ts_tablet_manager.cc:1929] T 9aeb492564a94a569f70506712dad4ed P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.408388 1176 log.cc:1199] T 9aeb492564a94a569f70506712dad4ed P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/9aeb492564a94a569f70506712dad4ed
I20260318 02:51:38.413456 1172 tablet_bootstrap.cc:492] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:38.409169 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 906) took 1841 ms. Trace:
I20260318 02:51:38.413707 1184 rpcz_store.cc:276] 0318 02:51:36.567644 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.568358 (+ 714us) service_pool.cc:225] Handling call
0318 02:51:38.384182 (+1815824us) ts_tablet_manager.cc:1151] Deleting tablet a4918d7f2f2645e88b7f3e1d52926fb1
0318 02:51:38.408996 (+ 24814us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.409143 (+ 147us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1815182}
I20260318 02:51:38.414152 1184 tablet_replica.cc:333] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
W20260318 02:51:38.414610 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet a4918d7f2f2645e88b7f3e1d52926fb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4918d7f2f2645e88b7f3e1d52926fb1 already in progress: creating tablet
I20260318 02:51:38.414780 1184 raft_consensus.cc:2243] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.414984 1184 raft_consensus.cc:2272] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.415594 1184 ts_tablet_manager.cc:1916] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.417351 1173 ts_tablet_manager.cc:1434] T 1b439fa2481a43c78d2c486d8711175f P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.022s user 0.001s sys 0.000s
I20260318 02:51:38.421346 1173 tablet_bootstrap.cc:492] T 083493ab9d26493a924025fbd96ab1d7 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:38.422837 1173 tablet_bootstrap.cc:654] T 083493ab9d26493a924025fbd96ab1d7 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.425484 1172 tablet_bootstrap.cc:654] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.412617 1174 tablet_bootstrap.cc:492] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:38.429746 1174 ts_tablet_manager.cc:1403] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.091s user 0.003s sys 0.003s
I20260318 02:51:38.430574 1174 raft_consensus.cc:359] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.430845 1174 raft_consensus.cc:385] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.430954 1174 raft_consensus.cc:740] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.431233 1174 consensus_queue.cc:260] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.431792 1174 ts_tablet_manager.cc:1434] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260318 02:51:38.408692 1176 ts_tablet_manager.cc:1950] T 9aeb492564a94a569f70506712dad4ed P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:38.432440 1174 tablet_bootstrap.cc:492] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:38.433586 1184 ts_tablet_manager.cc:1929] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.433753 1184 log.cc:1199] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/7cdd554113bf4a7092da876365a89456
I20260318 02:51:38.434065 1184 ts_tablet_manager.cc:1950] T 7cdd554113bf4a7092da876365a89456 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:38.434252 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 9aeb492564a94a569f70506712dad4ed (table default.Table_f664e51423be4580b3ebf91d14e66886 [id=f0a505a78b8e4ea695e1c3da2f9a0e80]) successfully deleted
I20260318 02:51:38.434670 1174 tablet_bootstrap.cc:654] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:38.435920 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet b9a6d8d743a742a4b2d19b85e59101cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9a6d8d743a742a4b2d19b85e59101cb already in progress: creating tablet
I20260318 02:51:38.436074 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 907) took 1859 ms. Trace:
I20260318 02:51:38.436167 1184 rpcz_store.cc:276] 0318 02:51:36.576903 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.577228 (+ 325us) service_pool.cc:225] Handling call
0318 02:51:38.414073 (+1836845us) ts_tablet_manager.cc:1151] Deleting tablet 7cdd554113bf4a7092da876365a89456
0318 02:51:38.414084 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.418643 (+ 4559us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.423499 (+ 4856us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.436003 (+ 12504us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":340,"tablet-delete.queue_time_us":1836603}
I20260318 02:51:38.436265 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_516dad30e58e4579af1579c35cdf7b89" } modify_external_catalogs: true
I20260318 02:51:38.436455 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_516dad30e58e4579af1579c35cdf7b89" } modify_external_catalogs: true
W20260318 02:51:38.436774 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 60dedba077d34435b30061bfba737412 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60dedba077d34435b30061bfba737412 already in progress: creating tablet
I20260318 02:51:38.436851 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 7cdd554113bf4a7092da876365a89456 (table default.Table_3f656b3bee94423f80dd692ce3481733 [id=6f9427cec2ee40699e0c736524feb90f]) successfully deleted
I20260318 02:51:38.437263 1184 tablet_replica.cc:333] T 24c66e2cc96f458fb3279827cea4ca9e P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
W20260318 02:51:38.437419 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet ecb2289a6bcd4b8ca6c3810b7d615bce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecb2289a6bcd4b8ca6c3810b7d615bce already in progress: creating tablet
I20260318 02:51:38.437474 1184 raft_consensus.cc:2243] T 24c66e2cc96f458fb3279827cea4ca9e P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.437686 1184 raft_consensus.cc:2272] T 24c66e2cc96f458fb3279827cea4ca9e P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.438058 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_39e1f51fc4d849a1b42a27f540395700"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:38.438637 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39e1f51fc4d849a1b42a27f540395700 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:38.439486 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 3d28aa6525184246a71ad198cf1df763 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d28aa6525184246a71ad198cf1df763 already in progress: creating tablet
I20260318 02:51:38.441282 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c75d2e6aa5dd4b8a89c29ec1d491967b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:38.441890 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c75d2e6aa5dd4b8a89c29ec1d491967b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:38.444900 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 9d9cc0f3aef0401c8f072b11d9498a59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d9cc0f3aef0401c8f072b11d9498a59 already in progress: creating tablet
I20260318 02:51:38.450536 1174 tablet_bootstrap.cc:492] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:38.450735 1174 ts_tablet_manager.cc:1403] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20260318 02:51:38.451573 1174 raft_consensus.cc:359] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.451788 1174 raft_consensus.cc:385] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.451874 1174 raft_consensus.cc:740] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.452139 1174 consensus_queue.cc:260] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.452397 2152 raft_consensus.cc:493] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:38.452629 2152 raft_consensus.cc:515] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.452901 1174 ts_tablet_manager.cc:1434] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:38.453317 2152 leader_election.cc:290] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:38.454121 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b383fd49049c4c1daba3f1ed60899f3e" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:38.454736 997 leader_election.cc:343] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.458096 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b383fd49049c4c1daba3f1ed60899f3e" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:38.458588 783 raft_consensus.cc:2468] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:38.459151 999 leader_election.cc:304] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:38.459889 2152 raft_consensus.cc:2804] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:38.459987 2152 raft_consensus.cc:493] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:38.460086 2152 raft_consensus.cc:3060] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:38.462716 2152 raft_consensus.cc:515] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.463371 2152 leader_election.cc:290] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:38.464318 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b383fd49049c4c1daba3f1ed60899f3e" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:38.465799 997 leader_election.cc:343] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.465986 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b383fd49049c4c1daba3f1ed60899f3e" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:38.466168 783 raft_consensus.cc:3060] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:38.463840 1174 tablet_bootstrap.cc:492] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:38.468998 783 raft_consensus.cc:2468] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:38.469475 999 leader_election.cc:304] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:38.469909 2152 raft_consensus.cc:2804] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:38.470132 1174 tablet_bootstrap.cc:654] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.470453 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bf3af9d6919949a6a752d58fd7782bc0" } modify_external_catalogs: true
I20260318 02:51:38.470757 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bf3af9d6919949a6a752d58fd7782bc0" } modify_external_catalogs: true
I20260318 02:51:38.471668 1173 tablet_bootstrap.cc:492] T 083493ab9d26493a924025fbd96ab1d7 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:38.471946 1173 ts_tablet_manager.cc:1403] T 083493ab9d26493a924025fbd96ab1d7 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.001s
I20260318 02:51:38.472684 1173 raft_consensus.cc:359] T 083493ab9d26493a924025fbd96ab1d7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.472934 1173 raft_consensus.cc:385] T 083493ab9d26493a924025fbd96ab1d7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.473031 1173 raft_consensus.cc:740] T 083493ab9d26493a924025fbd96ab1d7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.473289 1173 consensus_queue.cc:260] T 083493ab9d26493a924025fbd96ab1d7 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.476537 1173 ts_tablet_manager.cc:1434] T 083493ab9d26493a924025fbd96ab1d7 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260318 02:51:38.478668 2152 raft_consensus.cc:697] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:38.479024 2152 consensus_queue.cc:237] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.483558 1173 tablet_bootstrap.cc:492] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:38.485204 1173 tablet_bootstrap.cc:654] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.485948 833 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:38.495790 453 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 061ebb62f4c54a2a8c24b90ec15402d3 (table default.Table_88caf570ec6a4dfea94952fb5718c9c6 [id=5a3571f0765948588578d8e5185807a8]). Expected version 1 got 0
I20260318 02:51:38.496279 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5ed9c43cfcf94d058b59ec604059817b" } modify_external_catalogs: true
I20260318 02:51:38.496541 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5ed9c43cfcf94d058b59ec604059817b" } modify_external_catalogs: true
I20260318 02:51:38.497095 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet ba3e7e9a85c94d7380b96a9373c1f503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.501116 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3486ecde3c9249d4b6daa9a5c8334cf2" } new_table_name: "default.Table_420c4090dd86460db6ce0e7f8014ef94" modify_external_catalogs: true
I20260318 02:51:38.501621 1175 ts_tablet_manager.cc:1916] T dea25aaad60a4b2483a8832f995d1316 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.501672 1174 tablet_bootstrap.cc:492] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:38.501821 1174 ts_tablet_manager.cc:1403] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.000s
I20260318 02:51:38.502545 1174 raft_consensus.cc:359] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.502792 1174 raft_consensus.cc:385] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.502892 1174 raft_consensus.cc:740] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.503170 1174 consensus_queue.cc:260] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.504062 1174 ts_tablet_manager.cc:1434] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:38.504076 451 master_service.cc:954] ReplaceTablet: received request to replace tablet 2f3309339d61445eaf38baf068216ef4 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:38.506906 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 27fc03c90b584becb250546100af736c
I20260318 02:51:38.507664 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 27fc03c90b584becb250546100af736c with delete_type TABLET_DATA_DELETED (replaced by tablet 4937857ea9b54e7b871ee48ccb2754aa) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:38.507887 450 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet d0652735b8c24c23ade92913c1c7ad0f (table default.Table_20867faf86da4889b7995990926923a7 [id=5bc787aad96b4abd82ab3e033020ea9c]). Expected version 1 got 0
I20260318 02:51:38.509763 452 catalog_manager.cc:6741] ReplaceTablet: tablet 27fc03c90b584becb250546100af736c deleted and replaced by tablet 4937857ea9b54e7b871ee48ccb2754aa
I20260318 02:51:38.510787 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 27fc03c90b584becb250546100af736c with delete_type TABLET_DATA_DELETED (replaced by tablet 4937857ea9b54e7b871ee48ccb2754aa) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:38.511081 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 27fc03c90b584becb250546100af736c with delete_type TABLET_DATA_DELETED (replaced by tablet 4937857ea9b54e7b871ee48ccb2754aa) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.512274 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0c162c9f3baa4ac6ae56ef095498c61b" } modify_external_catalogs: true
I20260318 02:51:38.512465 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0c162c9f3baa4ac6ae56ef095498c61b" } modify_external_catalogs: true
I20260318 02:51:38.513110 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5ccfbbc3ac234ae1a1219ac5bef14e95" } new_table_name: "default.Table_d80fcfcffcf94d368ef8b09a4842128f" modify_external_catalogs: true
I20260318 02:51:38.515712 456 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet e58f7675546e46328b6308fa1dacc492
I20260318 02:51:38.516397 1184 ts_tablet_manager.cc:1916] T 24c66e2cc96f458fb3279827cea4ca9e P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.517165 1174 tablet_bootstrap.cc:492] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:38.518286 1176 tablet_replica.cc:333] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:38.518500 1176 raft_consensus.cc:2243] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.518684 1176 raft_consensus.cc:2272] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.518872 1174 tablet_bootstrap.cc:654] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.519234 1176 ts_tablet_manager.cc:1916] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.525254 1173 tablet_bootstrap.cc:492] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:38.525532 1173 ts_tablet_manager.cc:1403] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.003s
I20260318 02:51:38.526307 1173 raft_consensus.cc:359] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.526765 1173 raft_consensus.cc:385] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.526872 1173 raft_consensus.cc:740] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.527093 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet dff92dfca39e47f98d709cc67b97df66
I20260318 02:51:38.527199 1173 consensus_queue.cc:260] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.528416 761 tablet_service.cc:1558] Processing DeleteTablet for tablet dff92dfca39e47f98d709cc67b97df66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:38.529623 1176 ts_tablet_manager.cc:1929] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:38.529950 1176 log.cc:1199] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/27fc03c90b584becb250546100af736c
I20260318 02:51:38.530124 907 tablet_service.cc:1558] Processing DeleteTablet for tablet dff92dfca39e47f98d709cc67b97df66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:38.530391 1176 ts_tablet_manager.cc:1950] T 27fc03c90b584becb250546100af736c P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:38.531451 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 27fc03c90b584becb250546100af736c (table default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]) successfully deleted
I20260318 02:51:38.531819 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_80307085aa604fe886f98a99c6e55fe7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:38.531942 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 083493ab9d26493a924025fbd96ab1d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:38.531942 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b439fa2481a43c78d2c486d8711175f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:38.532472 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80307085aa604fe886f98a99c6e55fe7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:38.532537 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet dff92dfca39e47f98d709cc67b97df66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dff92dfca39e47f98d709cc67b97df66 already in progress: creating tablet
I20260318 02:51:38.532960 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ceedcaff18544b0e986386e5a8194d87" } new_table_name: "default.Table_4aebf277fe2649d19839dab3d49e8862" modify_external_catalogs: true
I20260318 02:51:38.534749 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_93eea9d4589e4d98bb49be9fa2cdaac6" } new_table_name: "default.Table_a7ea1d8667034b45a48efcbbeea254a1" modify_external_catalogs: true
I20260318 02:51:38.536062 1173 ts_tablet_manager.cc:1434] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.010s user 0.000s sys 0.001s
I20260318 02:51:38.540637 1173 tablet_bootstrap.cc:492] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:38.530405 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet dff92dfca39e47f98d709cc67b97df66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.542232 2152 raft_consensus.cc:493] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:38.543843 2297 raft_consensus.cc:493] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:38.544934 2152 raft_consensus.cc:515] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.544993 2297 raft_consensus.cc:515] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.545624 2297 leader_election.cc:290] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:38.545622 2152 leader_election.cc:290] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:38.546458 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7ddc0807d742cea258f889390e2142" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:38.546736 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e916c5419e3c457f98a47c6a1c6cdd56" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:38.547067 999 leader_election.cc:343] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: e916c5419e3c457f98a47c6a1c6cdd56
W20260318 02:51:38.547196 997 leader_election.cc:343] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:38.547590 997 leader_election.cc:343] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.547712 997 leader_election.cc:304] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:38.548017 999 leader_election.cc:343] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2a7ddc0807d742cea258f889390e2142
I20260318 02:51:38.548177 999 leader_election.cc:304] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:38.548491 2297 raft_consensus.cc:2749] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:38.548237 2152 raft_consensus.cc:2749] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:38.554899 1175 ts_tablet_manager.cc:1929] T dea25aaad60a4b2483a8832f995d1316 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.562762 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b383fd49049c4c1daba3f1ed60899f3e
I20260318 02:51:38.564566 761 tablet_service.cc:1558] Processing DeleteTablet for tablet b383fd49049c4c1daba3f1ed60899f3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:38.564657 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet b383fd49049c4c1daba3f1ed60899f3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:38.570986 997 consensus_peers.cc:597] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:38.571853 783 raft_consensus.cc:1275] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Refusing update from remote peer 9422bb7011f342b08be0b073a88c4c4d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:38.572541 2297 consensus_queue.cc:1048] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:38.575644 1172 tablet_bootstrap.cc:492] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:38.575855 1172 ts_tablet_manager.cc:1403] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.163s user 0.004s sys 0.000s
I20260318 02:51:38.576790 1172 raft_consensus.cc:359] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.577072 1172 raft_consensus.cc:385] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.579885 1176 tablet_replica.cc:333] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:38.580268 1172 raft_consensus.cc:740] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.565150 907 tablet_service.cc:1558] Processing DeleteTablet for tablet b383fd49049c4c1daba3f1ed60899f3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:38.569247 1173 tablet_bootstrap.cc:654] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.581689 1172 consensus_queue.cc:260] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.581691 1176 raft_consensus.cc:2243] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.582767 1176 raft_consensus.cc:2272] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.585192 1172 ts_tablet_manager.cc:1434] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260318 02:51:38.585595 1172 tablet_bootstrap.cc:492] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:38.586844 1176 ts_tablet_manager.cc:1916] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.587330 1172 tablet_bootstrap.cc:654] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.588308 1175 log.cc:1199] T dea25aaad60a4b2483a8832f995d1316 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/dea25aaad60a4b2483a8832f995d1316
I20260318 02:51:38.593374 1175 ts_tablet_manager.cc:1950] T dea25aaad60a4b2483a8832f995d1316 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:38.595552 1175 tablet_replica.cc:333] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:38.595840 1175 raft_consensus.cc:2243] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.596891 1175 raft_consensus.cc:2272] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.597411 2197 raft_consensus.cc:493] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:38.597537 2197 raft_consensus.cc:515] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.598110 2197 leader_election.cc:290] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:38.599236 860 leader_election.cc:343] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 5fec974d146f44aeb72df483fa85b287
W20260318 02:51:38.600312 862 leader_election.cc:343] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 5fec974d146f44aeb72df483fa85b287
I20260318 02:51:38.600416 862 leader_election.cc:304] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:38.601372 1174 tablet_bootstrap.cc:492] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:38.601418 2197 raft_consensus.cc:2749] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:38.601557 1174 ts_tablet_manager.cc:1403] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.084s user 0.002s sys 0.026s
I20260318 02:51:38.602200 1175 ts_tablet_manager.cc:1916] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.602228 1174 raft_consensus.cc:359] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.602499 1174 raft_consensus.cc:385] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.602604 1174 raft_consensus.cc:740] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.602851 1174 consensus_queue.cc:260] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.603508 1174 ts_tablet_manager.cc:1434] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:38.603909 1174 tablet_bootstrap.cc:492] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:38.605477 1174 tablet_bootstrap.cc:654] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.614044 1173 tablet_bootstrap.cc:492] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:38.614311 1173 ts_tablet_manager.cc:1403] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.074s user 0.002s sys 0.001s
I20260318 02:51:38.615223 1173 raft_consensus.cc:359] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.615495 1173 raft_consensus.cc:385] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.615600 1173 raft_consensus.cc:740] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.615892 1173 consensus_queue.cc:260] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.616771 1174 tablet_bootstrap.cc:492] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:38.616958 1174 ts_tablet_manager.cc:1403] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260318 02:51:38.617694 1174 raft_consensus.cc:359] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.617921 1174 raft_consensus.cc:385] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.618017 1174 raft_consensus.cc:740] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.618319 1174 consensus_queue.cc:260] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.619024 1174 ts_tablet_manager.cc:1434] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:38.619351 1174 tablet_bootstrap.cc:492] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:38.621156 1174 tablet_bootstrap.cc:654] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.625097 1173 ts_tablet_manager.cc:1434] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260318 02:51:38.626155 1173 tablet_bootstrap.cc:492] T 065ebc3c000a4ad3873ee031ecf9986b P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:38.627959 1173 tablet_bootstrap.cc:654] T 065ebc3c000a4ad3873ee031ecf9986b P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.637228 1176 ts_tablet_manager.cc:1929] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.638087 1174 tablet_bootstrap.cc:492] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:38.638108 1176 log.cc:1199] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/b383fd49049c4c1daba3f1ed60899f3e
I20260318 02:51:38.638367 1174 ts_tablet_manager.cc:1403] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.001s
I20260318 02:51:38.639997 1174 raft_consensus.cc:359] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.640187 1176 ts_tablet_manager.cc:1950] T b383fd49049c4c1daba3f1ed60899f3e P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:38.640318 1174 raft_consensus.cc:385] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.640661 1174 raft_consensus.cc:740] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.641955 2326 tablet.cc:1723] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:38.641935 1174 consensus_queue.cc:260] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.642565 1174 ts_tablet_manager.cc:1434] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:38.643445 2296 raft_consensus.cc:493] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:38.643579 2296 raft_consensus.cc:515] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.644189 2296 leader_election.cc:290] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:38.645262 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3e7e9a85c94d7380b96a9373c1f503" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:38.645802 997 leader_election.cc:343] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.647079 2328 tablet.cc:1723] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260318 02:51:38.648608 999 leader_election.cc:343] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: ba3e7e9a85c94d7380b96a9373c1f503
I20260318 02:51:38.648815 999 leader_election.cc:304] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:38.649154 2296 raft_consensus.cc:2749] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:38.649619 1174 tablet_bootstrap.cc:492] T 783c886a99994d6c8d9add724277819a P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:38.651311 1174 tablet_bootstrap.cc:654] T 783c886a99994d6c8d9add724277819a P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.660910 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet dea25aaad60a4b2483a8832f995d1316 (table default.Table_cfe05462158449cca7f529d5a37270be [id=feac1e97445140d9bfcb8eb2b9996498]) successfully deleted
W20260318 02:51:38.663233 441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 66482us
W20260318 02:51:38.664153 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet b9a6d8d743a742a4b2d19b85e59101cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9a6d8d743a742a4b2d19b85e59101cb already in progress: creating tablet
W20260318 02:51:38.664996 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 60dedba077d34435b30061bfba737412 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60dedba077d34435b30061bfba737412 already in progress: creating tablet
W20260318 02:51:38.665227 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet ecb2289a6bcd4b8ca6c3810b7d615bce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecb2289a6bcd4b8ca6c3810b7d615bce already in progress: creating tablet
I20260318 02:51:38.667433 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet b383fd49049c4c1daba3f1ed60899f3e (table default.Table_5ed9c43cfcf94d058b59ec604059817b [id=fc9e568fb3884c3ca8575e591393560e]) successfully deleted
I20260318 02:51:38.673470 1184 ts_tablet_manager.cc:1929] T 24c66e2cc96f458fb3279827cea4ca9e P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:38.674670 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a8591dbe29954c789b3bb7ece252f89e" } new_table_name: "default.Table_6188e1840e124ad0814b689b5887e654" modify_external_catalogs: true
W20260318 02:51:38.683540 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee5faed619d140fd99df5f104eb6adf9 has no consensus state
I20260318 02:51:38.677176 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fec974d146f44aeb72df483fa85b287 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:38.660826 1173 tablet_bootstrap.cc:492] T 065ebc3c000a4ad3873ee031ecf9986b P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:38.684887 1173 ts_tablet_manager.cc:1403] T 065ebc3c000a4ad3873ee031ecf9986b P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.059s user 0.003s sys 0.000s
I20260318 02:51:38.685755 1173 raft_consensus.cc:359] T 065ebc3c000a4ad3873ee031ecf9986b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.685956 1173 raft_consensus.cc:385] T 065ebc3c000a4ad3873ee031ecf9986b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.686014 1173 raft_consensus.cc:740] T 065ebc3c000a4ad3873ee031ecf9986b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
W20260318 02:51:38.686529 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 89b8448f18cb4d7c8c14edd76fd86c60 consensus state has no leader
I20260318 02:51:38.686949 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_74961d72446a429f916e0697790f2d0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:38.688814 1184 log.cc:1199] T 24c66e2cc96f458fb3279827cea4ca9e P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/24c66e2cc96f458fb3279827cea4ca9e
I20260318 02:51:38.689677 1174 tablet_bootstrap.cc:492] T 783c886a99994d6c8d9add724277819a P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:38.689798 1172 tablet_bootstrap.cc:492] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:38.689836 1174 ts_tablet_manager.cc:1403] T 783c886a99994d6c8d9add724277819a P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20260318 02:51:38.689981 1172 ts_tablet_manager.cc:1403] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.104s user 0.004s sys 0.000s
I20260318 02:51:38.690044 1184 ts_tablet_manager.cc:1950] T 24c66e2cc96f458fb3279827cea4ca9e P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:38.690217 457 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 3fccf1f2bc3547e9ba8cc5fe9419f70b (table default.Table_8afbb1eafd5f4977bfffdfd764689b39 [id=f282f0ee83114539bad2c36e8311e05e]). Expected version 2 got 0
I20260318 02:51:38.690372 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 903) took 2141 ms. Trace:
I20260318 02:51:38.690446 1184 rpcz_store.cc:276] 0318 02:51:36.548584 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.577518 (+ 28934us) service_pool.cc:225] Handling call
0318 02:51:38.437177 (+1859659us) ts_tablet_manager.cc:1151] Deleting tablet 24c66e2cc96f458fb3279827cea4ca9e
0318 02:51:38.437188 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.604305 (+167117us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.673338 (+ 69033us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.690354 (+ 17016us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1859464}
I20260318 02:51:38.690629 1174 raft_consensus.cc:359] T 783c886a99994d6c8d9add724277819a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.690791 1174 raft_consensus.cc:385] T 783c886a99994d6c8d9add724277819a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.690838 1174 raft_consensus.cc:740] T 783c886a99994d6c8d9add724277819a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.690780 1172 raft_consensus.cc:359] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.690932 1172 raft_consensus.cc:385] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.690984 1172 raft_consensus.cc:740] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.690960 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 24c66e2cc96f458fb3279827cea4ca9e (table default.Table_ac2dafcc68eb412da14e17b420c2bf92 [id=ade423581b18488699c64d3b107d0b07]) successfully deleted
I20260318 02:51:38.691020 1174 consensus_queue.cc:260] T 783c886a99994d6c8d9add724277819a P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.691164 1172 consensus_queue.cc:260] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.691505 1174 ts_tablet_manager.cc:1434] T 783c886a99994d6c8d9add724277819a P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260318 02:51:38.691735 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74961d72446a429f916e0697790f2d0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:38.691851 1174 tablet_bootstrap.cc:492] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:38.692665 1172 ts_tablet_manager.cc:1434] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:38.692952 1172 tablet_bootstrap.cc:492] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:38.693007 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_37aae142c970437f856dc0368bc7f382"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:38.693641 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37aae142c970437f856dc0368bc7f382 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:38.694433 1172 tablet_bootstrap.cc:654] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.694772 1174 tablet_bootstrap.cc:654] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:38.705751 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1fa6e24943d54a3ea40fd34980ba2b27 consensus state has no leader
I20260318 02:51:38.705596 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e404b68577c94087a07a7b0b59df0c5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:38.705986 449 master_service.cc:954] ReplaceTablet: received request to replace tablet 53462f4293594dd59ca17b712a1426c8 from {username='slave'} at 127.0.0.1:47158
W20260318 02:51:38.706502 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 33d90a619ae54227aaf95acd180af119 consensus state has no leader
I20260318 02:51:38.706843 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9120298498d84d788faf0bf46c505754"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:38.708000 1173 consensus_queue.cc:260] T 065ebc3c000a4ad3873ee031ecf9986b P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:38.708179 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 31ac876d59554349b897a9d2cb7c2c41 consensus state has no leader
I20260318 02:51:38.708498 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_04e409a69f51450a913d14a6a0086312" } modify_external_catalogs: true
I20260318 02:51:38.708643 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_04e409a69f51450a913d14a6a0086312" } modify_external_catalogs: true
I20260318 02:51:38.710523 1173 ts_tablet_manager.cc:1434] T 065ebc3c000a4ad3873ee031ecf9986b P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20260318 02:51:38.710736 2257 raft_consensus.cc:493] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:38.710862 1173 tablet_bootstrap.cc:492] T b8a46b4db30a48c99addf763f7edfb16 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:38.710880 2257 raft_consensus.cc:515] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.711474 2257 leader_election.cc:290] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:38.712132 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608df0ce4e1d4ed6b7655802a6f7f6bc" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:38.712949 719 leader_election.cc:343] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.715740 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608df0ce4e1d4ed6b7655802a6f7f6bc" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:38.715875 1174 tablet_bootstrap.cc:492] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:38.716149 1174 ts_tablet_manager.cc:1403] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.005s
W20260318 02:51:38.716418 719 leader_election.cc:343] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.716543 719 leader_election.cc:304] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:38.717069 2257 raft_consensus.cc:2749] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:38.717828 1174 raft_consensus.cc:359] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.718226 1174 raft_consensus.cc:385] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.718376 1174 raft_consensus.cc:740] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.718756 1174 consensus_queue.cc:260] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.721220 1174 ts_tablet_manager.cc:1434] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260318 02:51:38.724254 1174 tablet_bootstrap.cc:492] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:38.729909 1184 tablet_replica.cc:333] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:38.730242 1184 raft_consensus.cc:2243] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.730512 1184 raft_consensus.cc:2272] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.733764 2257 raft_consensus.cc:493] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:38.733920 2257 raft_consensus.cc:515] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.734105 1175 ts_tablet_manager.cc:1929] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.734220 1175 log.cc:1199] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/cc1543d0e1b1431baf6d2ab6a0484ca6
I20260318 02:51:38.734483 1175 ts_tablet_manager.cc:1950] T cc1543d0e1b1431baf6d2ab6a0484ca6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:38.734570 2257 leader_election.cc:290] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:38.735628 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f0750985d947a3a9323944540abbac" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:38.736321 719 leader_election.cc:343] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.736678 1174 tablet_bootstrap.cc:654] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.737030 1184 ts_tablet_manager.cc:1916] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.739387 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f0750985d947a3a9323944540abbac" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:38.740010 719 leader_election.cc:343] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.740159 719 leader_election.cc:304] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:38.740644 2257 raft_consensus.cc:2749] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:38.750126 1175 tablet_replica.cc:333] T 27fc03c90b584becb250546100af736c P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:38.750646 1175 raft_consensus.cc:2243] T 27fc03c90b584becb250546100af736c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.751008 1175 raft_consensus.cc:2272] T 27fc03c90b584becb250546100af736c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.753087 1175 ts_tablet_manager.cc:1916] T 27fc03c90b584becb250546100af736c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.754451 1174 tablet_bootstrap.cc:492] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:38.754762 1174 ts_tablet_manager.cc:1403] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.031s user 0.007s sys 0.002s
I20260318 02:51:38.758162 1174 raft_consensus.cc:359] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.758550 1174 raft_consensus.cc:385] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.758697 1174 raft_consensus.cc:740] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.759107 1174 consensus_queue.cc:260] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:38.761456 441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.104.131:37025, user_credentials={real_user=slave}} blocked reactor thread for 70546.2us
W20260318 02:51:38.761986 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e404b68577c94087a07a7b0b59df0c5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:38.763103 1172 tablet_bootstrap.cc:492] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:38.763248 1172 ts_tablet_manager.cc:1403] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.070s user 0.002s sys 0.000s
I20260318 02:51:38.764068 1172 raft_consensus.cc:359] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.764243 1172 raft_consensus.cc:385] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.764293 1172 raft_consensus.cc:740] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.764493 1172 consensus_queue.cc:260] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:38.764671 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9120298498d84d788faf0bf46c505754 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:38.764953 1172 ts_tablet_manager.cc:1434] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:38.766924 1174 ts_tablet_manager.cc:1434] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260318 02:51:38.768503 1174 tablet_bootstrap.cc:492] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:38.779630 761 tablet_service.cc:1511] Processing CreateTablet for tablet 61aaa708496c4d1b81690d59c54b98a7 (DEFAULT_TABLE table=default.Table_d1d7f165d03741de8da1ad12a2e5994b [id=5373abb289c5474cbcb6d9406c81cd7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.779512 448 catalog_manager.cc:5671] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:38.779924 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet d2fb9c8f339444bc8d7c6479e7d87f44 (table default.Table_278b10b38c074522b0e03e24d653346d [id=895bbd90cf47462ab116ee3f37e94982]). Expected version 3 got 0
I20260318 02:51:38.780160 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 061ebb62f4c54a2a8c24b90ec15402d3 (table default.Table_88caf570ec6a4dfea94952fb5718c9c6 [id=5a3571f0765948588578d8e5185807a8]). Expected version 1 got 0
I20260318 02:51:38.780673 453 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_4da517198db54744b96210b1f4438731 [id=541170c7c4bf49deb86cd4c15ffdd04f] alter complete (version 1)
I20260318 02:51:38.781294 750 tablet_service.cc:1511] Processing CreateTablet for tablet db8a5b0b3ae94144b6efb66f67d40ea2 (DEFAULT_TABLE table=default.Table_2adcf914f85541f0ad00e19d929d28d1 [id=6e929da718f14ca89555bdcd979300a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.782050 1172 tablet_bootstrap.cc:492] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:38.783524 1172 tablet_bootstrap.cc:654] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.785557 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet cc1543d0e1b1431baf6d2ab6a0484ca6 (table default.Table_d9fd8f01d59b47d9bc3053e485415619 [id=e7c0679f0795485db510de58088251a3]) successfully deleted
I20260318 02:51:38.785729 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61aaa708496c4d1b81690d59c54b98a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.786509 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 065ebc3c000a4ad3873ee031ecf9986b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:38.786862 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 3d28aa6525184246a71ad198cf1df763 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d28aa6525184246a71ad198cf1df763 already in progress: creating tablet
W20260318 02:51:38.787065 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 9d9cc0f3aef0401c8f072b11d9498a59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d9cc0f3aef0401c8f072b11d9498a59 already in progress: creating tablet
I20260318 02:51:38.788264 1184 ts_tablet_manager.cc:1929] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.788368 1184 log.cc:1199] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/ed697b98352c4f65931c154b1f160991
I20260318 02:51:38.788620 1184 ts_tablet_manager.cc:1950] T ed697b98352c4f65931c154b1f160991 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:38.789165 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_dd64f667c9894282a95897cd143f0965"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:38.789724 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd64f667c9894282a95897cd143f0965 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:38.789776 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db8a5b0b3ae94144b6efb66f67d40ea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.792160 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_52da837696ba4ad2be63b9b9d93f1c0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:38.792935 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_bfb0d740bb2448809a01cd8b7365090b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:38.793404 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfb0d740bb2448809a01cd8b7365090b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:38.793619 907 tablet_service.cc:1511] Processing CreateTablet for tablet 61aaa708496c4d1b81690d59c54b98a7 (DEFAULT_TABLE table=default.Table_d1d7f165d03741de8da1ad12a2e5994b [id=5373abb289c5474cbcb6d9406c81cd7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.794023 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61aaa708496c4d1b81690d59c54b98a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.794593 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c75d2e6aa5dd4b8a89c29ec1d491967b" } modify_external_catalogs: true
I20260318 02:51:38.794731 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c75d2e6aa5dd4b8a89c29ec1d491967b" } modify_external_catalogs: true
W20260318 02:51:38.796221 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52da837696ba4ad2be63b9b9d93f1c0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:38.797645 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 909) took 2212 ms. Trace:
I20260318 02:51:38.797762 1173 tablet_bootstrap.cc:654] T b8a46b4db30a48c99addf763f7edfb16 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.797744 1184 rpcz_store.cc:276] 0318 02:51:36.585592 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.603787 (+ 18195us) service_pool.cc:225] Handling call
0318 02:51:38.729841 (+2126054us) ts_tablet_manager.cc:1151] Deleting tablet ed697b98352c4f65931c154b1f160991
0318 02:51:38.729858 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.742551 (+ 12693us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.788136 (+ 45585us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:38.797615 (+ 9479us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2125836}
I20260318 02:51:38.798097 1184 tablet_replica.cc:333] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:38.798317 1184 raft_consensus.cc:2243] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.798498 1184 raft_consensus.cc:2272] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.799341 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 61aaa708496c4d1b81690d59c54b98a7 (DEFAULT_TABLE table=default.Table_d1d7f165d03741de8da1ad12a2e5994b [id=5373abb289c5474cbcb6d9406c81cd7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.799412 903 tablet_service.cc:1511] Processing CreateTablet for tablet db8a5b0b3ae94144b6efb66f67d40ea2 (DEFAULT_TABLE table=default.Table_2adcf914f85541f0ad00e19d929d28d1 [id=6e929da718f14ca89555bdcd979300a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.799728 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61aaa708496c4d1b81690d59c54b98a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.799754 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db8a5b0b3ae94144b6efb66f67d40ea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.800336 2152 raft_consensus.cc:493] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:38.800453 2152 raft_consensus.cc:515] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:38.802634 999 leader_election.cc:343] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 8a0af3aecf4f485ebc54e1955eca8c92
I20260318 02:51:38.802919 2152 leader_election.cc:290] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:38.804757 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet a628b6d2523344edbf78695a041113cf
I20260318 02:51:38.805516 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1dd07777d8ae4e569eb11bc585d0dab8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:38.806043 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1dd07777d8ae4e569eb11bc585d0dab8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:38.807253 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2f3309339d61445eaf38baf068216ef4
I20260318 02:51:38.807667 451 catalog_manager.cc:6741] ReplaceTablet: tablet 2f3309339d61445eaf38baf068216ef4 deleted and replaced by tablet cce09767819441e599e7a62526d2cb75
I20260318 02:51:38.807969 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_30cd08f319f842e4bd4fe25df7dccad6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:38.808506 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30cd08f319f842e4bd4fe25df7dccad6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:38.808885 748 tablet_service.cc:1558] Processing DeleteTablet for tablet a628b6d2523344edbf78695a041113cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:38.809242 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f3309339d61445eaf38baf068216ef4 with delete_type TABLET_DATA_DELETED (replaced by tablet cce09767819441e599e7a62526d2cb75) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:38.809729 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 53462f4293594dd59ca17b712a1426c8
I20260318 02:51:38.810103 449 catalog_manager.cc:6741] ReplaceTablet: tablet 53462f4293594dd59ca17b712a1426c8 deleted and replaced by tablet 23e82f24405b465fa26074a4370ed3d3
I20260318 02:51:38.810384 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6800c6f047d6426daca032c1a2866084" } modify_external_catalogs: true
I20260318 02:51:38.810535 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6800c6f047d6426daca032c1a2866084" } modify_external_catalogs: true
I20260318 02:51:38.810592 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 53462f4293594dd59ca17b712a1426c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 23e82f24405b465fa26074a4370ed3d3) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:38.811739 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0af3aecf4f485ebc54e1955eca8c92" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:38.812397 997 leader_election.cc:343] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.812536 997 leader_election.cc:304] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:38.812788 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 255979f9bbe74dd583798ea5da2ae4c4
I20260318 02:51:38.813419 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d3f9c221caf74f098016962ca5ae047e" } modify_external_catalogs: true
I20260318 02:51:38.813558 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d3f9c221caf74f098016962ca5ae047e" } modify_external_catalogs: true
I20260318 02:51:38.815703 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 255979f9bbe74dd583798ea5da2ae4c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:38.815972 759 tablet_service.cc:1511] Processing CreateTablet for tablet ee5faed619d140fd99df5f104eb6adf9 (DEFAULT_TABLE table=default.Table_420c4090dd86460db6ce0e7f8014ef94 [id=0028112644c7402fa64a901c1f7fdf53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.816212 2296 raft_consensus.cc:2749] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:38.816401 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5faed619d140fd99df5f104eb6adf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.816401 2296 raft_consensus.cc:493] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:38.816498 2296 raft_consensus.cc:515] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.817126 2296 leader_election.cc:290] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
W20260318 02:51:38.818143 999 leader_election.cc:343] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 3dda9bd9befd427fac9dfde6f299a6ab
I20260318 02:51:38.820884 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dda9bd9befd427fac9dfde6f299a6ab" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:38.821105 1175 ts_tablet_manager.cc:1929] T 27fc03c90b584becb250546100af736c P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260318 02:51:38.821468 997 leader_election.cc:343] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.821611 997 leader_election.cc:304] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:38.822047 2296 raft_consensus.cc:2749] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:38.825516 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet a628b6d2523344edbf78695a041113cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a628b6d2523344edbf78695a041113cf already in progress: creating tablet
W20260318 02:51:38.825769 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2f3309339d61445eaf38baf068216ef4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f3309339d61445eaf38baf068216ef4 already in progress: creating tablet
W20260318 02:51:38.825932 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 53462f4293594dd59ca17b712a1426c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53462f4293594dd59ca17b712a1426c8 already in progress: creating tablet
W20260318 02:51:38.826102 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 255979f9bbe74dd583798ea5da2ae4c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 255979f9bbe74dd583798ea5da2ae4c4 already in progress: creating tablet
I20260318 02:51:38.829082 1175 log.cc:1199] T 27fc03c90b584becb250546100af736c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/27fc03c90b584becb250546100af736c
I20260318 02:51:38.830346 748 tablet_service.cc:1511] Processing CreateTablet for tablet c97d655290d64cf8b546080ddb2c2ccf (DEFAULT_TABLE table=default.Table_0d3f85f7408a4890b0cd314f1dfe1507 [id=aa83e5a4d50c46cc8998410403da169d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.830766 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97d655290d64cf8b546080ddb2c2ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.833020 1175 ts_tablet_manager.cc:1950] T 27fc03c90b584becb250546100af736c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:38.842851 761 tablet_service.cc:1511] Processing CreateTablet for tablet 05439ca65b474324aee88ccf7dd341e5 (DEFAULT_TABLE table=default.Table_3bf4ed9b878547bc8d219b080a39c2fd [id=4efd014221664d63955bf5e041f16a61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.844365 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05439ca65b474324aee88ccf7dd341e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.847661 1175 tablet_replica.cc:333] T 083493ab9d26493a924025fbd96ab1d7 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:38.848199 907 tablet_service.cc:1558] Processing DeleteTablet for tablet a628b6d2523344edbf78695a041113cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:38.848830 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet a628b6d2523344edbf78695a041113cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.847882 1175 raft_consensus.cc:2243] T 083493ab9d26493a924025fbd96ab1d7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.849646 1175 raft_consensus.cc:2272] T 083493ab9d26493a924025fbd96ab1d7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.851491 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f3309339d61445eaf38baf068216ef4 with delete_type TABLET_DATA_DELETED (replaced by tablet cce09767819441e599e7a62526d2cb75) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.851527 750 tablet_service.cc:1511] Processing CreateTablet for tablet e7d96d23825043fe97d6d3120904ce24 (DEFAULT_TABLE table=default.Table_1cb17f7b14bb4c1e8282b948e7a26c74 [id=ed9feaaa8a49425e89322960a02ede8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.851960 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7d96d23825043fe97d6d3120904ce24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.855233 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 53462f4293594dd59ca17b712a1426c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 23e82f24405b465fa26074a4370ed3d3) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.855790 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 255979f9bbe74dd583798ea5da2ae4c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:38.856316 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 255979f9bbe74dd583798ea5da2ae4c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.856930 1033 tablet_service.cc:1511] Processing CreateTablet for tablet db8a5b0b3ae94144b6efb66f67d40ea2 (DEFAULT_TABLE table=default.Table_2adcf914f85541f0ad00e19d929d28d1 [id=6e929da718f14ca89555bdcd979300a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.857039 891 tablet_service.cc:1511] Processing CreateTablet for tablet ee5faed619d140fd99df5f104eb6adf9 (DEFAULT_TABLE table=default.Table_420c4090dd86460db6ce0e7f8014ef94 [id=0028112644c7402fa64a901c1f7fdf53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.857306 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db8a5b0b3ae94144b6efb66f67d40ea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.857430 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5faed619d140fd99df5f104eb6adf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.858911 1174 tablet_bootstrap.cc:654] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.863564 453 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_1960d955ce3f45458d16f7f892da82fc [id=61241ff920584692bba476799b6a60e7] alter complete (version 3)
I20260318 02:51:38.864785 1184 ts_tablet_manager.cc:1916] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.865197 450 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet f233980e01ba489f842c91570e0751ec
I20260318 02:51:38.865610 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 461adcc8bbd94d30b9b84d1010430829 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:38.865842 1176 tablet_replica.cc:333] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:38.865968 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 53462f4293594dd59ca17b712a1426c8 with delete_type TABLET_DATA_DELETED (replaced by tablet 23e82f24405b465fa26074a4370ed3d3) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:38.866019 1176 raft_consensus.cc:2243] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.866147 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f3309339d61445eaf38baf068216ef4 with delete_type TABLET_DATA_DELETED (replaced by tablet cce09767819441e599e7a62526d2cb75) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:38.866156 1176 raft_consensus.cc:2272] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.866642 1176 ts_tablet_manager.cc:1916] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.872548 1176 ts_tablet_manager.cc:1929] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.872905 1176 log.cc:1199] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/461adcc8bbd94d30b9b84d1010430829
I20260318 02:51:38.873268 1176 ts_tablet_manager.cc:1950] T 461adcc8bbd94d30b9b84d1010430829 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:38.874294 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 461adcc8bbd94d30b9b84d1010430829 (table default.Table_600a629a518c46678144af62a75ea690 [id=9de656e677a540ad90ccd30ab1d092e5]) successfully deleted
I20260318 02:51:38.865610 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 46ce65cca47f48db94e70226494cfbae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:38.874963 1176 tablet_replica.cc:333] T 46ce65cca47f48db94e70226494cfbae P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:38.875216 1176 raft_consensus.cc:2243] T 46ce65cca47f48db94e70226494cfbae P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.875403 1176 raft_consensus.cc:2272] T 46ce65cca47f48db94e70226494cfbae P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.875926 1176 ts_tablet_manager.cc:1916] T 46ce65cca47f48db94e70226494cfbae P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.877292 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 7c3976c82c914fbaa88df25e1642ed6c
I20260318 02:51:38.877543 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 03dba645392b46c48cf543fefc6e4d53
I20260318 02:51:38.878520 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c3976c82c914fbaa88df25e1642ed6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:38.878777 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 03dba645392b46c48cf543fefc6e4d53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:38.881108 448 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 3aa05403966349ae9056777d913a0db6 (table default.Table_da86a39b826541a9972e82d6cb145a84 [id=5b2e7b122a394e058dc5b2fd84a0f558]). Expected version 1 got 0
I20260318 02:51:38.881313 448 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 184ce58aa96d4e70ad7b2783f19ccdeb (table default.Table_f7c512acb00946069cb735b743f8b2af [id=3e7b4f46e6c04379b32c2d39de6aa759]). Expected version 1 got 0
I20260318 02:51:38.883822 748 tablet_service.cc:1511] Processing CreateTablet for tablet 71b45ec1da6440b98c796e61d3551424 (DEFAULT_TABLE table=default.Table_4f845969128d421bb81de4850d6f2f0c [id=acbfe636c8c044c69b9eb83dda18a5e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.884121 1027 tablet_service.cc:1511] Processing CreateTablet for tablet ee5faed619d140fd99df5f104eb6adf9 (DEFAULT_TABLE table=default.Table_420c4090dd86460db6ce0e7f8014ef94 [id=0028112644c7402fa64a901c1f7fdf53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.884229 449 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet d0652735b8c24c23ade92913c1c7ad0f (table default.Table_20867faf86da4889b7995990926923a7 [id=5bc787aad96b4abd82ab3e033020ea9c]). Expected version 1 got 0
I20260318 02:51:38.884408 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b45ec1da6440b98c796e61d3551424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.884577 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5faed619d140fd99df5f104eb6adf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.889532 1175 ts_tablet_manager.cc:1916] T 083493ab9d26493a924025fbd96ab1d7 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.891335 907 tablet_service.cc:1511] Processing CreateTablet for tablet c97d655290d64cf8b546080ddb2c2ccf (DEFAULT_TABLE table=default.Table_0d3f85f7408a4890b0cd314f1dfe1507 [id=aa83e5a4d50c46cc8998410403da169d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.891798 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97d655290d64cf8b546080ddb2c2ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.898198 448 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_2999327e014d4062a8e1aef2ba9ee277 [id=545ec19ee7a34ceb8e7adb93b6eaecf8] alter complete (version 2)
I20260318 02:51:38.901845 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 783c886a99994d6c8d9add724277819a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:38.902065 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 64c2a579264e43b9a1e25ded000d4d9f with delete_type TABLET_DATA_DELETED (replaced by tablet 5ce282f91c2f44b59c0b6ea836ad5d0e) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:38.903163 1173 tablet_bootstrap.cc:492] T b8a46b4db30a48c99addf763f7edfb16 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:38.903417 1173 ts_tablet_manager.cc:1403] T b8a46b4db30a48c99addf763f7edfb16 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.193s user 0.015s sys 0.001s
I20260318 02:51:38.903692 1033 tablet_service.cc:1511] Processing CreateTablet for tablet c97d655290d64cf8b546080ddb2c2ccf (DEFAULT_TABLE table=default.Table_0d3f85f7408a4890b0cd314f1dfe1507 [id=aa83e5a4d50c46cc8998410403da169d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.903880 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 27fc03c90b584becb250546100af736c (table default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]) successfully deleted
I20260318 02:51:38.904170 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97d655290d64cf8b546080ddb2c2ccf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:38.904198 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet dff92dfca39e47f98d709cc67b97df66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dff92dfca39e47f98d709cc67b97df66 already in progress: creating tablet
I20260318 02:51:38.904614 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet ed697b98352c4f65931c154b1f160991 (table default.Table_e8949513489d44e0a36b239de4fbed56 [id=412636f9a1d04551b9872e99570ba8fb]) successfully deleted
I20260318 02:51:38.904543 1173 raft_consensus.cc:359] T b8a46b4db30a48c99addf763f7edfb16 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.904830 1173 raft_consensus.cc:385] T b8a46b4db30a48c99addf763f7edfb16 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.904933 1173 raft_consensus.cc:740] T b8a46b4db30a48c99addf763f7edfb16 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.905217 1173 consensus_queue.cc:260] T b8a46b4db30a48c99addf763f7edfb16 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.905671 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 05439ca65b474324aee88ccf7dd341e5 (DEFAULT_TABLE table=default.Table_3bf4ed9b878547bc8d219b080a39c2fd [id=4efd014221664d63955bf5e041f16a61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.906031 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05439ca65b474324aee88ccf7dd341e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.906450 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 3dda9bd9befd427fac9dfde6f299a6ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.909040 1173 ts_tablet_manager.cc:1434] T b8a46b4db30a48c99addf763f7edfb16 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260318 02:51:38.909341 1173 tablet_bootstrap.cc:492] T 5ffcfc0784d947419fc9b22aa636521c P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:38.911653 903 tablet_service.cc:1511] Processing CreateTablet for tablet e7d96d23825043fe97d6d3120904ce24 (DEFAULT_TABLE table=default.Table_1cb17f7b14bb4c1e8282b948e7a26c74 [id=ed9feaaa8a49425e89322960a02ede8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.912025 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7d96d23825043fe97d6d3120904ce24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.915678 907 tablet_service.cc:1511] Processing CreateTablet for tablet 05439ca65b474324aee88ccf7dd341e5 (DEFAULT_TABLE table=default.Table_3bf4ed9b878547bc8d219b080a39c2fd [id=4efd014221664d63955bf5e041f16a61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.916061 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05439ca65b474324aee88ccf7dd341e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.919798 1175 ts_tablet_manager.cc:1929] T 083493ab9d26493a924025fbd96ab1d7 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.920279 752 tablet_service.cc:1511] Processing CreateTablet for tablet e51e65aee63a453b848d79feaf83307e (DEFAULT_TABLE table=default.Table_efb2704a3a7246fd94c799eba891c6de [id=9d89cb9cb36f4ca298d25b1efc9d0185]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.920696 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e51e65aee63a453b848d79feaf83307e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.920964 754 tablet_service.cc:1511] Processing CreateTablet for tablet 506666a94b0947189474f1e4a2b5ae64 (DEFAULT_TABLE table=default.Table_ee5a037155c842a692c67296f75031ba [id=a379faf4471840c0b9577fd974a6c493]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.923955 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506666a94b0947189474f1e4a2b5ae64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.925486 1172 tablet_bootstrap.cc:492] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:38.925614 1172 ts_tablet_manager.cc:1403] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.144s user 0.002s sys 0.002s
I20260318 02:51:38.926339 1172 raft_consensus.cc:359] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.926497 1172 raft_consensus.cc:385] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.926539 1172 raft_consensus.cc:740] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.926770 1172 consensus_queue.cc:260] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:38.929656 1172 ts_tablet_manager.cc:1434] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260318 02:51:38.929993 1172 tablet_bootstrap.cc:492] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:38.931459 1172 tablet_bootstrap.cc:654] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.933697 757 tablet_service.cc:1511] Processing CreateTablet for tablet 16f00e7e7ca847e9a5ebfd9bb5809147 (DEFAULT_TABLE table=default.Table_ca056f93d2b34add91c12aaf8b2ba513 [id=b728a168c45f4feca723389746e6f5ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.933873 751 tablet_service.cc:1511] Processing CreateTablet for tablet 496a16cba3824378ab5c3a2f08d5df17 (DEFAULT_TABLE table=default.Table_2421f558555545da81fa056cdb11cbf0 [id=37e3acd2ae6442f3934e49b4f46fb866]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.934073 756 tablet_service.cc:1511] Processing CreateTablet for tablet 1618fadf9f9d41f0acfcaf97f47409fd (DEFAULT_TABLE table=default.Table_4e016593707b40a8ae356583b104d313 [id=6dcc841acc3343cfb5a7393ca8d45df2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.934087 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f00e7e7ca847e9a5ebfd9bb5809147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.933899 766 tablet_service.cc:1511] Processing CreateTablet for tablet 31b6c2df8e1b47c3980f2c2a4295e659 (DEFAULT_TABLE table=default.Table_0bcd699c81914d4abeece81e1348f239 [id=ce35f1fd8f8a4bbb85b6100a0f893211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.934580 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b6c2df8e1b47c3980f2c2a4295e659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.934553 753 tablet_service.cc:1511] Processing CreateTablet for tablet 9279df5c45b5457a9177405a5e10163c (DEFAULT_TABLE table=default.Table_28d17f0ce0ec43f6848c9672433b33ab [id=9a3eca232830499db821e692bf8558a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.934818 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9279df5c45b5457a9177405a5e10163c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.936937 755 tablet_service.cc:1511] Processing CreateTablet for tablet ccd7f2117d4d45ddad02770b236a55d8 (DEFAULT_TABLE table=default.Table_fd2aa32d34794918a4ee7b6ece38a34c [id=04522827506649e68bef062e2fbcc14b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.937256 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd7f2117d4d45ddad02770b236a55d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.939756 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496a16cba3824378ab5c3a2f08d5df17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.941299 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1618fadf9f9d41f0acfcaf97f47409fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.942915 1175 log.cc:1199] T 083493ab9d26493a924025fbd96ab1d7 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/083493ab9d26493a924025fbd96ab1d7
I20260318 02:51:38.944639 1175 ts_tablet_manager.cc:1950] T 083493ab9d26493a924025fbd96ab1d7 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:38.945611 1175 tablet_replica.cc:333] T 1b439fa2481a43c78d2c486d8711175f P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:38.946286 2257 raft_consensus.cc:493] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:38.946409 2257 raft_consensus.cc:515] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.946967 2257 leader_election.cc:290] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:38.955646 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_20195e4878724c238c3830800130bb6d" } new_table_name: "default.Table_88fde304d3254f73ade7fd5fc6dd2887" modify_external_catalogs: true
I20260318 02:51:38.957441 1174 tablet_bootstrap.cc:492] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:38.949024 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c2a579264e43b9a1e25ded000d4d9f" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:38.960690 1174 ts_tablet_manager.cc:1403] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.193s user 0.002s sys 0.002s
I20260318 02:51:38.949460 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c3976c82c914fbaa88df25e1642ed6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:38.961349 719 leader_election.cc:343] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:38.950368 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 03dba645392b46c48cf543fefc6e4d53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:38.953373 902 tablet_service.cc:1511] Processing CreateTablet for tablet 71b45ec1da6440b98c796e61d3551424 (DEFAULT_TABLE table=default.Table_4f845969128d421bb81de4850d6f2f0c [id=acbfe636c8c044c69b9eb83dda18a5e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.961596 1175 raft_consensus.cc:2243] T 1b439fa2481a43c78d2c486d8711175f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:38.961755 1175 raft_consensus.cc:2272] T 1b439fa2481a43c78d2c486d8711175f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:38.961912 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b45ec1da6440b98c796e61d3551424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.961944 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e404b68577c94087a07a7b0b59df0c5d" } new_table_name: "default.Table_8a26eebc10854c6a84b60130cb3e5841" modify_external_catalogs: true
I20260318 02:51:38.962283 1175 ts_tablet_manager.cc:1916] T 1b439fa2481a43c78d2c486d8711175f P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.966084 901 tablet_service.cc:1558] Processing DeleteTablet for tablet b8a46b4db30a48c99addf763f7edfb16 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e9a5b965cb141e1a5dd1c96f590ad5a) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:38.966289 891 tablet_service.cc:1511] Processing CreateTablet for tablet e51e65aee63a453b848d79feaf83307e (DEFAULT_TABLE table=default.Table_efb2704a3a7246fd94c799eba891c6de [id=9d89cb9cb36f4ca298d25b1efc9d0185]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.966697 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e51e65aee63a453b848d79feaf83307e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:38.972426 1174 raft_consensus.cc:359] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.920267 1173 tablet_bootstrap.cc:654] T 5ffcfc0784d947419fc9b22aa636521c P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:38.972657 2328 tablet.cc:1723] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260318 02:51:38.978293 1174 raft_consensus.cc:385] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:38.978387 1174 raft_consensus.cc:740] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.975203 759 tablet_service.cc:1511] Processing CreateTablet for tablet a2b8723a0d354f248ffe4cd2ef5a21dc (DEFAULT_TABLE table=default.Table_666699f265dc4783bc3c8315e742e806 [id=48ce3e7eda964c70b96e3325196c623a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:38.979074 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b8723a0d354f248ffe4cd2ef5a21dc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:38.980335 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c8d7aad0f2c545628a13b2ad3269dcd6 has no consensus state
I20260318 02:51:38.983233 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 49afed40c7aa4f2d913daed8055a098e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:38.983978 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2aaac92ff81d4c9bb05cf21e7b4d9979 consensus state has no leader
I20260318 02:51:38.980698 1174 consensus_queue.cc:260] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:38.987910 1174 ts_tablet_manager.cc:1434] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20260318 02:51:38.989735 1175 ts_tablet_manager.cc:1929] T 1b439fa2481a43c78d2c486d8711175f P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:38.989924 1175 log.cc:1199] T 1b439fa2481a43c78d2c486d8711175f P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/1b439fa2481a43c78d2c486d8711175f
I20260318 02:51:38.990280 1175 ts_tablet_manager.cc:1950] T 1b439fa2481a43c78d2c486d8711175f P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:38.990795 1174 tablet_bootstrap.cc:492] T c4051c8e4d3d49829f9eac8e36baab2f P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:38.993388 454 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_4e770bc308894d9094b88315d9093ba5 [id=433e7aa77412424ebb38784bb073d1fb] alter complete (version 6)
I20260318 02:51:38.993254 1173 tablet_bootstrap.cc:492] T 5ffcfc0784d947419fc9b22aa636521c P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:38.944319 2295 raft_consensus.cc:493] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:39.000794 1173 ts_tablet_manager.cc:1403] T 5ffcfc0784d947419fc9b22aa636521c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.092s user 0.004s sys 0.000s
I20260318 02:51:39.000938 2295 raft_consensus.cc:515] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.001593 2295 leader_election.cc:290] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:38.949007 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c2a579264e43b9a1e25ded000d4d9f" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:39.001587 1173 raft_consensus.cc:359] T 5ffcfc0784d947419fc9b22aa636521c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.001772 1173 raft_consensus.cc:385] T 5ffcfc0784d947419fc9b22aa636521c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:39.001825 1173 raft_consensus.cc:740] T 5ffcfc0784d947419fc9b22aa636521c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:38.949901 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c3976c82c914fbaa88df25e1642ed6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.950708 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet 03dba645392b46c48cf543fefc6e4d53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.952229 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a7ddc0807d742cea258f889390e2142 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.952520 1030 tablet_service.cc:1511] Processing CreateTablet for tablet e7d96d23825043fe97d6d3120904ce24 (DEFAULT_TABLE table=default.Table_1cb17f7b14bb4c1e8282b948e7a26c74 [id=ed9feaaa8a49425e89322960a02ede8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.002282 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7d96d23825043fe97d6d3120904ce24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.002550 1175 tablet_replica.cc:333] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:39.002724 1175 raft_consensus.cc:2243] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:39.002862 1175 raft_consensus.cc:2272] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:39.004148 1175 ts_tablet_manager.cc:1916] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:38.952756 2326 tablet.cc:1723] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260318 02:51:38.954676 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a0af3aecf4f485ebc54e1955eca8c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:38.955087 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 56335a4a2c294f67a22206e6a59e29a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:39.005942 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf344c2361b7412c87a7c7f9a72a15b6" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:38.970606 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 71b45ec1da6440b98c796e61d3551424 (DEFAULT_TABLE table=default.Table_4f845969128d421bb81de4850d6f2f0c [id=acbfe636c8c044c69b9eb83dda18a5e3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:38.983002 999 consensus_peers.cc:597] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d -> Peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Couldn't send request to peer 6a903d876086423b8016d705b98895ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 27fc03c90b584becb250546100af736c. This is attempt 1: this message will repeat every 5th retry.
W20260318 02:51:39.009721 997 leader_election.cc:343] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:39.009984 719 leader_election.cc:343] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.010128 719 leader_election.cc:304] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:39.010281 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b45ec1da6440b98c796e61d3551424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.010811 2257 raft_consensus.cc:2749] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:39.012135 999 leader_election.cc:343] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: bf344c2361b7412c87a7c7f9a72a15b6
I20260318 02:51:39.012254 999 leader_election.cc:304] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:39.012568 1174 tablet_bootstrap.cc:654] T c4051c8e4d3d49829f9eac8e36baab2f P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:39.012667 2295 raft_consensus.cc:2749] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:39.012496 1176 ts_tablet_manager.cc:1929] T 46ce65cca47f48db94e70226494cfbae P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:39.013278 1176 log.cc:1199] T 46ce65cca47f48db94e70226494cfbae P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/46ce65cca47f48db94e70226494cfbae
I20260318 02:51:39.015861 1173 consensus_queue.cc:260] T 5ffcfc0784d947419fc9b22aa636521c P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.018087 1176 ts_tablet_manager.cc:1950] T 46ce65cca47f48db94e70226494cfbae P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:39.020427 1173 ts_tablet_manager.cc:1434] T 5ffcfc0784d947419fc9b22aa636521c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260318 02:51:39.025259 1184 ts_tablet_manager.cc:1929] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:39.025467 1184 log.cc:1199] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/1ef3181adc0542229897369591a30465
I20260318 02:51:39.025803 1184 ts_tablet_manager.cc:1950] T 1ef3181adc0542229897369591a30465 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:39.028190 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 46ce65cca47f48db94e70226494cfbae (table default.Table_a1b9dc84de4a42288ee7754f4a110daa [id=a858f67286ca4fe09d8e64e68b31337a]) successfully deleted
I20260318 02:51:39.029603 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 912) took 2306 ms. Trace:
I20260318 02:51:39.031081 926 raft_consensus.cc:3060] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:39.029501 833 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:39.034243 902 tablet_service.cc:1511] Processing CreateTablet for tablet 16f00e7e7ca847e9a5ebfd9bb5809147 (DEFAULT_TABLE table=default.Table_ca056f93d2b34add91c12aaf8b2ba513 [id=b728a168c45f4feca723389746e6f5ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.034633 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f00e7e7ca847e9a5ebfd9bb5809147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.034787 889 tablet_service.cc:1511] Processing CreateTablet for tablet 1618fadf9f9d41f0acfcaf97f47409fd (DEFAULT_TABLE table=default.Table_4e016593707b40a8ae356583b104d313 [id=6dcc841acc3343cfb5a7393ca8d45df2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.035153 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1618fadf9f9d41f0acfcaf97f47409fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.035295 901 tablet_service.cc:1511] Processing CreateTablet for tablet 31b6c2df8e1b47c3980f2c2a4295e659 (DEFAULT_TABLE table=default.Table_0bcd699c81914d4abeece81e1348f239 [id=ce35f1fd8f8a4bbb85b6100a0f893211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.035630 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b6c2df8e1b47c3980f2c2a4295e659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.035832 903 tablet_service.cc:1511] Processing CreateTablet for tablet 506666a94b0947189474f1e4a2b5ae64 (DEFAULT_TABLE table=default.Table_ee5a037155c842a692c67296f75031ba [id=a379faf4471840c0b9577fd974a6c493]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.036195 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506666a94b0947189474f1e4a2b5ae64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.034597 2197 raft_consensus.cc:493] T 1350684961f645e089fc3fd9ba3a5b09 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:39.039927 2197 raft_consensus.cc:515] T 1350684961f645e089fc3fd9ba3a5b09 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.040657 2197 leader_election.cc:290] T 1350684961f645e089fc3fd9ba3a5b09 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:39.041762 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1350684961f645e089fc3fd9ba3a5b09" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
W20260318 02:51:39.048162 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 7c3976c82c914fbaa88df25e1642ed6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c3976c82c914fbaa88df25e1642ed6c already in progress: creating tablet
I20260318 02:51:39.048662 1173 tablet_bootstrap.cc:492] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:39.050619 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 03dba645392b46c48cf543fefc6e4d53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03dba645392b46c48cf543fefc6e4d53 already in progress: creating tablet
I20260318 02:51:39.050894 891 tablet_service.cc:1511] Processing CreateTablet for tablet a2b8723a0d354f248ffe4cd2ef5a21dc (DEFAULT_TABLE table=default.Table_666699f265dc4783bc3c8315e742e806 [id=48ce3e7eda964c70b96e3325196c623a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.051280 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b8723a0d354f248ffe4cd2ef5a21dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.051981 1176 tablet_replica.cc:333] T 783c886a99994d6c8d9add724277819a P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:39.053097 1176 raft_consensus.cc:2243] T 783c886a99994d6c8d9add724277819a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:39.054106 1176 raft_consensus.cc:2272] T 783c886a99994d6c8d9add724277819a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:39.058317 1176 ts_tablet_manager.cc:1916] T 783c886a99994d6c8d9add724277819a P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:39.061842 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 083493ab9d26493a924025fbd96ab1d7 (table default.Table_0bc143d5f9bf42be85f911249422e04d [id=607d58701fef4551addddb65e64f7dcd]) successfully deleted
I20260318 02:51:39.062295 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 1b439fa2481a43c78d2c486d8711175f (table default.Table_46d782df1eb242b081563aeb0ae51278 [id=2cc63f24c25a4fc396e6d026ce1ba876]) successfully deleted
W20260318 02:51:39.062518 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet b383fd49049c4c1daba3f1ed60899f3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b383fd49049c4c1daba3f1ed60899f3e already in progress: creating tablet
I20260318 02:51:39.063680 455 master_service.cc:954] ReplaceTablet: received request to replace tablet 1814c903ba4f456098f862e9490aa05e from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:39.064329 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_96058704fc874517924223389d09a2cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:39.065337 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ff28a5f6be7743ff92181ad445d72c65" } new_table_name: "default.Table_558f141be2cb4cb4848fa3585dd6d35e" modify_external_catalogs: true
I20260318 02:51:39.065366 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ef70b74b7ca84cd5be4468de1ff4eac4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.065893 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef70b74b7ca84cd5be4468de1ff4eac4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.066033 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c7ff1bf8d29b485f92f33882f86219e5" } new_table_name: "default.Table_815494a3bd484f0699b693f7c6dbc5d7" modify_external_catalogs: true
I20260318 02:51:39.067044 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_de60cf0754954aff9bdf9288a5b026fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.067567 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de60cf0754954aff9bdf9288a5b026fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:39.067992 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96058704fc874517924223389d09a2cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.068689 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5541a4b1189d4b58ae13086d7ec46def" } new_table_name: "default.Table_09f572f20c2849d48c4eadedf4acb092" modify_external_catalogs: true
I20260318 02:51:39.068796 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a52cf4569ccd4c88843208989a5bb9fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.069231 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a52cf4569ccd4c88843208989a5bb9fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.070199 453 master_service.cc:954] ReplaceTablet: received request to replace tablet c9d09130cded4b2b9478a85066379e25 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:39.071084 1174 tablet_bootstrap.cc:492] T c4051c8e4d3d49829f9eac8e36baab2f P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:39.071316 1174 ts_tablet_manager.cc:1403] T c4051c8e4d3d49829f9eac8e36baab2f P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.081s user 0.005s sys 0.000s
I20260318 02:51:39.072103 1174 raft_consensus.cc:359] T c4051c8e4d3d49829f9eac8e36baab2f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.072343 1174 raft_consensus.cc:385] T c4051c8e4d3d49829f9eac8e36baab2f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:39.072444 1174 raft_consensus.cc:740] T c4051c8e4d3d49829f9eac8e36baab2f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:39.073868 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_061349cc00fd49a8b616b9b60caae177"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.074357 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_061349cc00fd49a8b616b9b60caae177 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.076500 2358 tablet.cc:1723] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 6
I20260318 02:51:39.078457 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 1814c903ba4f456098f862e9490aa05e
I20260318 02:51:39.078903 455 catalog_manager.cc:6741] ReplaceTablet: tablet 1814c903ba4f456098f862e9490aa05e deleted and replaced by tablet c3f37e3d16f943e0aeeddafe1a955599
I20260318 02:51:39.080135 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 1814c903ba4f456098f862e9490aa05e with delete_type TABLET_DATA_DELETED (replaced by tablet c3f37e3d16f943e0aeeddafe1a955599) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:39.082479 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_842d2c36399843b293a023c3043c631d" } modify_external_catalogs: true
I20260318 02:51:39.083015 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_842d2c36399843b293a023c3043c631d" } modify_external_catalogs: true
I20260318 02:51:39.083495 901 tablet_service.cc:1511] Processing CreateTablet for tablet ccd7f2117d4d45ddad02770b236a55d8 (DEFAULT_TABLE table=default.Table_fd2aa32d34794918a4ee7b6ece38a34c [id=04522827506649e68bef062e2fbcc14b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.083949 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd7f2117d4d45ddad02770b236a55d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.087057 902 tablet_service.cc:1511] Processing CreateTablet for tablet 9279df5c45b5457a9177405a5e10163c (DEFAULT_TABLE table=default.Table_28d17f0ce0ec43f6848c9672433b33ab [id=9a3eca232830499db821e692bf8558a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.087509 889 tablet_service.cc:1511] Processing CreateTablet for tablet 496a16cba3824378ab5c3a2f08d5df17 (DEFAULT_TABLE table=default.Table_2421f558555545da81fa056cdb11cbf0 [id=37e3acd2ae6442f3934e49b4f46fb866]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.088603 759 tablet_service.cc:1511] Processing CreateTablet for tablet 43a71d4820a84d3bb853c23b078e0fbf (DEFAULT_TABLE table=default.Table_e50bd5f5933849f5a43d064f39581f70 [id=a279b0afee5c47518aa74f1f9244a3c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.089018 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a71d4820a84d3bb853c23b078e0fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.041118 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 16f00e7e7ca847e9a5ebfd9bb5809147 (DEFAULT_TABLE table=default.Table_ca056f93d2b34add91c12aaf8b2ba513 [id=b728a168c45f4feca723389746e6f5ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.089622 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f00e7e7ca847e9a5ebfd9bb5809147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.041565 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 31b6c2df8e1b47c3980f2c2a4295e659 (DEFAULT_TABLE table=default.Table_0bcd699c81914d4abeece81e1348f239 [id=ce35f1fd8f8a4bbb85b6100a0f893211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.043684 2296 consensus_queue.cc:1048] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:39.044890 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1350684961f645e089fc3fd9ba3a5b09" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:39.049435 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 506666a94b0947189474f1e4a2b5ae64 (DEFAULT_TABLE table=default.Table_ee5a037155c842a692c67296f75031ba [id=a379faf4471840c0b9577fd974a6c493]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.090597 1184 rpcz_store.cc:276] 0318 02:51:36.723375 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.723592 (+ 217us) service_pool.cc:225] Handling call
0318 02:51:38.798044 (+2074452us) ts_tablet_manager.cc:1151] Deleting tablet 1ef3181adc0542229897369591a30465
0318 02:51:38.798055 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:38.868289 (+ 70234us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:39.025129 (+156840us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:39.029580 (+ 4451us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2074251}
I20260318 02:51:39.091169 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 915) took 2293 ms. Trace:
I20260318 02:51:39.091250 1184 rpcz_store.cc:276] 0318 02:51:36.797617 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.797671 (+ 54us) service_pool.cc:225] Handling call
0318 02:51:39.090877 (+2293206us) ts_tablet_manager.cc:1151] Deleting tablet fcbaf43f3ccc48a2b7f09d04c2da060d
0318 02:51:39.091032 (+ 155us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:39.091149 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2293054}
I20260318 02:51:39.091908 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 914) took 2295 ms. Trace:
I20260318 02:51:39.091879 860 leader_election.cc:304] T 1350684961f645e089fc3fd9ba3a5b09 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:39.092214 2362 raft_consensus.cc:2749] T 1350684961f645e089fc3fd9ba3a5b09 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:39.091971 1184 rpcz_store.cc:276] 0318 02:51:36.796872 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.797367 (+ 495us) service_pool.cc:225] Handling call
0318 02:51:39.091483 (+2294116us) ts_tablet_manager.cc:1151] Deleting tablet f95ebc89fd2545b1835a1bc10414248d
0318 02:51:39.091807 (+ 324us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:39.091889 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2293580}
I20260318 02:51:39.092800 750 tablet_service.cc:1511] Processing CreateTablet for tablet 2d2be46659b648af8a88edad97cc0c74 (DEFAULT_TABLE table=default.Table_daf5a8ed81964828a87c8b2dda0c4a6d [id=2caa4073a0db4b999e0bb2f6fefc4eeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.083212 451 master_service.cc:954] ReplaceTablet: received request to replace tablet ccbe2acf3be0434385d3caae31399f4c from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:39.094323 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 913) took 2298 ms. Trace:
I20260318 02:51:39.094422 1184 rpcz_store.cc:276] 0318 02:51:36.795997 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.798935 (+ 2938us) service_pool.cc:225] Handling call
0318 02:51:39.092575 (+2293640us) ts_tablet_manager.cc:1151] Deleting tablet e85d612871014dc2bd9139adcbe639d2
0318 02:51:39.094212 (+ 1637us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:39.094306 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2293356}
I20260318 02:51:39.094758 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 917) took 2229 ms. Trace:
I20260318 02:51:39.094852 1184 rpcz_store.cc:276] 0318 02:51:36.865374 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.865431 (+ 57us) service_pool.cc:225] Handling call
0318 02:51:39.094663 (+2229232us) ts_tablet_manager.cc:1151] Deleting tablet 8c1ba16db9d040708f8fd75c852bdbb1
0318 02:51:39.094672 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:39.094742 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2229049}
I20260318 02:51:39.094902 761 tablet_service.cc:1511] Processing CreateTablet for tablet ed14a6472c844051ace676b4dca42775 (DEFAULT_TABLE table=default.Table_a341f29b76c14ece8878ebaebff80142 [id=12a7ed669c5f43ceaad50e1f2d15bd2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.095115 1184 tablet_replica.cc:333] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:39.095297 1184 raft_consensus.cc:2243] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:39.095546 1184 raft_consensus.cc:2272] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:39.054596 1027 tablet_service.cc:1511] Processing CreateTablet for tablet a2b8723a0d354f248ffe4cd2ef5a21dc (DEFAULT_TABLE table=default.Table_666699f265dc4783bc3c8315e742e806 [id=48ce3e7eda964c70b96e3325196c623a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.096347 2358 tablet.cc:1723] T 3fccf1f2bc3547e9ba8cc5fe9419f70b P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:39.072674 1174 consensus_queue.cc:260] T c4051c8e4d3d49829f9eac8e36baab2f P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.101205 1174 ts_tablet_manager.cc:1434] T c4051c8e4d3d49829f9eac8e36baab2f P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.030s user 0.001s sys 0.000s
I20260318 02:51:39.102102 903 tablet_service.cc:1511] Processing CreateTablet for tablet 43a71d4820a84d3bb853c23b078e0fbf (DEFAULT_TABLE table=default.Table_e50bd5f5933849f5a43d064f39581f70 [id=a279b0afee5c47518aa74f1f9244a3c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.055604 1172 tablet_bootstrap.cc:492] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:39.102401 894 tablet_service.cc:1511] Processing CreateTablet for tablet ed14a6472c844051ace676b4dca42775 (DEFAULT_TABLE table=default.Table_a341f29b76c14ece8878ebaebff80142 [id=12a7ed669c5f43ceaad50e1f2d15bd2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.102587 1172 ts_tablet_manager.cc:1403] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.173s user 0.001s sys 0.003s
I20260318 02:51:39.102784 1174 tablet_bootstrap.cc:492] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:39.103237 895 tablet_service.cc:1511] Processing CreateTablet for tablet 2d2be46659b648af8a88edad97cc0c74 (DEFAULT_TABLE table=default.Table_daf5a8ed81964828a87c8b2dda0c4a6d [id=2caa4073a0db4b999e0bb2f6fefc4eeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.103468 1172 raft_consensus.cc:359] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.103641 1172 raft_consensus.cc:385] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:39.103694 1172 raft_consensus.cc:740] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:39.103899 1172 consensus_queue.cc:260] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:39.103979 2085 log.cc:927] Time spent T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7: Append to log took a long time: real 0.079s user 0.003s sys 0.000s
I20260318 02:51:39.105099 1172 ts_tablet_manager.cc:1434] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:39.111856 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d2be46659b648af8a88edad97cc0c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.114687 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed14a6472c844051ace676b4dca42775. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:39.120314 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b34cc689a9a94f22bd2aa84b7d2eaee9 consensus state has no leader
I20260318 02:51:39.120729 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0bcd699c81914d4abeece81e1348f239" } modify_external_catalogs: true
I20260318 02:51:39.120947 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0bcd699c81914d4abeece81e1348f239" } modify_external_catalogs: true
I20260318 02:51:39.122028 2257 raft_consensus.cc:493] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:39.122170 2257 raft_consensus.cc:515] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:39.122442 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a6d2dd53085848d6bd7237b07a5f81d0 consensus state has no leader
I20260318 02:51:39.122815 2257 leader_election.cc:290] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:39.124678 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet c9d09130cded4b2b9478a85066379e25
I20260318 02:51:39.125247 453 catalog_manager.cc:6741] ReplaceTablet: tablet c9d09130cded4b2b9478a85066379e25 deleted and replaced by tablet 801f0b01d4be42cebec554db9b3ac1e8
I20260318 02:51:39.126269 748 tablet_service.cc:1558] Processing DeleteTablet for tablet c9d09130cded4b2b9478a85066379e25 with delete_type TABLET_DATA_DELETED (replaced by tablet 801f0b01d4be42cebec554db9b3ac1e8) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:39.132829 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496a16cba3824378ab5c3a2f08d5df17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.133122 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d2be46659b648af8a88edad97cc0c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.133052 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa05403966349ae9056777d913a0db6" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:39.133312 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9279df5c45b5457a9177405a5e10163c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:39.133611 719 leader_election.cc:343] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.064831 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 1618fadf9f9d41f0acfcaf97f47409fd (DEFAULT_TABLE table=default.Table_4e016593707b40a8ae356583b104d313 [id=6dcc841acc3343cfb5a7393ca8d45df2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.064966 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 2882569524e74a308e9fabf533a8a87c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:39.134189 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 1814c903ba4f456098f862e9490aa05e with delete_type TABLET_DATA_DELETED (replaced by tablet c3f37e3d16f943e0aeeddafe1a955599) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:39.136524 1172 tablet_bootstrap.cc:492] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:39.065059 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 9279df5c45b5457a9177405a5e10163c (DEFAULT_TABLE table=default.Table_28d17f0ce0ec43f6848c9672433b33ab [id=9a3eca232830499db821e692bf8558a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.136974 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed14a6472c844051ace676b4dca42775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.065423 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 496a16cba3824378ab5c3a2f08d5df17 (DEFAULT_TABLE table=default.Table_2421f558555545da81fa056cdb11cbf0 [id=37e3acd2ae6442f3934e49b4f46fb866]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:39.076534 997 consensus_peers.cc:597] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 27fc03c90b584becb250546100af736c. This is attempt 1: this message will repeat every 5th retry.
W20260318 02:51:39.137197 997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 60756.2us
I20260318 02:51:39.137274 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a71d4820a84d3bb853c23b078e0fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.139055 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 43a71d4820a84d3bb853c23b078e0fbf (DEFAULT_TABLE table=default.Table_e50bd5f5933849f5a43d064f39581f70 [id=a279b0afee5c47518aa74f1f9244a3c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.106781 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b6c2df8e1b47c3980f2c2a4295e659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.139492 1038 tablet_service.cc:1511] Processing CreateTablet for tablet ed14a6472c844051ace676b4dca42775 (DEFAULT_TABLE table=default.Table_a341f29b76c14ece8878ebaebff80142 [id=12a7ed669c5f43ceaad50e1f2d15bd2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.139640 1044 tablet_service.cc:1511] Processing CreateTablet for tablet 2d2be46659b648af8a88edad97cc0c74 (DEFAULT_TABLE table=default.Table_daf5a8ed81964828a87c8b2dda0c4a6d [id=2caa4073a0db4b999e0bb2f6fefc4eeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.140849 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1618fadf9f9d41f0acfcaf97f47409fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.142122 452 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 061ebb62f4c54a2a8c24b90ec15402d3 (table default.Table_88caf570ec6a4dfea94952fb5718c9c6 [id=5a3571f0765948588578d8e5185807a8]). Expected version 1 got 0
I20260318 02:51:39.142587 452 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 5ffcfc0784d947419fc9b22aa636521c (table default.Table_815494a3bd484f0699b693f7c6dbc5d7 [id=d78c0f7eaa0743c784b4562452ff7c65]). Expected version 1 got 0
I20260318 02:51:39.142982 452 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet d0652735b8c24c23ade92913c1c7ad0f (table default.Table_20867faf86da4889b7995990926923a7 [id=5bc787aad96b4abd82ab3e033020ea9c]). Expected version 1 got 0
I20260318 02:51:39.143307 452 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet d2fb9c8f339444bc8d7c6479e7d87f44 (table default.Table_278b10b38c074522b0e03e24d653346d [id=895bbd90cf47462ab116ee3f37e94982]). Expected version 3 got 0
I20260318 02:51:39.145051 1028 tablet_service.cc:1511] Processing CreateTablet for tablet ccd7f2117d4d45ddad02770b236a55d8 (DEFAULT_TABLE table=default.Table_fd2aa32d34794918a4ee7b6ece38a34c [id=04522827506649e68bef062e2fbcc14b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.125732 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa05403966349ae9056777d913a0db6" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:39.146561 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506666a94b0947189474f1e4a2b5ae64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.148890 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9279df5c45b5457a9177405a5e10163c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.150318 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 6b0be67e8f064e879f9a790a87d8b27b
I20260318 02:51:39.151371 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet ccbe2acf3be0434385d3caae31399f4c
I20260318 02:51:39.151789 451 catalog_manager.cc:6741] ReplaceTablet: tablet ccbe2acf3be0434385d3caae31399f4c deleted and replaced by tablet 6f63025537c546eda3122aa2c2abb535
W20260318 02:51:39.152530 719 leader_election.cc:343] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.152649 719 leader_election.cc:304] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:39.153043 2257 raft_consensus.cc:2749] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:39.153259 2326 tablet.cc:1723] T 5ffcfc0784d947419fc9b22aa636521c P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:39.154799 1184 ts_tablet_manager.cc:1916] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:39.154266 1173 tablet_bootstrap.cc:654] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:39.157584 759 tablet_service.cc:1558] Processing DeleteTablet for tablet ccbe2acf3be0434385d3caae31399f4c with delete_type TABLET_DATA_DELETED (replaced by tablet 6f63025537c546eda3122aa2c2abb535) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:39.158880 2328 tablet.cc:1723] T 5ffcfc0784d947419fc9b22aa636521c P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:39.161024 1175 ts_tablet_manager.cc:1929] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:39.161140 1175 log.cc:1199] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/5fec974d146f44aeb72df483fa85b287
I20260318 02:51:39.161456 1175 ts_tablet_manager.cc:1950] T 5fec974d146f44aeb72df483fa85b287 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:39.162014 1175 tablet_replica.cc:333] T 065ebc3c000a4ad3873ee031ecf9986b P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:39.162279 1175 raft_consensus.cc:2243] T 065ebc3c000a4ad3873ee031ecf9986b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:39.162472 1175 raft_consensus.cc:2272] T 065ebc3c000a4ad3873ee031ecf9986b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:39.162751 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b0be67e8f064e879f9a790a87d8b27b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:39.162978 1175 ts_tablet_manager.cc:1916] T 065ebc3c000a4ad3873ee031ecf9986b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:39.163798 2363 log.cc:927] Time spent T 3fccf1f2bc3547e9ba8cc5fe9419f70b P b25f4f05e0c94c8db825d5afa0b8bf18: Append to log took a long time: real 0.075s user 0.000s sys 0.000s
I20260318 02:51:39.164848 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 31b6c2df8e1b47c3980f2c2a4295e659
I20260318 02:51:39.166621 1174 tablet_bootstrap.cc:654] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:39.167227 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet c9d09130cded4b2b9478a85066379e25 with delete_type TABLET_DATA_DELETED (replaced by tablet 801f0b01d4be42cebec554db9b3ac1e8) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:39.167898 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b0be67e8f064e879f9a790a87d8b27b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:39.168318 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 1814c903ba4f456098f862e9490aa05e with delete_type TABLET_DATA_DELETED (replaced by tablet c3f37e3d16f943e0aeeddafe1a955599) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:39.055905 1034 tablet_service.cc:1511] Processing CreateTablet for tablet e51e65aee63a453b848d79feaf83307e (DEFAULT_TABLE table=default.Table_efb2704a3a7246fd94c799eba891c6de [id=9d89cb9cb36f4ca298d25b1efc9d0185]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.168511 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b8723a0d354f248ffe4cd2ef5a21dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.168727 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet ccbe2acf3be0434385d3caae31399f4c with delete_type TABLET_DATA_DELETED (replaced by tablet 6f63025537c546eda3122aa2c2abb535) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:39.169351 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 1ef3181adc0542229897369591a30465 (table default.Table_3aa749750bd542738790c713a8ff0713 [id=c6ec8a81c28d493396980349b4ea31d8]) successfully deleted
W20260318 02:51:39.169652 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet fcbaf43f3ccc48a2b7f09d04c2da060d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fcbaf43f3ccc48a2b7f09d04c2da060d already in progress: creating tablet
W20260318 02:51:39.169848 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f95ebc89fd2545b1835a1bc10414248d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f95ebc89fd2545b1835a1bc10414248d already in progress: creating tablet
W20260318 02:51:39.170032 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet e85d612871014dc2bd9139adcbe639d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e85d612871014dc2bd9139adcbe639d2 already in progress: creating tablet
W20260318 02:51:39.170187 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 8c1ba16db9d040708f8fd75c852bdbb1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c1ba16db9d040708f8fd75c852bdbb1 already in progress: creating tablet
W20260318 02:51:39.170496 441 catalog_manager.cc:5075] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): alter failed for tablet b5c19bc5e07949088c84cedbf944dfdb (table default.Table_79bea80cab3d40f5bead32f2fdcf09fa [id=873432f002e14a4fa7065dcfe5caebd5]),no further retry: Not found: Tablet not found: b5c19bc5e07949088c84cedbf944dfdb
I20260318 02:51:39.170840 2152 raft_consensus.cc:493] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:39.170958 2152 raft_consensus.cc:515] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.171558 2152 leader_election.cc:290] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:39.172137 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56335a4a2c294f67a22206e6a59e29a8" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:39.172305 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 5fec974d146f44aeb72df483fa85b287 (table default.Table_167a79354e7844aabe2ae725df4f536c [id=095e4b55b1544007a032a984ba934743]) successfully deleted
W20260318 02:51:39.172374 999 leader_election.cc:343] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 56335a4a2c294f67a22206e6a59e29a8
W20260318 02:51:39.172758 997 leader_election.cc:343] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.172860 997 leader_election.cc:304] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:39.173061 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_268e9858449d471ca088f8b1f2492fe6" } modify_external_catalogs: true
I20260318 02:51:39.173205 2152 raft_consensus.cc:2749] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:39.173213 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ce283b50a5884aa99ab7110cc3d0c158"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:39.173375 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b0be67e8f064e879f9a790a87d8b27b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:39.173496 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_670c625946a84303b45ccb5bc01ba69e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.173840 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce283b50a5884aa99ab7110cc3d0c158 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:39.173990 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_670c625946a84303b45ccb5bc01ba69e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.173239 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_268e9858449d471ca088f8b1f2492fe6" } modify_external_catalogs: true
I20260318 02:51:39.174141 923 raft_consensus.cc:3060] T 1350684961f645e089fc3fd9ba3a5b09 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:39.175580 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3788aa65127c4272ab53ae531d8db638"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.176110 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3788aa65127c4272ab53ae531d8db638 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.176810 895 tablet_service.cc:1558] Processing DeleteTablet for tablet c9d09130cded4b2b9478a85066379e25 with delete_type TABLET_DATA_DELETED (replaced by tablet 801f0b01d4be42cebec554db9b3ac1e8) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:39.181398 902 tablet_service.cc:1558] Processing DeleteTablet for tablet ccbe2acf3be0434385d3caae31399f4c with delete_type TABLET_DATA_DELETED (replaced by tablet 6f63025537c546eda3122aa2c2abb535) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:39.181432 997 consensus_peers.cc:597] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab158343adb14eab85c595fa5405145d. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:39.184382 1184 ts_tablet_manager.cc:1929] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:39.184512 1184 log.cc:1199] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/20c6f1790ed34581b7507ec63ec66718
I20260318 02:51:39.186059 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 105326aea9f744779ca76e0cbb2448cd
I20260318 02:51:39.189911 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bfb0d740bb2448809a01cd8b7365090b" } modify_external_catalogs: true
I20260318 02:51:39.190142 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bfb0d740bb2448809a01cd8b7365090b" } modify_external_catalogs: true
I20260318 02:51:39.190366 1172 tablet_bootstrap.cc:654] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:39.192461 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3eb84f70b8164e24b0d9772b02268c85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:39.192893 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_dde65a0e8449460f970a61ce1e8d80df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.193312 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3eb84f70b8164e24b0d9772b02268c85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:39.193390 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dde65a0e8449460f970a61ce1e8d80df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.193699 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_358abbb589e2401b867ed3d33640193e" } modify_external_catalogs: true
I20260318 02:51:39.193890 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_358abbb589e2401b867ed3d33640193e" } modify_external_catalogs: true
I20260318 02:51:39.195487 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496a16cba3824378ab5c3a2f08d5df17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.196028 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 31b6c2df8e1b47c3980f2c2a4295e659 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:39.198489 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 105326aea9f744779ca76e0cbb2448cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:39.199826 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a71d4820a84d3bb853c23b078e0fbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.200400 1040 tablet_service.cc:1511] Processing CreateTablet for tablet b8396bc51bd441d19101549f2a981bac (DEFAULT_TABLE table=default.Table_2120492f0763427e980bbe20f96ed2c8 [id=35852dc0947d447c9e485ecf9d45c091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.200798 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8396bc51bd441d19101549f2a981bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.203882 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed14a6472c844051ace676b4dca42775. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.204918 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d2be46659b648af8a88edad97cc0c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.208094 1040 tablet_service.cc:1511] Processing CreateTablet for tablet aafae9992f884b6caa9b5cb91321d6d0 (DEFAULT_TABLE table=default.Table_fc39d2b3197a4db2876be7bf3d972045 [id=beb8f874a1174fd89af95363086121ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.208480 1184 ts_tablet_manager.cc:1950] T 20c6f1790ed34581b7507ec63ec66718 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:39.209554 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 240191ec2199466d9e7da39ed3ea8550 (DEFAULT_TABLE table=default.Table_1710ee85bd4547d297a56b4dcf3d7192 [id=70de2deb633642eb90aad49524cfa567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.209957 1043 tablet_service.cc:1511] Processing CreateTablet for tablet c1b33758e7e546abba5b02c79db6c1d2 (DEFAULT_TABLE table=default.Table_57dde8299a394890acd2aeff8a69cdc0 [id=e62850dde8384ade917285fe2cd8051a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.211506 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aafae9992f884b6caa9b5cb91321d6d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.211519 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 009208efabd84ac2affe91502cde143b (DEFAULT_TABLE table=default.Table_ea731c793b734bc5b818de21c6e70f8c [id=cceb4facad754456bd2939dc7a2b0dd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.212625 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 009208efabd84ac2affe91502cde143b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.214680 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 7c303520bb9c4a52a9b6b374df917802 (DEFAULT_TABLE table=default.Table_66fe286f603f49b8ad7f7146182503c0 [id=ab0970d4de0e4a21a429043a1d50cb7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.214881 1172 tablet_bootstrap.cc:492] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:39.215005 1172 ts_tablet_manager.cc:1403] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.079s user 0.003s sys 0.000s
I20260318 02:51:39.215050 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c303520bb9c4a52a9b6b374df917802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.216459 1172 raft_consensus.cc:359] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.220269 1172 raft_consensus.cc:385] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:39.220412 1172 raft_consensus.cc:740] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:39.220758 1172 consensus_queue.cc:260] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.221635 1172 ts_tablet_manager.cc:1434] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260318 02:51:39.222002 1172 tablet_bootstrap.cc:492] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:39.223603 1175 ts_tablet_manager.cc:1929] T 065ebc3c000a4ad3873ee031ecf9986b P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:39.226992 1026 tablet_service.cc:1511] Processing CreateTablet for tablet de99b14bb732478081d010cdd8fd76b4 (DEFAULT_TABLE table=default.Table_22ce3d4b35a8423bba8f74a6be3a551c [id=1365001e90444db4af48e525e56041d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.229269 1033 tablet_service.cc:1511] Processing CreateTablet for tablet cf3dffa683634780ba12e7fbda3e4bcc (DEFAULT_TABLE table=default.Table_83b3ae4889bc4e68970d8c091f4c55a0 [id=7485c5e89079420cb33de878a5c83ee2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.230582 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 50bd5c393b874c36bc872c5e1f56248c (DEFAULT_TABLE table=default.Table_3cef154980284ef0aa821a72c630d4cb [id=8409830c558f4055b4f8a45b37c115b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.230937 1031 tablet_service.cc:1511] Processing CreateTablet for tablet ca765bc27f564ab9ab419bcf2aeda59f (DEFAULT_TABLE table=default.Table_997790cbbac74789b5c64a54d0c44ff3 [id=c3eb102920ff46d89bf713e574a91a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.232327 1172 tablet_bootstrap.cc:654] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:39.232633 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bd5c393b874c36bc872c5e1f56248c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.236649 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b33758e7e546abba5b02c79db6c1d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.224257 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 31b6c2df8e1b47c3980f2c2a4295e659 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:39.237296 1175 log.cc:1199] T 065ebc3c000a4ad3873ee031ecf9986b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/065ebc3c000a4ad3873ee031ecf9986b
I20260318 02:51:39.237689 1175 ts_tablet_manager.cc:1950] T 065ebc3c000a4ad3873ee031ecf9986b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:39.240828 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 240191ec2199466d9e7da39ed3ea8550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.244860 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd7f2117d4d45ddad02770b236a55d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.187752 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 105326aea9f744779ca76e0cbb2448cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:39.197355 2257 raft_consensus.cc:493] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:39.249343 2257 raft_consensus.cc:515] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.249964 2257 leader_election.cc:290] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:39.199054 766 tablet_service.cc:1511] Processing CreateTablet for tablet 240191ec2199466d9e7da39ed3ea8550 (DEFAULT_TABLE table=default.Table_1710ee85bd4547d297a56b4dcf3d7192 [id=70de2deb633642eb90aad49524cfa567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.250347 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 240191ec2199466d9e7da39ed3ea8550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.199086 751 tablet_service.cc:1511] Processing CreateTablet for tablet aafae9992f884b6caa9b5cb91321d6d0 (DEFAULT_TABLE table=default.Table_fc39d2b3197a4db2876be7bf3d972045 [id=beb8f874a1174fd89af95363086121ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.252983 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aafae9992f884b6caa9b5cb91321d6d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.255558 1175 tablet_replica.cc:333] T b8a46b4db30a48c99addf763f7edfb16 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:39.255810 1175 raft_consensus.cc:2243] T b8a46b4db30a48c99addf763f7edfb16 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:39.256057 1175 raft_consensus.cc:2272] T b8a46b4db30a48c99addf763f7edfb16 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:39.227365 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 105326aea9f744779ca76e0cbb2448cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:39.199405 748 tablet_service.cc:1511] Processing CreateTablet for tablet b8396bc51bd441d19101549f2a981bac (DEFAULT_TABLE table=default.Table_2120492f0763427e980bbe20f96ed2c8 [id=35852dc0947d447c9e485ecf9d45c091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.227880 895 tablet_service.cc:1511] Processing CreateTablet for tablet 240191ec2199466d9e7da39ed3ea8550 (DEFAULT_TABLE table=default.Table_1710ee85bd4547d297a56b4dcf3d7192 [id=70de2deb633642eb90aad49524cfa567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.257053 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8396bc51bd441d19101549f2a981bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.257144 1175 ts_tablet_manager.cc:1916] T b8a46b4db30a48c99addf763f7edfb16 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:39.257256 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 240191ec2199466d9e7da39ed3ea8550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.199385 753 tablet_service.cc:1511] Processing CreateTablet for tablet c1b33758e7e546abba5b02c79db6c1d2 (DEFAULT_TABLE table=default.Table_57dde8299a394890acd2aeff8a69cdc0 [id=e62850dde8384ade917285fe2cd8051a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.205098 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 31b6c2df8e1b47c3980f2c2a4295e659 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:39.211825 754 tablet_service.cc:1511] Processing CreateTablet for tablet 009208efabd84ac2affe91502cde143b (DEFAULT_TABLE table=default.Table_ea731c793b734bc5b818de21c6e70f8c [id=cceb4facad754456bd2939dc7a2b0dd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.212172 755 tablet_service.cc:1511] Processing CreateTablet for tablet 7c303520bb9c4a52a9b6b374df917802 (DEFAULT_TABLE table=default.Table_66fe286f603f49b8ad7f7146182503c0 [id=ab0970d4de0e4a21a429043a1d50cb7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.217716 752 tablet_service.cc:1511] Processing CreateTablet for tablet de99b14bb732478081d010cdd8fd76b4 (DEFAULT_TABLE table=default.Table_22ce3d4b35a8423bba8f74a6be3a551c [id=1365001e90444db4af48e525e56041d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.218004 757 tablet_service.cc:1511] Processing CreateTablet for tablet ca765bc27f564ab9ab419bcf2aeda59f (DEFAULT_TABLE table=default.Table_997790cbbac74789b5c64a54d0c44ff3 [id=c3eb102920ff46d89bf713e574a91a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.218138 756 tablet_service.cc:1511] Processing CreateTablet for tablet cf3dffa683634780ba12e7fbda3e4bcc (DEFAULT_TABLE table=default.Table_83b3ae4889bc4e68970d8c091f4c55a0 [id=7485c5e89079420cb33de878a5c83ee2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.219585 762 tablet_service.cc:1511] Processing CreateTablet for tablet 50bd5c393b874c36bc872c5e1f56248c (DEFAULT_TABLE table=default.Table_3cef154980284ef0aa821a72c630d4cb [id=8409830c558f4055b4f8a45b37c115b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.259671 2296 raft_consensus.cc:493] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:39.259837 2296 raft_consensus.cc:515] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.260478 2296 leader_election.cc:290] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:39.260666 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184ce58aa96d4e70ad7b2783f19ccdeb" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:39.261379 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2882569524e74a308e9fabf533a8a87c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:39.261857 997 leader_election.cc:343] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.228259 907 tablet_service.cc:1511] Processing CreateTablet for tablet 009208efabd84ac2affe91502cde143b (DEFAULT_TABLE table=default.Table_ea731c793b734bc5b818de21c6e70f8c [id=cceb4facad754456bd2939dc7a2b0dd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.262408 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 009208efabd84ac2affe91502cde143b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.265141 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 065ebc3c000a4ad3873ee031ecf9986b (table default.Table_a1fc9d74bf8b4be5a48c0480aa55d189 [id=62eb3b210f764eaaa081488904cf8aa7]) successfully deleted
W20260318 02:51:39.265439 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet a628b6d2523344edbf78695a041113cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a628b6d2523344edbf78695a041113cf already in progress: creating tablet
I20260318 02:51:39.228556 901 tablet_service.cc:1511] Processing CreateTablet for tablet 7c303520bb9c4a52a9b6b374df917802 (DEFAULT_TABLE table=default.Table_66fe286f603f49b8ad7f7146182503c0 [id=ab0970d4de0e4a21a429043a1d50cb7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.266010 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c303520bb9c4a52a9b6b374df917802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.258827 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b33758e7e546abba5b02c79db6c1d2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:39.267158 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 255979f9bbe74dd583798ea5da2ae4c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 255979f9bbe74dd583798ea5da2ae4c4 already in progress: creating tablet
W20260318 02:51:39.267398 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 53462f4293594dd59ca17b712a1426c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53462f4293594dd59ca17b712a1426c8 already in progress: creating tablet
W20260318 02:51:39.262406 719 leader_election.cc:343] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.267930 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet d1a67e637d934c0f99c00d04fb26df0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:39.268435 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2f3309339d61445eaf38baf068216ef4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f3309339d61445eaf38baf068216ef4 already in progress: creating tablet
W20260318 02:51:39.268652 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 7c3976c82c914fbaa88df25e1642ed6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c3976c82c914fbaa88df25e1642ed6c already in progress: creating tablet
I20260318 02:51:39.228693 904 tablet_service.cc:1511] Processing CreateTablet for tablet de99b14bb732478081d010cdd8fd76b4 (DEFAULT_TABLE table=default.Table_22ce3d4b35a8423bba8f74a6be3a551c [id=1365001e90444db4af48e525e56041d9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:39.269088 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 03dba645392b46c48cf543fefc6e4d53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03dba645392b46c48cf543fefc6e4d53 already in progress: creating tablet
I20260318 02:51:39.269797 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de99b14bb732478081d010cdd8fd76b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.270761 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1cb89d002f144726af0a65edb1c8dd5f" } new_table_name: "default.Table_940418127bf346549bac194f885231f2" modify_external_catalogs: true
I20260318 02:51:39.271827 1175 ts_tablet_manager.cc:1929] T b8a46b4db30a48c99addf763f7edfb16 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:39.271929 1175 log.cc:1199] T b8a46b4db30a48c99addf763f7edfb16 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/b8a46b4db30a48c99addf763f7edfb16
I20260318 02:51:39.272377 1175 ts_tablet_manager.cc:1950] T b8a46b4db30a48c99addf763f7edfb16 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:39.228928 894 tablet_service.cc:1511] Processing CreateTablet for tablet c1b33758e7e546abba5b02c79db6c1d2 (DEFAULT_TABLE table=default.Table_57dde8299a394890acd2aeff8a69cdc0 [id=e62850dde8384ade917285fe2cd8051a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.273038 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1b33758e7e546abba5b02c79db6c1d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.274292 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a86b913c502e4655aae9d11230109dc1" } new_table_name: "default.Table_e7633153163443ce97eeb8423db6d4ea" modify_external_catalogs: true
I20260318 02:51:39.229043 899 tablet_service.cc:1511] Processing CreateTablet for tablet cf3dffa683634780ba12e7fbda3e4bcc (DEFAULT_TABLE table=default.Table_83b3ae4889bc4e68970d8c091f4c55a0 [id=7485c5e89079420cb33de878a5c83ee2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.276196 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf3dffa683634780ba12e7fbda3e4bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.229302 898 tablet_service.cc:1511] Processing CreateTablet for tablet ca765bc27f564ab9ab419bcf2aeda59f (DEFAULT_TABLE table=default.Table_997790cbbac74789b5c64a54d0c44ff3 [id=c3eb102920ff46d89bf713e574a91a5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.229542 888 tablet_service.cc:1511] Processing CreateTablet for tablet 50bd5c393b874c36bc872c5e1f56248c (DEFAULT_TABLE table=default.Table_3cef154980284ef0aa821a72c630d4cb [id=8409830c558f4055b4f8a45b37c115b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.230161 889 tablet_service.cc:1511] Processing CreateTablet for tablet aafae9992f884b6caa9b5cb91321d6d0 (DEFAULT_TABLE table=default.Table_fc39d2b3197a4db2876be7bf3d972045 [id=beb8f874a1174fd89af95363086121ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.231549 891 tablet_service.cc:1511] Processing CreateTablet for tablet b8396bc51bd441d19101549f2a981bac (DEFAULT_TABLE table=default.Table_2120492f0763427e980bbe20f96ed2c8 [id=35852dc0947d447c9e485ecf9d45c091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.277143 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c303520bb9c4a52a9b6b374df917802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.277309 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 009208efabd84ac2affe91502cde143b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.278165 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de99b14bb732478081d010cdd8fd76b4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:39.278847 999 leader_election.cc:343] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2882569524e74a308e9fabf533a8a87c
I20260318 02:51:39.278973 999 leader_election.cc:304] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:39.279383 2296 raft_consensus.cc:2749] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:39.280011 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184ce58aa96d4e70ad7b2783f19ccdeb" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:39.280885 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aafae9992f884b6caa9b5cb91321d6d0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:39.280830 719 leader_election.cc:343] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.280959 719 leader_election.cc:304] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:39.281359 2257 raft_consensus.cc:2749] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:39.281468 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8396bc51bd441d19101549f2a981bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.281852 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bd5c393b874c36bc872c5e1f56248c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.282341 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca765bc27f564ab9ab419bcf2aeda59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.284961 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bd5c393b874c36bc872c5e1f56248c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.286082 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf3dffa683634780ba12e7fbda3e4bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.286301 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca765bc27f564ab9ab419bcf2aeda59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.293807 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet b8a46b4db30a48c99addf763f7edfb16 (table default.Table_25494285095147fa885f1aa79e2f1722 [id=6f9a87f338414f20bb3969d3c3cdfa64]) successfully deleted
W20260318 02:51:39.295430 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 1814c903ba4f456098f862e9490aa05e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1814c903ba4f456098f862e9490aa05e already in progress: creating tablet
W20260318 02:51:39.296694 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 6b0be67e8f064e879f9a790a87d8b27b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b0be67e8f064e879f9a790a87d8b27b already in progress: creating tablet
W20260318 02:51:39.301827 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet c9d09130cded4b2b9478a85066379e25 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9d09130cded4b2b9478a85066379e25 already in progress: creating tablet
W20260318 02:51:39.302760 997 consensus_peers.cc:597] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260318 02:51:39.303385 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet ccbe2acf3be0434385d3caae31399f4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ccbe2acf3be0434385d3caae31399f4c already in progress: creating tablet
W20260318 02:51:39.304296 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 31b6c2df8e1b47c3980f2c2a4295e659 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31b6c2df8e1b47c3980f2c2a4295e659 already in progress: creating tablet
I20260318 02:51:39.304888 1175 tablet_replica.cc:333] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:39.311305 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b2ff027f70e44671ab6c7e8b30d4d755" } new_table_name: "default.Table_15c3b48cb1a4451fabb1a33af422d491" modify_external_catalogs: true
I20260318 02:51:39.315884 2085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7: Bootstrap replaying log segment 1/1 (211.7K/223.6K this segment, stats: ops{read=621 overwritten=0 applied=617 ignored=0} inserts{seen=584 ignored=0} mutations{seen=716 ignored=0} orphaned_commits=0)
I20260318 02:51:39.318356 1175 raft_consensus.cc:2243] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:39.318657 1175 raft_consensus.cc:2272] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:39.319209 1175 ts_tablet_manager.cc:1916] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:39.327524 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet de38fe3eb88147eab65f3dfed37fbf7d
I20260318 02:51:39.328775 453 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 393ea1440c3b4d1393c0eb159530235e
I20260318 02:51:39.329113 751 tablet_service.cc:1558] Processing DeleteTablet for tablet de38fe3eb88147eab65f3dfed37fbf7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:39.331254 1111 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:39.334446 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 921) took 2348 ms. Trace:
I20260318 02:51:39.334543 1184 rpcz_store.cc:276] 0318 02:51:36.986219 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.986314 (+ 95us) service_pool.cc:225] Handling call
0318 02:51:39.095076 (+2108762us) ts_tablet_manager.cc:1151] Deleting tablet 20c6f1790ed34581b7507ec63ec66718
0318 02:51:39.095083 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:39.157851 (+ 62768us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:39.184270 (+ 26419us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:39.334420 (+150150us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2108532}
I20260318 02:51:39.335114 1184 tablet_replica.cc:333] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:39.335325 1184 raft_consensus.cc:2243] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:39.335482 1184 raft_consensus.cc:2272] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:39.336025 1184 ts_tablet_manager.cc:1916] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:39.336823 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 20c6f1790ed34581b7507ec63ec66718 (table default.Table_cf5f0ff49fa24bf18b21a4ebbe45d2e4 [id=c532f0623efe4c3f8d9c90ae9c3d02c3]) successfully deleted
W20260318 02:51:39.340636 443 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 (table default.Table_ce996d68b1144b3aa44ab9618af7d43e [id=aa309b4ad7d6425d853518c95e0e0461], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 consensus state has no leader
W20260318 02:51:39.348340 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5b49b066f27b43829c8f922649744303 consensus state has no leader
W20260318 02:51:39.349349 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 504a8ead5ba24f51bd26df90feb92d96 consensus state has no leader
W20260318 02:51:39.349934 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f7cf608f75e43fea8a677ebd3513d3a consensus state has no leader
I20260318 02:51:39.350446 454 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_815494a3bd484f0699b693f7c6dbc5d7 [id=d78c0f7eaa0743c784b4562452ff7c65] alter complete (version 1)
I20260318 02:51:39.356863 1043 tablet_service.cc:1558] Processing DeleteTablet for tablet de38fe3eb88147eab65f3dfed37fbf7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:39.362126 899 tablet_service.cc:1558] Processing DeleteTablet for tablet de38fe3eb88147eab65f3dfed37fbf7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:39.363777 999 consensus_peers.cc:597] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d -> Peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Couldn't send request to peer 6a903d876086423b8016d705b98895ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b383fd49049c4c1daba3f1ed60899f3e. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:39.364485 1176 ts_tablet_manager.cc:1929] T 783c886a99994d6c8d9add724277819a P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:39.364598 1176 log.cc:1199] T 783c886a99994d6c8d9add724277819a P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/783c886a99994d6c8d9add724277819a
I20260318 02:51:39.367157 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_14099aef89c147ec896c324acb15d1ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:39.367280 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d8631b4230fc46efaaee519421401f19" } new_table_name: "default.Table_629d056f6284466ea2f3fef7bc274074" modify_external_catalogs: true
I20260318 02:51:39.367420 1176 ts_tablet_manager.cc:1950] T 783c886a99994d6c8d9add724277819a P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
W20260318 02:51:39.367813 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14099aef89c147ec896c324acb15d1ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.368314 1176 tablet_replica.cc:333] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:39.368502 1176 raft_consensus.cc:2243] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:39.368643 1176 raft_consensus.cc:2272] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:39.368690 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_12fb0eb56f354fdc9acff9c77b5bf3fa" } new_table_name: "default.Table_769b5ce3be99464fb8dd4ebffce823ba" modify_external_catalogs: true
I20260318 02:51:39.369359 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 783c886a99994d6c8d9add724277819a (table default.Table_cfd83086efd94aeeac453573d0c9350b [id=f1416944463a4ad98086e63fe84cf76f]) successfully deleted
I20260318 02:51:39.369792 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ca1893cd875e42808f00ad4ce719bad1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.370251 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca1893cd875e42808f00ad4ce719bad1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.371631 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8510ed9c86cf454ab5bfc99b2f84ad2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.372083 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8510ed9c86cf454ab5bfc99b2f84ad2d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.372943 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_bd0d028c717541a2803c9274d069d42f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.373391 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd0d028c717541a2803c9274d069d42f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.375384 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0eafcf7f327d4775aec804485d229020"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:39.375738 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf3dffa683634780ba12e7fbda3e4bcc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:39.375857 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0eafcf7f327d4775aec804485d229020 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.378583 1176 ts_tablet_manager.cc:1916] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:39.379778 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e51e65aee63a453b848d79feaf83307e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.381754 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de99b14bb732478081d010cdd8fd76b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.381904 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca765bc27f564ab9ab419bcf2aeda59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.383443 1172 tablet_bootstrap.cc:492] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:39.383711 1172 ts_tablet_manager.cc:1403] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.162s user 0.003s sys 0.000s
I20260318 02:51:39.384078 974 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:39.386485 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a7ea1d8667034b45a48efcbbeea254a1" } modify_external_catalogs: true
I20260318 02:51:39.387101 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a7ea1d8667034b45a48efcbbeea254a1" } modify_external_catalogs: true
I20260318 02:51:39.391697 454 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 5ffcfc0784d947419fc9b22aa636521c (table default.Table_815494a3bd484f0699b693f7c6dbc5d7 [id=d78c0f7eaa0743c784b4562452ff7c65]). Expected version 1 got 0
I20260318 02:51:39.391947 454 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 3fccf1f2bc3547e9ba8cc5fe9419f70b (table default.Table_8afbb1eafd5f4977bfffdfd764689b39 [id=f282f0ee83114539bad2c36e8311e05e]). Expected version 2 got 0
I20260318 02:51:39.392434 1184 ts_tablet_manager.cc:1929] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:39.392624 1184 log.cc:1199] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/9451d57fad72413c81443623c7995d4e
I20260318 02:51:39.393071 1184 ts_tablet_manager.cc:1950] T 9451d57fad72413c81443623c7995d4e P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:39.393882 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 922) took 2407 ms. Trace:
I20260318 02:51:39.394022 1184 rpcz_store.cc:276] 0318 02:51:36.986592 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:36.986742 (+ 150us) service_pool.cc:225] Handling call
0318 02:51:39.334813 (+2348071us) ts_tablet_manager.cc:1151] Deleting tablet 9451d57fad72413c81443623c7995d4e
0318 02:51:39.335070 (+ 257us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:39.379285 (+ 44215us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:39.392310 (+ 13025us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:39.393857 (+ 1547us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2347884}
I20260318 02:51:39.395085 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 9451d57fad72413c81443623c7995d4e (table default.Table_734eb14f943e4eab8ff7d14d00729858 [id=2d188e1de3394072a2327c0d08901bf5]) successfully deleted
I20260318 02:51:39.395920 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 926) took 2275 ms. Trace:
I20260318 02:51:39.398067 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_bb08c3624fb54b12a3295e6909a356ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.398672 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb08c3624fb54b12a3295e6909a356ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.399847 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8a988f7cdf3b4dff9e4bbf98492e7644" } modify_external_catalogs: true
I20260318 02:51:39.400036 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8a988f7cdf3b4dff9e4bbf98492e7644" } modify_external_catalogs: true
I20260318 02:51:39.405503 2085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7: Bootstrap replayed 1/1 log segments. Stats: ops{read=660 overwritten=0 applied=659 ignored=0} inserts{seen=630 ignored=0} mutations{seen=757 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260318 02:51:39.406262 2085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7: Bootstrap complete.
W20260318 02:51:39.419682 997 consensus_peers.cc:597] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:39.396073 1184 rpcz_store.cc:276] 0318 02:51:37.120263 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.120325 (+ 62us) service_pool.cc:225] Handling call
0318 02:51:39.395789 (+2275464us) ts_tablet_manager.cc:1151] Deleting tablet de2bc2f79e8b49248de3e7eca1a600cf
0318 02:51:39.395800 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:39.395902 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2275245}
W20260318 02:51:39.420662 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet de2bc2f79e8b49248de3e7eca1a600cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de2bc2f79e8b49248de3e7eca1a600cf already in progress: creating tablet
I20260318 02:51:39.422119 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 927) took 2300 ms. Trace:
I20260318 02:51:39.422734 1184 rpcz_store.cc:276] 0318 02:51:37.121199 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.121753 (+ 554us) service_pool.cc:225] Handling call
0318 02:51:39.419916 (+2298163us) ts_tablet_manager.cc:1151] Deleting tablet 0652fc250fa04565b069bb767530d747
0318 02:51:39.421989 (+ 2073us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:39.422099 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2297964}
W20260318 02:51:39.423295 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 0652fc250fa04565b069bb767530d747 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0652fc250fa04565b069bb767530d747 already in progress: creating tablet
I20260318 02:51:39.423799 1184 tablet_replica.cc:333] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:39.424815 1175 ts_tablet_manager.cc:1929] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:39.424971 1175 log.cc:1199] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/105326aea9f744779ca76e0cbb2448cd
I20260318 02:51:39.425352 1175 ts_tablet_manager.cc:1950] T 105326aea9f744779ca76e0cbb2448cd P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:39.425726 1184 raft_consensus.cc:2243] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:39.426100 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 105326aea9f744779ca76e0cbb2448cd (table default.Table_268e9858449d471ca088f8b1f2492fe6 [id=58354360683d422dbdcc43826b39dbc8]) successfully deleted
W20260318 02:51:39.426568 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet de38fe3eb88147eab65f3dfed37fbf7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de38fe3eb88147eab65f3dfed37fbf7d already in progress: creating tablet
I20260318 02:51:39.426939 1184 raft_consensus.cc:2272] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:39.426502 1172 raft_consensus.cc:359] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.427845 1172 raft_consensus.cc:385] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:39.423345 2085 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:39.428450 1172 raft_consensus.cc:740] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:39.432999 1172 consensus_queue.cc:260] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.428282 1184 ts_tablet_manager.cc:1916] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:39.442845 2085 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b701993861d4c11b3394a2d6588b3b7, State: Initialized, Role: FOLLOWER
I20260318 02:51:39.443820 2085 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 659, Last appended: 2.660, Last appended by leader: 660, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:39.452859 1172 ts_tablet_manager.cc:1434] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.069s user 0.001s sys 0.001s
W20260318 02:51:39.457489 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e6f40a5d3f14a779c26d73bf58f302b consensus state has no leader
I20260318 02:51:39.460491 1172 tablet_bootstrap.cc:492] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:39.461227 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_533d4a1dfa6a4a9c8b6f2ef12c61a9ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.461828 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_533d4a1dfa6a4a9c8b6f2ef12c61a9ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:39.463274 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac81de0ecdc24b87a4595bbb6f3e849b consensus state has no leader
I20260318 02:51:39.463625 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_efb2704a3a7246fd94c799eba891c6de" } modify_external_catalogs: true
I20260318 02:51:39.463794 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_efb2704a3a7246fd94c799eba891c6de" } modify_external_catalogs: true
I20260318 02:51:39.464660 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b9b4227a0df0476fa16d53a55a575a4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.465198 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9b4227a0df0476fa16d53a55a575a4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.411377 2257 raft_consensus.cc:493] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:39.473284 2257 raft_consensus.cc:515] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.475028 2295 raft_consensus.cc:493] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:39.475183 2295 raft_consensus.cc:515] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.475757 2295 leader_election.cc:290] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:39.476341 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b39433a5a7f42c39139db0da77ae75f" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:39.476956 997 leader_election.cc:343] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.477267 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet a6f42462ed9c49c797f5115b3ca6c423 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:39.479147 1173 tablet_bootstrap.cc:492] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:39.479923 1172 tablet_bootstrap.cc:654] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:39.480022 1173 ts_tablet_manager.cc:1403] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.446s user 0.016s sys 0.024s
I20260318 02:51:39.481190 1173 raft_consensus.cc:359] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.487200 2374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:39.490456 2374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260318 02:51:39.489558 2085 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260318 02:51:39.496697 1184 ts_tablet_manager.cc:1929] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:39.497298 1184 log.cc:1199] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/104cd36774df4bc0adf1d449224304d5
I20260318 02:51:39.499141 2257 leader_election.cc:290] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:39.499312 2257 raft_consensus.cc:493] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:39.499444 2257 raft_consensus.cc:515] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.502003 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b39433a5a7f42c39139db0da77ae75f" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:39.502228 783 raft_consensus.cc:2468] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:39.502703 999 leader_election.cc:304] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:39.503703 2296 raft_consensus.cc:2804] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:39.503785 2296 raft_consensus.cc:493] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:39.503840 2296 raft_consensus.cc:3060] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:39.505239 2257 leader_election.cc:290] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:39.507261 2296 raft_consensus.cc:515] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.509326 2296 leader_election.cc:290] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:39.509999 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b39433a5a7f42c39139db0da77ae75f" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:39.510205 783 raft_consensus.cc:3060] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:39.503213 1172 tablet_bootstrap.cc:492] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:39.510954 1172 ts_tablet_manager.cc:1403] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.051s user 0.004s sys 0.000s
I20260318 02:51:39.511852 1172 raft_consensus.cc:359] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.512115 1172 raft_consensus.cc:385] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:39.512233 1172 raft_consensus.cc:740] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:39.512532 1172 consensus_queue.cc:260] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.517823 783 raft_consensus.cc:2468] T 0b39433a5a7f42c39139db0da77ae75f P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:39.521250 1173 raft_consensus.cc:385] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:39.521374 1173 raft_consensus.cc:740] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:39.521574 1173 consensus_queue.cc:260] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.523277 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b39433a5a7f42c39139db0da77ae75f" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:39.523976 997 leader_election.cc:343] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.524392 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938a2eefe4471cb94a9544647f8e3e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:39.525074 1172 ts_tablet_manager.cc:1434] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260318 02:51:39.525198 1173 ts_tablet_manager.cc:1434] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.045s user 0.002s sys 0.000s
I20260318 02:51:39.525504 1173 tablet_bootstrap.cc:492] T 3348b200e5ca4f6ebecb2c25ddbe27bf P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:39.527100 719 leader_election.cc:343] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.531613 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebcf120100349319d27615b6e0c7550" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:39.526659 2372 raft_consensus.cc:493] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:39.532893 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2999327e014d4062a8e1aef2ba9ee277" } modify_external_catalogs: true
I20260318 02:51:39.533092 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2999327e014d4062a8e1aef2ba9ee277" } modify_external_catalogs: true
I20260318 02:51:39.533730 2372 raft_consensus.cc:515] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.534413 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_83df37ff0a08452697440678fe51ef9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:39.535128 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_265b3356de79492ea01fb1a46402ad02"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:39.534597 2372 leader_election.cc:290] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:39.535712 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_593af5f4ba59487a8dd335fdb4048253" } modify_external_catalogs: true
I20260318 02:51:39.535861 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_593af5f4ba59487a8dd335fdb4048253" } modify_external_catalogs: true
W20260318 02:51:39.538371 719 leader_election.cc:343] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.527021 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebcf120100349319d27615b6e0c7550" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:39.530480 2295 raft_consensus.cc:493] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260318 02:51:39.539924 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83df37ff0a08452697440678fe51ef9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.540099 2295 raft_consensus.cc:515] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.540853 2295 leader_election.cc:290] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:39.541531 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49b066f27b43829c8f922649744303" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:39.542099 997 leader_election.cc:343] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.535094 999 leader_election.cc:304] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:39.542253 1184 ts_tablet_manager.cc:1950] T 104cd36774df4bc0adf1d449224304d5 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:39.543516 2296 raft_consensus.cc:2804] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:39.543582 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49b066f27b43829c8f922649744303" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:39.543767 784 raft_consensus.cc:2468] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:39.544282 2326 tablet.cc:1723] T d2fb9c8f339444bc8d7c6479e7d87f44 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:39.545481 2328 tablet.cc:1723] T d2fb9c8f339444bc8d7c6479e7d87f44 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:39.545657 999 leader_election.cc:304] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:39.545735 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_265b3356de79492ea01fb1a46402ad02 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.545984 2152 raft_consensus.cc:2804] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:39.546092 2152 raft_consensus.cc:493] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:39.546187 2152 raft_consensus.cc:3060] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:39.546444 719 leader_election.cc:343] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.546572 719 leader_election.cc:304] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:39.546808 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49afed40c7aa4f2d913daed8055a098e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:39.547288 719 leader_election.cc:343] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.547341 2372 raft_consensus.cc:2749] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:39.551026 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_cce439d1cd8d4d6db1ccc4b4b31dbbe0" } new_table_name: "default.Table_4c6d7289bf5c4971892927a94cbf91f6" modify_external_catalogs: true
I20260318 02:51:39.551677 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c47734ae213a40a28d7866266dd02b6b" } new_table_name: "default.Table_a7db20999bd741cf9b102ed3b5b3f0b8" modify_external_catalogs: true
I20260318 02:51:39.553890 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 3d7b339a29ef456997d74a7a95d4c03a
I20260318 02:51:39.556092 448 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet d2fb9c8f339444bc8d7c6479e7d87f44 (table default.Table_278b10b38c074522b0e03e24d653346d [id=895bbd90cf47462ab116ee3f37e94982]). Expected version 3 got 0
I20260318 02:51:39.556761 2152 raft_consensus.cc:515] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.557346 1176 ts_tablet_manager.cc:1929] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:39.557471 1176 log.cc:1199] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/64c2a579264e43b9a1e25ded000d4d9f
I20260318 02:51:39.557461 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4f845969128d421bb81de4850d6f2f0c" } new_table_name: "default.Table_76cf5151c8c8462cbf34174053295750" modify_external_catalogs: true
I20260318 02:51:39.557753 1176 ts_tablet_manager.cc:1950] T 64c2a579264e43b9a1e25ded000d4d9f P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:39.558183 1176 tablet_replica.cc:333] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:39.558384 1176 raft_consensus.cc:2243] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:39.558537 1176 raft_consensus.cc:2272] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:39.559069 1176 ts_tablet_manager.cc:1916] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:39.559381 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49b066f27b43829c8f922649744303" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:39.559533 784 raft_consensus.cc:3060] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:39.562279 784 raft_consensus.cc:2468] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:39.562739 999 leader_election.cc:304] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:39.544169 2296 raft_consensus.cc:697] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:39.563074 2295 raft_consensus.cc:2804] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:39.563352 2296 consensus_queue.cc:237] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.564653 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 64c2a579264e43b9a1e25ded000d4d9f (table default.Table_c662869530134cb08ab6cc52957d07d9 [id=fda071b90fe64716b46fd1ab46f4b934]) successfully deleted
I20260318 02:51:39.564841 2152 leader_election.cc:290] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:39.565219 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49afed40c7aa4f2d913daed8055a098e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:39.566045 719 leader_election.cc:343] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.566162 719 leader_election.cc:304] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:39.566318 719 raft_consensus.cc:2686] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260318 02:51:39.566686 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49b066f27b43829c8f922649744303" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:39.567194 997 leader_election.cc:343] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.567530 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938a2eefe4471cb94a9544647f8e3e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:39.567840 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d7b339a29ef456997d74a7a95d4c03a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:39.567987 719 leader_election.cc:343] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.568079 719 leader_election.cc:304] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:39.568508 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d7b339a29ef456997d74a7a95d4c03a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:39.568794 2372 raft_consensus.cc:2749] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:39.569693 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d7b339a29ef456997d74a7a95d4c03a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:39.572923 1172 tablet_bootstrap.cc:492] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:39.575783 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 3d7b339a29ef456997d74a7a95d4c03a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d7b339a29ef456997d74a7a95d4c03a already in progress: creating tablet
W20260318 02:51:39.577013 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e91dd680615a4be79617ce018a6bd082 has no consensus state
I20260318 02:51:39.577185 1173 tablet_bootstrap.cc:654] T 3348b200e5ca4f6ebecb2c25ddbe27bf P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:39.575431 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 928) took 2451 ms. Trace:
I20260318 02:51:39.580252 1184 rpcz_store.cc:276] 0318 02:51:37.124224 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.124595 (+ 371us) service_pool.cc:225] Handling call
0318 02:51:39.423747 (+2299152us) ts_tablet_manager.cc:1151] Deleting tablet 104cd36774df4bc0adf1d449224304d5
0318 02:51:39.423759 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:39.467523 (+ 43764us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:39.496566 (+ 29043us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:39.575369 (+ 78803us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2298909}
W20260318 02:51:39.580525 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 77a17ef7cfee4d65808b11e9cb51e7df consensus state has no leader
I20260318 02:51:39.585110 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 104cd36774df4bc0adf1d449224304d5 (table default.Table_c978284529db4de7883f9f0664c4a158 [id=8b5e3535d9e44b1a86dc59211a31deb6]) successfully deleted
I20260318 02:51:39.585685 1184 tablet_replica.cc:333] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:39.586208 1184 raft_consensus.cc:2243] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:39.587800 1184 raft_consensus.cc:2272] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:39.589773 455 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 5b49b066f27b43829c8f922649744303 (table default.Table_e7633153163443ce97eeb8423db6d4ea [id=6f4e96b5a043423b95bfdf37a2411644]). Expected version 1 got 0
I20260318 02:51:39.592017 895 tablet_service.cc:1511] Processing CreateTablet for tablet de8d005ce9b04b9ba12102a4ba09b46f (DEFAULT_TABLE table=default.Table_670c625946a84303b45ccb5bc01ba69e [id=c9ce726a5e754359b4df94ca21723255]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.592444 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de8d005ce9b04b9ba12102a4ba09b46f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:39.599754 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 71b45ec1da6440b98c796e61d3551424 consensus state has no leader
I20260318 02:51:39.587095 1172 tablet_bootstrap.cc:654] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:39.606112 1184 ts_tablet_manager.cc:1916] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:39.613862 1176 ts_tablet_manager.cc:1929] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:39.614091 1176 log.cc:1199] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/49afed40c7aa4f2d913daed8055a098e
I20260318 02:51:39.614552 1176 ts_tablet_manager.cc:1950] T 49afed40c7aa4f2d913daed8055a098e P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:39.614992 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 31ac876d59554349b897a9d2cb7c2c41
I20260318 02:51:39.615694 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet e51e65aee63a453b848d79feaf83307e
I20260318 02:51:39.615782 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2295aef8f25f433ab8248940319fce3e
I20260318 02:51:39.616297 2372 raft_consensus.cc:493] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:39.616406 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 82d1e4cc5af6416ea6db123cfa321a53
I20260318 02:51:39.616487 2372 raft_consensus.cc:515] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.617116 2372 leader_election.cc:290] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:39.617209 907 tablet_service.cc:1558] Processing DeleteTablet for tablet e51e65aee63a453b848d79feaf83307e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:39.617990 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ac876d59554349b897a9d2cb7c2c41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:39.618477 755 tablet_service.cc:1558] Processing DeleteTablet for tablet e51e65aee63a453b848d79feaf83307e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:39.618783 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb731f97a764183aba7408bae969331" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:39.618777 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb731f97a764183aba7408bae969331" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:39.618861 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 2295aef8f25f433ab8248940319fce3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:39.619252 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d1e4cc5af6416ea6db123cfa321a53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:39.619299 719 leader_election.cc:343] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.619601 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 49afed40c7aa4f2d913daed8055a098e (table default.Table_8e1825ed6ac14c60b72e23cbbce1b677 [id=df327d7be3fc46d0b969529acb5684c5]) successfully deleted
W20260318 02:51:39.619625 719 leader_election.cc:343] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.619719 719 leader_election.cc:304] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:39.619860 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 1814c903ba4f456098f862e9490aa05e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1814c903ba4f456098f862e9490aa05e already in progress: creating tablet
I20260318 02:51:39.620026 2372 raft_consensus.cc:2749] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:39.620041 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet c9d09130cded4b2b9478a85066379e25 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9d09130cded4b2b9478a85066379e25 already in progress: creating tablet
W20260318 02:51:39.620285 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet ccbe2acf3be0434385d3caae31399f4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ccbe2acf3be0434385d3caae31399f4c already in progress: creating tablet
W20260318 02:51:39.620453 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 6b0be67e8f064e879f9a790a87d8b27b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b0be67e8f064e879f9a790a87d8b27b already in progress: creating tablet
W20260318 02:51:39.620623 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 31b6c2df8e1b47c3980f2c2a4295e659 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31b6c2df8e1b47c3980f2c2a4295e659 already in progress: creating tablet
W20260318 02:51:39.620893 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet e51e65aee63a453b848d79feaf83307e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e51e65aee63a453b848d79feaf83307e already in progress: creating tablet
I20260318 02:51:39.621091 453 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_278b10b38c074522b0e03e24d653346d [id=895bbd90cf47462ab116ee3f37e94982] alter complete (version 3)
I20260318 02:51:39.621507 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 2295aef8f25f433ab8248940319fce3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:39.621529 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d1e4cc5af6416ea6db123cfa321a53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:39.622432 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet e51e65aee63a453b848d79feaf83307e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:39.622615 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 2295aef8f25f433ab8248940319fce3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:39.622726 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d1e4cc5af6416ea6db123cfa321a53 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:39.622797 755 tablet_service.cc:1558] Processing DeleteTablet for tablet c4051c8e4d3d49829f9eac8e36baab2f with delete_type TABLET_DATA_DELETED (replaced by tablet 258dc29e4e4245289b7e450837edcd24) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:39.625276 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2295aef8f25f433ab8248940319fce3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2295aef8f25f433ab8248940319fce3e already in progress: creating tablet
W20260318 02:51:39.625545 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 82d1e4cc5af6416ea6db123cfa321a53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82d1e4cc5af6416ea6db123cfa321a53 already in progress: creating tablet
I20260318 02:51:39.619633 1174 tablet_bootstrap.cc:492] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:39.630997 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ac876d59554349b897a9d2cb7c2c41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:39.631843 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 31ac876d59554349b897a9d2cb7c2c41 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31ac876d59554349b897a9d2cb7c2c41 already in progress: creating tablet
I20260318 02:51:39.632269 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 31ac876d59554349b897a9d2cb7c2c41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:39.640038 1173 tablet_bootstrap.cc:492] T 3348b200e5ca4f6ebecb2c25ddbe27bf P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:39.640275 1173 ts_tablet_manager.cc:1403] T 3348b200e5ca4f6ebecb2c25ddbe27bf P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.115s user 0.002s sys 0.011s
I20260318 02:51:39.641079 1173 raft_consensus.cc:359] T 3348b200e5ca4f6ebecb2c25ddbe27bf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.641148 755 tablet_service.cc:1511] Processing CreateTablet for tablet de8d005ce9b04b9ba12102a4ba09b46f (DEFAULT_TABLE table=default.Table_670c625946a84303b45ccb5bc01ba69e [id=c9ce726a5e754359b4df94ca21723255]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.641410 1173 raft_consensus.cc:385] T 3348b200e5ca4f6ebecb2c25ddbe27bf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:39.641472 1173 raft_consensus.cc:740] T 3348b200e5ca4f6ebecb2c25ddbe27bf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:39.641563 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de8d005ce9b04b9ba12102a4ba09b46f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.641659 1173 consensus_queue.cc:260] T 3348b200e5ca4f6ebecb2c25ddbe27bf P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.644871 2361 raft_consensus.cc:493] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:39.644994 2361 raft_consensus.cc:515] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.646317 2361 leader_election.cc:290] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:39.617125 1176 tablet_replica.cc:333] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:39.647418 1176 raft_consensus.cc:2243] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:39.647689 1176 raft_consensus.cc:2272] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:39.648204 860 leader_election.cc:343] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 900c6ef2dc634a788239dd5b77c4bde0
I20260318 02:51:39.648375 1176 ts_tablet_manager.cc:1916] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:39.648866 862 leader_election.cc:343] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 900c6ef2dc634a788239dd5b77c4bde0
I20260318 02:51:39.648959 862 leader_election.cc:304] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:39.649402 2362 raft_consensus.cc:2749] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:39.651211 2152 raft_consensus.cc:493] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:39.651386 2152 raft_consensus.cc:515] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.651988 2152 leader_election.cc:290] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:39.652781 2295 raft_consensus.cc:697] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:39.653000 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6f42462ed9c49c797f5115b3ca6c423" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:39.653164 999 leader_election.cc:343] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: a6f42462ed9c49c797f5115b3ca6c423
I20260318 02:51:39.653097 2295 consensus_queue.cc:237] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:39.653478 997 leader_election.cc:343] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.653594 997 leader_election.cc:304] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:39.653991 453 master_service.cc:954] ReplaceTablet: received request to replace tablet 9eb15de8387248f1b2359c08230ff034 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:39.654464 1172 tablet_bootstrap.cc:492] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:39.654616 1172 ts_tablet_manager.cc:1403] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.082s user 0.004s sys 0.000s
I20260318 02:51:39.655397 1172 raft_consensus.cc:359] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.655565 1172 raft_consensus.cc:385] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:39.655871 1172 raft_consensus.cc:740] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:39.656190 1172 consensus_queue.cc:260] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.656751 1172 ts_tablet_manager.cc:1434] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:39.657038 1172 tablet_bootstrap.cc:492] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:39.657079 2152 raft_consensus.cc:2749] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:39.658866 1172 tablet_bootstrap.cc:654] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:39.659520 1173 ts_tablet_manager.cc:1434] T 3348b200e5ca4f6ebecb2c25ddbe27bf P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.019s user 0.001s sys 0.000s
I20260318 02:51:39.660323 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 9eb15de8387248f1b2359c08230ff034
I20260318 02:51:39.660822 453 catalog_manager.cc:6741] ReplaceTablet: tablet 9eb15de8387248f1b2359c08230ff034 deleted and replaced by tablet 52d77526010648739496b7b2cc315268
I20260318 02:51:39.662470 1173 tablet_bootstrap.cc:492] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:39.664629 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 9eb15de8387248f1b2359c08230ff034 with delete_type TABLET_DATA_DELETED (replaced by tablet 52d77526010648739496b7b2cc315268) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:39.664989 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 9eb15de8387248f1b2359c08230ff034 with delete_type TABLET_DATA_DELETED (replaced by tablet 52d77526010648739496b7b2cc315268) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:39.665413 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 9eb15de8387248f1b2359c08230ff034 with delete_type TABLET_DATA_DELETED (replaced by tablet 52d77526010648739496b7b2cc315268) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:39.669829 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a52cf4569ccd4c88843208989a5bb9fd" } new_table_name: "default.Table_b8f5883380bc49fa8b363bfb86b8d526" modify_external_catalogs: true
I20260318 02:51:39.671463 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_663d04a904c7459690a70b01e71c1933"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.672057 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_663d04a904c7459690a70b01e71c1933 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.674247 1033 tablet_service.cc:1511] Processing CreateTablet for tablet de8d005ce9b04b9ba12102a4ba09b46f (DEFAULT_TABLE table=default.Table_670c625946a84303b45ccb5bc01ba69e [id=c9ce726a5e754359b4df94ca21723255]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.674726 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de8d005ce9b04b9ba12102a4ba09b46f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.674762 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1a61666d86db47ffad7bafd4a07f0439" } new_table_name: "default.Table_98ee8782f42f4fcfb097b49984ee99cc" modify_external_catalogs: true
I20260318 02:51:39.676381 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b0e4642ca0a2453c910aaa30943534bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:39.676671 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_4b8ea2a5404649d8943f9b93f9675603"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.676930 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0e4642ca0a2453c910aaa30943534bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:39.677152 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b8ea2a5404649d8943f9b93f9675603 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.678453 895 tablet_service.cc:1511] Processing CreateTablet for tablet 2ecbbe70dfd74243982cf1b03b0f167b (DEFAULT_TABLE table=default.Table_a52cf4569ccd4c88843208989a5bb9fd [id=20ccaa3114e7484f8975a852cce1474f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.678877 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b4856e51667b41c68c764ff0e157cee2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.679368 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4856e51667b41c68c764ff0e157cee2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.681161 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_18229fb86a1143978b06d587f7498d51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.681609 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18229fb86a1143978b06d587f7498d51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.682610 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 0cda13385dbb4c6daa211e933c1f93a1 (DEFAULT_TABLE table=default.Table_1dd07777d8ae4e569eb11bc585d0dab8 [id=8c5b0f3d57e744debd6f34cb2596cbbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.682835 888 tablet_service.cc:1511] Processing CreateTablet for tablet dd97103da8924a4583cf5fe300073446 (DEFAULT_TABLE table=default.Table_dd64f667c9894282a95897cd143f0965 [id=dbdfbeca4a1e43d0be38eef03bc10bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.682909 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 2ecbbe70dfd74243982cf1b03b0f167b (DEFAULT_TABLE table=default.Table_a52cf4569ccd4c88843208989a5bb9fd [id=20ccaa3114e7484f8975a852cce1474f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.682994 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cda13385dbb4c6daa211e933c1f93a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.682930 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8dd951b2c36541e383c5ce9a1b1e2a57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:39.683230 901 tablet_service.cc:1511] Processing CreateTablet for tablet cf9b17ec750941b1b4e2653ca34e5930 (DEFAULT_TABLE table=default.Table_de60cf0754954aff9bdf9288a5b026fa [id=849eb936c25f40469c0ed8b064e4d567]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:39.683373 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8dd951b2c36541e383c5ce9a1b1e2a57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.683605 1026 tablet_service.cc:1511] Processing CreateTablet for tablet cf9b17ec750941b1b4e2653ca34e5930 (DEFAULT_TABLE table=default.Table_de60cf0754954aff9bdf9288a5b026fa [id=849eb936c25f40469c0ed8b064e4d567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.684038 907 tablet_service.cc:1511] Processing CreateTablet for tablet ae2584d0b26b4783928a0b0a32a7f74d (DEFAULT_TABLE table=default.Table_96058704fc874517924223389d09a2cd [id=98533bf4b8a241ccb1e6a5a1eaf80c6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.684427 1031 tablet_service.cc:1511] Processing CreateTablet for tablet ae2584d0b26b4783928a0b0a32a7f74d (DEFAULT_TABLE table=default.Table_96058704fc874517924223389d09a2cd [id=98533bf4b8a241ccb1e6a5a1eaf80c6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.686025 755 tablet_service.cc:1511] Processing CreateTablet for tablet 2ecbbe70dfd74243982cf1b03b0f167b (DEFAULT_TABLE table=default.Table_a52cf4569ccd4c88843208989a5bb9fd [id=20ccaa3114e7484f8975a852cce1474f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.686517 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ecbbe70dfd74243982cf1b03b0f167b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.690415 1173 tablet_bootstrap.cc:654] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:39.693017 756 tablet_service.cc:1511] Processing CreateTablet for tablet cf9b17ec750941b1b4e2653ca34e5930 (DEFAULT_TABLE table=default.Table_de60cf0754954aff9bdf9288a5b026fa [id=849eb936c25f40469c0ed8b064e4d567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.693439 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf9b17ec750941b1b4e2653ca34e5930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.695811 456 catalog_manager.cc:5671] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:39.696354 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 5b49b066f27b43829c8f922649744303 (table default.Table_e7633153163443ce97eeb8423db6d4ea [id=6f4e96b5a043423b95bfdf37a2411644]). Expected version 1 got 0
I20260318 02:51:39.696619 456 catalog_manager.cc:5671] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:39.696771 762 tablet_service.cc:1511] Processing CreateTablet for tablet ae2584d0b26b4783928a0b0a32a7f74d (DEFAULT_TABLE table=default.Table_96058704fc874517924223389d09a2cd [id=98533bf4b8a241ccb1e6a5a1eaf80c6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.697130 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae2584d0b26b4783928a0b0a32a7f74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.700990 752 tablet_service.cc:1511] Processing CreateTablet for tablet 0cda13385dbb4c6daa211e933c1f93a1 (DEFAULT_TABLE table=default.Table_1dd07777d8ae4e569eb11bc585d0dab8 [id=8c5b0f3d57e744debd6f34cb2596cbbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.701349 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cda13385dbb4c6daa211e933c1f93a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.703249 1176 ts_tablet_manager.cc:1929] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260318 02:51:39.705819 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2ecbbe70dfd74243982cf1b03b0f167b consensus state has no leader
I20260318 02:51:39.706333 1176 log.cc:1199] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/105326aea9f744779ca76e0cbb2448cd
I20260318 02:51:39.706821 1176 ts_tablet_manager.cc:1950] T 105326aea9f744779ca76e0cbb2448cd P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:39.708572 1176 tablet_replica.cc:333] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:39.708999 1176 raft_consensus.cc:2243] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:39.709957 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_36ee456043a744d7b2ae15b5366d65ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:39.710227 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_4a1bffd2251c411f85b8c49165c2a214"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.710515 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36ee456043a744d7b2ae15b5366d65ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.712769 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 105326aea9f744779ca76e0cbb2448cd (table default.Table_268e9858449d471ca088f8b1f2492fe6 [id=58354360683d422dbdcc43826b39dbc8]) successfully deleted
W20260318 02:51:39.713037 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet de38fe3eb88147eab65f3dfed37fbf7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de38fe3eb88147eab65f3dfed37fbf7d already in progress: creating tablet
W20260318 02:51:39.713274 997 consensus_peers.cc:597] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:39.713649 1176 raft_consensus.cc:2272] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:39.713853 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a1bffd2251c411f85b8c49165c2a214 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.714196 1176 ts_tablet_manager.cc:1916] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:39.715232 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7253dcb3d73c4297bf444defd3ef6e74 consensus state has no leader
I20260318 02:51:39.717597 1172 tablet_bootstrap.cc:492] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:39.717749 1172 ts_tablet_manager.cc:1403] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.000s
I20260318 02:51:39.718490 1172 raft_consensus.cc:359] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.718664 1172 raft_consensus.cc:385] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:39.718710 1172 raft_consensus.cc:740] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:39.718884 1172 consensus_queue.cc:260] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.719365 1172 ts_tablet_manager.cc:1434] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:39.719636 1172 tablet_bootstrap.cc:492] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:39.722541 1184 ts_tablet_manager.cc:1929] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:39.722718 1184 log.cc:1199] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/b4ed28b9a7f2471aa4ed7cd2e1efda1a
I20260318 02:51:39.723100 1184 ts_tablet_manager.cc:1950] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:39.734508 891 tablet_service.cc:1511] Processing CreateTablet for tablet 0b4c81cfcdad4a448374c6364c7c6865 (DEFAULT_TABLE table=default.Table_9120298498d84d788faf0bf46c505754 [id=f8426b491b294bd4bdbb31287e6433be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.735536 762 tablet_service.cc:1511] Processing CreateTablet for tablet dd97103da8924a4583cf5fe300073446 (DEFAULT_TABLE table=default.Table_dd64f667c9894282a95897cd143f0965 [id=dbdfbeca4a1e43d0be38eef03bc10bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.735795 756 tablet_service.cc:1511] Processing CreateTablet for tablet 0b4c81cfcdad4a448374c6364c7c6865 (DEFAULT_TABLE table=default.Table_9120298498d84d788faf0bf46c505754 [id=f8426b491b294bd4bdbb31287e6433be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.736013 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd97103da8924a4583cf5fe300073446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.736306 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b4c81cfcdad4a448374c6364c7c6865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.741240 2372 raft_consensus.cc:493] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:39.741405 2372 raft_consensus.cc:515] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.742022 2372 leader_election.cc:290] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:39.742976 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169f97b2320e4a5baae1dec29a1c7c36" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:39.743603 719 leader_election.cc:343] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.745071 1176 ts_tablet_manager.cc:1929] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:39.745898 1176 log.cc:1199] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/3d7b339a29ef456997d74a7a95d4c03a
I20260318 02:51:39.746474 1176 ts_tablet_manager.cc:1950] T 3d7b339a29ef456997d74a7a95d4c03a P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:39.749107 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 3d7b339a29ef456997d74a7a95d4c03a (table default.Table_2999327e014d4062a8e1aef2ba9ee277 [id=545ec19ee7a34ceb8e7adb93b6eaecf8]) successfully deleted
W20260318 02:51:39.749527 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 31ac876d59554349b897a9d2cb7c2c41 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31ac876d59554349b897a9d2cb7c2c41 already in progress: creating tablet
W20260318 02:51:39.749855 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet e51e65aee63a453b848d79feaf83307e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e51e65aee63a453b848d79feaf83307e already in progress: creating tablet
W20260318 02:51:39.750319 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2295aef8f25f433ab8248940319fce3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2295aef8f25f433ab8248940319fce3e already in progress: creating tablet
W20260318 02:51:39.750614 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 82d1e4cc5af6416ea6db123cfa321a53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82d1e4cc5af6416ea6db123cfa321a53 already in progress: creating tablet
I20260318 02:51:39.750802 1176 tablet_replica.cc:333] T c4051c8e4d3d49829f9eac8e36baab2f P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:39.751183 1176 raft_consensus.cc:2243] T c4051c8e4d3d49829f9eac8e36baab2f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:39.752120 1176 raft_consensus.cc:2272] T c4051c8e4d3d49829f9eac8e36baab2f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:39.752928 1176 ts_tablet_manager.cc:1916] T c4051c8e4d3d49829f9eac8e36baab2f P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:39.760795 755 tablet_service.cc:1511] Processing CreateTablet for tablet 4b72ffcc3bb94d6aa47f0d5e815f55d6 (DEFAULT_TABLE table=default.Table_74961d72446a429f916e0697790f2d0a [id=b8d4407368684d4bb3ee1d64c67dae76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.761849 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b72ffcc3bb94d6aa47f0d5e815f55d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.762025 762 tablet_service.cc:1511] Processing CreateTablet for tablet c8d7aad0f2c545628a13b2ad3269dcd6 (DEFAULT_TABLE table=default.Table_8a26eebc10854c6a84b60130cb3e5841 [id=5c1fa8e866d7406eb2c186b6592935a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.762434 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8d7aad0f2c545628a13b2ad3269dcd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.761456 756 tablet_service.cc:1511] Processing CreateTablet for tablet e91dd680615a4be79617ce018a6bd082 (DEFAULT_TABLE table=default.Table_a7db20999bd741cf9b102ed3b5b3f0b8 [id=3dccd830db144df88d99f1d5af50f6dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.763108 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e91dd680615a4be79617ce018a6bd082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.766789 1176 ts_tablet_manager.cc:1929] T c4051c8e4d3d49829f9eac8e36baab2f P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:39.766952 1176 log.cc:1199] T c4051c8e4d3d49829f9eac8e36baab2f P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/c4051c8e4d3d49829f9eac8e36baab2f
I20260318 02:51:39.767258 1176 ts_tablet_manager.cc:1950] T c4051c8e4d3d49829f9eac8e36baab2f P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:39.733808 1033 tablet_service.cc:1511] Processing CreateTablet for tablet dd97103da8924a4583cf5fe300073446 (DEFAULT_TABLE table=default.Table_dd64f667c9894282a95897cd143f0965 [id=dbdfbeca4a1e43d0be38eef03bc10bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.735389 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 0b4c81cfcdad4a448374c6364c7c6865 (DEFAULT_TABLE table=default.Table_9120298498d84d788faf0bf46c505754 [id=f8426b491b294bd4bdbb31287e6433be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.742861 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169f97b2320e4a5baae1dec29a1c7c36" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:39.753819 2295 raft_consensus.cc:493] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:39.768476 2295 raft_consensus.cc:515] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:39.768837 719 leader_election.cc:343] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.768955 719 leader_election.cc:304] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:39.769129 2295 leader_election.cc:290] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:39.769167 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 930) took 2602 ms. Trace:
I20260318 02:51:39.769313 2372 raft_consensus.cc:2749] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:39.769289 1184 rpcz_store.cc:276] 0318 02:51:37.166813 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.167527 (+ 714us) service_pool.cc:225] Handling call
0318 02:51:39.585589 (+2418062us) ts_tablet_manager.cc:1151] Deleting tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a
0318 02:51:39.585602 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:39.681721 (+ 96119us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:39.722436 (+ 40715us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:39.769153 (+ 46717us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2417841}
I20260318 02:51:39.770031 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 931) took 2603 ms. Trace:
W20260318 02:51:39.770390 999 leader_election.cc:343] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 254b8722e7ff4ccabc6d16f04daf85aa
I20260318 02:51:39.770233 1184 rpcz_store.cc:276] 0318 02:51:37.166899 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.168704 (+ 1805us) service_pool.cc:225] Handling call
0318 02:51:39.769843 (+2601139us) ts_tablet_manager.cc:1151] Deleting tablet 9f274ae7a6834ca98f01575fcf8b161e
0318 02:51:39.769852 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:39.769989 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2600899}
I20260318 02:51:39.758579 1040 tablet_service.cc:1511] Processing CreateTablet for tablet c8d7aad0f2c545628a13b2ad3269dcd6 (DEFAULT_TABLE table=default.Table_8a26eebc10854c6a84b60130cb3e5841 [id=5c1fa8e866d7406eb2c186b6592935a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.760176 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 4b72ffcc3bb94d6aa47f0d5e815f55d6 (DEFAULT_TABLE table=default.Table_74961d72446a429f916e0697790f2d0a [id=b8d4407368684d4bb3ee1d64c67dae76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.770592 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet c4051c8e4d3d49829f9eac8e36baab2f (table default.Table_fe03be40cbc54d21927bda17030ed005 [id=3665ac075f964d4c8e2cdda80cbef8a4]) successfully deleted
I20260318 02:51:39.761688 1028 tablet_service.cc:1511] Processing CreateTablet for tablet e91dd680615a4be79617ce018a6bd082 (DEFAULT_TABLE table=default.Table_a7db20999bd741cf9b102ed3b5b3f0b8 [id=3dccd830db144df88d99f1d5af50f6dc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:39.770851 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 9eb15de8387248f1b2359c08230ff034 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9eb15de8387248f1b2359c08230ff034 already in progress: creating tablet
I20260318 02:51:39.771126 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b4c81cfcdad4a448374c6364c7c6865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.771513 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ecbbe70dfd74243982cf1b03b0f167b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.774245 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae2584d0b26b4783928a0b0a32a7f74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.775892 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd97103da8924a4583cf5fe300073446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.775837 889 tablet_service.cc:1511] Processing CreateTablet for tablet 0cda13385dbb4c6daa211e933c1f93a1 (DEFAULT_TABLE table=default.Table_1dd07777d8ae4e569eb11bc585d0dab8 [id=8c5b0f3d57e744debd6f34cb2596cbbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.776877 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf9b17ec750941b1b4e2653ca34e5930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.778188 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf9b17ec750941b1b4e2653ca34e5930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.778491 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd97103da8924a4583cf5fe300073446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.780961 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e91dd680615a4be79617ce018a6bd082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.781299 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae2584d0b26b4783928a0b0a32a7f74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.784953 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b72ffcc3bb94d6aa47f0d5e815f55d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.785192 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b4c81cfcdad4a448374c6364c7c6865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.790593 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ecbbe70dfd74243982cf1b03b0f167b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.790731 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254b8722e7ff4ccabc6d16f04daf85aa" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:39.790938 894 tablet_service.cc:1511] Processing CreateTablet for tablet e91dd680615a4be79617ce018a6bd082 (DEFAULT_TABLE table=default.Table_a7db20999bd741cf9b102ed3b5b3f0b8 [id=3dccd830db144df88d99f1d5af50f6dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.791256 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e91dd680615a4be79617ce018a6bd082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.791632 888 tablet_service.cc:1511] Processing CreateTablet for tablet c8d7aad0f2c545628a13b2ad3269dcd6 (DEFAULT_TABLE table=default.Table_8a26eebc10854c6a84b60130cb3e5841 [id=5c1fa8e866d7406eb2c186b6592935a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.791947 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8d7aad0f2c545628a13b2ad3269dcd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.793641 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7692f02c62f94771bc39331507161bb2" } modify_external_catalogs: true
I20260318 02:51:39.793826 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7692f02c62f94771bc39331507161bb2" } modify_external_catalogs: true
W20260318 02:51:39.795303 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 9eb15de8387248f1b2359c08230ff034 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9eb15de8387248f1b2359c08230ff034 already in progress: creating tablet
I20260318 02:51:39.796033 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a (table default.Table_8d6d4b35c7754174adfe3a4d4889cdae [id=9dc5f3bbe7a34ffab1bd5105bac98325]) successfully deleted
W20260318 02:51:39.796249 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 9f274ae7a6834ca98f01575fcf8b161e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f274ae7a6834ca98f01575fcf8b161e already in progress: creating tablet
I20260318 02:51:39.797474 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cda13385dbb4c6daa211e933c1f93a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.798370 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1d44de7cb31c45a8a09b4889c875ba21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.798919 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d44de7cb31c45a8a09b4889c875ba21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.800806 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6aa6181c2ea647e9a91f1a0ec07fdfa3" } new_table_name: "default.Table_c1ed86ac29324832b5dc6a87189354ee" modify_external_catalogs: true
I20260318 02:51:39.800899 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8d7aad0f2c545628a13b2ad3269dcd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.802634 901 tablet_service.cc:1511] Processing CreateTablet for tablet 4b72ffcc3bb94d6aa47f0d5e815f55d6 (DEFAULT_TABLE table=default.Table_74961d72446a429f916e0697790f2d0a [id=b8d4407368684d4bb3ee1d64c67dae76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.802992 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b72ffcc3bb94d6aa47f0d5e815f55d6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:39.806077 997 leader_election.cc:343] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:39.806200 997 leader_election.cc:304] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:39.806794 2382 raft_consensus.cc:2749] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:39.807590 453 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet a9c60ef260d049bea4ce729316a0d09f (table default.Table_d5ddb641ef9245ca92ab35d8ac25b157 [id=fb45f238426142faa79cbe89242c7418]). Expected version 1 got 0
I20260318 02:51:39.809978 1173 tablet_bootstrap.cc:492] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:39.810119 1172 tablet_bootstrap.cc:654] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:39.810138 1173 ts_tablet_manager.cc:1403] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.148s user 0.008s sys 0.004s
I20260318 02:51:39.810835 1173 raft_consensus.cc:359] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.811126 1173 raft_consensus.cc:385] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:39.811229 1173 raft_consensus.cc:740] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:39.811472 1173 consensus_queue.cc:260] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.813810 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_adb87f4cd4574655a262d9570e440d1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:39.814404 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_adb87f4cd4574655a262d9570e440d1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:39.815034 1173 ts_tablet_manager.cc:1434] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260318 02:51:39.815318 1173 tablet_bootstrap.cc:492] T e1d804f5e9564f6d83efb77e6c18724b P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:39.815649 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_691a1be9c3854061ba5b3ce5ec5c6241" } new_table_name: "default.Table_9fd4f1b1845a40a5bc8d409f867c38e2" modify_external_catalogs: true
I20260318 02:51:39.816201 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 933) took 2562 ms. Trace:
I20260318 02:51:39.816275 1184 rpcz_store.cc:276] 0318 02:51:37.253880 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.255157 (+ 1277us) service_pool.cc:225] Handling call
0318 02:51:39.770752 (+2515595us) ts_tablet_manager.cc:1151] Deleting tablet 868605c58c1d4744ab8930313e7dcaa9
0318 02:51:39.816088 (+ 45336us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:39.816185 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2515218}
I20260318 02:51:39.816532 1184 tablet_replica.cc:333] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:39.816700 1184 raft_consensus.cc:2243] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:39.817054 1184 raft_consensus.cc:2272] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:39.817574 1184 ts_tablet_manager.cc:1916] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:39.821179 1173 tablet_bootstrap.cc:654] T e1d804f5e9564f6d83efb77e6c18724b P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:39.826609 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1dd07777d8ae4e569eb11bc585d0dab8" } modify_external_catalogs: true
I20260318 02:51:39.826835 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1dd07777d8ae4e569eb11bc585d0dab8" } modify_external_catalogs: true
W20260318 02:51:39.826936 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 868605c58c1d4744ab8930313e7dcaa9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 868605c58c1d4744ab8930313e7dcaa9 already in progress: creating tablet
I20260318 02:51:39.827557 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_25494285095147fa885f1aa79e2f1722" } new_table_name: "default.Table_5351174539b64d46841d42da2f1acce4" modify_external_catalogs: true
I20260318 02:51:39.828138 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9f269c4844cc473580c4743dd9be3dea" } modify_external_catalogs: true
I20260318 02:51:39.828282 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9f269c4844cc473580c4743dd9be3dea" } modify_external_catalogs: true
I20260318 02:51:39.829393 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c8ea19bed9e54eaf91af95c365e46851" } modify_external_catalogs: true
I20260318 02:51:39.829555 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c8ea19bed9e54eaf91af95c365e46851" } modify_external_catalogs: true
I20260318 02:51:39.830685 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9724bed50bdb463db42189c0d44f43a0" } modify_external_catalogs: true
I20260318 02:51:39.830862 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9724bed50bdb463db42189c0d44f43a0" } modify_external_catalogs: true
I20260318 02:51:39.833859 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet fb5d1d828899472e8f48723b35e94d62
I20260318 02:51:39.836117 888 tablet_service.cc:1511] Processing CreateTablet for tablet 63d02a1a0d544fc89d0e9920ff26a52b (DEFAULT_TABLE table=default.Table_0e9f3984919d46a99af1eb866bcb9394 [id=a450718dd1234e5b8bb535b49e7af8a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.836395 891 tablet_service.cc:1558] Processing DeleteTablet for tablet fb5d1d828899472e8f48723b35e94d62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:39.836551 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63d02a1a0d544fc89d0e9920ff26a52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.836396 901 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfcaa44e4ba473ba88c404b3d51e3fa (DEFAULT_TABLE table=default.Table_6749e2f6c9fe469eb76b07916189d7f7 [id=a8a68f377ee646f4893544038c9706f3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:39.837172 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet fb5d1d828899472e8f48723b35e94d62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb5d1d828899472e8f48723b35e94d62 already in progress: creating tablet
I20260318 02:51:39.837553 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfcaa44e4ba473ba88c404b3d51e3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.838181 752 tablet_service.cc:1511] Processing CreateTablet for tablet 12d59689d5954416890541bffb0267a7 (DEFAULT_TABLE table=default.Table_0a8ce5b5e5574dd0953d8cfb836bc898 [id=33bec25e7fb3408e85c0ba27402aec77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.838546 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12d59689d5954416890541bffb0267a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.838563 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet c7c4257a54d3487aa520531a64fc721c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:39.840154 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet fb5d1d828899472e8f48723b35e94d62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:39.840574 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 12d59689d5954416890541bffb0267a7 (DEFAULT_TABLE table=default.Table_0a8ce5b5e5574dd0953d8cfb836bc898 [id=33bec25e7fb3408e85c0ba27402aec77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.840994 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12d59689d5954416890541bffb0267a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.845526 888 tablet_service.cc:1511] Processing CreateTablet for tablet 6b2084350a1e48b3b0edd992a1191a46 (DEFAULT_TABLE table=default.Table_ad2b47d8b3d545b4ae86fb931e29cb85 [id=7b6416d0dd8f4b96af0d3a1f1b42d3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.845945 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b2084350a1e48b3b0edd992a1191a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.846411 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 6b2084350a1e48b3b0edd992a1191a46 (DEFAULT_TABLE table=default.Table_ad2b47d8b3d545b4ae86fb931e29cb85 [id=7b6416d0dd8f4b96af0d3a1f1b42d3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.846879 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b2084350a1e48b3b0edd992a1191a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.849016 762 tablet_service.cc:1558] Processing DeleteTablet for tablet fb5d1d828899472e8f48723b35e94d62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:39.751540 1174 ts_tablet_manager.cc:1403] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.649s user 0.024s sys 0.002s
I20260318 02:51:39.850415 1174 raft_consensus.cc:359] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.851128 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 63d02a1a0d544fc89d0e9920ff26a52b (DEFAULT_TABLE table=default.Table_0e9f3984919d46a99af1eb866bcb9394 [id=a450718dd1234e5b8bb535b49e7af8a3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:39.853899 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet fb5d1d828899472e8f48723b35e94d62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb5d1d828899472e8f48723b35e94d62 already in progress: creating tablet
I20260318 02:51:39.861167 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63d02a1a0d544fc89d0e9920ff26a52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.854369 752 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfcaa44e4ba473ba88c404b3d51e3fa (DEFAULT_TABLE table=default.Table_6749e2f6c9fe469eb76b07916189d7f7 [id=a8a68f377ee646f4893544038c9706f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.861867 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfcaa44e4ba473ba88c404b3d51e3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.862522 1174 raft_consensus.cc:385] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:39.862769 1174 raft_consensus.cc:740] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:39.863102 1174 consensus_queue.cc:260] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.865079 907 tablet_service.cc:1511] Processing CreateTablet for tablet 12d59689d5954416890541bffb0267a7 (DEFAULT_TABLE table=default.Table_0a8ce5b5e5574dd0953d8cfb836bc898 [id=33bec25e7fb3408e85c0ba27402aec77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.865574 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12d59689d5954416890541bffb0267a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.870750 1174 ts_tablet_manager.cc:1434] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.021s user 0.001s sys 0.000s
I20260318 02:51:39.872303 895 tablet_service.cc:1511] Processing CreateTablet for tablet 8845dbc4ad3a499bb77aa9b6e24b554d (DEFAULT_TABLE table=default.Table_8d234aec26b24c4d8aeca66b6539c362 [id=f0ce51f5fba74028a3442c78e8cee564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.872941 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8845dbc4ad3a499bb77aa9b6e24b554d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.878973 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 4dfcaa44e4ba473ba88c404b3d51e3fa (DEFAULT_TABLE table=default.Table_6749e2f6c9fe469eb76b07916189d7f7 [id=a8a68f377ee646f4893544038c9706f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.879544 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dfcaa44e4ba473ba88c404b3d51e3fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.854032 1184 ts_tablet_manager.cc:1929] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:39.881371 1184 log.cc:1199] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/ab158343adb14eab85c595fa5405145d
I20260318 02:51:39.881970 1184 ts_tablet_manager.cc:1950] T ab158343adb14eab85c595fa5405145d P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:39.882779 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 935) took 2453 ms. Trace:
I20260318 02:51:39.884402 751 tablet_service.cc:1511] Processing CreateTablet for tablet 1294e1ae2115471a8b605d38f1c26e60 (DEFAULT_TABLE table=default.Table_ef70b74b7ca84cd5be4468de1ff4eac4 [id=8e1b0836189c47cfa27e615a99fe2616]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.884860 759 tablet_service.cc:1511] Processing CreateTablet for tablet 0af921934443453f81bcd6bf22544352 (DEFAULT_TABLE table=default.Table_ce283b50a5884aa99ab7110cc3d0c158 [id=e20217e652e34d7591fbeaf29741c0ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.884939 766 tablet_service.cc:1511] Processing CreateTablet for tablet 23e82f24405b465fa26074a4370ed3d3 (DEFAULT_TABLE table=default.Table_38436e11a4b24cfc9f350d474dc9cb5c [id=a374760d61ef4ed4955b811164122970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.885221 750 tablet_service.cc:1511] Processing CreateTablet for tablet 41d775d166fa47e29670c0313cdc69d6 (DEFAULT_TABLE table=default.Table_52da837696ba4ad2be63b9b9d93f1c0a [id=ed7226c452d7440a9f64291c64126fee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.885586 761 tablet_service.cc:1511] Processing CreateTablet for tablet 801f0b01d4be42cebec554db9b3ac1e8 (DEFAULT_TABLE table=default.Table_ee8d3cf2be29490e882954710a91f9a6 [id=4f93af3a1fa0443b80a46a93e182950c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.885613 901 tablet_service.cc:1511] Processing CreateTablet for tablet 23e82f24405b465fa26074a4370ed3d3 (DEFAULT_TABLE table=default.Table_38436e11a4b24cfc9f350d474dc9cb5c [id=a374760d61ef4ed4955b811164122970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.886006 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e82f24405b465fa26074a4370ed3d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.885974 888 tablet_service.cc:1511] Processing CreateTablet for tablet d5c81f563c6641349a1f8ca014af6dfb (DEFAULT_TABLE table=default.Table_e34ab505a4f642708008eb59ce02b5b6 [id=fcefabac03a64cc292a9630aaac1b330]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.886300 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c81f563c6641349a1f8ca014af6dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.886950 748 tablet_service.cc:1511] Processing CreateTablet for tablet 6b2084350a1e48b3b0edd992a1191a46 (DEFAULT_TABLE table=default.Table_ad2b47d8b3d545b4ae86fb931e29cb85 [id=7b6416d0dd8f4b96af0d3a1f1b42d3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.887050 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 900c6ef2dc634a788239dd5b77c4bde0 with delete_type TABLET_DATA_DELETED (replaced by tablet 20ecb11db30e409b9090ebfc4a4f0785) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:39.887264 753 tablet_service.cc:1511] Processing CreateTablet for tablet 8845dbc4ad3a499bb77aa9b6e24b554d (DEFAULT_TABLE table=default.Table_8d234aec26b24c4d8aeca66b6539c362 [id=f0ce51f5fba74028a3442c78e8cee564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.887552 754 tablet_service.cc:1511] Processing CreateTablet for tablet d5c81f563c6641349a1f8ca014af6dfb (DEFAULT_TABLE table=default.Table_e34ab505a4f642708008eb59ce02b5b6 [id=fcefabac03a64cc292a9630aaac1b330]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.887701 1175 tablet_replica.cc:333] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:39.887838 757 tablet_service.cc:1511] Processing CreateTablet for tablet cce09767819441e599e7a62526d2cb75 (DEFAULT_TABLE table=default.Table_6aa6181c2ea647e9a91f1a0ec07fdfa3 [id=79792b4bfc8d4fc2b5c4f5f8f2c803f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.887881 1175 raft_consensus.cc:2243] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:39.888051 1175 raft_consensus.cc:2272] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:39.889199 1175 ts_tablet_manager.cc:1916] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:39.894590 891 tablet_service.cc:1511] Processing CreateTablet for tablet cce09767819441e599e7a62526d2cb75 (DEFAULT_TABLE table=default.Table_6aa6181c2ea647e9a91f1a0ec07fdfa3 [id=79792b4bfc8d4fc2b5c4f5f8f2c803f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.894960 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cce09767819441e599e7a62526d2cb75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.895184 889 tablet_service.cc:1511] Processing CreateTablet for tablet 1294e1ae2115471a8b605d38f1c26e60 (DEFAULT_TABLE table=default.Table_ef70b74b7ca84cd5be4468de1ff4eac4 [id=8e1b0836189c47cfa27e615a99fe2616]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.895509 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1294e1ae2115471a8b605d38f1c26e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.902232 1175 ts_tablet_manager.cc:1929] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:39.902456 1175 log.cc:1199] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/900c6ef2dc634a788239dd5b77c4bde0
I20260318 02:51:39.902881 1175 ts_tablet_manager.cc:1950] T 900c6ef2dc634a788239dd5b77c4bde0 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:39.887478 1038 tablet_service.cc:1511] Processing CreateTablet for tablet d5c81f563c6641349a1f8ca014af6dfb (DEFAULT_TABLE table=default.Table_e34ab505a4f642708008eb59ce02b5b6 [id=fcefabac03a64cc292a9630aaac1b330]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.905238 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c81f563c6641349a1f8ca014af6dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.905277 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 21e6e89e5a0a4d1bb952e74be1b7e551 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:39.906301 888 tablet_service.cc:1511] Processing CreateTablet for tablet 41d775d166fa47e29670c0313cdc69d6 (DEFAULT_TABLE table=default.Table_52da837696ba4ad2be63b9b9d93f1c0a [id=ed7226c452d7440a9f64291c64126fee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.906709 904 tablet_service.cc:1511] Processing CreateTablet for tablet c19c7bb908ec4586a1454d99802e099f (DEFAULT_TABLE table=default.Table_39e1f51fc4d849a1b42a27f540395700 [id=113a7f7490a84df8a0b4e3b86b0454be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.907052 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c19c7bb908ec4586a1454d99802e099f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.907275 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 900c6ef2dc634a788239dd5b77c4bde0 (table default.Table_c2d16f88924544cbaf4ed64b9c5bc7a6 [id=8749d9c9086f43a99348c9bfe995e6e6]) successfully deleted
I20260318 02:51:39.907645 891 tablet_service.cc:1511] Processing CreateTablet for tablet 0af921934443453f81bcd6bf22544352 (DEFAULT_TABLE table=default.Table_ce283b50a5884aa99ab7110cc3d0c158 [id=e20217e652e34d7591fbeaf29741c0ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.907938 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0af921934443453f81bcd6bf22544352. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:39.908594 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cce09767819441e599e7a62526d2cb75 consensus state has no leader
I20260318 02:51:39.908998 894 tablet_service.cc:1511] Processing CreateTablet for tablet 801f0b01d4be42cebec554db9b3ac1e8 (DEFAULT_TABLE table=default.Table_ee8d3cf2be29490e882954710a91f9a6 [id=4f93af3a1fa0443b80a46a93e182950c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.909291 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801f0b01d4be42cebec554db9b3ac1e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.912663 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41d775d166fa47e29670c0313cdc69d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.913399 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 0af921934443453f81bcd6bf22544352 (DEFAULT_TABLE table=default.Table_ce283b50a5884aa99ab7110cc3d0c158 [id=e20217e652e34d7591fbeaf29741c0ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.913769 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0af921934443453f81bcd6bf22544352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.916985 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 41d775d166fa47e29670c0313cdc69d6 (DEFAULT_TABLE table=default.Table_52da837696ba4ad2be63b9b9d93f1c0a [id=ed7226c452d7440a9f64291c64126fee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.917327 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41d775d166fa47e29670c0313cdc69d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.921033 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 801f0b01d4be42cebec554db9b3ac1e8 (DEFAULT_TABLE table=default.Table_ee8d3cf2be29490e882954710a91f9a6 [id=4f93af3a1fa0443b80a46a93e182950c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.921392 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801f0b01d4be42cebec554db9b3ac1e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.888437 1037 tablet_service.cc:1511] Processing CreateTablet for tablet cce09767819441e599e7a62526d2cb75 (DEFAULT_TABLE table=default.Table_6aa6181c2ea647e9a91f1a0ec07fdfa3 [id=79792b4bfc8d4fc2b5c4f5f8f2c803f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.925315 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cce09767819441e599e7a62526d2cb75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.894222 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 1294e1ae2115471a8b605d38f1c26e60 (DEFAULT_TABLE table=default.Table_ef70b74b7ca84cd5be4468de1ff4eac4 [id=8e1b0836189c47cfa27e615a99fe2616]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.894527 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 23e82f24405b465fa26074a4370ed3d3 (DEFAULT_TABLE table=default.Table_38436e11a4b24cfc9f350d474dc9cb5c [id=a374760d61ef4ed4955b811164122970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.894846 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 8845dbc4ad3a499bb77aa9b6e24b554d (DEFAULT_TABLE table=default.Table_8d234aec26b24c4d8aeca66b6539c362 [id=f0ce51f5fba74028a3442c78e8cee564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.929311 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1294e1ae2115471a8b605d38f1c26e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.929519 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e82f24405b465fa26074a4370ed3d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.933059 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8845dbc4ad3a499bb77aa9b6e24b554d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.854377 762 tablet_service.cc:1511] Processing CreateTablet for tablet 63d02a1a0d544fc89d0e9920ff26a52b (DEFAULT_TABLE table=default.Table_0e9f3984919d46a99af1eb866bcb9394 [id=a450718dd1234e5b8bb535b49e7af8a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.957289 1174 tablet_bootstrap.cc:492] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:39.958952 1174 tablet_bootstrap.cc:654] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:39.960273 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801f0b01d4be42cebec554db9b3ac1e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.961509 1172 tablet_bootstrap.cc:492] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:39.961639 1172 ts_tablet_manager.cc:1403] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.242s user 0.008s sys 0.000s
I20260318 02:51:39.962400 1172 raft_consensus.cc:359] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.962569 1172 raft_consensus.cc:385] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:39.962618 1172 raft_consensus.cc:740] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:39.962852 1172 consensus_queue.cc:260] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:39.963439 1172 ts_tablet_manager.cc:1434] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:39.963518 1184 rpcz_store.cc:276] 0318 02:51:37.429521 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.429605 (+ 84us) service_pool.cc:225] Handling call
0318 02:51:39.816493 (+2386888us) ts_tablet_manager.cc:1151] Deleting tablet ab158343adb14eab85c595fa5405145d
0318 02:51:39.816502 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:39.820389 (+ 3887us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:39.853927 (+ 33538us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:39.882761 (+ 28834us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2386651}
I20260318 02:51:39.963920 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0af921934443453f81bcd6bf22544352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.963974 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet ab158343adb14eab85c595fa5405145d (table default.Table_b76c4b353fbe45c8a866d4cd2c4e264c [id=d20f8f1bd66d4dceab3b7bc72608da2a]) successfully deleted
I20260318 02:51:39.964466 1172 tablet_bootstrap.cc:492] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:39.965803 1172 tablet_bootstrap.cc:654] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:39.966435 1184 tablet_replica.cc:333] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:39.966600 1184 raft_consensus.cc:2243] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:39.966722 1184 raft_consensus.cc:2272] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:39.967079 2361 raft_consensus.cc:493] T 5ffcfc0784d947419fc9b22aa636521c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:39.967186 1184 ts_tablet_manager.cc:1916] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:39.967239 2361 raft_consensus.cc:515] T 5ffcfc0784d947419fc9b22aa636521c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:39.967878 2361 leader_election.cc:290] T 5ffcfc0784d947419fc9b22aa636521c P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:39.968528 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e82f24405b465fa26074a4370ed3d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.973479 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41d775d166fa47e29670c0313cdc69d6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:39.976007 423 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 52398.8us
I20260318 02:51:39.978127 1176 tablet_replica.cc:333] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:39.978293 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b2084350a1e48b3b0edd992a1191a46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.978317 1176 raft_consensus.cc:2243] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:39.978462 1176 raft_consensus.cc:2272] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:39.978751 784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffcfc0784d947419fc9b22aa636521c" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:39.980922 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8845dbc4ad3a499bb77aa9b6e24b554d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.983012 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ffcfc0784d947419fc9b22aa636521c" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:39.984221 862 leader_election.cc:304] T 5ffcfc0784d947419fc9b22aa636521c P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:39.984766 2362 raft_consensus.cc:2749] T 5ffcfc0784d947419fc9b22aa636521c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:39.984954 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c81f563c6641349a1f8ca014af6dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.985638 1176 ts_tablet_manager.cc:1916] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:39.988552 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cce09767819441e599e7a62526d2cb75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.988788 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1294e1ae2115471a8b605d38f1c26e60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:39.990046 1031 tablet_service.cc:1511] Processing CreateTablet for tablet c19c7bb908ec4586a1454d99802e099f (DEFAULT_TABLE table=default.Table_39e1f51fc4d849a1b42a27f540395700 [id=113a7f7490a84df8a0b4e3b86b0454be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:39.990401 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c19c7bb908ec4586a1454d99802e099f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:39.995215 997 consensus_peers.cc:597] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:39.995762 1176 ts_tablet_manager.cc:1929] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:39.995905 1176 log.cc:1199] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/21e6e89e5a0a4d1bb952e74be1b7e551
I20260318 02:51:39.996451 783 raft_consensus.cc:1275] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Refusing update from remote peer 9422bb7011f342b08be0b073a88c4c4d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:40.004153 2152 consensus_queue.cc:1048] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:40.005839 1176 ts_tablet_manager.cc:1950] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:40.008247 926 raft_consensus.cc:3060] T 5ffcfc0784d947419fc9b22aa636521c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:40.009272 894 tablet_service.cc:1511] Processing CreateTablet for tablet 6f63025537c546eda3122aa2c2abb535 (DEFAULT_TABLE table=default.Table_0ff88b3a70da42c0bf69b7a88fa5d032 [id=46370f845bc94093a717627bcd2540d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.009673 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f63025537c546eda3122aa2c2abb535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.009735 888 tablet_service.cc:1511] Processing CreateTablet for tablet c5afbb4fd4b146ed9e0e8ff46aecc465 (DEFAULT_TABLE table=default.Table_138374c056b841499f29fc539894ad68 [id=572b70a76d1f492c977eacaafa2c1771]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.010070 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5afbb4fd4b146ed9e0e8ff46aecc465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.010020 907 tablet_service.cc:1511] Processing CreateTablet for tablet 4937857ea9b54e7b871ee48ccb2754aa (DEFAULT_TABLE table=default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.010304 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4937857ea9b54e7b871ee48ccb2754aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.011276 891 tablet_service.cc:1511] Processing CreateTablet for tablet c844057d612049d8b90ee51ad8f3ec0b (DEFAULT_TABLE table=default.Table_061349cc00fd49a8b616b9b60caae177 [id=d60c5d29ef494248964adc37d9db9930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.011569 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c844057d612049d8b90ee51ad8f3ec0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.012964 895 tablet_service.cc:1511] Processing CreateTablet for tablet c3f37e3d16f943e0aeeddafe1a955599 (DEFAULT_TABLE table=default.Table_f88018436952478cb888ea867404843c [id=33412846f2364daf9584573090bafa7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.013266 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3f37e3d16f943e0aeeddafe1a955599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.014981 1034 tablet_service.cc:1511] Processing CreateTablet for tablet c844057d612049d8b90ee51ad8f3ec0b (DEFAULT_TABLE table=default.Table_061349cc00fd49a8b616b9b60caae177 [id=d60c5d29ef494248964adc37d9db9930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.015383 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c844057d612049d8b90ee51ad8f3ec0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.015527 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 6f63025537c546eda3122aa2c2abb535 (DEFAULT_TABLE table=default.Table_0ff88b3a70da42c0bf69b7a88fa5d032 [id=46370f845bc94093a717627bcd2540d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.015832 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f63025537c546eda3122aa2c2abb535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.017436 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63d02a1a0d544fc89d0e9920ff26a52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.020579 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 69b5315fe198465388d826101f00b844 (DEFAULT_TABLE table=default.Table_37aae142c970437f856dc0368bc7f382 [id=1b5427f18cef4ec4a3919ebb8b32a9ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.020941 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69b5315fe198465388d826101f00b844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.021142 889 tablet_service.cc:1511] Processing CreateTablet for tablet 69b5315fe198465388d826101f00b844 (DEFAULT_TABLE table=default.Table_37aae142c970437f856dc0368bc7f382 [id=1b5427f18cef4ec4a3919ebb8b32a9ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.021508 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69b5315fe198465388d826101f00b844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.021624 754 tablet_service.cc:1511] Processing CreateTablet for tablet c3f37e3d16f943e0aeeddafe1a955599 (DEFAULT_TABLE table=default.Table_f88018436952478cb888ea867404843c [id=33412846f2364daf9584573090bafa7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.021970 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3f37e3d16f943e0aeeddafe1a955599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.029695 752 tablet_service.cc:1511] Processing CreateTablet for tablet c19c7bb908ec4586a1454d99802e099f (DEFAULT_TABLE table=default.Table_39e1f51fc4d849a1b42a27f540395700 [id=113a7f7490a84df8a0b4e3b86b0454be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.030117 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c19c7bb908ec4586a1454d99802e099f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.031935 1172 tablet_bootstrap.cc:492] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:40.032119 1172 ts_tablet_manager.cc:1403] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.000s
I20260318 02:51:40.032691 753 tablet_service.cc:1511] Processing CreateTablet for tablet 4937857ea9b54e7b871ee48ccb2754aa (DEFAULT_TABLE table=default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.033231 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4937857ea9b54e7b871ee48ccb2754aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.033639 1172 raft_consensus.cc:359] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.034479 1172 raft_consensus.cc:385] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.034677 1172 raft_consensus.cc:740] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.035135 1172 consensus_queue.cc:260] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.038223 766 tablet_service.cc:1511] Processing CreateTablet for tablet c844057d612049d8b90ee51ad8f3ec0b (DEFAULT_TABLE table=default.Table_061349cc00fd49a8b616b9b60caae177 [id=d60c5d29ef494248964adc37d9db9930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.038371 757 tablet_service.cc:1511] Processing CreateTablet for tablet 69b5315fe198465388d826101f00b844 (DEFAULT_TABLE table=default.Table_37aae142c970437f856dc0368bc7f382 [id=1b5427f18cef4ec4a3919ebb8b32a9ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.038620 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c844057d612049d8b90ee51ad8f3ec0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.038816 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69b5315fe198465388d826101f00b844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.043375 1172 ts_tablet_manager.cc:1434] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260318 02:51:40.043759 1172 tablet_bootstrap.cc:492] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:40.045753 1172 tablet_bootstrap.cc:654] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.049707 751 tablet_service.cc:1511] Processing CreateTablet for tablet c5afbb4fd4b146ed9e0e8ff46aecc465 (DEFAULT_TABLE table=default.Table_138374c056b841499f29fc539894ad68 [id=572b70a76d1f492c977eacaafa2c1771]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.050112 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5afbb4fd4b146ed9e0e8ff46aecc465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.052122 2326 tablet.cc:1723] T 5b49b066f27b43829c8f922649744303 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:40.054090 2328 tablet.cc:1723] T 5b49b066f27b43829c8f922649744303 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:40.055615 766 tablet_service.cc:1511] Processing CreateTablet for tablet 6f63025537c546eda3122aa2c2abb535 (DEFAULT_TABLE table=default.Table_0ff88b3a70da42c0bf69b7a88fa5d032 [id=46370f845bc94093a717627bcd2540d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.056253 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f63025537c546eda3122aa2c2abb535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.057253 1111 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:40.064874 1184 ts_tablet_manager.cc:1929] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:40.065141 1184 log.cc:1199] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/42a6983dce4e476cae97b3ecb1133077
I20260318 02:51:40.065546 1184 ts_tablet_manager.cc:1950] T 42a6983dce4e476cae97b3ecb1133077 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:40.069780 889 tablet_service.cc:1511] Processing CreateTablet for tablet 7def4e9c164a4fc9b4578c660ec13b99 (DEFAULT_TABLE table=default.Table_233c7a1c8f824e23a0e1e965241fb7c8 [id=7d497d0d471e4b5589ae75766d88f80e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.070215 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7def4e9c164a4fc9b4578c660ec13b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.070427 1034 tablet_service.cc:1511] Processing CreateTablet for tablet c5afbb4fd4b146ed9e0e8ff46aecc465 (DEFAULT_TABLE table=default.Table_138374c056b841499f29fc539894ad68 [id=572b70a76d1f492c977eacaafa2c1771]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.071096 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 4ea1caf000264d6fa2a7b0bd0aa18062 (DEFAULT_TABLE table=default.Table_3788aa65127c4272ab53ae531d8db638 [id=69ad3cb2b6344cbd98664ff0cefc2b3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.071946 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 2fe517a0498e4ac3b0bb52a0eea7448d (DEFAULT_TABLE table=default.Table_80307085aa604fe886f98a99c6e55fe7 [id=8e2907c54a994b77bcd149068f38dd7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.072618 894 tablet_service.cc:1511] Processing CreateTablet for tablet b302e4db52d74b5f865e15246c875515 (DEFAULT_TABLE table=default.Table_30cd08f319f842e4bd4fe25df7dccad6 [id=5d44e41043a64a39a217d1c99cc87b41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.072993 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b302e4db52d74b5f865e15246c875515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.073033 891 tablet_service.cc:1511] Processing CreateTablet for tablet 2fe517a0498e4ac3b0bb52a0eea7448d (DEFAULT_TABLE table=default.Table_80307085aa604fe886f98a99c6e55fe7 [id=8e2907c54a994b77bcd149068f38dd7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.073439 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe517a0498e4ac3b0bb52a0eea7448d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.080276 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 7def4e9c164a4fc9b4578c660ec13b99 (DEFAULT_TABLE table=default.Table_233c7a1c8f824e23a0e1e965241fb7c8 [id=7d497d0d471e4b5589ae75766d88f80e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.080834 901 tablet_service.cc:1511] Processing CreateTablet for tablet 4ea1caf000264d6fa2a7b0bd0aa18062 (DEFAULT_TABLE table=default.Table_3788aa65127c4272ab53ae531d8db638 [id=69ad3cb2b6344cbd98664ff0cefc2b3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.081053 1043 tablet_service.cc:1511] Processing CreateTablet for tablet c3f37e3d16f943e0aeeddafe1a955599 (DEFAULT_TABLE table=default.Table_f88018436952478cb888ea867404843c [id=33412846f2364daf9584573090bafa7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.081288 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ea1caf000264d6fa2a7b0bd0aa18062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.085085 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_fdd4c8fb57774e488f0d45084debbb5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:40.085706 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fdd4c8fb57774e488f0d45084debbb5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:40.087061 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_32e6a83a70cc4160b123fe8a5df81812"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:40.087584 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32e6a83a70cc4160b123fe8a5df81812 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:40.088727 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1874597fd7ed4dfd86db402da16e53e8" } new_table_name: "default.Table_f368a8dc34ae4ea7815aea031af47ed3" modify_external_catalogs: true
I20260318 02:51:40.089896 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f6b8b4d3b2c646ceb47e4a306bd93fe9" } new_table_name: "default.Table_ba6394a91baa4e3889ba7a14f2287aab" modify_external_catalogs: true
I20260318 02:51:40.090219 1035 tablet_service.cc:1511] Processing CreateTablet for tablet b302e4db52d74b5f865e15246c875515 (DEFAULT_TABLE table=default.Table_30cd08f319f842e4bd4fe25df7dccad6 [id=5d44e41043a64a39a217d1c99cc87b41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.092468 2296 raft_consensus.cc:493] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:40.092603 2296 raft_consensus.cc:515] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.093634 2296 leader_election.cc:290] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:40.094403 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a67e637d934c0f99c00d04fb26df0d" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:40.094581 999 leader_election.cc:343] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: d1a67e637d934c0f99c00d04fb26df0d
W20260318 02:51:40.095011 997 leader_election.cc:343] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.095127 997 leader_election.cc:304] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:40.095503 1173 tablet_bootstrap.cc:492] T e1d804f5e9564f6d83efb77e6c18724b P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:40.095606 2296 raft_consensus.cc:2749] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:40.095631 1173 ts_tablet_manager.cc:1403] T e1d804f5e9564f6d83efb77e6c18724b P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.280s user 0.021s sys 0.036s
I20260318 02:51:40.096429 1173 raft_consensus.cc:359] T e1d804f5e9564f6d83efb77e6c18724b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.096601 1173 raft_consensus.cc:385] T e1d804f5e9564f6d83efb77e6c18724b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.096652 1173 raft_consensus.cc:740] T e1d804f5e9564f6d83efb77e6c18724b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.096861 1173 consensus_queue.cc:260] T e1d804f5e9564f6d83efb77e6c18724b P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.097319 1173 ts_tablet_manager.cc:1434] T e1d804f5e9564f6d83efb77e6c18724b P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260318 02:51:40.097586 1173 tablet_bootstrap.cc:492] T 96a6d1808417419dac0d2b2e80c5ca22 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:40.099287 1173 tablet_bootstrap.cc:654] T 96a6d1808417419dac0d2b2e80c5ca22 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.099431 2296 raft_consensus.cc:493] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:40.099542 2296 raft_consensus.cc:515] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.100076 2296 leader_election.cc:290] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:40.101311 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c4257a54d3487aa520531a64fc721c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:40.101956 999 leader_election.cc:343] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: c7c4257a54d3487aa520531a64fc721c
I20260318 02:51:40.102033 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 21e6e89e5a0a4d1bb952e74be1b7e551 (table default.Table_997fb2399fa943e9b940ce4e2b1f31ca [id=e3ae42e4eb124dcebd6692574f6d0a9b]) successfully deleted
W20260318 02:51:40.102342 997 leader_election.cc:343] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.102434 997 leader_election.cc:304] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:40.102828 2295 raft_consensus.cc:2749] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:40.103549 766 tablet_service.cc:1511] Processing CreateTablet for tablet 4ea1caf000264d6fa2a7b0bd0aa18062 (DEFAULT_TABLE table=default.Table_3788aa65127c4272ab53ae531d8db638 [id=69ad3cb2b6344cbd98664ff0cefc2b3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.103963 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ea1caf000264d6fa2a7b0bd0aa18062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.104118 748 tablet_service.cc:1511] Processing CreateTablet for tablet b302e4db52d74b5f865e15246c875515 (DEFAULT_TABLE table=default.Table_30cd08f319f842e4bd4fe25df7dccad6 [id=5d44e41043a64a39a217d1c99cc87b41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.104420 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b302e4db52d74b5f865e15246c875515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.105974 1173 tablet_bootstrap.cc:492] T 96a6d1808417419dac0d2b2e80c5ca22 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:40.106133 1173 ts_tablet_manager.cc:1403] T 96a6d1808417419dac0d2b2e80c5ca22 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.002s
I20260318 02:51:40.106982 751 tablet_service.cc:1511] Processing CreateTablet for tablet 2fe517a0498e4ac3b0bb52a0eea7448d (DEFAULT_TABLE table=default.Table_80307085aa604fe886f98a99c6e55fe7 [id=8e2907c54a994b77bcd149068f38dd7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.107353 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe517a0498e4ac3b0bb52a0eea7448d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.107409 1173 raft_consensus.cc:359] T 96a6d1808417419dac0d2b2e80c5ca22 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.107565 1173 raft_consensus.cc:385] T 96a6d1808417419dac0d2b2e80c5ca22 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.107609 1173 raft_consensus.cc:740] T 96a6d1808417419dac0d2b2e80c5ca22 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.107832 1173 consensus_queue.cc:260] T 96a6d1808417419dac0d2b2e80c5ca22 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.108325 1173 ts_tablet_manager.cc:1434] T 96a6d1808417419dac0d2b2e80c5ca22 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:40.108614 1173 tablet_bootstrap.cc:492] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:40.111387 1172 tablet_bootstrap.cc:492] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:40.111547 1172 ts_tablet_manager.cc:1403] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.068s user 0.003s sys 0.000s
I20260318 02:51:40.112262 1172 raft_consensus.cc:359] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.112430 1172 raft_consensus.cc:385] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.112471 1172 raft_consensus.cc:740] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.112649 1172 consensus_queue.cc:260] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.113226 1172 ts_tablet_manager.cc:1434] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:40.114135 2408 tablet.cc:1723] T 5ffcfc0784d947419fc9b22aa636521c P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:40.127408 1174 tablet_bootstrap.cc:492] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:40.133255 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b302e4db52d74b5f865e15246c875515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.133534 1173 tablet_bootstrap.cc:654] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.134575 1174 ts_tablet_manager.cc:1403] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.177s user 0.002s sys 0.001s
I20260318 02:51:40.136008 1174 raft_consensus.cc:359] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.136607 1174 raft_consensus.cc:385] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.136647 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ea1caf000264d6fa2a7b0bd0aa18062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.136843 1174 raft_consensus.cc:740] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.137283 1174 consensus_queue.cc:260] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.138101 1174 ts_tablet_manager.cc:1434] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:40.139194 1174 tablet_bootstrap.cc:492] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:40.140969 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe517a0498e4ac3b0bb52a0eea7448d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.141328 1174 tablet_bootstrap.cc:654] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.145444 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7def4e9c164a4fc9b4578c660ec13b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.151942 1174 tablet_bootstrap.cc:492] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:40.152657 1174 ts_tablet_manager.cc:1403] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.003s
I20260318 02:51:40.153669 1174 raft_consensus.cc:359] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.153949 2361 raft_consensus.cc:493] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:40.154083 2361 raft_consensus.cc:515] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.154713 2361 leader_election.cc:290] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:40.155391 1174 raft_consensus.cc:385] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260318 02:51:40.155573 860 leader_election.cc:343] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 785f6728f94d41f3997961e3d1ebee34
I20260318 02:51:40.155747 1174 raft_consensus.cc:740] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
W20260318 02:51:40.155993 862 leader_election.cc:343] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 785f6728f94d41f3997961e3d1ebee34
I20260318 02:51:40.155978 1174 consensus_queue.cc:260] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.156101 862 leader_election.cc:304] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:40.156430 2362 raft_consensus.cc:2749] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:40.156481 1174 ts_tablet_manager.cc:1434] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260318 02:51:40.156754 1174 tablet_bootstrap.cc:492] T 59c6741a6d154d8f99d487c6590d2d26 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:40.159862 1174 tablet_bootstrap.cc:654] T 59c6741a6d154d8f99d487c6590d2d26 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.164188 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3f37e3d16f943e0aeeddafe1a955599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.164443 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5afbb4fd4b146ed9e0e8ff46aecc465. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.170928 1172 tablet_bootstrap.cc:492] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:40.172905 1172 tablet_bootstrap.cc:654] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.174530 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 936) took 2689 ms. Trace:
I20260318 02:51:40.174749 1184 rpcz_store.cc:276] 0318 02:51:37.485482 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.485552 (+ 70us) service_pool.cc:225] Handling call
0318 02:51:39.964253 (+2478701us) ts_tablet_manager.cc:1151] Deleting tablet 42a6983dce4e476cae97b3ecb1133077
0318 02:51:39.966395 (+ 2142us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:39.997964 (+ 31569us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:40.064738 (+ 66774us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:40.174510 (+109772us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2478407}
I20260318 02:51:40.175514 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 42a6983dce4e476cae97b3ecb1133077 (table default.Table_c14f375645d84629b54e18e482938be5 [id=a2001813279f4449abf9bceaa75bcf76]) successfully deleted
I20260318 02:51:40.176054 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 941) took 2532 ms. Trace:
I20260318 02:51:40.179805 1184 rpcz_store.cc:276] 0318 02:51:37.644473 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.648684 (+ 4211us) service_pool.cc:225] Handling call
0318 02:51:40.175930 (+2527246us) ts_tablet_manager.cc:1151] Deleting tablet 1d2c64dc7c0b479494ca474dad51a528
0318 02:51:40.175942 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:40.176038 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2526417}
I20260318 02:51:40.180285 1172 tablet_bootstrap.cc:492] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:40.180414 1172 ts_tablet_manager.cc:1403] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
W20260318 02:51:40.180364 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 1d2c64dc7c0b479494ca474dad51a528 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d2c64dc7c0b479494ca474dad51a528 already in progress: creating tablet
I20260318 02:51:40.181605 1172 raft_consensus.cc:359] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.181764 1172 raft_consensus.cc:385] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.181811 1172 raft_consensus.cc:740] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.181967 1172 consensus_queue.cc:260] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.182528 1172 ts_tablet_manager.cc:1434] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:40.182785 1172 tablet_bootstrap.cc:492] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:40.183981 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6e9a5b965cb141e1a5dd1c96f590ad5a consensus state has no leader
W20260318 02:51:40.184418 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 373a94164167431c87025ce82c9b88d9 consensus state has no leader
I20260318 02:51:40.184528 1172 tablet_bootstrap.cc:654] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.185506 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 5c89f413a26a43ef95c850d7c44f85b2
I20260318 02:51:40.186676 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 0cda13385dbb4c6daa211e933c1f93a1
I20260318 02:51:40.189826 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c89f413a26a43ef95c850d7c44f85b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.190537 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cda13385dbb4c6daa211e933c1f93a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.190976 2372 raft_consensus.cc:493] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:40.191128 2372 raft_consensus.cc:515] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.191830 2372 leader_election.cc:290] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:40.192523 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c89f413a26a43ef95c850d7c44f85b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.193161 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317cc133346412fb981b1c8e5b99c4d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:40.193756 719 leader_election.cc:343] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.194069 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cda13385dbb4c6daa211e933c1f93a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.196010 1174 tablet_bootstrap.cc:492] T 59c6741a6d154d8f99d487c6590d2d26 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:40.196245 1174 ts_tablet_manager.cc:1403] T 59c6741a6d154d8f99d487c6590d2d26 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.040s user 0.007s sys 0.001s
I20260318 02:51:40.197520 1174 raft_consensus.cc:359] T 59c6741a6d154d8f99d487c6590d2d26 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.199888 1174 raft_consensus.cc:385] T 59c6741a6d154d8f99d487c6590d2d26 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.200248 1174 raft_consensus.cc:740] T 59c6741a6d154d8f99d487c6590d2d26 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.202966 753 tablet_service.cc:1511] Processing CreateTablet for tablet 7def4e9c164a4fc9b4578c660ec13b99 (DEFAULT_TABLE table=default.Table_233c7a1c8f824e23a0e1e965241fb7c8 [id=7d497d0d471e4b5589ae75766d88f80e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.204291 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 942) took 2550 ms. Trace:
I20260318 02:51:40.204391 1184 rpcz_store.cc:276] 0318 02:51:37.653533 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.653968 (+ 435us) service_pool.cc:225] Handling call
0318 02:51:40.204138 (+2550170us) ts_tablet_manager.cc:1151] Deleting tablet 243a2f81711f4712ab21c8ae5bdc94a8
0318 02:51:40.204151 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:40.204267 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2549932}
I20260318 02:51:40.204777 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 943) took 2549 ms. Trace:
I20260318 02:51:40.204856 1184 rpcz_store.cc:276] 0318 02:51:37.658473 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.658531 (+ 58us) service_pool.cc:225] Handling call
0318 02:51:40.204649 (+2546118us) ts_tablet_manager.cc:1151] Deleting tablet 98ac6bdd852d468ba6821af6c85bfd19
0318 02:51:40.204658 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:40.204758 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2545900}
I20260318 02:51:40.205149 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 950) took 2544 ms. Trace:
I20260318 02:51:40.205225 1184 rpcz_store.cc:276] 0318 02:51:37.660677 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.661702 (+ 1025us) service_pool.cc:225] Handling call
0318 02:51:40.205054 (+2543352us) ts_tablet_manager.cc:1151] Deleting tablet f37ab96f13444fcbb5cfc3ad92d53c35
0318 02:51:40.205062 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:40.205135 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2543180}
I20260318 02:51:40.205510 1184 tablet_replica.cc:333] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
W20260318 02:51:40.205466 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 243a2f81711f4712ab21c8ae5bdc94a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 243a2f81711f4712ab21c8ae5bdc94a8 already in progress: creating tablet
I20260318 02:51:40.205680 1184 raft_consensus.cc:2243] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:40.205788 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 98ac6bdd852d468ba6821af6c85bfd19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98ac6bdd852d468ba6821af6c85bfd19 already in progress: creating tablet
I20260318 02:51:40.205840 1184 raft_consensus.cc:2272] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:40.206405 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f37ab96f13444fcbb5cfc3ad92d53c35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f37ab96f13444fcbb5cfc3ad92d53c35 already in progress: creating tablet
I20260318 02:51:40.208793 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317cc133346412fb981b1c8e5b99c4d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:40.209365 719 leader_election.cc:343] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.209483 719 leader_election.cc:304] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:40.209843 2372 raft_consensus.cc:2749] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:40.210434 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7def4e9c164a4fc9b4578c660ec13b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.213658 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 4937857ea9b54e7b871ee48ccb2754aa (DEFAULT_TABLE table=default.Table_c7a8290fdcc149148f002a665a6c3d41 [id=348edc09be924f24934c12fa52e9f40c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.214084 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4937857ea9b54e7b871ee48ccb2754aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.216287 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 0cda13385dbb4c6daa211e933c1f93a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:40.221091 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 5c89f413a26a43ef95c850d7c44f85b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c89f413a26a43ef95c850d7c44f85b2 already in progress: creating tablet
W20260318 02:51:40.221383 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 0cda13385dbb4c6daa211e933c1f93a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0cda13385dbb4c6daa211e933c1f93a1 already in progress: creating tablet
W20260318 02:51:40.223860 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 0cda13385dbb4c6daa211e933c1f93a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0cda13385dbb4c6daa211e933c1f93a1 already in progress: creating tablet
I20260318 02:51:40.227807 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c89f413a26a43ef95c850d7c44f85b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.231679 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet e918bb008e0743a9bf7ada170812146e
I20260318 02:51:40.232781 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 54b8f3520a4e4a5987bb7a6732c7b882
I20260318 02:51:40.233424 457 master_service.cc:954] ReplaceTablet: received request to replace tablet c0349def0e4045f2b1e9a02dd654a174 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:40.200877 1174 consensus_queue.cc:260] T 59c6741a6d154d8f99d487c6590d2d26 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.236825 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet e918bb008e0743a9bf7ada170812146e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.237033 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 54b8f3520a4e4a5987bb7a6732c7b882 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.237259 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_264cd755c1b7411bb23285ef3b3cb663"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:40.237751 1174 ts_tablet_manager.cc:1434] T 59c6741a6d154d8f99d487c6590d2d26 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.041s user 0.002s sys 0.000s
W20260318 02:51:40.237886 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_264cd755c1b7411bb23285ef3b3cb663 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:40.238085 1174 tablet_bootstrap.cc:492] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:40.239432 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a1de822992eb44f497fb6b3b961b538a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:40.239732 1174 tablet_bootstrap.cc:654] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:40.239982 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1de822992eb44f497fb6b3b961b538a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:40.243017 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a0be43b415d14f67935a3dfa9cc3837f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:40.243623 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0be43b415d14f67935a3dfa9cc3837f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:40.253284 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_de29ee8839bf4e3482ba6201e0125eea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:40.252622 448 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 3348b200e5ca4f6ebecb2c25ddbe27bf (table default.Table_10d43fa780ea41f68847fc2ef753c3ef [id=a1ea27c3f8534259bceaa1300242640a]). Expected version 2 got 0
I20260318 02:51:40.255393 2296 raft_consensus.cc:493] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:40.255537 2296 raft_consensus.cc:515] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.256204 2296 leader_election.cc:290] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:40.256817 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c60ef260d049bea4ce729316a0d09f" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:40.257004 783 raft_consensus.cc:2468] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:40.257687 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c60ef260d049bea4ce729316a0d09f" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:40.258260 999 leader_election.cc:304] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
W20260318 02:51:40.258733 997 leader_election.cc:343] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.259042 2296 raft_consensus.cc:2804] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:40.259130 2296 raft_consensus.cc:493] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:40.259188 2296 raft_consensus.cc:3060] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:40.260609 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 54b8f3520a4e4a5987bb7a6732c7b882 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:40.260916 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de29ee8839bf4e3482ba6201e0125eea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:40.261775 2296 raft_consensus.cc:515] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:40.262516 999 consensus_peers.cc:597] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d -> Peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Couldn't send request to peer 6a903d876086423b8016d705b98895ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 105326aea9f744779ca76e0cbb2448cd. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:40.263334 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_77afda1bd8aa46e0b03b1dc203059f1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:40.264165 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77afda1bd8aa46e0b03b1dc203059f1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:40.265427 2296 leader_election.cc:290] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:40.264912 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c60ef260d049bea4ce729316a0d09f" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:40.265486 895 tablet_service.cc:1558] Processing DeleteTablet for tablet e918bb008e0743a9bf7ada170812146e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.266256 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 785f6728f94d41f3997961e3d1ebee34 with delete_type TABLET_DATA_DELETED (replaced by tablet ca4e1eec9a2148488295416cd68ca607) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.266453 1175 tablet_replica.cc:333] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:40.266539 901 tablet_service.cc:1558] Processing DeleteTablet for tablet e1d804f5e9564f6d83efb77e6c18724b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.266636 1175 raft_consensus.cc:2243] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:40.266773 1175 raft_consensus.cc:2272] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:40.266760 997 leader_election.cc:343] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:40.267026 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 54b8f3520a4e4a5987bb7a6732c7b882 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54b8f3520a4e4a5987bb7a6732c7b882 already in progress: creating tablet
W20260318 02:51:40.267323 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet e918bb008e0743a9bf7ada170812146e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e918bb008e0743a9bf7ada170812146e already in progress: creating tablet
I20260318 02:51:40.268075 1175 ts_tablet_manager.cc:1916] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:40.271288 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 21e6e89e5a0a4d1bb952e74be1b7e551 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.274755 1175 ts_tablet_manager.cc:1929] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:40.274883 1175 log.cc:1199] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/785f6728f94d41f3997961e3d1ebee34
I20260318 02:51:40.275166 1175 ts_tablet_manager.cc:1950] T 785f6728f94d41f3997961e3d1ebee34 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:40.275730 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 785f6728f94d41f3997961e3d1ebee34 (table default.Table_496e7d616c09464a884078334d256839 [id=f6fae39c375b41e096459fe397b69b72]) successfully deleted
I20260318 02:51:40.276466 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 54b8f3520a4e4a5987bb7a6732c7b882 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.276651 754 tablet_service.cc:1558] Processing DeleteTablet for tablet e918bb008e0743a9bf7ada170812146e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.279414 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c60ef260d049bea4ce729316a0d09f" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:40.279595 785 raft_consensus.cc:3060] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:40.282146 785 raft_consensus.cc:2468] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:40.282331 1184 ts_tablet_manager.cc:1916] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:40.282593 999 leader_election.cc:304] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:40.283006 2296 raft_consensus.cc:2804] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:40.283244 2296 raft_consensus.cc:697] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:40.283516 2296 consensus_queue.cc:237] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.284677 1175 tablet_replica.cc:333] T e1d804f5e9564f6d83efb77e6c18724b P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:40.284925 1175 raft_consensus.cc:2243] T e1d804f5e9564f6d83efb77e6c18724b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:40.285895 1175 raft_consensus.cc:2272] T e1d804f5e9564f6d83efb77e6c18724b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:40.286571 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 96a6d1808417419dac0d2b2e80c5ca22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.287134 1175 ts_tablet_manager.cc:1916] T e1d804f5e9564f6d83efb77e6c18724b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:40.299749 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 5c89f413a26a43ef95c850d7c44f85b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c89f413a26a43ef95c850d7c44f85b2 already in progress: creating tablet
W20260318 02:51:40.300195 443 catalog_manager.cc:4969] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 21e6e89e5a0a4d1bb952e74be1b7e551 because the tablet was not found. No further retry: Not found: Tablet not found: 21e6e89e5a0a4d1bb952e74be1b7e551
W20260318 02:51:40.300450 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet e918bb008e0743a9bf7ada170812146e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e918bb008e0743a9bf7ada170812146e already in progress: creating tablet
W20260318 02:51:40.300755 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 54b8f3520a4e4a5987bb7a6732c7b882 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54b8f3520a4e4a5987bb7a6732c7b882 already in progress: creating tablet
I20260318 02:51:40.306617 1172 tablet_bootstrap.cc:492] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:40.306859 1172 ts_tablet_manager.cc:1403] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.124s user 0.002s sys 0.010s
I20260318 02:51:40.307861 1172 raft_consensus.cc:359] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.308174 1172 raft_consensus.cc:385] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.308280 1172 raft_consensus.cc:740] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.308565 1172 consensus_queue.cc:260] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.309274 1172 ts_tablet_manager.cc:1434] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260318 02:51:40.309633 1172 tablet_bootstrap.cc:492] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:40.312743 1119 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.DeleteTable -> {remote=127.0.104.190:39451, user_credentials={real_user=slave}} blocked reactor thread for 78931.5us
I20260318 02:51:40.313429 1174 tablet_bootstrap.cc:492] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:40.313664 1174 ts_tablet_manager.cc:1403] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.076s user 0.004s sys 0.001s
I20260318 02:51:40.314534 1174 raft_consensus.cc:359] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.314788 1174 raft_consensus.cc:385] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.314888 1174 raft_consensus.cc:740] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.315171 1174 consensus_queue.cc:260] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.318864 1173 tablet_bootstrap.cc:492] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:40.319078 1173 ts_tablet_manager.cc:1403] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.211s user 0.019s sys 0.012s
I20260318 02:51:40.319886 1173 raft_consensus.cc:359] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.320143 1173 raft_consensus.cc:385] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.320237 1173 raft_consensus.cc:740] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.320498 1173 consensus_queue.cc:260] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.321048 1173 ts_tablet_manager.cc:1434] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:40.321907 974 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:40.325702 1174 ts_tablet_manager.cc:1434] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260318 02:51:40.326028 1174 tablet_bootstrap.cc:492] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:40.329146 1173 tablet_bootstrap.cc:492] T 1ef3181adc0542229897369591a30465 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:40.330808 1173 tablet_bootstrap.cc:654] T 1ef3181adc0542229897369591a30465 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.337549 1172 tablet_bootstrap.cc:654] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.339202 1174 tablet_bootstrap.cc:654] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.345276 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2cfd06c2ef384e81a1cbde18678a8737"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:40.346035 1174 tablet_bootstrap.cc:492] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:40.346172 1174 ts_tablet_manager.cc:1403] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.001s
I20260318 02:51:40.346912 1174 raft_consensus.cc:359] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:40.347009 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2cfd06c2ef384e81a1cbde18678a8737 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:40.347714 1173 tablet_bootstrap.cc:492] T 1ef3181adc0542229897369591a30465 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:40.347823 1174 raft_consensus.cc:385] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.347910 1174 raft_consensus.cc:740] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.348060 1173 ts_tablet_manager.cc:1403] T 1ef3181adc0542229897369591a30465 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.001s
W20260318 02:51:40.348282 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6f8b5120633e4e0d8964f17d6d5f316d consensus state has no leader
I20260318 02:51:40.348294 1174 consensus_queue.cc:260] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.349139 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1424aa1a08ae4f3584a9f415cd41b6e7" } modify_external_catalogs: true
I20260318 02:51:40.349320 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1424aa1a08ae4f3584a9f415cd41b6e7" } modify_external_catalogs: true
I20260318 02:51:40.349560 1173 raft_consensus.cc:359] T 1ef3181adc0542229897369591a30465 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:40.349712 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3073fbe00c5d45b6b3100e927e0cc5c3 consensus state has no leader
I20260318 02:51:40.349746 1173 raft_consensus.cc:385] T 1ef3181adc0542229897369591a30465 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.349792 1173 raft_consensus.cc:740] T 1ef3181adc0542229897369591a30465 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.349978 1173 consensus_queue.cc:260] T 1ef3181adc0542229897369591a30465 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.350358 1174 ts_tablet_manager.cc:1434] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
W20260318 02:51:40.350621 443 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 6e9a5b965cb141e1a5dd1c96f590ad5a (table default.Table_5351174539b64d46841d42da2f1acce4 [id=6f9a87f338414f20bb3969d3c3cdfa64], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6e9a5b965cb141e1a5dd1c96f590ad5a consensus state has no leader
I20260318 02:51:40.352360 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8b73a29ea2714bc787b97dcded68671f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:40.353042 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b73a29ea2714bc787b97dcded68671f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:40.354486 1174 tablet_bootstrap.cc:492] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:40.356204 1174 tablet_bootstrap.cc:654] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.362180 1173 ts_tablet_manager.cc:1434] T 1ef3181adc0542229897369591a30465 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260318 02:51:40.362643 1173 tablet_bootstrap.cc:492] T ed697b98352c4f65931c154b1f160991 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:40.366045 1172 tablet_bootstrap.cc:492] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:40.366302 1172 ts_tablet_manager.cc:1403] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.057s user 0.001s sys 0.005s
I20260318 02:51:40.367195 1172 raft_consensus.cc:359] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.367475 1172 raft_consensus.cc:385] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.367573 1172 raft_consensus.cc:740] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.367784 1184 ts_tablet_manager.cc:1929] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:40.367815 1172 consensus_queue.cc:260] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.368417 1172 ts_tablet_manager.cc:1434] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:40.369061 1172 tablet_bootstrap.cc:492] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:40.369223 1173 tablet_bootstrap.cc:654] T ed697b98352c4f65931c154b1f160991 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.370805 1172 tablet_bootstrap.cc:654] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.372146 833 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:40.377856 1175 ts_tablet_manager.cc:1929] T e1d804f5e9564f6d83efb77e6c18724b P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260318 02:51:40.381441 423 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 64477.6us
I20260318 02:51:40.381611 1172 tablet_bootstrap.cc:492] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:40.381763 1172 ts_tablet_manager.cc:1403] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260318 02:51:40.382532 1172 raft_consensus.cc:359] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.382690 1172 raft_consensus.cc:385] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.382740 1172 raft_consensus.cc:740] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.382927 1172 consensus_queue.cc:260] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.367960 1184 log.cc:1199] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/503386365f6a49f6b84c64b59b764c10
I20260318 02:51:40.383318 2372 raft_consensus.cc:493] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:40.383378 1172 ts_tablet_manager.cc:1434] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:40.383460 2372 raft_consensus.cc:515] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.383639 1172 tablet_bootstrap.cc:492] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:40.383937 1184 ts_tablet_manager.cc:1950] T 503386365f6a49f6b84c64b59b764c10 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:40.384104 2372 leader_election.cc:290] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:40.384277 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 952) took 2622 ms. Trace:
I20260318 02:51:40.384351 1184 rpcz_store.cc:276] 0318 02:51:37.762529 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.771737 (+ 9208us) service_pool.cc:225] Handling call
0318 02:51:40.205469 (+2433732us) ts_tablet_manager.cc:1151] Deleting tablet 503386365f6a49f6b84c64b59b764c10
0318 02:51:40.205478 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:40.285379 (+ 79901us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:40.367675 (+ 82296us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:40.384260 (+ 16585us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2433517}
I20260318 02:51:40.384686 1184 tablet_replica.cc:333] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:40.384888 1184 raft_consensus.cc:2243] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:40.385025 1184 raft_consensus.cc:2272] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:40.385329 1172 tablet_bootstrap.cc:654] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.385314 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 503386365f6a49f6b84c64b59b764c10 (table default.Table_9a44c965ec574cae8cced06f58d02bff [id=f3b5bd76bc0945119db3449ce8ce5998]) successfully deleted
I20260318 02:51:40.387187 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dedba077d34435b30061bfba737412" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:40.387777 719 leader_election.cc:343] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.385011 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dedba077d34435b30061bfba737412" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:40.388886 1175 log.cc:1199] T e1d804f5e9564f6d83efb77e6c18724b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/e1d804f5e9564f6d83efb77e6c18724b
W20260318 02:51:40.389446 719 leader_election.cc:343] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.389554 719 leader_election.cc:304] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:40.389925 2372 raft_consensus.cc:2749] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:40.391821 1175 ts_tablet_manager.cc:1950] T e1d804f5e9564f6d83efb77e6c18724b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:40.393049 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet e1d804f5e9564f6d83efb77e6c18724b (table default.Table_017276a514464042a76dbff62faa6f82 [id=61b10b92b10b48a4a139b129f8797ea3]) successfully deleted
I20260318 02:51:40.406365 2296 raft_consensus.cc:493] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:40.406554 2296 raft_consensus.cc:515] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.407248 2296 leader_election.cc:290] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
W20260318 02:51:40.408418 999 leader_election.cc:343] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: c0c33cfa1c194a65bfc64d0e1e9434ff
I20260318 02:51:40.408934 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_76cf5151c8c8462cbf34174053295750" } new_table_name: "default.Table_bc98038492be426d8b2d5982727baf82" modify_external_catalogs: true
I20260318 02:51:40.409824 1173 tablet_bootstrap.cc:492] T ed697b98352c4f65931c154b1f160991 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:40.409950 1173 ts_tablet_manager.cc:1403] T ed697b98352c4f65931c154b1f160991 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.047s user 0.005s sys 0.017s
I20260318 02:51:40.410766 1172 tablet_bootstrap.cc:492] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:40.410691 1173 raft_consensus.cc:359] T ed697b98352c4f65931c154b1f160991 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.410851 1173 raft_consensus.cc:385] T ed697b98352c4f65931c154b1f160991 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.410885 1172 ts_tablet_manager.cc:1403] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.027s user 0.008s sys 0.016s
I20260318 02:51:40.410900 1173 raft_consensus.cc:740] T ed697b98352c4f65931c154b1f160991 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.410859 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5e4db74f50fe44f5b01ea2ffbe1388b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:40.411101 1173 consensus_queue.cc:260] T ed697b98352c4f65931c154b1f160991 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:40.411368 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e4db74f50fe44f5b01ea2ffbe1388b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:40.411624 1173 ts_tablet_manager.cc:1434] T ed697b98352c4f65931c154b1f160991 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:40.411578 1172 raft_consensus.cc:359] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.411734 1172 raft_consensus.cc:385] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.411788 1172 raft_consensus.cc:740] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.411965 1172 consensus_queue.cc:260] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.412204 1173 tablet_bootstrap.cc:492] T ca23d4d0d3734fceb14966a4f2ad9c35 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:40.412508 1172 ts_tablet_manager.cc:1434] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:40.415676 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cdd554113bf4a7092da876365a89456 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.412680 453 master_service.cc:954] ReplaceTablet: received request to replace tablet 5433e0aebdd34666a655c21a77fe2654 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:40.417124 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0c33cfa1c194a65bfc64d0e1e9434ff" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:40.413487 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e50bd5f5933849f5a43d064f39581f70" } new_table_name: "default.Table_f1a86c50dea044e6bcf3072cbcc4fbf3" modify_external_catalogs: true
W20260318 02:51:40.418848 997 leader_election.cc:343] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.418978 997 leader_election.cc:304] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:40.419224 1173 tablet_bootstrap.cc:654] T ca23d4d0d3734fceb14966a4f2ad9c35 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.419225 2382 raft_consensus.cc:493] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:40.419341 2382 raft_consensus.cc:515] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.419345 2296 raft_consensus.cc:2749] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:40.419947 2382 leader_election.cc:290] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:40.413874 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_98ca59366b9c4d358295432c55ccbc2b" } new_table_name: "default.Table_a5a4509fc8ed42eb81760cb6bb9a7cc8" modify_external_catalogs: true
W20260318 02:51:40.421298 999 leader_election.cc:343] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2a3a36a7fd4742c9827b334ce31d4a7c
I20260318 02:51:40.427037 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_962a2e57d3cd414da0cebbd805a7c937" } modify_external_catalogs: true
I20260318 02:51:40.427263 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_962a2e57d3cd414da0cebbd805a7c937" } modify_external_catalogs: true
I20260318 02:51:40.429216 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4a675721365c4600b0a6a7712c03db81" } modify_external_catalogs: true
I20260318 02:51:40.429390 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4a675721365c4600b0a6a7712c03db81" } modify_external_catalogs: true
I20260318 02:51:40.430918 450 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 6f8b5120633e4e0d8964f17d6d5f316d (table default.Table_ba6394a91baa4e3889ba7a14f2287aab [id=779018c836a14c518c02a844331ce251]). Expected version 1 got 0
I20260318 02:51:40.432207 457 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_e7633153163443ce97eeb8423db6d4ea [id=6f4e96b5a043423b95bfdf37a2411644] alter complete (version 1)
I20260318 02:51:40.434331 1174 tablet_bootstrap.cc:492] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:40.434557 1174 ts_tablet_manager.cc:1403] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.082s user 0.003s sys 0.005s
I20260318 02:51:40.434877 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a36a7fd4742c9827b334ce31d4a7c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:40.435354 1174 raft_consensus.cc:359] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.435626 1174 raft_consensus.cc:385] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.435683 1174 raft_consensus.cc:740] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.435878 1174 consensus_queue.cc:260] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.436856 754 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca9bad2b9aa4a41bb7801da61cd0d16 (DEFAULT_TABLE table=default.Table_b0e4642ca0a2453c910aaa30943534bf [id=4334f19341eb40e58a2b54c55e4eb09e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.437352 766 tablet_service.cc:1511] Processing CreateTablet for tablet 2b7d54bee9c34cf3beb8f59510302c0b (DEFAULT_TABLE table=default.Table_265b3356de79492ea01fb1a46402ad02 [id=aa45d40f8ddf4b4da510d57881122a77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.437570 757 tablet_service.cc:1511] Processing CreateTablet for tablet a08267b7300c452697c0f8b0cf885e9c (DEFAULT_TABLE table=default.Table_4b8ea2a5404649d8943f9b93f9675603 [id=1bd97d0e890c46eeb00cc0ab29510830]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.437682 751 tablet_service.cc:1511] Processing CreateTablet for tablet bbb9349d077a4092893614323bd8e448 (DEFAULT_TABLE table=default.Table_83df37ff0a08452697440678fe51ef9a [id=728fbeddc22041e6afaf02251eea9e5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.437965 761 tablet_service.cc:1511] Processing CreateTablet for tablet a8c1a1e097d34126ada38cec2f3d34b6 (DEFAULT_TABLE table=default.Table_bb08c3624fb54b12a3295e6909a356ea [id=2812b34ea18942f296c8422154cd5366]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.438133 756 tablet_service.cc:1511] Processing CreateTablet for tablet 1be09e67b9d94e669f28a7cd236b48a4 (DEFAULT_TABLE table=default.Table_dde65a0e8449460f970a61ce1e8d80df [id=5e6e3859b4f64874b3dc1657cdbe0d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.438282 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 59c6741a6d154d8f99d487c6590d2d26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.438431 755 tablet_service.cc:1511] Processing CreateTablet for tablet bdf0ceb9b5a54b1eb9dd34115c0750e1 (DEFAULT_TABLE table=default.Table_3eb84f70b8164e24b0d9772b02268c85 [id=a7a986f000524dc8a468653f7eaab395]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.438479 759 tablet_service.cc:1511] Processing CreateTablet for tablet 7624aaa7231b4c5099cc3367ca9efefc (DEFAULT_TABLE table=default.Table_14099aef89c147ec896c324acb15d1ab [id=2d84c1428d7f436c872278df7cd7be48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.437966 748 tablet_service.cc:1511] Processing CreateTablet for tablet 4b43a0b485fa4b2e89d034de742018a5 (DEFAULT_TABLE table=default.Table_533d4a1dfa6a4a9c8b6f2ef12c61a9ea [id=15b9a9756977413883d0aa138fc5a4ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.438748 1174 ts_tablet_manager.cc:1434] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260318 02:51:40.439035 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca9bad2b9aa4a41bb7801da61cd0d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.440110 1175 tablet_replica.cc:333] T 96a6d1808417419dac0d2b2e80c5ca22 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:40.440308 1175 raft_consensus.cc:2243] T 96a6d1808417419dac0d2b2e80c5ca22 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:40.440446 1175 raft_consensus.cc:2272] T 96a6d1808417419dac0d2b2e80c5ca22 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:40.440754 1184 ts_tablet_manager.cc:1916] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:40.440969 1176 tablet_replica.cc:333] T 59c6741a6d154d8f99d487c6590d2d26 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:40.442265 1176 raft_consensus.cc:2243] T 59c6741a6d154d8f99d487c6590d2d26 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:40.442431 1176 raft_consensus.cc:2272] T 59c6741a6d154d8f99d487c6590d2d26 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:40.442642 750 tablet_service.cc:1558] Processing DeleteTablet for tablet b317cc133346412fb981b1c8e5b99c4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.442967 752 tablet_service.cc:1511] Processing CreateTablet for tablet ae15aab5d37747bbb2c483597fdd6ea6 (DEFAULT_TABLE table=default.Table_36ee456043a744d7b2ae15b5366d65ad [id=4b4a577cd4a84deeadbad83fd2c94b90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.443120 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 85e6ad2a9817444caecb78eabde5d222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.443393 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae15aab5d37747bbb2c483597fdd6ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.443782 1176 ts_tablet_manager.cc:1916] T 59c6741a6d154d8f99d487c6590d2d26 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:40.450228 753 tablet_service.cc:1511] Processing CreateTablet for tablet 4584a37cd9944c478549a4ea6c3f48fa (DEFAULT_TABLE table=default.Table_1d44de7cb31c45a8a09b4889c875ba21 [id=9dc6f7a237a84ad5a1f799067869c46a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.453486 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4584a37cd9944c478549a4ea6c3f48fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.453666 889 tablet_service.cc:1511] Processing CreateTablet for tablet ae15aab5d37747bbb2c483597fdd6ea6 (DEFAULT_TABLE table=default.Table_36ee456043a744d7b2ae15b5366d65ad [id=4b4a577cd4a84deeadbad83fd2c94b90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.454089 899 tablet_service.cc:1511] Processing CreateTablet for tablet bbb9349d077a4092893614323bd8e448 (DEFAULT_TABLE table=default.Table_83df37ff0a08452697440678fe51ef9a [id=728fbeddc22041e6afaf02251eea9e5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.454315 903 tablet_service.cc:1511] Processing CreateTablet for tablet 7624aaa7231b4c5099cc3367ca9efefc (DEFAULT_TABLE table=default.Table_14099aef89c147ec896c324acb15d1ab [id=2d84c1428d7f436c872278df7cd7be48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.454352 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ef3181adc0542229897369591a30465 with delete_type TABLET_DATA_DELETED (replaced by tablet defda79dd0f34c37ae16ea808df0754b) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.454493 888 tablet_service.cc:1511] Processing CreateTablet for tablet 769e8f3cb27e471d8ea7988e0a17556b (DEFAULT_TABLE table=default.Table_663d04a904c7459690a70b01e71c1933 [id=30332a64f47144ddbac13c2310f4fbc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.454576 901 tablet_service.cc:1558] Processing DeleteTablet for tablet ed697b98352c4f65931c154b1f160991 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.454617 898 tablet_service.cc:1511] Processing CreateTablet for tablet 4b43a0b485fa4b2e89d034de742018a5 (DEFAULT_TABLE table=default.Table_533d4a1dfa6a4a9c8b6f2ef12c61a9ea [id=15b9a9756977413883d0aa138fc5a4ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.454834 891 tablet_service.cc:1511] Processing CreateTablet for tablet a08267b7300c452697c0f8b0cf885e9c (DEFAULT_TABLE table=default.Table_4b8ea2a5404649d8943f9b93f9675603 [id=1bd97d0e890c46eeb00cc0ab29510830]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.454897 904 tablet_service.cc:1511] Processing CreateTablet for tablet 2b7d54bee9c34cf3beb8f59510302c0b (DEFAULT_TABLE table=default.Table_265b3356de79492ea01fb1a46402ad02 [id=aa45d40f8ddf4b4da510d57881122a77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.455099 902 tablet_service.cc:1511] Processing CreateTablet for tablet a8c1a1e097d34126ada38cec2f3d34b6 (DEFAULT_TABLE table=default.Table_bb08c3624fb54b12a3295e6909a356ea [id=2812b34ea18942f296c8422154cd5366]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.455297 894 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca9bad2b9aa4a41bb7801da61cd0d16 (DEFAULT_TABLE table=default.Table_b0e4642ca0a2453c910aaa30943534bf [id=4334f19341eb40e58a2b54c55e4eb09e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.455474 906 tablet_service.cc:1511] Processing CreateTablet for tablet 1be09e67b9d94e669f28a7cd236b48a4 (DEFAULT_TABLE table=default.Table_dde65a0e8449460f970a61ce1e8d80df [id=5e6e3859b4f64874b3dc1657cdbe0d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.454089 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae15aab5d37747bbb2c483597fdd6ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.455612 897 tablet_service.cc:1511] Processing CreateTablet for tablet bdf0ceb9b5a54b1eb9dd34115c0750e1 (DEFAULT_TABLE table=default.Table_3eb84f70b8164e24b0d9772b02268c85 [id=a7a986f000524dc8a468653f7eaab395]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.455929 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7624aaa7231b4c5099cc3367ca9efefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.456022 907 tablet_service.cc:1511] Processing CreateTablet for tablet 4584a37cd9944c478549a4ea6c3f48fa (DEFAULT_TABLE table=default.Table_1d44de7cb31c45a8a09b4889c875ba21 [id=9dc6f7a237a84ad5a1f799067869c46a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.456266 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08267b7300c452697c0f8b0cf885e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.457629 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c1a1e097d34126ada38cec2f3d34b6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:40.457969 997 leader_election.cc:343] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.458079 997 leader_election.cc:304] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:40.459028 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca9bad2b9aa4a41bb7801da61cd0d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.458956 1034 tablet_service.cc:1511] Processing CreateTablet for tablet ae15aab5d37747bbb2c483597fdd6ea6 (DEFAULT_TABLE table=default.Table_36ee456043a744d7b2ae15b5366d65ad [id=4b4a577cd4a84deeadbad83fd2c94b90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.459293 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 2b7d54bee9c34cf3beb8f59510302c0b (DEFAULT_TABLE table=default.Table_265b3356de79492ea01fb1a46402ad02 [id=aa45d40f8ddf4b4da510d57881122a77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.459498 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca9bad2b9aa4a41bb7801da61cd0d16 (DEFAULT_TABLE table=default.Table_b0e4642ca0a2453c910aaa30943534bf [id=4334f19341eb40e58a2b54c55e4eb09e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.459690 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1be09e67b9d94e669f28a7cd236b48a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.459657 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 4b43a0b485fa4b2e89d034de742018a5 (DEFAULT_TABLE table=default.Table_533d4a1dfa6a4a9c8b6f2ef12c61a9ea [id=15b9a9756977413883d0aa138fc5a4ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.459792 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 769e8f3cb27e471d8ea7988e0a17556b (DEFAULT_TABLE table=default.Table_663d04a904c7459690a70b01e71c1933 [id=30332a64f47144ddbac13c2310f4fbc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.460045 2152 raft_consensus.cc:2749] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:40.460129 1035 tablet_service.cc:1511] Processing CreateTablet for tablet bbb9349d077a4092893614323bd8e448 (DEFAULT_TABLE table=default.Table_83df37ff0a08452697440678fe51ef9a [id=728fbeddc22041e6afaf02251eea9e5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.460426 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf0ceb9b5a54b1eb9dd34115c0750e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.460387 1040 tablet_service.cc:1511] Processing CreateTablet for tablet a8c1a1e097d34126ada38cec2f3d34b6 (DEFAULT_TABLE table=default.Table_bb08c3624fb54b12a3295e6909a356ea [id=2812b34ea18942f296c8422154cd5366]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.460467 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 7624aaa7231b4c5099cc3367ca9efefc (DEFAULT_TABLE table=default.Table_14099aef89c147ec896c324acb15d1ab [id=2d84c1428d7f436c872278df7cd7be48]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.460808 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 1be09e67b9d94e669f28a7cd236b48a4 (DEFAULT_TABLE table=default.Table_dde65a0e8449460f970a61ce1e8d80df [id=5e6e3859b4f64874b3dc1657cdbe0d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.460930 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769e8f3cb27e471d8ea7988e0a17556b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.461012 762 tablet_service.cc:1511] Processing CreateTablet for tablet 769e8f3cb27e471d8ea7988e0a17556b (DEFAULT_TABLE table=default.Table_663d04a904c7459690a70b01e71c1933 [id=30332a64f47144ddbac13c2310f4fbc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.461141 1028 tablet_service.cc:1511] Processing CreateTablet for tablet bdf0ceb9b5a54b1eb9dd34115c0750e1 (DEFAULT_TABLE table=default.Table_3eb84f70b8164e24b0d9772b02268c85 [id=a7a986f000524dc8a468653f7eaab395]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.461344 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769e8f3cb27e471d8ea7988e0a17556b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.459303 1038 tablet_service.cc:1511] Processing CreateTablet for tablet a08267b7300c452697c0f8b0cf885e9c (DEFAULT_TABLE table=default.Table_4b8ea2a5404649d8943f9b93f9675603 [id=1bd97d0e890c46eeb00cc0ab29510830]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.461750 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b43a0b485fa4b2e89d034de742018a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.462057 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4584a37cd9944c478549a4ea6c3f48fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.462258 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb9349d077a4092893614323bd8e448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.462419 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b7d54bee9c34cf3beb8f59510302c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.473778 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 41646d513e834600a209761392ac7fb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.474115 760 tablet_service.cc:1558] Processing DeleteTablet for tablet 9777963ff20c4a799de2870555f6b335 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.474159 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet c0c33cfa1c194a65bfc64d0e1e9434ff with delete_type TABLET_DATA_DELETED (replaced by tablet e918bb008e0743a9bf7ada170812146e) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.474356 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f04e5699531479d8b76edb0e2d2873c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.474437 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet a0a6f4b34ff14714892ed9e9b3604dc9 with delete_type TABLET_DATA_DELETED (replaced by tablet fb5d1d828899472e8f48723b35e94d62) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.476588 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 60dedba077d34435b30061bfba737412 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.477360 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b43a0b485fa4b2e89d034de742018a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.481048 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf0ceb9b5a54b1eb9dd34115c0750e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.484934 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb9349d077a4092893614323bd8e448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.486122 1172 tablet_bootstrap.cc:492] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:40.487999 1172 tablet_bootstrap.cc:654] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.488945 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b7d54bee9c34cf3beb8f59510302c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.492870 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1be09e67b9d94e669f28a7cd236b48a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.492985 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae15aab5d37747bbb2c483597fdd6ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.493144 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b43a0b485fa4b2e89d034de742018a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.496246 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7624aaa7231b4c5099cc3367ca9efefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.496922 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b7d54bee9c34cf3beb8f59510302c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.500949 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769e8f3cb27e471d8ea7988e0a17556b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.500959 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08267b7300c452697c0f8b0cf885e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.505000 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c1a1e097d34126ada38cec2f3d34b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.505023 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb9349d077a4092893614323bd8e448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.508872 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca9bad2b9aa4a41bb7801da61cd0d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.509084 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7624aaa7231b4c5099cc3367ca9efefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.509755 2296 raft_consensus.cc:493] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:40.509874 2296 raft_consensus.cc:515] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.510458 2296 leader_election.cc:290] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:40.511963 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2ebcf120100349319d27615b6e0c7550
I20260318 02:51:40.512179 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1be09e67b9d94e669f28a7cd236b48a4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:40.512264 999 consensus_peers.cc:597] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d -> Peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Couldn't send request to peer 6a903d876086423b8016d705b98895ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d7b339a29ef456997d74a7a95d4c03a. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:40.512863 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 5433e0aebdd34666a655c21a77fe2654
W20260318 02:51:40.513464 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 43a71d4820a84d3bb853c23b078e0fbf consensus state has no leader
W20260318 02:51:40.513850 999 leader_election.cc:343] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: de2bc2f79e8b49248de3e7eca1a600cf
I20260318 02:51:40.513484 453 catalog_manager.cc:6741] ReplaceTablet: tablet 5433e0aebdd34666a655c21a77fe2654 deleted and replaced by tablet 15cae82c808a435e86f8c514e415d546
I20260318 02:51:40.516096 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ebcf120100349319d27615b6e0c7550 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.517740 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 5433e0aebdd34666a655c21a77fe2654 with delete_type TABLET_DATA_DELETED (replaced by tablet 15cae82c808a435e86f8c514e415d546) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:40.518808 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 71b45ec1da6440b98c796e61d3551424 consensus state has no leader
I20260318 02:51:40.522562 2296 raft_consensus.cc:493] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:40.522689 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdf0ceb9b5a54b1eb9dd34115c0750e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.522719 2296 raft_consensus.cc:515] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.523321 2296 leader_election.cc:290] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
W20260318 02:51:40.524444 999 leader_election.cc:343] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: b8973d8930ef4b65be7b4ff990bf9d72
I20260318 02:51:40.524947 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a08267b7300c452697c0f8b0cf885e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.528853 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c1a1e097d34126ada38cec2f3d34b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.529284 1175 ts_tablet_manager.cc:1916] T 96a6d1808417419dac0d2b2e80c5ca22 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:40.529574 1172 tablet_bootstrap.cc:492] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:40.529724 1172 ts_tablet_manager.cc:1403] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.044s user 0.005s sys 0.000s
I20260318 02:51:40.530483 1172 raft_consensus.cc:359] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.530645 1172 raft_consensus.cc:385] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.530687 1172 raft_consensus.cc:740] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.530894 1172 consensus_queue.cc:260] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.531721 1172 ts_tablet_manager.cc:1434] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:40.532014 1172 tablet_bootstrap.cc:492] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:40.533033 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b9e0c54b3f1b44e4bea7253473714e94
I20260318 02:51:40.533739 1172 tablet_bootstrap.cc:654] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.534631 752 tablet_service.cc:1558] Processing DeleteTablet for tablet b9e0c54b3f1b44e4bea7253473714e94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.539719 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_50775e92a3544e0bb2d75969b9a6b57a" } modify_external_catalogs: true
I20260318 02:51:40.539943 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_50775e92a3544e0bb2d75969b9a6b57a" } modify_external_catalogs: true
I20260318 02:51:40.540532 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b0e4642ca0a2453c910aaa30943534bf" } modify_external_catalogs: true
I20260318 02:51:40.540768 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b0e4642ca0a2453c910aaa30943534bf" } modify_external_catalogs: true
I20260318 02:51:40.542774 752 tablet_service.cc:1511] Processing CreateTablet for tablet f1f5bebb9d774ce8847f74025baf1f5c (DEFAULT_TABLE table=default.Table_b4856e51667b41c68c764ff0e157cee2 [id=59c6383294bf4dac927fe4273fe54f37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.543442 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f5bebb9d774ce8847f74025baf1f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.549173 894 tablet_service.cc:1558] Processing DeleteTablet for tablet 5433e0aebdd34666a655c21a77fe2654 with delete_type TABLET_DATA_DELETED (replaced by tablet 15cae82c808a435e86f8c514e415d546) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.549747 899 tablet_service.cc:1558] Processing DeleteTablet for tablet b9e0c54b3f1b44e4bea7253473714e94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.550233 907 tablet_service.cc:1511] Processing CreateTablet for tablet f1f5bebb9d774ce8847f74025baf1f5c (DEFAULT_TABLE table=default.Table_b4856e51667b41c68c764ff0e157cee2 [id=59c6383294bf4dac927fe4273fe54f37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.550719 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f5bebb9d774ce8847f74025baf1f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.550740 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 20009aa96bf44ae88acfeef8e38bc204
I20260318 02:51:40.556872 2382 raft_consensus.cc:493] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:40.557030 2382 raft_consensus.cc:515] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.557323 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet 5433e0aebdd34666a655c21a77fe2654 with delete_type TABLET_DATA_DELETED (replaced by tablet 15cae82c808a435e86f8c514e415d546) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.557655 2382 leader_election.cc:290] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:40.558684 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2bc2f79e8b49248de3e7eca1a600cf" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:40.558800 999 leader_election.cc:343] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 41646d513e834600a209761392ac7fb1
I20260318 02:51:40.558988 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ebcf120100349319d27615b6e0c7550 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.559432 2372 raft_consensus.cc:493] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:40.559578 2372 raft_consensus.cc:515] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.563441 1042 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ebcf120100349319d27615b6e0c7550 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.565795 450 catalog_manager.cc:5671] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:40.566370 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8973d8930ef4b65be7b4ff990bf9d72" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:40.568420 1175 ts_tablet_manager.cc:1929] T 96a6d1808417419dac0d2b2e80c5ca22 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:40.568949 1174 tablet_bootstrap.cc:492] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:40.571380 1184 ts_tablet_manager.cc:1929] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:40.571709 1032 tablet_service.cc:1558] Processing DeleteTablet for tablet b9e0c54b3f1b44e4bea7253473714e94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.577203 1184 log.cc:1199] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/7c0d87304c41481299f1e2ddfdfcfdec
I20260318 02:51:40.578150 1184 ts_tablet_manager.cc:1950] T 7c0d87304c41481299f1e2ddfdfcfdec P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:40.578774 450 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet a9c60ef260d049bea4ce729316a0d09f (table default.Table_d5ddb641ef9245ca92ab35d8ac25b157 [id=fb45f238426142faa79cbe89242c7418]). Expected version 1 got 0
I20260318 02:51:40.579288 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 953) took 2816 ms. Trace:
I20260318 02:51:40.582024 450 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet cf73a9f8f67b42d9baf1396d70a1a3a9 (table default.Table_c0889091422144f8af318ab6f38afd05 [id=75621b04db1d4c67bd2d2f5fe76c8a25]). Expected version 4 got 0
W20260318 02:51:40.572651 997 leader_election.cc:343] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.585469 997 leader_election.cc:304] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:40.585819 2382 raft_consensus.cc:2749] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:40.586361 997 leader_election.cc:343] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.586539 997 leader_election.cc:304] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:40.586786 2382 raft_consensus.cc:2749] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:40.569523 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0b58fa8e85f44c4289e5865488fa93ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:40.582669 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d550bf15de2b4cc5a3bf45213eb07236"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:40.589473 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d550bf15de2b4cc5a3bf45213eb07236 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:40.583498 455 master_service.cc:954] ReplaceTablet: received request to replace tablet e993481bf55747b0a6a1c996c6917408 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:40.591090 753 tablet_service.cc:1511] Processing CreateTablet for tablet 51f03f764e9140308538da60ca08916d (DEFAULT_TABLE table=default.Table_18229fb86a1143978b06d587f7498d51 [id=f239c61c109d489fb664f33513a20241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.583613 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c2d16f88924544cbaf4ed64b9c5bc7a6" } new_table_name: "default.Table_15a4739258304320bbfc03fc6fb2f74d" modify_external_catalogs: true
I20260318 02:51:40.592136 2372 leader_election.cc:290] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:40.592293 2372 raft_consensus.cc:493] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:40.592458 2372 raft_consensus.cc:515] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.593258 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9777963ff20c4a799de2870555f6b335" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:40.593870 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b58fa8e85f44c4289e5865488fa93ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:40.594892 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f04e5699531479d8b76edb0e2d2873c" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:40.585577 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_18229fb86a1143978b06d587f7498d51" } new_table_name: "default.Table_87a699c155bb43c983c67985bd20446a" modify_external_catalogs: true
W20260318 02:51:40.595417 719 leader_election.cc:343] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:40.595945 719 leader_election.cc:343] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.596652 1032 tablet_service.cc:1511] Processing CreateTablet for tablet f1f5bebb9d774ce8847f74025baf1f5c (DEFAULT_TABLE table=default.Table_b4856e51667b41c68c764ff0e157cee2 [id=59c6383294bf4dac927fe4273fe54f37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.596814 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 51f03f764e9140308538da60ca08916d (DEFAULT_TABLE table=default.Table_18229fb86a1143978b06d587f7498d51 [id=f239c61c109d489fb664f33513a20241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.598726 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 82d2922edaae4dc0bd8bcf859d248a11 (DEFAULT_TABLE table=default.Table_8510ed9c86cf454ab5bfc99b2f84ad2d [id=333df43b27d14015855b94e06bec3742]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.599224 1176 ts_tablet_manager.cc:1929] T 59c6741a6d154d8f99d487c6590d2d26 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:40.593037 2372 leader_election.cc:290] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:40.600270 1176 log.cc:1199] T 59c6741a6d154d8f99d487c6590d2d26 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/59c6741a6d154d8f99d487c6590d2d26
I20260318 02:51:40.599661 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 4584a37cd9944c478549a4ea6c3f48fa (DEFAULT_TABLE table=default.Table_1d44de7cb31c45a8a09b4889c875ba21 [id=9dc6f7a237a84ad5a1f799067869c46a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.600845 1174 tablet_bootstrap.cc:654] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.602483 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51f03f764e9140308538da60ca08916d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.600997 1176 ts_tablet_manager.cc:1950] T 59c6741a6d154d8f99d487c6590d2d26 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:40.604574 1176 tablet_replica.cc:333] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:40.608242 1176 raft_consensus.cc:2243] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:40.608862 1176 raft_consensus.cc:2272] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:40.609943 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1f5bebb9d774ce8847f74025baf1f5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.610142 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 63c61a38efeb4de7b08c75dba87d68f1 (DEFAULT_TABLE table=default.Table_adb87f4cd4574655a262d9570e440d1a [id=5a45fc3cde9545a794d56b39c394cd3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.610423 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 20009aa96bf44ae88acfeef8e38bc204 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.568626 904 tablet_service.cc:1511] Processing CreateTablet for tablet 51f03f764e9140308538da60ca08916d (DEFAULT_TABLE table=default.Table_18229fb86a1143978b06d587f7498d51 [id=f239c61c109d489fb664f33513a20241]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.611081 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51f03f764e9140308538da60ca08916d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.611572 1176 ts_tablet_manager.cc:1916] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:40.611742 1175 log.cc:1199] T 96a6d1808417419dac0d2b2e80c5ca22 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/96a6d1808417419dac0d2b2e80c5ca22
I20260318 02:51:40.612998 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 52d77526010648739496b7b2cc315268 (DEFAULT_TABLE table=default.Table_7286c0505cce4fdbb3d3ff1021f7ae40 [id=78b9f9c06bd44938a359dacc47696211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.613662 1175 ts_tablet_manager.cc:1950] T 96a6d1808417419dac0d2b2e80c5ca22 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:40.618613 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51f03f764e9140308538da60ca08916d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.569204 894 tablet_service.cc:1511] Processing CreateTablet for tablet 63c61a38efeb4de7b08c75dba87d68f1 (DEFAULT_TABLE table=default.Table_adb87f4cd4574655a262d9570e440d1a [id=5a45fc3cde9545a794d56b39c394cd3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.619151 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63c61a38efeb4de7b08c75dba87d68f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.620306 1175 tablet_replica.cc:333] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
W20260318 02:51:40.621135 997 consensus_peers.cc:597] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:40.622325 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 96a6d1808417419dac0d2b2e80c5ca22 (table default.Table_8b0935ef185c46f8ba4fe96e60fad278 [id=a401bb840c9a4dddb1619805a406f8aa]) successfully deleted
I20260318 02:51:40.623361 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 0047870efc7b4eb18ce7929b7c9d92c9 (DEFAULT_TABLE table=default.Table_ca1893cd875e42808f00ad4ce719bad1 [id=3a230be68f0f4015857f8486218566ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.579430 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41646d513e834600a209761392ac7fb1" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:40.625629 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 93d8928efa59415e810c44cc08b42a4f (DEFAULT_TABLE table=default.Table_4a1bffd2251c411f85b8c49165c2a214 [id=21e646bd2f7e4f3fa4aca6d229066ad3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.587901 888 tablet_service.cc:1511] Processing CreateTablet for tablet 0047870efc7b4eb18ce7929b7c9d92c9 (DEFAULT_TABLE table=default.Table_ca1893cd875e42808f00ad4ce719bad1 [id=3a230be68f0f4015857f8486218566ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.626052 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0047870efc7b4eb18ce7929b7c9d92c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.623301 1184 rpcz_store.cc:276] 0318 02:51:37.762750 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.772013 (+ 9263us) service_pool.cc:225] Handling call
0318 02:51:40.384639 (+2612626us) ts_tablet_manager.cc:1151] Deleting tablet 7c0d87304c41481299f1e2ddfdfcfdec
0318 02:51:40.384648 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:40.536202 (+151554us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:40.571260 (+ 35058us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:40.579261 (+ 8001us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2612448}
W20260318 02:51:40.626185 997 leader_election.cc:343] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.626296 997 leader_election.cc:304] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:40.626816 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 7c0d87304c41481299f1e2ddfdfcfdec (table default.Table_b735de7cc516403da40f10ec36cf25f1 [id=e3979c7eefe84cd7bb1dd36fa9351b7e]) successfully deleted
I20260318 02:51:40.593923 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f04e5699531479d8b76edb0e2d2873c" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:40.629046 2382 raft_consensus.cc:2749] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:40.594640 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9777963ff20c4a799de2870555f6b335" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:40.602087 923 raft_consensus.cc:3060] T 3348b200e5ca4f6ebecb2c25ddbe27bf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:40.607956 2362 raft_consensus.cc:493] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:40.634145 2362 raft_consensus.cc:515] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.634891 2362 leader_election.cc:290] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:40.635236 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ca45a42e395240b2b2cd83f10d5b99aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:40.635957 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca45a42e395240b2b2cd83f10d5b99aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:40.636976 860 leader_election.cc:343] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 7cdd554113bf4a7092da876365a89456
W20260318 02:51:40.637192 862 leader_election.cc:343] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 7cdd554113bf4a7092da876365a89456
I20260318 02:51:40.637271 862 leader_election.cc:304] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:40.637723 2362 raft_consensus.cc:2749] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:40.638289 719 leader_election.cc:343] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.638423 719 leader_election.cc:304] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:40.638785 719 leader_election.cc:343] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.638872 719 leader_election.cc:304] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:40.640522 2431 raft_consensus.cc:2749] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:40.640687 2431 raft_consensus.cc:2749] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:40.641480 748 tablet_service.cc:1511] Processing CreateTablet for tablet 63c61a38efeb4de7b08c75dba87d68f1 (DEFAULT_TABLE table=default.Table_adb87f4cd4574655a262d9570e440d1a [id=5a45fc3cde9545a794d56b39c394cd3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.641917 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63c61a38efeb4de7b08c75dba87d68f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.648628 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 9ca9bad2b9aa4a41bb7801da61cd0d16
I20260318 02:51:40.649554 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6e299f3484ca428cbccc8ea294a0ea69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:40.650202 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e299f3484ca428cbccc8ea294a0ea69 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:40.651548 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 54ba25c5ad3747bf9845245e29561dc9 consensus state has no leader
I20260318 02:51:40.651803 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_78768f3f016b4f7985a6b386b016bd62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:40.651988 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5ff5f71a1bec45fdb637b5846419efdb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:40.652375 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78768f3f016b4f7985a6b386b016bd62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:40.652526 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ff5f71a1bec45fdb637b5846419efdb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:40.653636 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet e993481bf55747b0a6a1c996c6917408
I20260318 02:51:40.653769 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 62af4992cca84830ab8317f734338365
I20260318 02:51:40.654106 455 catalog_manager.cc:6741] ReplaceTablet: tablet e993481bf55747b0a6a1c996c6917408 deleted and replaced by tablet ffa9d9dcc70e402099b414029f062d6e
I20260318 02:51:40.654485 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_56beb1ca03424d678071acc86399a892"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:40.654559 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ef3fc2e773ac4783a799b73a979a0bcb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:40.655035 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef3fc2e773ac4783a799b73a979a0bcb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:40.655761 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56beb1ca03424d678071acc86399a892 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:40.656287 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20ecb11db30e409b9090ebfc4a4f0785 consensus state has no leader
W20260318 02:51:40.656970 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 51f03f764e9140308538da60ca08916d consensus state has no leader
I20260318 02:51:40.658063 904 tablet_service.cc:1511] Processing CreateTablet for tablet 93d8928efa59415e810c44cc08b42a4f (DEFAULT_TABLE table=default.Table_4a1bffd2251c411f85b8c49165c2a214 [id=21e646bd2f7e4f3fa4aca6d229066ad3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.658514 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d8928efa59415e810c44cc08b42a4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.660075 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_402673bdfb764fe681dfe66dc2c1ba48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:40.660640 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_402673bdfb764fe681dfe66dc2c1ba48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:40.661226 761 tablet_service.cc:1511] Processing CreateTablet for tablet a1fae59934f342038d82739754f88394 (DEFAULT_TABLE table=default.Table_b9b4227a0df0476fa16d53a55a575a4a [id=2b0cabd6605d41bf8ac43aa3bb178bbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.661620 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1fae59934f342038d82739754f88394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.661736 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 20009aa96bf44ae88acfeef8e38bc204 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.662074 751 tablet_service.cc:1511] Processing CreateTablet for tablet 0047870efc7b4eb18ce7929b7c9d92c9 (DEFAULT_TABLE table=default.Table_ca1893cd875e42808f00ad4ce719bad1 [id=3a230be68f0f4015857f8486218566ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.662397 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0047870efc7b4eb18ce7929b7c9d92c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.609196 907 tablet_service.cc:1511] Processing CreateTablet for tablet 52d77526010648739496b7b2cc315268 (DEFAULT_TABLE table=default.Table_7286c0505cce4fdbb3d3ff1021f7ae40 [id=78b9f9c06bd44938a359dacc47696211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.568897 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 20009aa96bf44ae88acfeef8e38bc204 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.663240 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d77526010648739496b7b2cc315268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.569485 899 tablet_service.cc:1511] Processing CreateTablet for tablet 82d2922edaae4dc0bd8bcf859d248a11 (DEFAULT_TABLE table=default.Table_8510ed9c86cf454ab5bfc99b2f84ad2d [id=333df43b27d14015855b94e06bec3742]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.625505 891 tablet_service.cc:1511] Processing CreateTablet for tablet a1fae59934f342038d82739754f88394 (DEFAULT_TABLE table=default.Table_b9b4227a0df0476fa16d53a55a575a4a [id=2b0cabd6605d41bf8ac43aa3bb178bbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.665015 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1fae59934f342038d82739754f88394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.665254 762 tablet_service.cc:1511] Processing CreateTablet for tablet 93d8928efa59415e810c44cc08b42a4f (DEFAULT_TABLE table=default.Table_4a1bffd2251c411f85b8c49165c2a214 [id=21e646bd2f7e4f3fa4aca6d229066ad3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.665563 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d8928efa59415e810c44cc08b42a4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.668934 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d2922edaae4dc0bd8bcf859d248a11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.669354 748 tablet_service.cc:1511] Processing CreateTablet for tablet 52d77526010648739496b7b2cc315268 (DEFAULT_TABLE table=default.Table_7286c0505cce4fdbb3d3ff1021f7ae40 [id=78b9f9c06bd44938a359dacc47696211]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.669695 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d77526010648739496b7b2cc315268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.676497 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d2922edaae4dc0bd8bcf859d248a11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.680994 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4584a37cd9944c478549a4ea6c3f48fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.681056 752 tablet_service.cc:1511] Processing CreateTablet for tablet 82d2922edaae4dc0bd8bcf859d248a11 (DEFAULT_TABLE table=default.Table_8510ed9c86cf454ab5bfc99b2f84ad2d [id=333df43b27d14015855b94e06bec3742]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.681439 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d2922edaae4dc0bd8bcf859d248a11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.684948 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63c61a38efeb4de7b08c75dba87d68f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.685484 761 tablet_service.cc:1558] Processing DeleteTablet for tablet e993481bf55747b0a6a1c996c6917408 with delete_type TABLET_DATA_DELETED (replaced by tablet ffa9d9dcc70e402099b414029f062d6e) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.685693 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ca9bad2b9aa4a41bb7801da61cd0d16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.687374 1175 raft_consensus.cc:2243] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:40.687821 1175 raft_consensus.cc:2272] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:40.688933 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d77526010648739496b7b2cc315268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.689862 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ca9bad2b9aa4a41bb7801da61cd0d16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.691044 889 tablet_service.cc:1558] Processing DeleteTablet for tablet e993481bf55747b0a6a1c996c6917408 with delete_type TABLET_DATA_DELETED (replaced by tablet ffa9d9dcc70e402099b414029f062d6e) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.691359 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 62af4992cca84830ab8317f734338365 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.691641 1175 ts_tablet_manager.cc:1916] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:40.692639 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 62af4992cca84830ab8317f734338365 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.694196 889 tablet_service.cc:1511] Processing CreateTablet for tablet 77727d2bfb95488e943808a58920f20c (DEFAULT_TABLE table=default.Table_bd0d028c717541a2803c9274d069d42f [id=1e2b3a08e4934fd69c64d795be261fd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.694597 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77727d2bfb95488e943808a58920f20c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.694849 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet 62af4992cca84830ab8317f734338365 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.694923 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a3a36a7fd4742c9827b334ce31d4a7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.695258 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet b8973d8930ef4b65be7b4ff990bf9d72 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c89f413a26a43ef95c850d7c44f85b2) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.695535 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet de2bc2f79e8b49248de3e7eca1a600cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.695595 891 tablet_service.cc:1511] Processing CreateTablet for tablet b4f47ccf0b194919902cc4142b097bf3 (DEFAULT_TABLE table=default.Table_0eafcf7f327d4775aec804485d229020 [id=af33a9adf0c44152858a624ac86f2f59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.695981 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f47ccf0b194919902cc4142b097bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.696259 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 9aeb492564a94a569f70506712dad4ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.696517 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 59c6741a6d154d8f99d487c6590d2d26 (table default.Table_f4978db62ff94982b1fbb4afc8e96b29 [id=9c9b005136654a8e874925b6bbef33a4]) successfully deleted
I20260318 02:51:40.696687 1034 tablet_service.cc:1511] Processing CreateTablet for tablet a1fae59934f342038d82739754f88394 (DEFAULT_TABLE table=default.Table_b9b4227a0df0476fa16d53a55a575a4a [id=2b0cabd6605d41bf8ac43aa3bb178bbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.696796 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ca9bad2b9aa4a41bb7801da61cd0d16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.696942 1033 tablet_service.cc:1558] Processing DeleteTablet for tablet e993481bf55747b0a6a1c996c6917408 with delete_type TABLET_DATA_DELETED (replaced by tablet ffa9d9dcc70e402099b414029f062d6e) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.697069 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1fae59934f342038d82739754f88394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.697208 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0047870efc7b4eb18ce7929b7c9d92c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.700445 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d8928efa59415e810c44cc08b42a4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.703560 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 77727d2bfb95488e943808a58920f20c (DEFAULT_TABLE table=default.Table_bd0d028c717541a2803c9274d069d42f [id=1e2b3a08e4934fd69c64d795be261fd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.704569 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77727d2bfb95488e943808a58920f20c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.704975 1184 tablet_replica.cc:333] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:40.705188 1184 raft_consensus.cc:2243] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:40.705333 1184 raft_consensus.cc:2272] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:40.705811 1184 ts_tablet_manager.cc:1916] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:40.710186 2296 consensus_queue.cc:1048] T 0b39433a5a7f42c39139db0da77ae75f P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:40.717877 1174 tablet_bootstrap.cc:492] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:40.718036 1174 ts_tablet_manager.cc:1403] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.149s user 0.001s sys 0.005s
I20260318 02:51:40.718765 1174 raft_consensus.cc:359] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.718932 1174 raft_consensus.cc:385] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.718974 1174 raft_consensus.cc:740] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.719168 1174 consensus_queue.cc:260] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.727095 1184 ts_tablet_manager.cc:1929] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:40.727221 1176 ts_tablet_manager.cc:1929] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:40.727319 1176 log.cc:1199] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/b317cc133346412fb981b1c8e5b99c4d
I20260318 02:51:40.727646 1176 ts_tablet_manager.cc:1950] T b317cc133346412fb981b1c8e5b99c4d P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:40.729156 1184 log.cc:1199] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/254b8722e7ff4ccabc6d16f04daf85aa
I20260318 02:51:40.729610 1184 ts_tablet_manager.cc:1950] T 254b8722e7ff4ccabc6d16f04daf85aa P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:40.730020 889 tablet_service.cc:1511] Processing CreateTablet for tablet 672200f356864228b7a04dfba7b4ff41 (DEFAULT_TABLE table=default.Table_8dd951b2c36541e383c5ce9a1b1e2a57 [id=cbf9854404d94e73a231510245d5b31e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.730523 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 967) took 2917 ms. Trace:
I20260318 02:51:40.730948 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 672200f356864228b7a04dfba7b4ff41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.731103 1184 rpcz_store.cc:276] 0318 02:51:37.813277 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:37.813329 (+ 52us) service_pool.cc:225] Handling call
0318 02:51:40.626394 (+2813065us) ts_tablet_manager.cc:1151] Deleting tablet 254b8722e7ff4ccabc6d16f04daf85aa
0318 02:51:40.704931 (+ 78537us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:40.708526 (+ 3595us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:40.726975 (+ 18449us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:40.730505 (+ 3530us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2812889}
I20260318 02:51:40.731592 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 981) took 2660 ms. Trace:
I20260318 02:51:40.733469 1184 rpcz_store.cc:276] 0318 02:51:38.071085 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.072563 (+ 1478us) service_pool.cc:225] Handling call
0318 02:51:40.731463 (+2658900us) ts_tablet_manager.cc:1151] Deleting tablet b9a6d8d743a742a4b2d19b85e59101cb
0318 02:51:40.731472 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:40.731575 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2658754}
I20260318 02:51:40.733933 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 978) took 2663 ms. Trace:
I20260318 02:51:40.734053 1184 rpcz_store.cc:276] 0318 02:51:38.070804 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.073601 (+ 2797us) service_pool.cc:225] Handling call
0318 02:51:40.733812 (+2660211us) ts_tablet_manager.cc:1151] Deleting tablet 60a4e38c14f84e6ba9d0402b62f7432c
0318 02:51:40.733823 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:40.733918 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2660048}
I20260318 02:51:40.734545 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 985) took 2663 ms. Trace:
I20260318 02:51:40.734638 1184 rpcz_store.cc:276] 0318 02:51:38.071387 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.072076 (+ 689us) service_pool.cc:225] Handling call
0318 02:51:40.734343 (+2662267us) ts_tablet_manager.cc:1151] Deleting tablet 60dedba077d34435b30061bfba737412
0318 02:51:40.734440 (+ 97us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:40.734526 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2657248}
I20260318 02:51:40.734957 1184 tablet_replica.cc:333] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:40.735141 1184 raft_consensus.cc:2243] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:40.735304 1184 raft_consensus.cc:2272] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:40.735831 1184 ts_tablet_manager.cc:1916] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:40.736667 762 tablet_service.cc:1511] Processing CreateTablet for tablet b4f47ccf0b194919902cc4142b097bf3 (DEFAULT_TABLE table=default.Table_0eafcf7f327d4775aec804485d229020 [id=af33a9adf0c44152858a624ac86f2f59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.737105 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f47ccf0b194919902cc4142b097bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.738408 1172 tablet_bootstrap.cc:492] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:40.738572 1040 tablet_service.cc:1511] Processing CreateTablet for tablet b4f47ccf0b194919902cc4142b097bf3 (DEFAULT_TABLE table=default.Table_0eafcf7f327d4775aec804485d229020 [id=af33a9adf0c44152858a624ac86f2f59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.738987 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f47ccf0b194919902cc4142b097bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.740682 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 672200f356864228b7a04dfba7b4ff41 (DEFAULT_TABLE table=default.Table_8dd951b2c36541e383c5ce9a1b1e2a57 [id=cbf9854404d94e73a231510245d5b31e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.744349 753 tablet_service.cc:1511] Processing CreateTablet for tablet 77727d2bfb95488e943808a58920f20c (DEFAULT_TABLE table=default.Table_bd0d028c717541a2803c9274d069d42f [id=1e2b3a08e4934fd69c64d795be261fd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.745985 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 672200f356864228b7a04dfba7b4ff41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.747270 1174 ts_tablet_manager.cc:1434] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.029s user 0.001s sys 0.002s
I20260318 02:51:40.738651 1172 ts_tablet_manager.cc:1403] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.207s user 0.027s sys 0.026s
I20260318 02:51:40.753904 1172 raft_consensus.cc:359] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.756006 1172 raft_consensus.cc:385] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260318 02:51:40.756974 2373 lock_manager.cc:585] Waited 1 seconds to obtain row lock on key '<redacted>' (key hash 15438828024701347345) tablet 00000000000000000000000000000000 cur holder 0x617000031b00
I20260318 02:51:40.757150 1172 raft_consensus.cc:740] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.758692 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77727d2bfb95488e943808a58920f20c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.760696 1172 consensus_queue.cc:260] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.769419 1175 ts_tablet_manager.cc:1929] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:40.770406 1175 log.cc:1199] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/7cdd554113bf4a7092da876365a89456
I20260318 02:51:40.770406 762 tablet_service.cc:1511] Processing CreateTablet for tablet 672200f356864228b7a04dfba7b4ff41 (DEFAULT_TABLE table=default.Table_8dd951b2c36541e383c5ce9a1b1e2a57 [id=cbf9854404d94e73a231510245d5b31e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.771082 1175 ts_tablet_manager.cc:1950] T 7cdd554113bf4a7092da876365a89456 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:40.771083 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 672200f356864228b7a04dfba7b4ff41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.772470 1175 tablet_replica.cc:333] T 1ef3181adc0542229897369591a30465 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:40.772930 1175 raft_consensus.cc:2243] T 1ef3181adc0542229897369591a30465 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:40.773403 1175 raft_consensus.cc:2272] T 1ef3181adc0542229897369591a30465 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:40.770138 1184 ts_tablet_manager.cc:1929] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:40.774802 1184 log.cc:1199] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/e916c5419e3c457f98a47c6a1c6cdd56
I20260318 02:51:40.775199 1184 ts_tablet_manager.cc:1950] T e916c5419e3c457f98a47c6a1c6cdd56 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:40.776063 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 979) took 2705 ms. Trace:
I20260318 02:51:40.776214 1184 rpcz_store.cc:276] 0318 02:51:38.070915 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.072354 (+ 1439us) service_pool.cc:225] Handling call
0318 02:51:40.734911 (+2662557us) ts_tablet_manager.cc:1151] Deleting tablet e916c5419e3c457f98a47c6a1c6cdd56
0318 02:51:40.734924 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:40.758020 (+ 23096us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:40.770024 (+ 12004us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:40.776041 (+ 6017us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2646103}
I20260318 02:51:40.769312 1172 ts_tablet_manager.cc:1434] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20260318 02:51:40.776919 2431 raft_consensus.cc:493] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:40.777088 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 986) took 2482 ms. Trace:
I20260318 02:51:40.777134 2431 raft_consensus.cc:515] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.777855 1184 rpcz_store.cc:276] 0318 02:51:38.294681 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.294846 (+ 165us) service_pool.cc:225] Handling call
0318 02:51:40.776684 (+2481838us) ts_tablet_manager.cc:1151] Deleting tablet ecb2289a6bcd4b8ca6c3810b7d615bce
0318 02:51:40.776696 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:40.777072 (+ 376us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2481626}
I20260318 02:51:40.778496 1175 ts_tablet_manager.cc:1916] T 1ef3181adc0542229897369591a30465 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:40.778645 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e6ad2a9817444caecb78eabde5d222" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:40.779232 719 leader_election.cc:343] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.779559 2431 leader_election.cc:290] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:40.780895 456 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet d7f21df58fac437da5747becfa3f28b4 (table default.Table_357b13fa64234ab49f2349df67f8a0e2 [id=48b004d4295f40f0ac9ff77d7bb31720]). Expected version 3 got 0
I20260318 02:51:40.778183 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e6ad2a9817444caecb78eabde5d222" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:40.791186 719 leader_election.cc:343] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.791320 719 leader_election.cc:304] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:40.791785 2431 raft_consensus.cc:2749] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:40.790494 1172 tablet_bootstrap.cc:492] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:40.794076 1184 tablet_replica.cc:333] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:40.793804 451 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 68b0f0cd89234e72a052f3f9f964aa35 (table default.Table_1068ed12c0774560af59c6eb9d2f292c [id=9a52b01ffd5b4f7e8a7a20a817aa842f]). Expected version 2 got 0
I20260318 02:51:40.795276 1184 raft_consensus.cc:2243] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:40.795477 1184 raft_consensus.cc:2272] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:40.796034 1184 ts_tablet_manager.cc:1916] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:40.801138 1172 tablet_bootstrap.cc:654] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.807102 455 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 68b0f0cd89234e72a052f3f9f964aa35 (table default.Table_1068ed12c0774560af59c6eb9d2f292c [id=9a52b01ffd5b4f7e8a7a20a817aa842f]). Expected version 2 got 0
I20260318 02:51:40.807289 1172 tablet_bootstrap.cc:492] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:40.807432 1172 ts_tablet_manager.cc:1403] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.000s
I20260318 02:51:40.808235 1172 raft_consensus.cc:359] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.813212 1172 raft_consensus.cc:385] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.814848 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 7cdd554113bf4a7092da876365a89456 (table default.Table_3f656b3bee94423f80dd692ce3481733 [id=6f9427cec2ee40699e0c736524feb90f]) successfully deleted
I20260318 02:51:40.815501 1172 raft_consensus.cc:740] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.815629 1174 tablet_bootstrap.cc:492] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:40.816531 1173 tablet_bootstrap.cc:492] T ca23d4d0d3734fceb14966a4f2ad9c35 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:40.816781 1173 ts_tablet_manager.cc:1403] T ca23d4d0d3734fceb14966a4f2ad9c35 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.405s user 0.035s sys 0.087s
I20260318 02:51:40.817122 1172 consensus_queue.cc:260] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.817744 1175 ts_tablet_manager.cc:1929] T 1ef3181adc0542229897369591a30465 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:40.817739 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a45c93f14c58497cb5a6e81c8bef604c" } modify_external_catalogs: true
I20260318 02:51:40.814996 455 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet d7f21df58fac437da5747becfa3f28b4 (table default.Table_357b13fa64234ab49f2349df67f8a0e2 [id=48b004d4295f40f0ac9ff77d7bb31720]). Expected version 3 got 0
I20260318 02:51:40.817950 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a45c93f14c58497cb5a6e81c8bef604c" } modify_external_catalogs: true
I20260318 02:51:40.818356 1172 ts_tablet_manager.cc:1434] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260318 02:51:40.818588 1175 log.cc:1199] T 1ef3181adc0542229897369591a30465 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/1ef3181adc0542229897369591a30465
I20260318 02:51:40.818912 1175 ts_tablet_manager.cc:1950] T 1ef3181adc0542229897369591a30465 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:40.819437 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9051f0735dad4cef8cbce07f27319d58" } new_table_name: "default.Table_614e1c29256e4ddbb9a5dfb12f4a27f2" modify_external_catalogs: true
I20260318 02:51:40.819538 453 master_service.cc:954] ReplaceTablet: received request to replace tablet 4a60e189801440bca43f35fe787d3aa7 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:40.819602 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 254b8722e7ff4ccabc6d16f04daf85aa (table default.Table_c8066725c1a94b1f9e3a030be08a461d [id=d9f99876511c4cf294e3edbbfae441c0]) successfully deleted
W20260318 02:51:40.819851 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet b9a6d8d743a742a4b2d19b85e59101cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b9a6d8d743a742a4b2d19b85e59101cb already in progress: creating tablet
W20260318 02:51:40.820060 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 60a4e38c14f84e6ba9d0402b62f7432c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60a4e38c14f84e6ba9d0402b62f7432c already in progress: creating tablet
W20260318 02:51:40.820307 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 60dedba077d34435b30061bfba737412 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 60dedba077d34435b30061bfba737412 already in progress: creating tablet
I20260318 02:51:40.821600 1173 raft_consensus.cc:359] T ca23d4d0d3734fceb14966a4f2ad9c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.821857 1173 raft_consensus.cc:385] T ca23d4d0d3734fceb14966a4f2ad9c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.821947 1173 raft_consensus.cc:740] T ca23d4d0d3734fceb14966a4f2ad9c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.822201 1173 consensus_queue.cc:260] T ca23d4d0d3734fceb14966a4f2ad9c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.822760 1173 ts_tablet_manager.cc:1434] T ca23d4d0d3734fceb14966a4f2ad9c35 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260318 02:51:40.823089 1173 tablet_bootstrap.cc:492] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:40.824046 1172 tablet_bootstrap.cc:492] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:40.824584 1173 tablet_bootstrap.cc:654] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.826426 1172 tablet_bootstrap.cc:654] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.827725 1184 ts_tablet_manager.cc:1929] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:40.830313 1184 log.cc:1199] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/813702e53eee4a54a7d693fd6e03bbbb
I20260318 02:51:40.820763 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet e916c5419e3c457f98a47c6a1c6cdd56 (table default.Table_1ca30903a9ca4d31b9ad481adc6e3016 [id=b22ba2f393644e99b2b74ff6236325c5]) successfully deleted
I20260318 02:51:40.830837 1184 ts_tablet_manager.cc:1950] T 813702e53eee4a54a7d693fd6e03bbbb P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:40.828310 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9fd4f1b1845a40a5bc8d409f867c38e2" } modify_external_catalogs: true
W20260318 02:51:40.831166 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet ecb2289a6bcd4b8ca6c3810b7d615bce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ecb2289a6bcd4b8ca6c3810b7d615bce already in progress: creating tablet
I20260318 02:51:40.820834 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c7a8290fdcc149148f002a665a6c3d41" } new_table_name: "default.Table_2a25f2687bad470988b6af088ea5695c" modify_external_catalogs: true
I20260318 02:51:40.831272 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9fd4f1b1845a40a5bc8d409f867c38e2" } modify_external_catalogs: true
I20260318 02:51:40.831872 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_69de0fc8d3014dd887249ce81b9485f2" } modify_external_catalogs: true
I20260318 02:51:40.832028 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_69de0fc8d3014dd887249ce81b9485f2" } modify_external_catalogs: true
I20260318 02:51:40.832444 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 1ef3181adc0542229897369591a30465 (table default.Table_3aa749750bd542738790c713a8ff0713 [id=c6ec8a81c28d493396980349b4ea31d8]) successfully deleted
I20260318 02:51:40.826697 1175 tablet_replica.cc:333] T ed697b98352c4f65931c154b1f160991 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:40.834976 1175 raft_consensus.cc:2243] T ed697b98352c4f65931c154b1f160991 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:40.836122 1175 raft_consensus.cc:2272] T ed697b98352c4f65931c154b1f160991 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:40.837044 1175 ts_tablet_manager.cc:1916] T ed697b98352c4f65931c154b1f160991 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:40.837093 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f5ce7b986536414099b53f61033a960d
I20260318 02:51:40.839531 1174 tablet_bootstrap.cc:654] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.831728 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ff188f25ff146fab121ebfab1af8467 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.833268 2382 raft_consensus.cc:493] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260318 02:51:40.839720 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ffa9d9dcc70e402099b414029f062d6e has no consensus state
I20260318 02:51:40.839776 2382 raft_consensus.cc:515] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.840437 2382 leader_election.cc:290] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:40.841465 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a6f4b34ff14714892ed9e9b3604dc9" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:40.842037 997 leader_election.cc:343] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.842540 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 4a60e189801440bca43f35fe787d3aa7
I20260318 02:51:40.842576 762 tablet_service.cc:1558] Processing DeleteTablet for tablet f5ce7b986536414099b53f61033a960d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:40.842718 999 leader_election.cc:343] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: a0a6f4b34ff14714892ed9e9b3604dc9
I20260318 02:51:40.842814 999 leader_election.cc:304] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:40.843051 453 catalog_manager.cc:6741] ReplaceTablet: tablet 4a60e189801440bca43f35fe787d3aa7 deleted and replaced by tablet 2c35a8af5d92445a851c8847f75476f9
I20260318 02:51:40.843190 2382 raft_consensus.cc:2749] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:40.842269 1176 tablet_replica.cc:333] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:40.843657 1176 raft_consensus.cc:2243] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:40.843686 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 987) took 2526 ms. Trace:
I20260318 02:51:40.843752 1184 rpcz_store.cc:276] 0318 02:51:38.317315 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.317366 (+ 51us) service_pool.cc:225] Handling call
0318 02:51:40.794019 (+2476653us) ts_tablet_manager.cc:1151] Deleting tablet 813702e53eee4a54a7d693fd6e03bbbb
0318 02:51:40.794031 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:40.809304 (+ 15273us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:40.827610 (+ 18306us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:40.843671 (+ 16061us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2476433}
I20260318 02:51:40.844372 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet b317cc133346412fb981b1c8e5b99c4d (table default.Table_39aee165029f47559776d7610e509b6a [id=dbaa2341227b48d19ec73a413513358a]) successfully deleted
I20260318 02:51:40.844823 1184 tablet_replica.cc:333] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:40.845021 1184 raft_consensus.cc:2243] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:40.845178 1184 raft_consensus.cc:2272] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:40.845861 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a60e189801440bca43f35fe787d3aa7 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c35a8af5d92445a851c8847f75476f9) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.845724 1184 ts_tablet_manager.cc:1916] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:40.846943 1176 raft_consensus.cc:2272] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:40.847554 1176 ts_tablet_manager.cc:1916] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:40.848852 889 tablet_service.cc:1558] Processing DeleteTablet for tablet f5ce7b986536414099b53f61033a960d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.850399 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet f5ce7b986536414099b53f61033a960d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.851325 1172 tablet_bootstrap.cc:492] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:40.851475 1172 ts_tablet_manager.cc:1403] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
I20260318 02:51:40.852234 1172 raft_consensus.cc:359] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.852416 1172 raft_consensus.cc:385] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.852466 1172 raft_consensus.cc:740] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.852674 1172 consensus_queue.cc:260] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.854408 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2f58164571244099848c2984bd08ef81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:40.855522 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f58164571244099848c2984bd08ef81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:40.857028 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4937857ea9b54e7b871ee48ccb2754aa consensus state has no leader
I20260318 02:51:40.859758 1175 ts_tablet_manager.cc:1929] T ed697b98352c4f65931c154b1f160991 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:40.870533 2382 raft_consensus.cc:493] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:40.870720 2382 raft_consensus.cc:515] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.871362 2382 leader_election.cc:290] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:40.871919 1172 ts_tablet_manager.cc:1434] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260318 02:51:40.872843 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8b5120633e4e0d8964f17d6d5f316d" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:40.873116 785 raft_consensus.cc:2468] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:40.873521 999 leader_election.cc:304] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:40.875037 1172 tablet_bootstrap.cc:492] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:40.881578 1174 tablet_bootstrap.cc:492] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:40.881788 1174 ts_tablet_manager.cc:1403] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.066s user 0.003s sys 0.000s
I20260318 02:51:40.882619 1174 raft_consensus.cc:359] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.882820 1174 raft_consensus.cc:385] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.882892 1174 raft_consensus.cc:740] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.883147 1174 consensus_queue.cc:260] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.883654 1174 ts_tablet_manager.cc:1434] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:40.885147 453 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 3348b200e5ca4f6ebecb2c25ddbe27bf (table default.Table_10d43fa780ea41f68847fc2ef753c3ef [id=a1ea27c3f8534259bceaa1300242640a]). Expected version 2 got 0
I20260318 02:51:40.900243 448 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 3348b200e5ca4f6ebecb2c25ddbe27bf (table default.Table_10d43fa780ea41f68847fc2ef753c3ef [id=a1ea27c3f8534259bceaa1300242640a]). Expected version 2 got 0
I20260318 02:51:40.900630 448 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet ca23d4d0d3734fceb14966a4f2ad9c35 (table default.Table_1960d955ce3f45458d16f7f892da82fc [id=61241ff920584692bba476799b6a60e7]). Expected version 3 got 0
I20260318 02:51:40.904803 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 78aba0a60d494da9ac3b8b4fd3d5dc68
I20260318 02:51:40.905958 1174 tablet_bootstrap.cc:492] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:40.907119 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 813702e53eee4a54a7d693fd6e03bbbb (table default.Table_1acdeb444a404cb0b89ac6450e835639 [id=9278db75ac0f4aa59c4af2f13a58e314]) successfully deleted
I20260318 02:51:40.908339 1174 tablet_bootstrap.cc:654] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.908895 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 78aba0a60d494da9ac3b8b4fd3d5dc68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.909900 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1f0223a1a57a4f84850ba99f63de7e9f" } modify_external_catalogs: true
I20260318 02:51:40.910110 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1f0223a1a57a4f84850ba99f63de7e9f" } modify_external_catalogs: true
I20260318 02:51:40.910974 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3446374754d742b3b14fd6e6ee092923"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:40.911234 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ce996d68b1144b3aa44ab9618af7d43e" } modify_external_catalogs: true
I20260318 02:51:40.911454 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ce996d68b1144b3aa44ab9618af7d43e" } modify_external_catalogs: true
W20260318 02:51:40.911573 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3446374754d742b3b14fd6e6ee092923 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:40.912045 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3c6ca00ede95432386694a36856a4e6d" } new_table_name: "default.Table_33682c1fb3284897980e07d95f302cad" modify_external_catalogs: true
I20260318 02:51:40.912796 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_57dde8299a394890acd2aeff8a69cdc0" } new_table_name: "default.Table_c374014a6e6e410ba8bc055bdeec7788" modify_external_catalogs: true
I20260318 02:51:40.876088 2382 raft_consensus.cc:2804] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:40.914078 2382 raft_consensus.cc:493] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:40.914186 2382 raft_consensus.cc:3060] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:40.906584 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a60e189801440bca43f35fe787d3aa7 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c35a8af5d92445a851c8847f75476f9) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.908178 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet f72023f5408f4ef4b628568da0c008d6 with delete_type TABLET_DATA_DELETED (replaced by tablet bf54f8603e514f1cad3f53ff1427cabe) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.908783 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 78aba0a60d494da9ac3b8b4fd3d5dc68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:40.918331 2382 raft_consensus.cc:515] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.918941 2382 leader_election.cc:290] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:40.920012 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8b5120633e4e0d8964f17d6d5f316d" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:40.920209 785 raft_consensus.cc:3060] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:40.922794 785 raft_consensus.cc:2468] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:40.923257 999 leader_election.cc:304] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:40.923741 2382 raft_consensus.cc:2804] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:40.924006 2382 raft_consensus.cc:697] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:40.924741 2382 consensus_queue.cc:237] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.928047 1174 tablet_bootstrap.cc:492] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:40.930061 1172 tablet_bootstrap.cc:654] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.930545 1174 ts_tablet_manager.cc:1403] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
W20260318 02:51:40.930862 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c1b33758e7e546abba5b02c79db6c1d2 consensus state has no leader
W20260318 02:51:40.931380 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fa077243d5634d888f3a191b7f9d2d19 consensus state has no leader
I20260318 02:51:40.934152 1174 raft_consensus.cc:359] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.872200 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8b5120633e4e0d8964f17d6d5f316d" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:40.875155 2443 tablet.cc:1723] T 3348b200e5ca4f6ebecb2c25ddbe27bf P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:40.906005 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a60e189801440bca43f35fe787d3aa7 with delete_type TABLET_DATA_DELETED (replaced by tablet 2c35a8af5d92445a851c8847f75476f9) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.908521 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 78aba0a60d494da9ac3b8b4fd3d5dc68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.917730 2362 raft_consensus.cc:493] T ca23d4d0d3734fceb14966a4f2ad9c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:40.937093 1175 log.cc:1199] T ed697b98352c4f65931c154b1f160991 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/ed697b98352c4f65931c154b1f160991
I20260318 02:51:40.937021 2362 raft_consensus.cc:515] T ca23d4d0d3734fceb14966a4f2ad9c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.937434 1175 ts_tablet_manager.cc:1950] T ed697b98352c4f65931c154b1f160991 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:40.937736 2362 leader_election.cc:290] T ca23d4d0d3734fceb14966a4f2ad9c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:40.937955 1175 tablet_replica.cc:333] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:40.938127 1175 raft_consensus.cc:2243] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:40.938408 1175 raft_consensus.cc:2272] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:40.939251 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca23d4d0d3734fceb14966a4f2ad9c35" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:40.940800 1174 raft_consensus.cc:385] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.925941 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f8b5120633e4e0d8964f17d6d5f316d" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:40.941028 1174 raft_consensus.cc:740] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.942463 1174 consensus_queue.cc:260] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.947309 1173 tablet_bootstrap.cc:492] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:40.947618 1173 ts_tablet_manager.cc:1403] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.125s user 0.005s sys 0.000s
I20260318 02:51:40.948443 1173 raft_consensus.cc:359] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.948617 1173 raft_consensus.cc:385] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:40.948659 1173 raft_consensus.cc:740] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:40.948901 1173 consensus_queue.cc:260] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:40.949178 450 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 7e6f40a5d3f14a779c26d73bf58f302b (table default.Table_629d056f6284466ea2f3fef7bc274074 [id=05445eb067cb46a5803415774772c91e]). Expected version 1 got 0
I20260318 02:51:40.949491 1173 ts_tablet_manager.cc:1434] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:40.952188 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c152ad8f81b94f778ef9ff94c5f0ddfd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:40.952795 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c152ad8f81b94f778ef9ff94c5f0ddfd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:40.954433 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_38436e11a4b24cfc9f350d474dc9cb5c" } new_table_name: "default.Table_a5e3cd25c6a24afc817c7d65bf1f8478" modify_external_catalogs: true
I20260318 02:51:40.954767 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c732fb4a2d2f4001b7869a76cc1bd987"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:40.955291 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c732fb4a2d2f4001b7869a76cc1bd987 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:40.955915 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet ed697b98352c4f65931c154b1f160991 (table default.Table_e8949513489d44e0a36b239de4fbed56 [id=412636f9a1d04551b9872e99570ba8fb]) successfully deleted
W20260318 02:51:40.956234 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 5433e0aebdd34666a655c21a77fe2654 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5433e0aebdd34666a655c21a77fe2654 already in progress: creating tablet
I20260318 02:51:40.957787 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 373a94164167431c87025ce82c9b88d9
I20260318 02:51:40.960554 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 373a94164167431c87025ce82c9b88d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.960804 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bb381f10d87414f9c1a99942216adc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.961418 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 373a94164167431c87025ce82c9b88d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.962458 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 916f7a2a31f843e39f8703ba72b78287
I20260318 02:51:40.963390 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 916f7a2a31f843e39f8703ba72b78287 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.963948 1174 ts_tablet_manager.cc:1434] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.033s user 0.002s sys 0.000s
I20260318 02:51:40.964182 1176 ts_tablet_manager.cc:1929] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:40.964504 1176 log.cc:1199] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/85e6ad2a9817444caecb78eabde5d222
I20260318 02:51:40.964923 1176 ts_tablet_manager.cc:1950] T 85e6ad2a9817444caecb78eabde5d222 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:40.965977 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 85e6ad2a9817444caecb78eabde5d222 (table default.Table_c23e7504b2474f1686592467b684da52 [id=96801ef3b02b4ab6b22d34157d05bb49]) successfully deleted
I20260318 02:51:40.966346 1176 tablet_replica.cc:333] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:40.966631 1176 raft_consensus.cc:2243] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:40.966846 1176 raft_consensus.cc:2272] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:40.967420 1176 ts_tablet_manager.cc:1916] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:40.969158 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 916f7a2a31f843e39f8703ba72b78287 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.969331 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 6a65ccfd73234e8fb2bea5b6911cb3f1
W20260318 02:51:40.970189 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 23e82f24405b465fa26074a4370ed3d3 consensus state has no leader
I20260318 02:51:40.970548 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.970755 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:40.976980 2431 raft_consensus.cc:493] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:40.977146 2431 raft_consensus.cc:515] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:40.977716 2431 leader_election.cc:290] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:40.978729 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f21df58fac437da5747becfa3f28b4" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:40.978762 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f21df58fac437da5747becfa3f28b4" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:40.978873 1175 ts_tablet_manager.cc:1916] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:40.979393 719 leader_election.cc:343] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.979646 448 master_service.cc:954] ReplaceTablet: received request to replace tablet f72023f5408f4ef4b628568da0c008d6 from {username='slave'} at 127.0.0.1:47158
W20260318 02:51:40.979992 719 leader_election.cc:343] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:40.980091 719 leader_election.cc:304] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:40.980162 889 tablet_service.cc:1511] Processing CreateTablet for tablet 3332a507699349c2874b4ea205740a8e (DEFAULT_TABLE table=default.Table_5e4db74f50fe44f5b01ea2ffbe1388b9 [id=efd29ee1c834413fbd75fafd9e6d7355]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.980978 762 tablet_service.cc:1511] Processing CreateTablet for tablet 3332a507699349c2874b4ea205740a8e (DEFAULT_TABLE table=default.Table_5e4db74f50fe44f5b01ea2ffbe1388b9 [id=efd29ee1c834413fbd75fafd9e6d7355]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.981391 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3332a507699349c2874b4ea205740a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.982581 904 tablet_service.cc:1511] Processing CreateTablet for tablet ff06698ddc554c1aa65c3cadb0bb7263 (DEFAULT_TABLE table=default.Table_8b73a29ea2714bc787b97dcded68671f [id=b5409ba1f5964703806b58756968f5a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.983790 1173 tablet_bootstrap.cc:492] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:40.985133 1173 tablet_bootstrap.cc:654] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:40.985858 907 tablet_service.cc:1511] Processing CreateTablet for tablet d8205812fef14c7b832d30624911c2aa (DEFAULT_TABLE table=default.Table_77afda1bd8aa46e0b03b1dc203059f1e [id=e0d9d27b8dc54aa8a3705f6d8c654080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.986192 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8205812fef14c7b832d30624911c2aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.989514 752 tablet_service.cc:1511] Processing CreateTablet for tablet ff06698ddc554c1aa65c3cadb0bb7263 (DEFAULT_TABLE table=default.Table_8b73a29ea2714bc787b97dcded68671f [id=b5409ba1f5964703806b58756968f5a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.989913 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff06698ddc554c1aa65c3cadb0bb7263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.992821 891 tablet_service.cc:1558] Processing DeleteTablet for tablet 305cc777ed0c46e497c80f15b8e6ead1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:40.994386 751 tablet_service.cc:1511] Processing CreateTablet for tablet 364c783482924f6c998748c6147545d6 (DEFAULT_TABLE table=default.Table_a0be43b415d14f67935a3dfa9cc3837f [id=002388913dc34042864aed3cedd77adc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.994745 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 364c783482924f6c998748c6147545d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:40.997083 2431 raft_consensus.cc:2749] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:40.997591 891 tablet_service.cc:1511] Processing CreateTablet for tablet 364c783482924f6c998748c6147545d6 (DEFAULT_TABLE table=default.Table_a0be43b415d14f67935a3dfa9cc3837f [id=002388913dc34042864aed3cedd77adc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.998123 902 tablet_service.cc:1511] Processing CreateTablet for tablet 15cae82c808a435e86f8c514e415d546 (DEFAULT_TABLE table=default.Table_f141890f83124edb914868a35fc73df2 [id=58b8369a23414b1f9dd77cd73be50714]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.998584 888 tablet_service.cc:1511] Processing CreateTablet for tablet abd3755caea546348c4214fa7481f2bb (DEFAULT_TABLE table=default.Table_0b58fa8e85f44c4289e5865488fa93ce [id=338b03434ddf4b0ba95e404ceb1a8ae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.998994 894 tablet_service.cc:1511] Processing CreateTablet for tablet 02b7260e386e4802aa380757ab8e1d39 (DEFAULT_TABLE table=default.Table_de29ee8839bf4e3482ba6201e0125eea [id=7295c33ecac247878d8a9cf99046f32c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.999428 897 tablet_service.cc:1511] Processing CreateTablet for tablet 66f2eb49809945b3ae9d083a4fe56245 (DEFAULT_TABLE table=default.Table_2cfd06c2ef384e81a1cbde18678a8737 [id=647e1ea04de74aa3a912bc93fc81c90f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:40.997602 899 tablet_service.cc:1511] Processing CreateTablet for tablet f5d268a4ecbd40208957b5053cd34e4f (DEFAULT_TABLE table=default.Table_fdd4c8fb57774e488f0d45084debbb5a [id=5239acce5c2645ea98a04fa29df94f96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.000087 906 tablet_service.cc:1511] Processing CreateTablet for tablet 61196fc8d2e04cf8ad5d0d732b3484b7 (DEFAULT_TABLE table=default.Table_d550bf15de2b4cc5a3bf45213eb07236 [id=f74c720f0ab342a6b9d983d1dc49483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.000523 903 tablet_service.cc:1511] Processing CreateTablet for tablet 3b25d9f870a64b77a9c18ecef9814b5e (DEFAULT_TABLE table=default.Table_a1de822992eb44f497fb6b3b961b538a [id=8b9483b4c1e04519b6a7d9a4a70bc279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.003847 2296 raft_consensus.cc:493] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:41.004004 2296 raft_consensus.cc:515] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.004570 2296 leader_election.cc:290] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:41.005498 898 tablet_service.cc:1511] Processing CreateTablet for tablet ffa9d9dcc70e402099b414029f062d6e (DEFAULT_TABLE table=default.Table_614e1c29256e4ddbb9a5dfb12f4a27f2 [id=c868efae5833440b90596b5de5d7b800]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.005645 1172 tablet_bootstrap.cc:492] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:41.005772 1172 ts_tablet_manager.cc:1403] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.131s user 0.003s sys 0.000s
I20260318 02:51:41.005939 901 tablet_service.cc:1511] Processing CreateTablet for tablet 773bb5f643244686917f3c2f0ca961c5 (DEFAULT_TABLE table=default.Table_264cd755c1b7411bb23285ef3b3cb663 [id=d836fbeb4fa546babc311e4aa0b3d521]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.006753 1172 raft_consensus.cc:359] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.006924 1172 raft_consensus.cc:385] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:41.006976 1172 raft_consensus.cc:740] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:41.007192 1172 consensus_queue.cc:260] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.007687 1172 ts_tablet_manager.cc:1434] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:41.008566 895 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc55cdfbf684a4f90c3e359c92d9371 (DEFAULT_TABLE table=default.Table_32e6a83a70cc4160b123fe8a5df81812 [id=57e11e25bf3b4f7d8ec06acc23119c36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.010246 1172 tablet_bootstrap.cc:492] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:41.011866 1172 tablet_bootstrap.cc:654] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:41.016398 892 tablet_service.cc:1511] Processing CreateTablet for tablet 88a87022b1c44d1291dd2af1124ea850 (DEFAULT_TABLE table=default.Table_ca45a42e395240b2b2cd83f10d5b99aa [id=6d2ebbab78ae43adb9a5b9c9a1c656a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.017987 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_efd6b115c80b4129b5a781aba46d4d7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.018579 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_efd6b115c80b4129b5a781aba46d4d7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.018668 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa9d9dcc70e402099b414029f062d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.018869 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a87022b1c44d1291dd2af1124ea850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.019577 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61196fc8d2e04cf8ad5d0d732b3484b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.019925 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d268a4ecbd40208957b5053cd34e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.024685 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff06698ddc554c1aa65c3cadb0bb7263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.025358 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b7260e386e4802aa380757ab8e1d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.028951 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66f2eb49809945b3ae9d083a4fe56245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.030290 1175 ts_tablet_manager.cc:1929] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:41.030640 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3332a507699349c2874b4ea205740a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.030799 1175 log.cc:1199] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/b9e0c54b3f1b44e4bea7253473714e94
I20260318 02:51:41.030993 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7d8be37120444625a37452a9660aaa43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:41.031311 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc55cdfbf684a4f90c3e359c92d9371. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:41.032228 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d8be37120444625a37452a9660aaa43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.032508 1175 ts_tablet_manager.cc:1950] T b9e0c54b3f1b44e4bea7253473714e94 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:41.032732 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8a2e4f4c8bef459ab9c867dfd768d373"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:41.032881 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15cae82c808a435e86f8c514e415d546. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:41.033356 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a2e4f4c8bef459ab9c867dfd768d373 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.034224 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_69553ca89bbd4df08e60a4ba2ea6840c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.034710 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69553ca89bbd4df08e60a4ba2ea6840c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.034756 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5d0dbc23192742adaa65c0aa5f9da382"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.035210 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d0dbc23192742adaa65c0aa5f9da382 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.036368 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 773bb5f643244686917f3c2f0ca961c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.036314 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1f9399c6144e4eeab22c7c2219f29c03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.036805 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f9399c6144e4eeab22c7c2219f29c03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.038256 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet b9e0c54b3f1b44e4bea7253473714e94 (table default.Table_4a675721365c4600b0a6a7712c03db81 [id=96f382936c1d4b30a3c5e3a1b55b04d4]) successfully deleted
I20260318 02:51:41.039776 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd3755caea546348c4214fa7481f2bb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:41.041774 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2ebcf120100349319d27615b6e0c7550 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ebcf120100349319d27615b6e0c7550 already in progress: creating tablet
I20260318 02:51:41.044878 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b25d9f870a64b77a9c18ecef9814b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.050470 451 catalog_manager.cc:5671] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:41.050889 451 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 6f8b5120633e4e0d8964f17d6d5f316d (table default.Table_ba6394a91baa4e3889ba7a14f2287aab [id=779018c836a14c518c02a844331ce251]). Expected version 1 got 0
I20260318 02:51:41.052767 2362 raft_consensus.cc:493] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:41.052902 2362 raft_consensus.cc:515] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.053539 2362 leader_election.cc:290] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:41.054505 1172 tablet_bootstrap.cc:492] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:41.054677 1172 ts_tablet_manager.cc:1403] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.045s user 0.005s sys 0.000s
W20260318 02:51:41.054682 860 leader_election.cc:343] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 305cc777ed0c46e497c80f15b8e6ead1
I20260318 02:51:41.054795 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 364c783482924f6c998748c6147545d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.055461 1172 raft_consensus.cc:359] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:41.055795 1172 raft_consensus.cc:385] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:41.055868 1172 raft_consensus.cc:740] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:41.056080 1172 consensus_queue.cc:260] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:41.056653 1172 ts_tablet_manager.cc:1434] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:41.056937 1172 tablet_bootstrap.cc:492] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:41.054661 1173 tablet_bootstrap.cc:492] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:41.061605 1173 ts_tablet_manager.cc:1403] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.078s user 0.006s sys 0.000s
I20260318 02:51:41.062475 1173 raft_consensus.cc:359] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.062829 1172 tablet_bootstrap.cc:654] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:41.065910 1173 raft_consensus.cc:385] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:41.066047 1173 raft_consensus.cc:740] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:41.066323 1173 consensus_queue.cc:260] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:41.066429 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 20009aa96bf44ae88acfeef8e38bc204 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20009aa96bf44ae88acfeef8e38bc204 already in progress: creating tablet
W20260318 02:51:41.066653 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 9ca9bad2b9aa4a41bb7801da61cd0d16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ca9bad2b9aa4a41bb7801da61cd0d16 already in progress: creating tablet
I20260318 02:51:41.066653 753 tablet_service.cc:1511] Processing CreateTablet for tablet d8205812fef14c7b832d30624911c2aa (DEFAULT_TABLE table=default.Table_77afda1bd8aa46e0b03b1dc203059f1e [id=e0d9d27b8dc54aa8a3705f6d8c654080]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:41.067054 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet e993481bf55747b0a6a1c996c6917408 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e993481bf55747b0a6a1c996c6917408 already in progress: creating tablet
I20260318 02:51:41.067085 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8205812fef14c7b832d30624911c2aa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:41.067281 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 62af4992cca84830ab8317f734338365 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62af4992cca84830ab8317f734338365 already in progress: creating tablet
W20260318 02:51:41.067575 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f5ce7b986536414099b53f61033a960d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5ce7b986536414099b53f61033a960d already in progress: creating tablet
W20260318 02:51:41.067806 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 78aba0a60d494da9ac3b8b4fd3d5dc68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78aba0a60d494da9ac3b8b4fd3d5dc68 already in progress: creating tablet
W20260318 02:51:41.068122 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 4a60e189801440bca43f35fe787d3aa7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a60e189801440bca43f35fe787d3aa7 already in progress: creating tablet
W20260318 02:51:41.068349 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 373a94164167431c87025ce82c9b88d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 373a94164167431c87025ce82c9b88d9 already in progress: creating tablet
W20260318 02:51:41.068615 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 916f7a2a31f843e39f8703ba72b78287 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 916f7a2a31f843e39f8703ba72b78287 already in progress: creating tablet
I20260318 02:51:41.068744 1173 ts_tablet_manager.cc:1434] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260318 02:51:41.069046 1173 tablet_bootstrap.cc:492] T 7c4eca5e16f84564b31933b8227fd980 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:41.071484 1173 tablet_bootstrap.cc:654] T 7c4eca5e16f84564b31933b8227fd980 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:41.072176 754 tablet_service.cc:1511] Processing CreateTablet for tablet 61196fc8d2e04cf8ad5d0d732b3484b7 (DEFAULT_TABLE table=default.Table_d550bf15de2b4cc5a3bf45213eb07236 [id=f74c720f0ab342a6b9d983d1dc49483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.072554 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61196fc8d2e04cf8ad5d0d732b3484b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.072788 748 tablet_service.cc:1511] Processing CreateTablet for tablet abd3755caea546348c4214fa7481f2bb (DEFAULT_TABLE table=default.Table_0b58fa8e85f44c4289e5865488fa93ce [id=338b03434ddf4b0ba95e404ceb1a8ae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.073125 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd3755caea546348c4214fa7481f2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.075265 761 tablet_service.cc:1511] Processing CreateTablet for tablet 02b7260e386e4802aa380757ab8e1d39 (DEFAULT_TABLE table=default.Table_de29ee8839bf4e3482ba6201e0125eea [id=7295c33ecac247878d8a9cf99046f32c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.075584 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b7260e386e4802aa380757ab8e1d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.072566 755 tablet_service.cc:1511] Processing CreateTablet for tablet 15cae82c808a435e86f8c514e415d546 (DEFAULT_TABLE table=default.Table_f141890f83124edb914868a35fc73df2 [id=58b8369a23414b1f9dd77cd73be50714]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.076042 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15cae82c808a435e86f8c514e415d546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.078593 766 tablet_service.cc:1511] Processing CreateTablet for tablet 66f2eb49809945b3ae9d083a4fe56245 (DEFAULT_TABLE table=default.Table_2cfd06c2ef384e81a1cbde18678a8737 [id=647e1ea04de74aa3a912bc93fc81c90f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.078907 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66f2eb49809945b3ae9d083a4fe56245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.080977 759 tablet_service.cc:1511] Processing CreateTablet for tablet 3b25d9f870a64b77a9c18ecef9814b5e (DEFAULT_TABLE table=default.Table_a1de822992eb44f497fb6b3b961b538a [id=8b9483b4c1e04519b6a7d9a4a70bc279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.081322 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b25d9f870a64b77a9c18ecef9814b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.082239 757 tablet_service.cc:1511] Processing CreateTablet for tablet ffa9d9dcc70e402099b414029f062d6e (DEFAULT_TABLE table=default.Table_614e1c29256e4ddbb9a5dfb12f4a27f2 [id=c868efae5833440b90596b5de5d7b800]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.082561 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa9d9dcc70e402099b414029f062d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.083041 764 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc55cdfbf684a4f90c3e359c92d9371 (DEFAULT_TABLE table=default.Table_32e6a83a70cc4160b123fe8a5df81812 [id=57e11e25bf3b4f7d8ec06acc23119c36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.083339 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc55cdfbf684a4f90c3e359c92d9371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.083889 750 tablet_service.cc:1511] Processing CreateTablet for tablet 88a87022b1c44d1291dd2af1124ea850 (DEFAULT_TABLE table=default.Table_ca45a42e395240b2b2cd83f10d5b99aa [id=6d2ebbab78ae43adb9a5b9c9a1c656a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.084252 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a87022b1c44d1291dd2af1124ea850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.090198 2361 raft_consensus.cc:493] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:41.090346 2361 raft_consensus.cc:515] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.090953 2361 leader_election.cc:290] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:41.092069 860 leader_election.cc:343] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 9451d57fad72413c81443623c7995d4e
W20260318 02:51:41.093466 862 leader_election.cc:343] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 305cc777ed0c46e497c80f15b8e6ead1
I20260318 02:51:41.093566 862 leader_election.cc:304] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:41.093961 2362 raft_consensus.cc:2749] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:41.096518 752 tablet_service.cc:1511] Processing CreateTablet for tablet f5d268a4ecbd40208957b5053cd34e4f (DEFAULT_TABLE table=default.Table_fdd4c8fb57774e488f0d45084debbb5a [id=5239acce5c2645ea98a04fa29df94f96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.097005 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d268a4ecbd40208957b5053cd34e4f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:41.097062 862 leader_election.cc:343] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 9451d57fad72413c81443623c7995d4e
I20260318 02:51:41.097187 862 leader_election.cc:304] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:41.097555 2362 raft_consensus.cc:2749] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:41.101040 999 leader_election.cc:343] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 9aeb492564a94a569f70506712dad4ed
I20260318 02:51:41.105773 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 9451d57fad72413c81443623c7995d4e with delete_type TABLET_DATA_DELETED (replaced by tablet 535ff4839c9646a594db820dd5308d70) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:41.107920 1175 tablet_replica.cc:333] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:41.108141 1175 raft_consensus.cc:2243] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:41.108301 1175 raft_consensus.cc:2272] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:41.110782 1175 ts_tablet_manager.cc:1916] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:41.111315 1174 tablet_bootstrap.cc:492] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:41.113422 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 already in progress: creating tablet
I20260318 02:51:41.114002 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6799c18042274bc9a7f0a18d69756ecb" } modify_external_catalogs: true
I20260318 02:51:41.114121 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_233c7a1c8f824e23a0e1e965241fb7c8" } new_table_name: "default.Table_6a4db85b1193491689db525690926fd4" modify_external_catalogs: true
I20260318 02:51:41.114190 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6799c18042274bc9a7f0a18d69756ecb" } modify_external_catalogs: true
I20260318 02:51:41.114625 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0dcf05cd68b046b0a50ee043026b97fa" } new_table_name: "default.Table_3d223beddc944ff4aaafa2fe0e72c0a7" modify_external_catalogs: true
I20260318 02:51:40.933436 1184 ts_tablet_manager.cc:1929] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:41.115662 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c374014a6e6e410ba8bc055bdeec7788" } modify_external_catalogs: true
I20260318 02:51:40.938493 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca23d4d0d3734fceb14966a4f2ad9c35" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:40.939433 997 leader_election.cc:343] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:41.115792 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c374014a6e6e410ba8bc055bdeec7788" } modify_external_catalogs: true
W20260318 02:51:41.116003 997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 176585us
I20260318 02:51:41.116122 1184 log.cc:1199] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/bf344c2361b7412c87a7c7f9a72a15b6
I20260318 02:51:41.116480 1184 ts_tablet_manager.cc:1950] T bf344c2361b7412c87a7c7f9a72a15b6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:41.117401 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aeb492564a94a569f70506712dad4ed" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:41.117703 860 leader_election.cc:304] T ca23d4d0d3734fceb14966a4f2ad9c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:41.118151 2362 raft_consensus.cc:2749] T ca23d4d0d3734fceb14966a4f2ad9c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:41.126332 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7def4e9c164a4fc9b4578c660ec13b99 consensus state has no leader
W20260318 02:51:41.127024 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df499767dfee4fbd939d775db9d2577e consensus state has no leader
I20260318 02:51:41.128157 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 989) took 2809 ms. Trace:
I20260318 02:51:41.128259 1184 rpcz_store.cc:276] 0318 02:51:38.318712 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.318755 (+ 43us) service_pool.cc:225] Handling call
0318 02:51:40.844768 (+2526013us) ts_tablet_manager.cc:1151] Deleting tablet bf344c2361b7412c87a7c7f9a72a15b6
0318 02:51:40.844779 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:40.855673 (+ 10894us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:40.933305 (+ 77632us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:41.128133 (+194828us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2525849}
I20260318 02:51:41.128650 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 990) took 2727 ms. Trace:
I20260318 02:51:41.128749 1184 rpcz_store.cc:276] 0318 02:51:38.401684 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.401757 (+ 73us) service_pool.cc:225] Handling call
0318 02:51:41.128521 (+2726764us) ts_tablet_manager.cc:1151] Deleting tablet 3d28aa6525184246a71ad198cf1df763
0318 02:51:41.128533 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:41.128634 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2726531}
I20260318 02:51:41.129074 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 991) took 2727 ms. Trace:
I20260318 02:51:41.129141 1184 rpcz_store.cc:276] 0318 02:51:38.401808 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.402611 (+ 803us) service_pool.cc:225] Handling call
0318 02:51:41.128969 (+2726358us) ts_tablet_manager.cc:1151] Deleting tablet 9d9cc0f3aef0401c8f072b11d9498a59
0318 02:51:41.128978 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:41.129058 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2726141}
I20260318 02:51:41.129374 1184 tablet_replica.cc:333] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:41.129544 1184 raft_consensus.cc:2243] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:41.129678 1184 raft_consensus.cc:2272] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:41.130175 1184 ts_tablet_manager.cc:1916] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:41.130183 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 373a94164167431c87025ce82c9b88d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:41.130543 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 916f7a2a31f843e39f8703ba72b78287 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:41.131214 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:41.131857 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 3332a507699349c2874b4ea205740a8e (DEFAULT_TABLE table=default.Table_5e4db74f50fe44f5b01ea2ffbe1388b9 [id=efd29ee1c834413fbd75fafd9e6d7355]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.132371 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3332a507699349c2874b4ea205740a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.134061 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet c1b33758e7e546abba5b02c79db6c1d2
I20260318 02:51:41.139513 888 tablet_service.cc:1558] Processing DeleteTablet for tablet c1b33758e7e546abba5b02c79db6c1d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:41.140512 1038 tablet_service.cc:1511] Processing CreateTablet for tablet ff06698ddc554c1aa65c3cadb0bb7263 (DEFAULT_TABLE table=default.Table_8b73a29ea2714bc787b97dcded68671f [id=b5409ba1f5964703806b58756968f5a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.140573 1040 tablet_service.cc:1511] Processing CreateTablet for tablet d8205812fef14c7b832d30624911c2aa (DEFAULT_TABLE table=default.Table_77afda1bd8aa46e0b03b1dc203059f1e [id=e0d9d27b8dc54aa8a3705f6d8c654080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.141044 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff06698ddc554c1aa65c3cadb0bb7263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.141297 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8205812fef14c7b832d30624911c2aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.151412 1035 tablet_service.cc:1511] Processing CreateTablet for tablet f5d268a4ecbd40208957b5053cd34e4f (DEFAULT_TABLE table=default.Table_fdd4c8fb57774e488f0d45084debbb5a [id=5239acce5c2645ea98a04fa29df94f96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.151635 1043 tablet_service.cc:1511] Processing CreateTablet for tablet 66f2eb49809945b3ae9d083a4fe56245 (DEFAULT_TABLE table=default.Table_2cfd06c2ef384e81a1cbde18678a8737 [id=647e1ea04de74aa3a912bc93fc81c90f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.151829 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d268a4ecbd40208957b5053cd34e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.151984 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66f2eb49809945b3ae9d083a4fe56245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.153709 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 15cae82c808a435e86f8c514e415d546 (DEFAULT_TABLE table=default.Table_f141890f83124edb914868a35fc73df2 [id=58b8369a23414b1f9dd77cd73be50714]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.154049 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15cae82c808a435e86f8c514e415d546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.154968 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 02b7260e386e4802aa380757ab8e1d39 (DEFAULT_TABLE table=default.Table_de29ee8839bf4e3482ba6201e0125eea [id=7295c33ecac247878d8a9cf99046f32c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.155296 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b7260e386e4802aa380757ab8e1d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.157295 1184 ts_tablet_manager.cc:1929] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:41.157506 1184 log.cc:1199] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/ba3e7e9a85c94d7380b96a9373c1f503
I20260318 02:51:41.157840 1184 ts_tablet_manager.cc:1950] T ba3e7e9a85c94d7380b96a9373c1f503 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:41.158636 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 992) took 2661 ms. Trace:
I20260318 02:51:41.158771 1184 rpcz_store.cc:276] 0318 02:51:38.496947 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.497005 (+ 58us) service_pool.cc:225] Handling call
0318 02:51:41.129319 (+2632314us) ts_tablet_manager.cc:1151] Deleting tablet ba3e7e9a85c94d7380b96a9373c1f503
0318 02:51:41.129338 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:41.138912 (+ 9574us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:41.157205 (+ 18293us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:41.158616 (+ 1411us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2632085}
I20260318 02:51:41.159159 1184 tablet_replica.cc:333] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:41.159286 1042 tablet_service.cc:1511] Processing CreateTablet for tablet abd3755caea546348c4214fa7481f2bb (DEFAULT_TABLE table=default.Table_0b58fa8e85f44c4289e5865488fa93ce [id=338b03434ddf4b0ba95e404ceb1a8ae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.159390 1184 raft_consensus.cc:2243] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:41.159607 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd3755caea546348c4214fa7481f2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.159981 1184 raft_consensus.cc:2272] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:41.160339 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_46a2caeb0a8f424b85290dc1e56f8e15" } new_table_name: "default.Table_9d288316a7cc4b47b83ff8daa9ff9cb3" modify_external_catalogs: true
I20260318 02:51:41.160387 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_79bedc3624ae427a82d835cb058fa32a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:41.160843 1184 ts_tablet_manager.cc:1916] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:41.161051 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79bedc3624ae427a82d835cb058fa32a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.162340 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_596fb74e991f4ef8b81844cdf7522ea4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:41.162827 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c94a38b528114f8bb0e4f599698906f2" } modify_external_catalogs: true
I20260318 02:51:41.162982 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c94a38b528114f8bb0e4f599698906f2" } modify_external_catalogs: true
W20260318 02:51:41.162824 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_596fb74e991f4ef8b81844cdf7522ea4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.164340 751 tablet_service.cc:1558] Processing DeleteTablet for tablet c1b33758e7e546abba5b02c79db6c1d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:41.164815 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 364c783482924f6c998748c6147545d6 (DEFAULT_TABLE table=default.Table_a0be43b415d14f67935a3dfa9cc3837f [id=002388913dc34042864aed3cedd77adc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.165170 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 364c783482924f6c998748c6147545d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.167678 1173 tablet_bootstrap.cc:492] T 7c4eca5e16f84564b31933b8227fd980 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:41.167898 1173 ts_tablet_manager.cc:1403] T 7c4eca5e16f84564b31933b8227fd980 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.099s user 0.004s sys 0.000s
I20260318 02:51:41.168751 1173 raft_consensus.cc:359] T 7c4eca5e16f84564b31933b8227fd980 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.169036 1173 raft_consensus.cc:385] T 7c4eca5e16f84564b31933b8227fd980 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:41.169142 1173 raft_consensus.cc:740] T 7c4eca5e16f84564b31933b8227fd980 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:41.169467 1173 consensus_queue.cc:260] T 7c4eca5e16f84564b31933b8227fd980 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.171092 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c466f3337bd64897b0087a42bec37a0c" } modify_external_catalogs: true
I20260318 02:51:41.171223 974 heartbeater.cc:344] Connected to a master server at 127.0.104.189:45933
I20260318 02:51:41.171275 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c466f3337bd64897b0087a42bec37a0c" } modify_external_catalogs: true
I20260318 02:51:41.171849 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c1ed86ac29324832b5dc6a87189354ee" } modify_external_catalogs: true
I20260318 02:51:41.171988 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c1ed86ac29324832b5dc6a87189354ee" } modify_external_catalogs: true
I20260318 02:51:41.178916 1173 ts_tablet_manager.cc:1434] T 7c4eca5e16f84564b31933b8227fd980 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.011s user 0.000s sys 0.001s
I20260318 02:51:41.179365 457 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 7c4eca5e16f84564b31933b8227fd980 (table default.Table_4da517198db54744b96210b1f4438731 [id=541170c7c4bf49deb86cd4c15ffdd04f]). Expected version 1 got 0
I20260318 02:51:41.182629 897 tablet_service.cc:1511] Processing CreateTablet for tablet f5f53ee0015740a5a32a858e798c592e (DEFAULT_TABLE table=default.Table_402673bdfb764fe681dfe66dc2c1ba48 [id=02e0855be45f47428ab98726ad0a630a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.182818 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0017672117da4353a653457b466315b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:41.183032 888 tablet_service.cc:1511] Processing CreateTablet for tablet 75c4ba372960496880405e5dffe11d60 (DEFAULT_TABLE table=default.Table_2f58164571244099848c2984bd08ef81 [id=8d282a0ea34f484f9b8f29cc45bb7dea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.183255 907 tablet_service.cc:1511] Processing CreateTablet for tablet c8d9662f2f3949b7b4fb7f5a14d06126 (DEFAULT_TABLE table=default.Table_78768f3f016b4f7985a6b386b016bd62 [id=b66b9b81bcfc4d339d1f71d380ee3e72]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:41.183347 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0017672117da4353a653457b466315b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.183591 899 tablet_service.cc:1511] Processing CreateTablet for tablet 7a534e0050514e2b8f0a06d73f4dc1ea (DEFAULT_TABLE table=default.Table_56beb1ca03424d678071acc86399a892 [id=f5d9be5991c7426aa1fb07d0587dd7ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.184026 903 tablet_service.cc:1511] Processing CreateTablet for tablet b8477c484db84187a3a576de6195a228 (DEFAULT_TABLE table=default.Table_c732fb4a2d2f4001b7869a76cc1bd987 [id=624501b257f345dc9dbcfb4de04cf1a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.184033 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a5a4509fc8ed42eb81760cb6bb9a7cc8" } new_table_name: "default.Table_4a368894951942b7be9928e9781a7378" modify_external_catalogs: true
I20260318 02:51:41.183041 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f53ee0015740a5a32a858e798c592e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.185693 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8d9662f2f3949b7b4fb7f5a14d06126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.185909 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8477c484db84187a3a576de6195a228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.186537 891 tablet_service.cc:1511] Processing CreateTablet for tablet 3feb3a76a7b947f5a35baae379e8754d (DEFAULT_TABLE table=default.Table_5ff5f71a1bec45fdb637b5846419efdb [id=3bf7ead32d3c43218f9bb65ed5347874]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.186867 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3feb3a76a7b947f5a35baae379e8754d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.187958 756 tablet_service.cc:1511] Processing CreateTablet for tablet 773bb5f643244686917f3c2f0ca961c5 (DEFAULT_TABLE table=default.Table_264cd755c1b7411bb23285ef3b3cb663 [id=d836fbeb4fa546babc311e4aa0b3d521]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.188340 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 773bb5f643244686917f3c2f0ca961c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.188985 894 tablet_service.cc:1511] Processing CreateTablet for tablet 2c35a8af5d92445a851c8847f75476f9 (DEFAULT_TABLE table=default.Table_4c1ff8f187b34eb59f2b189fbf314142 [id=01148f7db8934decb958485d618c88a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.189267 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c35a8af5d92445a851c8847f75476f9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:41.190523 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ccff619ef27f48a59d5dd683fe5d09db consensus state has no leader
I20260318 02:51:41.190862 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9d108b010bbd4cc69eed488a5356a87e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.191352 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d108b010bbd4cc69eed488a5356a87e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.193023 906 tablet_service.cc:1511] Processing CreateTablet for tablet 25d140f7821648e0a8d412dd400938d9 (DEFAULT_TABLE table=default.Table_c152ad8f81b94f778ef9ff94c5f0ddfd [id=ca32e48096de480abe0205aba31a8212]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.193440 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d140f7821648e0a8d412dd400938d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.198576 1032 tablet_service.cc:1511] Processing CreateTablet for tablet 773bb5f643244686917f3c2f0ca961c5 (DEFAULT_TABLE table=default.Table_264cd755c1b7411bb23285ef3b3cb663 [id=d836fbeb4fa546babc311e4aa0b3d521]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.198975 1032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 773bb5f643244686917f3c2f0ca961c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.199296 1033 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc55cdfbf684a4f90c3e359c92d9371 (DEFAULT_TABLE table=default.Table_32e6a83a70cc4160b123fe8a5df81812 [id=57e11e25bf3b4f7d8ec06acc23119c36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.199609 1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc55cdfbf684a4f90c3e359c92d9371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.200763 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 3b25d9f870a64b77a9c18ecef9814b5e (DEFAULT_TABLE table=default.Table_a1de822992eb44f497fb6b3b961b538a [id=8b9483b4c1e04519b6a7d9a4a70bc279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.201125 1043 tablet_service.cc:1511] Processing CreateTablet for tablet ffa9d9dcc70e402099b414029f062d6e (DEFAULT_TABLE table=default.Table_614e1c29256e4ddbb9a5dfb12f4a27f2 [id=c868efae5833440b90596b5de5d7b800]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.202787 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a534e0050514e2b8f0a06d73f4dc1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.203426 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c4ba372960496880405e5dffe11d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.210085 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ef70b74b7ca84cd5be4468de1ff4eac4" } new_table_name: "default.Table_6cec27214c2d4ab1bf225a47b1a0a445" modify_external_catalogs: true
I20260318 02:51:41.215759 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet c93e05eb5c9e4d5da1b688a03312ad8e
I20260318 02:51:41.216933 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 793a87e8bcb442c1b6fb0ecfcbc71480
I20260318 02:51:41.217674 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet cce09767819441e599e7a62526d2cb75
I20260318 02:51:41.218874 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 5f63108c062348b1ba995ea16f40a695
W20260318 02:51:41.219900 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 54ba25c5ad3747bf9845245e29561dc9 consensus state has no leader
I20260318 02:51:41.222368 751 tablet_service.cc:1511] Processing CreateTablet for tablet f5f53ee0015740a5a32a858e798c592e (DEFAULT_TABLE table=default.Table_402673bdfb764fe681dfe66dc2c1ba48 [id=02e0855be45f47428ab98726ad0a630a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.222793 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f53ee0015740a5a32a858e798c592e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.222565 766 tablet_service.cc:1511] Processing CreateTablet for tablet 7a534e0050514e2b8f0a06d73f4dc1ea (DEFAULT_TABLE table=default.Table_56beb1ca03424d678071acc86399a892 [id=f5d9be5991c7426aa1fb07d0587dd7ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.223124 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a534e0050514e2b8f0a06d73f4dc1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.223654 1026 tablet_service.cc:1558] Processing DeleteTablet for tablet c1b33758e7e546abba5b02c79db6c1d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:41.223838 1028 tablet_service.cc:1511] Processing CreateTablet for tablet 88a87022b1c44d1291dd2af1124ea850 (DEFAULT_TABLE table=default.Table_ca45a42e395240b2b2cd83f10d5b99aa [id=6d2ebbab78ae43adb9a5b9c9a1c656a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.222368 761 tablet_service.cc:1511] Processing CreateTablet for tablet c8d9662f2f3949b7b4fb7f5a14d06126 (DEFAULT_TABLE table=default.Table_78768f3f016b4f7985a6b386b016bd62 [id=b66b9b81bcfc4d339d1f71d380ee3e72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.224499 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8d9662f2f3949b7b4fb7f5a14d06126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.224974 748 tablet_service.cc:1511] Processing CreateTablet for tablet 75c4ba372960496880405e5dffe11d60 (DEFAULT_TABLE table=default.Table_2f58164571244099848c2984bd08ef81 [id=8d282a0ea34f484f9b8f29cc45bb7dea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.225333 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c4ba372960496880405e5dffe11d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.227362 902 tablet_service.cc:1558] Processing DeleteTablet for tablet cce09767819441e599e7a62526d2cb75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:41.227663 904 tablet_service.cc:1511] Processing CreateTablet for tablet f96013c844414fd28c35724a6160ee81 (DEFAULT_TABLE table=default.Table_ef3fc2e773ac4783a799b73a979a0bcb [id=fca7537907a64f0f856fb77b6b863d49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.228080 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96013c844414fd28c35724a6160ee81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.231231 901 tablet_service.cc:1511] Processing CreateTablet for tablet df9d5919242a41aa8e119570f75b7c24 (DEFAULT_TABLE table=default.Table_3446374754d742b3b14fd6e6ee092923 [id=ebdc5d4f5bd8480c8d0399b94497d350]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.231665 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df9d5919242a41aa8e119570f75b7c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.232934 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f63108c062348b1ba995ea16f40a695 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:41.233197 889 tablet_service.cc:1558] Processing DeleteTablet for tablet 793a87e8bcb442c1b6fb0ecfcbc71480 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:41.233364 898 tablet_service.cc:1558] Processing DeleteTablet for tablet c93e05eb5c9e4d5da1b688a03312ad8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:41.233703 895 tablet_service.cc:1511] Processing CreateTablet for tablet 6f15a63d18f14061b8e5ec8f6306f79b (DEFAULT_TABLE table=default.Table_6e299f3484ca428cbccc8ea294a0ea69 [id=4155be67977b4b9cb7733f243f3a67a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.234069 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f15a63d18f14061b8e5ec8f6306f79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.238003 755 tablet_service.cc:1511] Processing CreateTablet for tablet 25d140f7821648e0a8d412dd400938d9 (DEFAULT_TABLE table=default.Table_c152ad8f81b94f778ef9ff94c5f0ddfd [id=ca32e48096de480abe0205aba31a8212]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.238446 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d140f7821648e0a8d412dd400938d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.239046 752 tablet_service.cc:1511] Processing CreateTablet for tablet 3feb3a76a7b947f5a35baae379e8754d (DEFAULT_TABLE table=default.Table_5ff5f71a1bec45fdb637b5846419efdb [id=3bf7ead32d3c43218f9bb65ed5347874]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.239355 2382 raft_consensus.cc:493] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:41.239497 2382 raft_consensus.cc:515] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.239768 754 tablet_service.cc:1511] Processing CreateTablet for tablet 2c35a8af5d92445a851c8847f75476f9 (DEFAULT_TABLE table=default.Table_4c1ff8f187b34eb59f2b189fbf314142 [id=01148f7db8934decb958485d618c88a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.240213 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 61196fc8d2e04cf8ad5d0d732b3484b7 (DEFAULT_TABLE table=default.Table_d550bf15de2b4cc5a3bf45213eb07236 [id=f74c720f0ab342a6b9d983d1dc49483d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.241726 1173 tablet_bootstrap.cc:492] T 3d7b339a29ef456997d74a7a95d4c03a P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:41.243477 1173 tablet_bootstrap.cc:654] T 3d7b339a29ef456997d74a7a95d4c03a P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:41.244495 456 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 7c4eca5e16f84564b31933b8227fd980 (table default.Table_4da517198db54744b96210b1f4438731 [id=541170c7c4bf49deb86cd4c15ffdd04f]). Expected version 1 got 0
W20260318 02:51:41.249881 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1294e1ae2115471a8b605d38f1c26e60 consensus state has no leader
I20260318 02:51:41.251194 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 793a87e8bcb442c1b6fb0ecfcbc71480 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:41.251969 749 tablet_service.cc:1558] Processing DeleteTablet for tablet cce09767819441e599e7a62526d2cb75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:41.252156 758 tablet_service.cc:1558] Processing DeleteTablet for tablet c93e05eb5c9e4d5da1b688a03312ad8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:41.252394 763 tablet_service.cc:1511] Processing CreateTablet for tablet df9d5919242a41aa8e119570f75b7c24 (DEFAULT_TABLE table=default.Table_3446374754d742b3b14fd6e6ee092923 [id=ebdc5d4f5bd8480c8d0399b94497d350]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.248292 760 tablet_service.cc:1511] Processing CreateTablet for tablet f96013c844414fd28c35724a6160ee81 (DEFAULT_TABLE table=default.Table_ef3fc2e773ac4783a799b73a979a0bcb [id=fca7537907a64f0f856fb77b6b863d49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.239423 757 tablet_service.cc:1511] Processing CreateTablet for tablet b8477c484db84187a3a576de6195a228 (DEFAULT_TABLE table=default.Table_c732fb4a2d2f4001b7869a76cc1bd987 [id=624501b257f345dc9dbcfb4de04cf1a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.253016 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3feb3a76a7b947f5a35baae379e8754d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.261615 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f63108c062348b1ba995ea16f40a695 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:41.262046 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df9d5919242a41aa8e119570f75b7c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.263092 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96013c844414fd28c35724a6160ee81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.263787 2382 leader_election.cc:290] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:41.264187 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8477c484db84187a3a576de6195a228. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:41.264782 999 leader_election.cc:343] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: f72023f5408f4ef4b628568da0c008d6
I20260318 02:51:41.266013 1026 tablet_service.cc:1511] Processing CreateTablet for tablet 75c4ba372960496880405e5dffe11d60 (DEFAULT_TABLE table=default.Table_2f58164571244099848c2984bd08ef81 [id=8d282a0ea34f484f9b8f29cc45bb7dea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.267928 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c35a8af5d92445a851c8847f75476f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.268550 1027 tablet_service.cc:1511] Processing CreateTablet for tablet f5f53ee0015740a5a32a858e798c592e (DEFAULT_TABLE table=default.Table_402673bdfb764fe681dfe66dc2c1ba48 [id=02e0855be45f47428ab98726ad0a630a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.269229 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 7a534e0050514e2b8f0a06d73f4dc1ea (DEFAULT_TABLE table=default.Table_56beb1ca03424d678071acc86399a892 [id=f5d9be5991c7426aa1fb07d0587dd7ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.270125 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1f92e5cb67504f599ef161548211b85a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.270809 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f92e5cb67504f599ef161548211b85a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.270941 2454 raft_consensus.cc:493] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:41.271054 2454 raft_consensus.cc:515] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.271018 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_35e1b87e35c947778dd94385977b5a25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:41.271231 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_bae1cb521c5c406db7f8073d5425e529"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.271590 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35e1b87e35c947778dd94385977b5a25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.271631 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_441cbaff547544aba96bb83d7c61132a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.271988 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_441cbaff547544aba96bb83d7c61132a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:41.271590 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bae1cb521c5c406db7f8073d5425e529 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.272907 747 tablet_service.cc:1511] Processing CreateTablet for tablet 6f15a63d18f14061b8e5ec8f6306f79b (DEFAULT_TABLE table=default.Table_6e299f3484ca428cbccc8ea294a0ea69 [id=4155be67977b4b9cb7733f243f3a67a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.273295 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f15a63d18f14061b8e5ec8f6306f79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.274065 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b25d9f870a64b77a9c18ecef9814b5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.274310 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a87022b1c44d1291dd2af1124ea850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.272940 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c22bbb5e62d444b9ab1ccd977c2ac194"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.274945 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c22bbb5e62d444b9ab1ccd977c2ac194 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.275738 1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffa9d9dcc70e402099b414029f062d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.276398 1026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c4ba372960496880405e5dffe11d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.276607 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f53ee0015740a5a32a858e798c592e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.277201 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61196fc8d2e04cf8ad5d0d732b3484b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.277763 1036 tablet_service.cc:1511] Processing CreateTablet for tablet b8477c484db84187a3a576de6195a228 (DEFAULT_TABLE table=default.Table_c732fb4a2d2f4001b7869a76cc1bd987 [id=624501b257f345dc9dbcfb4de04cf1a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.277869 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 25d140f7821648e0a8d412dd400938d9 (DEFAULT_TABLE table=default.Table_c152ad8f81b94f778ef9ff94c5f0ddfd [id=ca32e48096de480abe0205aba31a8212]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.278132 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8477c484db84187a3a576de6195a228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.278350 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d140f7821648e0a8d412dd400938d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.278556 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 2c35a8af5d92445a851c8847f75476f9 (DEFAULT_TABLE table=default.Table_4c1ff8f187b34eb59f2b189fbf314142 [id=01148f7db8934decb958485d618c88a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.278712 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a534e0050514e2b8f0a06d73f4dc1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.278827 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c35a8af5d92445a851c8847f75476f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.279263 1025 tablet_service.cc:1511] Processing CreateTablet for tablet 3feb3a76a7b947f5a35baae379e8754d (DEFAULT_TABLE table=default.Table_5ff5f71a1bec45fdb637b5846419efdb [id=3bf7ead32d3c43218f9bb65ed5347874]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.279497 2454 leader_election.cc:290] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:41.279578 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3feb3a76a7b947f5a35baae379e8754d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.280032 1044 tablet_service.cc:1511] Processing CreateTablet for tablet c8d9662f2f3949b7b4fb7f5a14d06126 (DEFAULT_TABLE table=default.Table_78768f3f016b4f7985a6b386b016bd62 [id=b66b9b81bcfc4d339d1f71d380ee3e72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.280351 1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8d9662f2f3949b7b4fb7f5a14d06126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.280376 1173 tablet_bootstrap.cc:492] T 3d7b339a29ef456997d74a7a95d4c03a P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:41.280512 1173 ts_tablet_manager.cc:1403] T 3d7b339a29ef456997d74a7a95d4c03a P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.003s
I20260318 02:51:41.281303 1173 raft_consensus.cc:359] T 3d7b339a29ef456997d74a7a95d4c03a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.281603 1173 raft_consensus.cc:385] T 3d7b339a29ef456997d74a7a95d4c03a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:41.281709 1173 raft_consensus.cc:740] T 3d7b339a29ef456997d74a7a95d4c03a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:41.281733 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0f0cd89234e72a052f3f9f964aa35" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:41.282022 785 raft_consensus.cc:2468] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:41.281984 1173 consensus_queue.cc:260] T 3d7b339a29ef456997d74a7a95d4c03a P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.282476 1173 ts_tablet_manager.cc:1434] T 3d7b339a29ef456997d74a7a95d4c03a P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260318 02:51:41.282588 1039 tablet_service.cc:1511] Processing CreateTablet for tablet f96013c844414fd28c35724a6160ee81 (DEFAULT_TABLE table=default.Table_ef3fc2e773ac4783a799b73a979a0bcb [id=fca7537907a64f0f856fb77b6b863d49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.282742 1173 tablet_bootstrap.cc:492] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:41.282902 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96013c844414fd28c35724a6160ee81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.284307 1173 tablet_bootstrap.cc:654] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:41.285516 1174 tablet_bootstrap.cc:654] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:41.286454 2454 raft_consensus.cc:493] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:41.286594 2454 raft_consensus.cc:515] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.287169 2454 leader_election.cc:290] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
W20260318 02:51:41.291698 997 leader_election.cc:343] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:41.292052 997 leader_election.cc:343] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:41.292136 997 leader_election.cc:304] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:41.298166 1028 tablet_service.cc:1511] Processing CreateTablet for tablet df9d5919242a41aa8e119570f75b7c24 (DEFAULT_TABLE table=default.Table_3446374754d742b3b14fd6e6ee092923 [id=ebdc5d4f5bd8480c8d0399b94497d350]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.299589 1176 ts_tablet_manager.cc:1929] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:41.299702 1176 log.cc:1199] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/9777963ff20c4a799de2870555f6b335
I20260318 02:51:41.299954 1176 ts_tablet_manager.cc:1950] T 9777963ff20c4a799de2870555f6b335 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:41.300390 1176 tablet_replica.cc:333] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:41.300575 1176 raft_consensus.cc:2243] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:41.301685 1176 raft_consensus.cc:2272] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:41.302261 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 9777963ff20c4a799de2870555f6b335 (table default.Table_6de905c387094641af62b74f3e0cee37 [id=f8c2021fcd4c4fb2b807bf8fa92088dd]) successfully deleted
I20260318 02:51:41.305308 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df9d5919242a41aa8e119570f75b7c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.305956 927 raft_consensus.cc:3060] T 3d7b339a29ef456997d74a7a95d4c03a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:41.308795 423 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 135859us
I20260318 02:51:41.310696 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72023f5408f4ef4b628568da0c008d6" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:41.310971 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0f0cd89234e72a052f3f9f964aa35" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:41.299328 1184 ts_tablet_manager.cc:1929] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:41.304157 2296 raft_consensus.cc:2749] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:41.311591 1184 log.cc:1199] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/27fc03c90b584becb250546100af736c
I20260318 02:51:41.312007 1184 ts_tablet_manager.cc:1950] T 27fc03c90b584becb250546100af736c P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:41.302968 999 leader_election.cc:304] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:41.312492 2296 raft_consensus.cc:2804] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:41.312574 2296 raft_consensus.cc:493] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:41.312633 2296 raft_consensus.cc:3060] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:41.313114 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 993) took 2802 ms. Trace:
I20260318 02:51:41.313201 1184 rpcz_store.cc:276] 0318 02:51:38.510910 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.510969 (+ 59us) service_pool.cc:225] Handling call
0318 02:51:41.159117 (+2648148us) ts_tablet_manager.cc:1151] Deleting tablet 27fc03c90b584becb250546100af736c
0318 02:51:41.159126 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:41.263998 (+104872us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:41.299205 (+ 35207us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:41.313092 (+ 13887us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2647893}
I20260318 02:51:41.313619 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 994) took 2783 ms. Trace:
I20260318 02:51:41.313694 1184 rpcz_store.cc:276] 0318 02:51:38.529786 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.530326 (+ 540us) service_pool.cc:225] Handling call
0318 02:51:41.313485 (+2783159us) ts_tablet_manager.cc:1151] Deleting tablet dff92dfca39e47f98d709cc67b97df66
0318 02:51:41.313496 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:41.313603 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2768838}
I20260318 02:51:41.313962 1184 tablet_replica.cc:333] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:41.314168 1184 raft_consensus.cc:2243] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:41.314493 1184 pending_rounds.cc:70] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d: Trying to abort 1 pending ops.
I20260318 02:51:41.314540 1184 pending_rounds.cc:77] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494214573236224 op_type: NO_OP noop_request { }
I20260318 02:51:41.314631 1184 raft_consensus.cc:2889] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:41.314710 1184 raft_consensus.cc:2272] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:41.315279 1184 ts_tablet_manager.cc:1916] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:41.315462 2296 raft_consensus.cc:515] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.316063 2296 leader_election.cc:290] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:41.318059 1042 tablet_service.cc:1511] Processing CreateTablet for tablet 6f15a63d18f14061b8e5ec8f6306f79b (DEFAULT_TABLE table=default.Table_6e299f3484ca428cbccc8ea294a0ea69 [id=4155be67977b4b9cb7733f243f3a67a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.318533 1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f15a63d18f14061b8e5ec8f6306f79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.321331 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet c93e05eb5c9e4d5da1b688a03312ad8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:41.322432 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet bf344c2361b7412c87a7c7f9a72a15b6 (table default.Table_67969be821524f06922e86b98527c45b [id=d22d61a1d07149c3bf62dd9412aaa9c6]) successfully deleted
W20260318 02:51:41.322666 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 3d28aa6525184246a71ad198cf1df763 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3d28aa6525184246a71ad198cf1df763 already in progress: creating tablet
W20260318 02:51:41.322803 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 9d9cc0f3aef0401c8f072b11d9498a59 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d9cc0f3aef0401c8f072b11d9498a59 already in progress: creating tablet
I20260318 02:51:41.323073 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet ba3e7e9a85c94d7380b96a9373c1f503 (table default.Table_51d490345e9f497ca6b3076edf95c90f [id=fbbe8921ed4344c18e2276270fcaf24f]) successfully deleted
I20260318 02:51:41.323921 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8e99f9b321c347e5bbf237455c27ffd6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.324508 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e99f9b321c347e5bbf237455c27ffd6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.325415 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d7b339a29ef456997d74a7a95d4c03a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:41.325974 1176 ts_tablet_manager.cc:1916] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:41.332250 2454 raft_consensus.cc:493] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260318 02:51:41.332118 999 leader_election.cc:343] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 5ff188f25ff146fab121ebfab1af8467
I20260318 02:51:41.332643 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff188f25ff146fab121ebfab1af8467" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:41.338256 2454 raft_consensus.cc:515] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.338675 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0f0cd89234e72a052f3f9f964aa35" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:41.338892 2454 leader_election.cc:290] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:41.339576 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 27fc03c90b584becb250546100af736c (table default.Table_2a25f2687bad470988b6af088ea5695c [id=348edc09be924f24934c12fa52e9f40c]) successfully deleted
W20260318 02:51:41.339779 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet dff92dfca39e47f98d709cc67b97df66 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dff92dfca39e47f98d709cc67b97df66 already in progress: creating tablet
I20260318 02:51:41.339910 2443 tablet.cc:1723] T 3d7b339a29ef456997d74a7a95d4c03a P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:41.340149 1175 ts_tablet_manager.cc:1929] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:41.340234 1175 log.cc:1199] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/305cc777ed0c46e497c80f15b8e6ead1
I20260318 02:51:41.340497 1175 ts_tablet_manager.cc:1950] T 305cc777ed0c46e497c80f15b8e6ead1 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:41.341087 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d2abf77a628943db8e72558732f7c73c" } new_table_name: "default.Table_4cf6b8ad124543f1855ef61f1bedf442" modify_external_catalogs: true
I20260318 02:51:41.341135 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5e4db74f50fe44f5b01ea2ffbe1388b9" } new_table_name: "default.Table_6e99ecda3f32420f9aafb0a129769e76" modify_external_catalogs: true
I20260318 02:51:41.342569 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c0889091422144f8af318ab6f38afd05" } modify_external_catalogs: true
I20260318 02:51:41.342721 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c0889091422144f8af318ab6f38afd05" } modify_external_catalogs: true
I20260318 02:51:41.345932 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 793a87e8bcb442c1b6fb0ecfcbc71480 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:41.346119 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet cce09767819441e599e7a62526d2cb75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:41.346297 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f63108c062348b1ba995ea16f40a695 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:41.349030 2152 consensus_queue.cc:1048] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260318 02:51:41.349417 997 consensus_peers.cc:597] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260318 02:51:41.353364 443 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 14a7e8753094406baa5a0c32a81e2af4 (table default.Table_8c3927a237184aad84d0b87da876f5e4 [id=27a0b540137045258fde9f421a4ad665], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 14a7e8753094406baa5a0c32a81e2af4 consensus state has no leader
W20260318 02:51:41.349575 997 leader_election.cc:343] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:41.356155 997 leader_election.cc:304] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:41.356626 2382 raft_consensus.cc:2749] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:41.357118 997 leader_election.cc:343] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:41.357483 997 leader_election.cc:343] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:41.371168 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf73a9f8f67b42d9baf1396d70a1a3a9" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:41.371371 783 raft_consensus.cc:2468] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:41.371443 997 leader_election.cc:304] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:41.371889 997 leader_election.cc:343] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:41.372313 2152 raft_consensus.cc:2749] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:41.376911 1173 tablet_bootstrap.cc:492] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:41.377185 1173 ts_tablet_manager.cc:1403] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.095s user 0.004s sys 0.001s
I20260318 02:51:41.377688 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf73a9f8f67b42d9baf1396d70a1a3a9" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:41.378161 1173 raft_consensus.cc:359] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.378432 1173 raft_consensus.cc:385] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:41.378513 1173 raft_consensus.cc:740] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:41.378783 1173 consensus_queue.cc:260] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:41.381085 997 leader_election.cc:343] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:41.382462 457 master_service.cc:954] ReplaceTablet: received request to replace tablet 6b82751cbcbb4c39a6942b6856412fc8 from {username='slave'} at 127.0.0.1:47158
W20260318 02:51:41.390439 441 catalog_manager.cc:5075] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): alter failed for tablet b5c19bc5e07949088c84cedbf944dfdb (table default.Table_79bea80cab3d40f5bead32f2fdcf09fa [id=873432f002e14a4fa7065dcfe5caebd5]),no further retry: Not found: Tablet not found: b5c19bc5e07949088c84cedbf944dfdb
I20260318 02:51:41.390810 1175 tablet_replica.cc:333] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:41.390870 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 305cc777ed0c46e497c80f15b8e6ead1 (table default.Table_dbd509def99c4f02a35097ecbd42c1f1 [id=74932ba5f5794283833a97ff4ea61734]) successfully deleted
I20260318 02:51:41.391121 1175 raft_consensus.cc:2243] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:41.370538 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0f0cd89234e72a052f3f9f964aa35" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:41.391268 785 raft_consensus.cc:3060] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:41.391393 1175 raft_consensus.cc:2272] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:41.393913 785 raft_consensus.cc:2468] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:41.398748 1176 ts_tablet_manager.cc:1929] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:41.398877 1176 log.cc:1199] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/2f04e5699531479d8b76edb0e2d2873c
I20260318 02:51:41.399235 1176 ts_tablet_manager.cc:1950] T 2f04e5699531479d8b76edb0e2d2873c P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:41.399811 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 2f04e5699531479d8b76edb0e2d2873c (table default.Table_9e6e77bf748f460894d85c701ccfad5b [id=ddd8b0b49c334776b49a59c18e75453c]) successfully deleted
I20260318 02:51:41.402909 999 leader_election.cc:304] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:41.407226 2382 raft_consensus.cc:2804] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:41.407323 2382 raft_consensus.cc:493] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:41.407378 2382 raft_consensus.cc:3060] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:41.409863 1173 ts_tablet_manager.cc:1434] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20260318 02:51:41.410374 1173 tablet_bootstrap.cc:492] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:41.422055 999 leader_election.cc:304] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:41.422362 2296 raft_consensus.cc:2804] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:41.422468 2296 raft_consensus.cc:697] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:41.422683 2296 consensus_queue.cc:237] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.424782 1176 tablet_replica.cc:333] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:41.427107 1176 raft_consensus.cc:2243] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:41.427970 1176 raft_consensus.cc:2272] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:41.429924 1176 ts_tablet_manager.cc:1916] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:41.432458 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_10d43fa780ea41f68847fc2ef753c3ef" } new_table_name: "default.Table_44cdbced7bd948a1acf7fd8a8dece892" modify_external_catalogs: true
I20260318 02:51:41.432508 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c74ad47eacde4e2491f1e80f170a8cad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.433116 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c74ad47eacde4e2491f1e80f170a8cad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.435547 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ab97acbecde44e5185a408584586f845"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:41.435776 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2a5da32146c44463ad1d7eb9f8ba6232" } modify_external_catalogs: true
I20260318 02:51:41.435945 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2a5da32146c44463ad1d7eb9f8ba6232" } modify_external_catalogs: true
W20260318 02:51:41.436125 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab97acbecde44e5185a408584586f845 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.437295 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0d2858909c654b5c9566dab7b33da1c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.437762 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d2858909c654b5c9566dab7b33da1c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.442883 1173 tablet_bootstrap.cc:654] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:41.444213 1176 ts_tablet_manager.cc:1929] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:41.444357 1176 log.cc:1199] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/60dedba077d34435b30061bfba737412
I20260318 02:51:41.444626 1176 ts_tablet_manager.cc:1950] T 60dedba077d34435b30061bfba737412 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
W20260318 02:51:41.448010 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3332a507699349c2874b4ea205740a8e consensus state has no leader
I20260318 02:51:41.448603 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet cf73a9f8f67b42d9baf1396d70a1a3a9
I20260318 02:51:41.449388 754 tablet_service.cc:1558] Processing DeleteTablet for tablet cf73a9f8f67b42d9baf1396d70a1a3a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:41.449738 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47069b65872d4a3ab33771eba3da781e consensus state has no leader
I20260318 02:51:41.431417 1174 tablet_bootstrap.cc:492] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:41.451419 1174 ts_tablet_manager.cc:1403] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.340s user 0.019s sys 0.008s
I20260318 02:51:41.451768 1184 ts_tablet_manager.cc:1929] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:41.451887 1184 log.cc:1199] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/b383fd49049c4c1daba3f1ed60899f3e
I20260318 02:51:41.452462 1174 raft_consensus.cc:359] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:41.452647 1174 raft_consensus.cc:385] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:41.452724 1174 raft_consensus.cc:740] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:41.452930 1174 consensus_queue.cc:260] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:41.454110 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_01108ecf756748c989c72cdacfbce742" } modify_external_catalogs: true
I20260318 02:51:41.454304 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_01108ecf756748c989c72cdacfbce742" } modify_external_catalogs: true
I20260318 02:51:41.455196 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b81a2f1910364b37874f85258bf76a65" } modify_external_catalogs: true
I20260318 02:51:41.455363 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b81a2f1910364b37874f85258bf76a65" } modify_external_catalogs: true
I20260318 02:51:41.456511 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3d223beddc944ff4aaafa2fe0e72c0a7" } modify_external_catalogs: true
I20260318 02:51:41.456918 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3d223beddc944ff4aaafa2fe0e72c0a7" } modify_external_catalogs: true
I20260318 02:51:41.459537 2382 raft_consensus.cc:515] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.459900 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 6b82751cbcbb4c39a6942b6856412fc8
I20260318 02:51:41.460176 2382 leader_election.cc:290] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:41.460343 457 catalog_manager.cc:6741] ReplaceTablet: tablet 6b82751cbcbb4c39a6942b6856412fc8 deleted and replaced by tablet f93faa7ab523427da63b8db7e8757046
I20260318 02:51:41.460633 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ac3e0d779cea49a6bd0789aedae5d43c" } new_table_name: "default.Table_510e870eb15a4ad2b685f4e565f310ca" modify_external_catalogs: true
I20260318 02:51:41.462568 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b82751cbcbb4c39a6942b6856412fc8 with delete_type TABLET_DATA_DELETED (replaced by tablet f93faa7ab523427da63b8db7e8757046) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:41.466053 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet fae818515c7744899b80b87bd6dcd198
I20260318 02:51:41.467399 752 tablet_service.cc:1558] Processing DeleteTablet for tablet fae818515c7744899b80b87bd6dcd198 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:41.477624 2404 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6aa91804a2401fa0ceb31b196ec40a)
I20260318 02:51:41.477905 2404 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:41.481261 2374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee6aa91804a2401fa0ceb31b196ec40a. Latest consensus state: current_term: 2 leader_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:41.481537 2374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260318 02:51:41.483610 2404 leader_election.cc:290] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6aa91804a2401fa0ceb31b196ec40a (127.0.104.190:39451), 971baf5b9e4644c990dbf4d4fc7ba900 (127.0.104.188:41593)
I20260318 02:51:41.500090 1184 ts_tablet_manager.cc:1950] T b383fd49049c4c1daba3f1ed60899f3e P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:41.500617 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 995) took 2936 ms. Trace:
I20260318 02:51:41.500850 1184 rpcz_store.cc:276] 0318 02:51:38.564259 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.564582 (+ 323us) service_pool.cc:225] Handling call
0318 02:51:41.313912 (+2749330us) ts_tablet_manager.cc:1151] Deleting tablet b383fd49049c4c1daba3f1ed60899f3e
0318 02:51:41.313920 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:41.392645 (+ 78725us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:41.451648 (+ 59003us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:41.500593 (+ 48945us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2749046}
I20260318 02:51:41.501619 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 999) took 2653 ms. Trace:
I20260318 02:51:41.501770 1184 rpcz_store.cc:276] 0318 02:51:38.848655 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.848774 (+ 119us) service_pool.cc:225] Handling call
0318 02:51:41.501461 (+2652687us) ts_tablet_manager.cc:1151] Deleting tablet a628b6d2523344edbf78695a041113cf
0318 02:51:41.501475 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:41.501601 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2652481}
I20260318 02:51:41.502190 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1000) took 2650 ms. Trace:
I20260318 02:51:41.502305 1184 rpcz_store.cc:276] 0318 02:51:38.851373 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.851442 (+ 69us) service_pool.cc:225] Handling call
0318 02:51:41.502086 (+2650644us) ts_tablet_manager.cc:1151] Deleting tablet 2f3309339d61445eaf38baf068216ef4
0318 02:51:41.502095 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:41.502177 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2650466}
I20260318 02:51:41.502664 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1001) took 2647 ms. Trace:
I20260318 02:51:41.502776 1184 rpcz_store.cc:276] 0318 02:51:38.855080 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.855171 (+ 91us) service_pool.cc:225] Handling call
0318 02:51:41.502573 (+2647402us) ts_tablet_manager.cc:1151] Deleting tablet 53462f4293594dd59ca17b712a1426c8
0318 02:51:41.502582 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:41.502651 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2647197}
I20260318 02:51:41.503185 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1002) took 2647 ms. Trace:
I20260318 02:51:41.503440 1184 rpcz_store.cc:276] 0318 02:51:38.856228 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.856274 (+ 46us) service_pool.cc:225] Handling call
0318 02:51:41.503088 (+2646814us) ts_tablet_manager.cc:1151] Deleting tablet 255979f9bbe74dd583798ea5da2ae4c4
0318 02:51:41.503097 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:41.503172 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2646652}
I20260318 02:51:41.503839 1184 tablet_replica.cc:333] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:41.504297 1184 raft_consensus.cc:2243] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:41.511107 904 tablet_service.cc:1558] Processing DeleteTablet for tablet cf73a9f8f67b42d9baf1396d70a1a3a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:41.517416 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b82751cbcbb4c39a6942b6856412fc8 with delete_type TABLET_DATA_DELETED (replaced by tablet f93faa7ab523427da63b8db7e8757046) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:41.519424 904 tablet_service.cc:1558] Processing DeleteTablet for tablet fae818515c7744899b80b87bd6dcd198 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:41.520808 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0ff88b3a70da42c0bf69b7a88fa5d032" } new_table_name: "default.Table_a2cb2d12bba34ad7a8a559cba3c1a3bb" modify_external_catalogs: true
I20260318 02:51:41.522226 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f27228fc834e4dfa99011aca3fb3c5ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.522825 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f27228fc834e4dfa99011aca3fb3c5ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.523293 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1098) took 1049 ms. Trace:
I20260318 02:51:41.523381 1176 rpcz_store.cc:276] 0318 02:51:40.473875 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.476531 (+ 2656us) service_pool.cc:225] Handling call
0318 02:51:41.424727 (+948196us) ts_tablet_manager.cc:1151] Deleting tablet 60dedba077d34435b30061bfba737412
0318 02:51:41.424738 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:41.441326 (+ 16588us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:41.444106 (+ 2780us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:41.523267 (+ 79161us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":947989}
I20260318 02:51:41.523754 1176 tablet_replica.cc:333] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:41.527783 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf73a9f8f67b42d9baf1396d70a1a3a9" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:41.529560 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6f63025537c546eda3122aa2c2abb535 consensus state has no leader
I20260318 02:51:41.532804 923 raft_consensus.cc:3060] T ca23d4d0d3734fceb14966a4f2ad9c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:41.534751 2007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40520 (request call id 0) took 7567 ms. Trace:
I20260318 02:51:41.538611 2469 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260318 02:51:41.539945 1173 tablet_bootstrap.cc:492] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:41.540112 1173 ts_tablet_manager.cc:1403] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.130s user 0.002s sys 0.002s
I20260318 02:51:41.540917 1173 raft_consensus.cc:359] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.541179 1173 raft_consensus.cc:385] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:41.541231 1173 raft_consensus.cc:740] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:41.541440 1173 consensus_queue.cc:260] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.541924 1173 ts_tablet_manager.cc:1434] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:41.542236 1173 tablet_bootstrap.cc:492] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:41.544021 1173 tablet_bootstrap.cc:654] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:41.551429 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 60dedba077d34435b30061bfba737412 (table default.Table_374dfe5a11944231bc786a2cb0c66a84 [id=6449f780fd6a4361960f0a62d81dd60d]) successfully deleted
I20260318 02:51:41.557755 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 416d5d20d0f649ca872de02471fa9cf8
I20260318 02:51:41.558066 1184 raft_consensus.cc:2272] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:41.523525 1172 tablet_bootstrap.cc:492] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:41.558871 1172 ts_tablet_manager.cc:1403] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.502s user 0.006s sys 0.005s
I20260318 02:51:41.560214 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 416d5d20d0f649ca872de02471fa9cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:41.562048 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 9a0fe429edde49fe8702ffb13b034a6c
I20260318 02:51:41.563045 752 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a0fe429edde49fe8702ffb13b034a6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:41.568333 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet fae818515c7744899b80b87bd6dcd198 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:41.569756 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet cf73a9f8f67b42d9baf1396d70a1a3a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:41.571193 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 416d5d20d0f649ca872de02471fa9cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:41.584546 2464 raft_consensus.cc:493] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:41.586043 1176 raft_consensus.cc:2243] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:41.588219 752 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4f4d1ba09e447f88f565e5f76fd521 (DEFAULT_TABLE table=default.Table_efd6b115c80b4129b5a781aba46d4d7f [id=eb826a561d8f4425a01c1f4fb379bd09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.588392 1176 raft_consensus.cc:2272] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:41.588615 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet df499767dfee4fbd939d775db9d2577e
I20260318 02:51:41.588658 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4f4d1ba09e447f88f565e5f76fd521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.588937 1176 ts_tablet_manager.cc:1916] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:41.589836 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a0fe429edde49fe8702ffb13b034a6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:41.590734 1184 ts_tablet_manager.cc:1916] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:41.593567 757 tablet_service.cc:1511] Processing CreateTablet for tablet 01d1892c446242efae8cc3ab4561f73f (DEFAULT_TABLE table=default.Table_5d0dbc23192742adaa65c0aa5f9da382 [id=17231955ba644d1eb12b16b34a9e5a97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.593967 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d1892c446242efae8cc3ab4561f73f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.594628 1176 ts_tablet_manager.cc:1929] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:41.594722 1176 log.cc:1199] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/2ebcf120100349319d27615b6e0c7550
I20260318 02:51:41.594970 1176 ts_tablet_manager.cc:1950] T 2ebcf120100349319d27615b6e0c7550 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:41.595319 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1100) took 1079 ms. Trace:
I20260318 02:51:41.595674 2464 raft_consensus.cc:515] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:41.596141 1172 raft_consensus.cc:359] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:41.596331 1172 raft_consensus.cc:385] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:41.596375 1172 raft_consensus.cc:740] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:41.596601 1172 consensus_queue.cc:260] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:41.596822 755 tablet_service.cc:1558] Processing DeleteTablet for tablet df499767dfee4fbd939d775db9d2577e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:41.597273 1172 ts_tablet_manager.cc:1434] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.038s user 0.002s sys 0.000s
I20260318 02:51:41.597584 1172 tablet_bootstrap.cc:492] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:41.599189 1172 tablet_bootstrap.cc:654] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:41.599478 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b82751cbcbb4c39a6942b6856412fc8 with delete_type TABLET_DATA_DELETED (replaced by tablet f93faa7ab523427da63b8db7e8757046) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:41.599711 1173 tablet_bootstrap.cc:492] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
W20260318 02:51:41.600958 997 leader_election.cc:343] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:41.601584 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a0fe429edde49fe8702ffb13b034a6c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:41.601898 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 416d5d20d0f649ca872de02471fa9cf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:41.601882 755 tablet_service.cc:1511] Processing CreateTablet for tablet bc037f535c854063bee6d0a29f7c71ef (DEFAULT_TABLE table=default.Table_1f9399c6144e4eeab22c7c2219f29c03 [id=38bf687f7ca74c1fb72afece2ac00956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.602320 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc037f535c854063bee6d0a29f7c71ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.603019 1173 ts_tablet_manager.cc:1403] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.061s user 0.002s sys 0.001s
I20260318 02:51:41.603405 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_fb13d51af88747b7870e81cc493396ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:41.603865 1173 raft_consensus.cc:359] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:41.603946 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb13d51af88747b7870e81cc493396ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.604023 1173 raft_consensus.cc:385] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:41.604076 1173 raft_consensus.cc:740] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:41.604935 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb381f10d87414f9c1a99942216adc7" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:41.605026 2464 leader_election.cc:290] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:41.595391 1176 rpcz_store.cc:276] 0318 02:51:40.515740 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.516021 (+ 281us) service_pool.cc:225] Handling call
0318 02:51:41.523701 (+1007680us) ts_tablet_manager.cc:1151] Deleting tablet 2ebcf120100349319d27615b6e0c7550
0318 02:51:41.523712 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:41.591831 (+ 68119us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:41.594551 (+ 2720us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:41.595301 (+ 750us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":61980,"tablet-delete.queue_time_us":1007468}
W20260318 02:51:41.605532 719 leader_election.cc:343] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:41.605919 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 2ebcf120100349319d27615b6e0c7550 (table default.Table_1424aa1a08ae4f3584a9f415cd41b6e7 [id=566d84b4953c4753a0b3a2bc060aae3b]) successfully deleted
I20260318 02:51:41.607914 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1101) took 1092 ms. Trace:
I20260318 02:51:41.608006 1176 rpcz_store.cc:276] 0318 02:51:40.515851 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.517671 (+ 1820us) service_pool.cc:225] Handling call
0318 02:51:41.607723 (+1090052us) ts_tablet_manager.cc:1151] Deleting tablet 5433e0aebdd34666a655c21a77fe2654
0318 02:51:41.607733 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:41.607890 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1089851}
I20260318 02:51:41.608233 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2245697c211947e68293c7d2b80e4837"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.608853 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2245697c211947e68293c7d2b80e4837 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.609568 752 tablet_service.cc:1511] Processing CreateTablet for tablet 17699eee74be4698b84ee6f604aec41a (DEFAULT_TABLE table=default.Table_7d8be37120444625a37452a9660aaa43 [id=7ccbabfaed4640f8bfb8adc8f60f7a73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.610270 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17699eee74be4698b84ee6f604aec41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.611682 757 tablet_service.cc:1511] Processing CreateTablet for tablet f8157efcbf83432cb46d924e013c0a98 (DEFAULT_TABLE table=default.Table_8a2e4f4c8bef459ab9c867dfd768d373 [id=e2a81b915679441cb3eeb749a89d7c2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.612092 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8157efcbf83432cb46d924e013c0a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.617870 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf73a9f8f67b42d9baf1396d70a1a3a9" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:41.618063 785 raft_consensus.cc:3060] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:41.618692 1173 consensus_queue.cc:260] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.619225 1173 ts_tablet_manager.cc:1434] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260318 02:51:41.619499 1173 tablet_bootstrap.cc:492] T 061ebb62f4c54a2a8c24b90ec15402d3 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:41.623418 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2625cc88249249458cdcf3b123670e70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.624064 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2625cc88249249458cdcf3b123670e70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.624676 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet b383fd49049c4c1daba3f1ed60899f3e (table default.Table_5ed9c43cfcf94d058b59ec604059817b [id=fc9e568fb3884c3ca8575e591393560e]) successfully deleted
W20260318 02:51:41.624940 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet a628b6d2523344edbf78695a041113cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a628b6d2523344edbf78695a041113cf already in progress: creating tablet
W20260318 02:51:41.625342 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 53462f4293594dd59ca17b712a1426c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53462f4293594dd59ca17b712a1426c8 already in progress: creating tablet
W20260318 02:51:41.625519 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 255979f9bbe74dd583798ea5da2ae4c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 255979f9bbe74dd583798ea5da2ae4c4 already in progress: creating tablet
I20260318 02:51:41.625454 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b7ead4ffcc7c4b288dccc939e5013fea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:41.625907 785 raft_consensus.cc:2468] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
W20260318 02:51:41.625963 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7ead4ffcc7c4b288dccc939e5013fea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.626346 904 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4f4d1ba09e447f88f565e5f76fd521 (DEFAULT_TABLE table=default.Table_efd6b115c80b4129b5a781aba46d4d7f [id=eb826a561d8f4425a01c1f4fb379bd09]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:41.624699 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 5433e0aebdd34666a655c21a77fe2654 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5433e0aebdd34666a655c21a77fe2654 already in progress: creating tablet
I20260318 02:51:41.626794 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4f4d1ba09e447f88f565e5f76fd521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.627106 455 master_service.cc:954] ReplaceTablet: received request to replace tablet fa077243d5634d888f3a191b7f9d2d19 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:41.636554 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet fa077243d5634d888f3a191b7f9d2d19
I20260318 02:51:41.637056 455 catalog_manager.cc:6741] ReplaceTablet: tablet fa077243d5634d888f3a191b7f9d2d19 deleted and replaced by tablet f2c7972bf42744699012425706ac4667
I20260318 02:51:41.637836 755 tablet_service.cc:1558] Processing DeleteTablet for tablet fa077243d5634d888f3a191b7f9d2d19 with delete_type TABLET_DATA_DELETED (replaced by tablet f2c7972bf42744699012425706ac4667) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:41.639976 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6134a522bf0f451994e720fe8644f4db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.640556 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6134a522bf0f451994e720fe8644f4db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.646178 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb381f10d87414f9c1a99942216adc7" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:41.648010 755 tablet_service.cc:1511] Processing CreateTablet for tablet 7b388b964c5f402ea4485d266563d07a (DEFAULT_TABLE table=default.Table_69553ca89bbd4df08e60a4ba2ea6840c [id=8ce43d1271b34b71a5187761a4e63994]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.648314 999 leader_election.cc:304] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:41.648866 2152 raft_consensus.cc:2804] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:41.649014 2152 raft_consensus.cc:697] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:41.649242 2152 consensus_queue.cc:237] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.650938 2431 raft_consensus.cc:493] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:41.651196 2431 raft_consensus.cc:515] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:41.657727 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6f40a5d3f14a779c26d73bf58f302b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:41.657943 1175 ts_tablet_manager.cc:1916] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:41.658509 719 leader_election.cc:343] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:41.659319 2431 leader_election.cc:290] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:41.660818 1173 tablet_bootstrap.cc:654] T 061ebb62f4c54a2a8c24b90ec15402d3 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:41.666528 997 consensus_peers.cc:597] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:41.675838 2362 raft_consensus.cc:493] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:41.676012 2362 raft_consensus.cc:515] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.676641 2362 leader_election.cc:290] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:41.677937 860 leader_election.cc:343] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 42a6983dce4e476cae97b3ecb1133077
W20260318 02:51:41.692790 999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.129:46711, user_credentials={real_user=slave}} blocked reactor thread for 44501.9us
W20260318 02:51:41.693501 719 leader_election.cc:343] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:41.693632 719 leader_election.cc:304] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:41.694154 2475 raft_consensus.cc:2749] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:41.719182 2443 tablet.cc:1723] T d0652735b8c24c23ade92913c1c7ad0f P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:41.723050 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6f40a5d3f14a779c26d73bf58f302b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:41.723881 719 leader_election.cc:343] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:41.724025 719 leader_election.cc:304] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:41.724437 2475 raft_consensus.cc:2749] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:41.730180 904 tablet_service.cc:1511] Processing CreateTablet for tablet 01d1892c446242efae8cc3ab4561f73f (DEFAULT_TABLE table=default.Table_5d0dbc23192742adaa65c0aa5f9da382 [id=17231955ba644d1eb12b16b34a9e5a97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.730754 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d1892c446242efae8cc3ab4561f73f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.738623 2491 tablet.cc:1723] T d0652735b8c24c23ade92913c1c7ad0f P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:41.743876 2443 tablet.cc:1723] T ca23d4d0d3734fceb14966a4f2ad9c35 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:41.745177 1174 ts_tablet_manager.cc:1434] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.294s user 0.009s sys 0.012s
I20260318 02:51:41.747475 907 tablet_service.cc:1558] Processing DeleteTablet for tablet df499767dfee4fbd939d775db9d2577e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:41.747793 2492 tablet.cc:1723] T d6a08d8bbe3a4234b97203536db32078 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:41.753497 448 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet ca23d4d0d3734fceb14966a4f2ad9c35 (table default.Table_1960d955ce3f45458d16f7f892da82fc [id=61241ff920584692bba476799b6a60e7]). Expected version 3 got 0
I20260318 02:51:41.758942 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4f4d1ba09e447f88f565e5f76fd521 (DEFAULT_TABLE table=default.Table_efd6b115c80b4129b5a781aba46d4d7f [id=eb826a561d8f4425a01c1f4fb379bd09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.759613 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4f4d1ba09e447f88f565e5f76fd521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.768505 448 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_20867faf86da4889b7995990926923a7 [id=5bc787aad96b4abd82ab3e033020ea9c] alter complete (version 1)
I20260318 02:51:41.775233 907 tablet_service.cc:1511] Processing CreateTablet for tablet bc037f535c854063bee6d0a29f7c71ef (DEFAULT_TABLE table=default.Table_1f9399c6144e4eeab22c7c2219f29c03 [id=38bf687f7ca74c1fb72afece2ac00956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.776684 901 tablet_service.cc:1511] Processing CreateTablet for tablet 17699eee74be4698b84ee6f604aec41a (DEFAULT_TABLE table=default.Table_7d8be37120444625a37452a9660aaa43 [id=7ccbabfaed4640f8bfb8adc8f60f7a73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.777895 895 tablet_service.cc:1511] Processing CreateTablet for tablet f8157efcbf83432cb46d924e013c0a98 (DEFAULT_TABLE table=default.Table_8a2e4f4c8bef459ab9c867dfd768d373 [id=e2a81b915679441cb3eeb749a89d7c2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.781888 2362 raft_consensus.cc:493] T 7c4eca5e16f84564b31933b8227fd980 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:41.782042 2362 raft_consensus.cc:515] T 7c4eca5e16f84564b31933b8227fd980 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.782653 2362 leader_election.cc:290] T 7c4eca5e16f84564b31933b8227fd980 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:41.785634 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc037f535c854063bee6d0a29f7c71ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.788935 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17699eee74be4698b84ee6f604aec41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.793208 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8157efcbf83432cb46d924e013c0a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.755574 1996 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" instance_seqno: 1773802278480685) as {username='slave'} at 127.0.104.130:45211; Asking this server to re-register.
I20260318 02:51:41.798664 974 heartbeater.cc:461] Registering TS with master...
I20260318 02:51:41.802690 1996 ts_manager.cc:194] Registered new tserver with Master: b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:41.814651 1172 tablet_bootstrap.cc:492] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:41.814958 1172 ts_tablet_manager.cc:1403] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.217s user 0.005s sys 0.000s
I20260318 02:51:41.815826 1172 raft_consensus.cc:359] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:41.816118 1172 raft_consensus.cc:385] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:41.816226 1172 raft_consensus.cc:740] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:41.816555 1172 consensus_queue.cc:260] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:41.817183 1172 ts_tablet_manager.cc:1434] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:41.817886 1172 tablet_bootstrap.cc:492] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:41.819435 1172 tablet_bootstrap.cc:654] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:41.821236 781 raft_consensus.cc:1275] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Refusing update from remote peer 9422bb7011f342b08be0b073a88c4c4d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:41.825351 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4eca5e16f84564b31933b8227fd980" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:41.826296 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b388b964c5f402ea4485d266563d07a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:41.829346 862 leader_election.cc:343] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 42a6983dce4e476cae97b3ecb1133077
I20260318 02:51:41.829491 862 leader_election.cc:304] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:41.830014 2362 raft_consensus.cc:2749] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:41.834057 448 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet a9c60ef260d049bea4ce729316a0d09f (table default.Table_d5ddb641ef9245ca92ab35d8ac25b157 [id=fb45f238426142faa79cbe89242c7418]). Expected version 1 got 0
I20260318 02:51:41.847302 1996 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6a903d876086423b8016d705b98895ad" instance_seqno: 1773802277965329) as {username='slave'} at 127.0.104.129:43863; Asking this server to re-register.
I20260318 02:51:41.849303 833 heartbeater.cc:461] Registering TS with master...
I20260318 02:51:41.854314 448 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 3348b200e5ca4f6ebecb2c25ddbe27bf (table default.Table_44cdbced7bd948a1acf7fd8a8dece892 [id=a1ea27c3f8534259bceaa1300242640a]). Expected version 3 got 2
I20260318 02:51:41.860842 2443 tablet.cc:1723] T 3348b200e5ca4f6ebecb2c25ddbe27bf P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:41.874976 755 tablet_service.cc:1558] Processing DeleteTablet for tablet 20a492fdea6c44ba8439614b0dcc2ba6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:41.876631 1996 ts_manager.cc:194] Registered new tserver with Master: 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:41.880404 448 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_44cdbced7bd948a1acf7fd8a8dece892 [id=a1ea27c3f8534259bceaa1300242640a] alter complete (version 3)
I20260318 02:51:41.896560 1176 tablet_replica.cc:333] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:41.896915 1176 raft_consensus.cc:2243] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:41.897200 1176 raft_consensus.cc:2272] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:41.897811 1176 ts_tablet_manager.cc:1916] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:41.901213 1174 tablet_bootstrap.cc:492] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:41.902702 1174 tablet_bootstrap.cc:654] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:41.908674 1174 tablet_bootstrap.cc:492] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:41.908861 1174 ts_tablet_manager.cc:1403] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.002s
I20260318 02:51:41.909654 1174 raft_consensus.cc:359] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.909826 1174 raft_consensus.cc:385] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:41.909878 1174 raft_consensus.cc:740] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:41.910277 1174 consensus_queue.cc:260] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.910923 1174 ts_tablet_manager.cc:1434] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260318 02:51:41.913156 1174 tablet_bootstrap.cc:492] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:41.914669 1174 tablet_bootstrap.cc:654] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:41.915885 901 tablet_service.cc:1511] Processing CreateTablet for tablet 7b388b964c5f402ea4485d266563d07a (DEFAULT_TABLE table=default.Table_69553ca89bbd4df08e60a4ba2ea6840c [id=8ce43d1271b34b71a5187761a4e63994]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:41.919806 895 tablet_service.cc:1558] Processing DeleteTablet for tablet fa077243d5634d888f3a191b7f9d2d19 with delete_type TABLET_DATA_DELETED (replaced by tablet f2c7972bf42744699012425706ac4667) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:41.921883 1173 tablet_bootstrap.cc:492] T 061ebb62f4c54a2a8c24b90ec15402d3 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:41.922111 1173 ts_tablet_manager.cc:1403] T 061ebb62f4c54a2a8c24b90ec15402d3 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.303s user 0.018s sys 0.018s
I20260318 02:51:41.922665 1174 tablet_bootstrap.cc:492] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:41.922849 1174 ts_tablet_manager.cc:1403] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.006s
I20260318 02:51:41.922914 1173 raft_consensus.cc:359] T 061ebb62f4c54a2a8c24b90ec15402d3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.923110 1173 raft_consensus.cc:385] T 061ebb62f4c54a2a8c24b90ec15402d3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:41.923190 1173 raft_consensus.cc:740] T 061ebb62f4c54a2a8c24b90ec15402d3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:41.923440 1173 consensus_queue.cc:260] T 061ebb62f4c54a2a8c24b90ec15402d3 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.923686 1174 raft_consensus.cc:359] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:41.923887 1174 raft_consensus.cc:385] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:41.923982 1173 ts_tablet_manager.cc:1434] T 061ebb62f4c54a2a8c24b90ec15402d3 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:41.923977 1174 raft_consensus.cc:740] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:41.924276 1174 consensus_queue.cc:260] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:41.924906 1174 ts_tablet_manager.cc:1434] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260318 02:51:41.925292 1174 tablet_bootstrap.cc:492] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:41.926718 1174 tablet_bootstrap.cc:654] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:41.934121 1173 tablet_bootstrap.cc:492] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:41.934571 2443 tablet.cc:1723] T d6a08d8bbe3a4234b97203536db32078 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:41.935335 1995 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" instance_seqno: 1773802278982506) as {username='slave'} at 127.0.104.131:37663; Asking this server to re-register.
I20260318 02:51:41.935528 754 tablet_service.cc:1558] Processing DeleteTablet for tablet f37ab96f13444fcbb5cfc3ad92d53c35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:41.935835 1173 tablet_bootstrap.cc:654] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:41.935837 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 4df7d75e696a4aec981de3963c282b0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:41.534896 2007 rpcz_store.cc:276] 0318 02:51:33.967345 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:33.967408 (+ 63us) service_pool.cc:225] Handling call
0318 02:51:39.489853 (+5522445us) raft_consensus.cc:1471] Updating replica for 312 ops
0318 02:51:39.506058 (+ 16205us) raft_consensus.cc:1534] Early marking committed up to index 660
0318 02:51:39.643425 (+137367us) raft_consensus.cc:1539] Triggering prepare for 312 ops
0318 02:51:39.643791 (+ 366us) write_op.cc:270] Start()
0318 02:51:39.643847 (+ 56us) write_op.cc:276] Timestamp: P: 1773802288351038 usec, L: 0
0318 02:51:39.644199 (+ 352us) write_op.cc:270] Start()
0318 02:51:39.644241 (+ 42us) write_op.cc:276] Timestamp: P: 1773802288354348 usec, L: 0
0318 02:51:39.644455 (+ 214us) write_op.cc:270] Start()
0318 02:51:39.644476 (+ 21us) write_op.cc:276] Timestamp: P: 1773802288357706 usec, L: 0
0318 02:51:39.644598 (+ 122us) write_op.cc:270] Start()
0318 02:51:39.644616 (+ 18us) write_op.cc:276] Timestamp: P: 1773802288359660 usec, L: 0
0318 02:51:39.644786 (+ 170us) write_op.cc:270] Start()
0318 02:51:39.644807 (+ 21us) write_op.cc:276] Timestamp: P: 1773802288364788 usec, L: 0
0318 02:51:39.644946 (+ 139us) write_op.cc:270] Start()
0318 02:51:39.644970 (+ 24us) write_op.cc:276] Timestamp: P: 1773802288373688 usec, L: 0
0318 02:51:39.645107 (+ 137us) write_op.cc:270] Start()
0318 02:51:39.645143 (+ 36us) write_op.cc:276] Timestamp: P: 1773802288662155 usec, L: 0
0318 02:51:39.645262 (+ 119us) write_op.cc:270] Start()
0318 02:51:39.645279 (+ 17us) write_op.cc:276] Timestamp: P: 1773802288662904 usec, L: 0
0318 02:51:39.645408 (+ 129us) write_op.cc:270] Start()
0318 02:51:39.645428 (+ 20us) write_op.cc:276] Timestamp: P: 1773802288663660 usec, L: 0
0318 02:51:39.645579 (+ 151us) write_op.cc:270] Start()
0318 02:51:39.645599 (+ 20us) write_op.cc:276] Timestamp: P: 1773802288664269 usec, L: 0
0318 02:51:39.645749 (+ 150us) write_op.cc:270] Start()
0318 02:51:39.645776 (+ 27us) write_op.cc:276] Timestamp: P: 1773802288672593 usec, L: 0
0318 02:51:39.645912 (+ 136us) write_op.cc:270] Start()
0318 02:51:39.645937 (+ 25us) write_op.cc:276] Timestamp: P: 1773802288673248 usec, L: 0
0318 02:51:39.646053 (+ 116us) write_op.cc:270] Start()
0318 02:51:39.646072 (+ 19us) write_op.cc:276] Timestamp: P: 1773802288673762 usec, L: 0
0318 02:51:39.646240 (+ 168us) write_op.cc:270] Start()
0318 02:51:39.646259 (+ 19us) write_op.cc:276] Timestamp: P: 1773802288695299 usec, L: 0
0318 02:51:39.646400 (+ 141us) write_op.cc:270] Start()
0318 02:51:39.646420 (+ 20us) write_op.cc:276] Timestamp: P: 1773802288696535 usec, L: 0
0318 02:51:39.646590 (+ 170us) write_op.cc:270] Start()
0318 02:51:39.646623 (+ 33us) write_op.cc:276] Timestamp: P: 1773802288751141 usec, L: 0
0318 02:51:39.646766 (+ 143us) write_op.cc:270] Start()
0318 02:51:39.646785 (+ 19us) write_op.cc:276] Timestamp: P: 1773802288752337 usec, L: 0
0318 02:51:39.647130 (+ 345us) write_op.cc:270] Start()
0318 02:51:39.647151 (+ 21us) write_op.cc:276] Timestamp: P: 1773802288775700 usec, L: 0
0318 02:51:39.647320 (+ 169us) write_op.cc:270] Start()
0318 02:51:39.647340 (+ 20us) write_op.cc:276] Timestamp: P: 1773802288776341 usec, L: 0
0318 02:51:39.647474 (+ 134us) write_op.cc:270] Start()
0318 02:51:39.647494 (+ 20us) write_op.cc:276] Timestamp: P: 1773802288776895 usec, L: 0
0318 02:51:39.647689 (+ 195us) write_op.cc:270] Start()
0318 02:51:39.647711 (+ 22us) write_op.cc:276] Timestamp: P: 1773802288777409 usec, L: 0
0318 02:51:39.647845 (+ 134us) write_op.cc:270] Start()
0318 02:51:39.647866 (+ 21us) write_op.cc:276] Timestamp: P: 1773802288777838 usec, L: 0
0318 02:51:39.647991 (+ 125us) write_op.cc:270] Start()
0318 02:51:39.648010 (+ 19us) write_op.cc:276] Timestamp: P: 1773802288778308 usec, L: 0
0318 02:51:39.648147 (+ 137us) write_op.cc:270] Start()
0318 02:51:39.648168 (+ 21us) write_op.cc:276] Timestamp: P: 1773802288784963 usec, L: 0
0318 02:51:39.757350 (+109182us) write_op.cc:270] Start()
0318 02:51:39.757387 (+ 37us) write_op.cc:276] Timestamp: P: 1773802288785576 usec, L: 0
0318 02:51:39.757587 (+ 200us) write_op.cc:270] Start()
0318 02:51:39.757611 (+ 24us) write_op.cc:276] Timestamp: P: 1773802288826024 usec, L: 0
0318 02:51:39.757766 (+ 155us) write_op.cc:270] Start()
0318 02:51:39.757785 (+ 19us) write_op.cc:276] Timestamp: P: 1773802288826649 usec, L: 0
0318 02:51:39.757910 (+ 125us) write_op.cc:270] Start()
0318 02:51:39.757928 (+ 18us) write_op.cc:276] Timestamp: P: 1773802288827211 usec, L: 0
0318 02:51:39.758032 (+ 104us) write_op.cc:270] Start()
0318 02:51:39.758048 (+ 16us) write_op.cc:276] Timestamp: P: 1773802288831645 usec, L: 0
0318 02:51:39.758247 (+ 199us) write_op.cc:270] Start()
0318 02:51:39.758266 (+ 19us) write_op.cc:276] Timestamp: P: 1773802288832276 usec, L: 0
0318 02:51:39.758397 (+ 131us) write_op.cc:270] Start()
0318 02:51:39.758414 (+ 17us) write_op.cc:276] Timestamp: P: 1773802288889313 usec, L: 0
0318 02:51:39.758514 (+ 100us) write_op.cc:270] Start()
0318 02:51:39.758529 (+ 15us) write_op.cc:276] Timestamp: P: 1773802288966306 usec, L: 0
0318 02:51:39.758655 (+ 126us) write_op.cc:270] Start()
0318 02:51:39.758673 (+ 18us) write_op.cc:276] Timestamp: P: 1773802288972062 usec, L: 0
0318 02:51:39.758794 (+ 121us) write_op.cc:270] Start()
0318 02:51:39.758809 (+ 15us) write_op.cc:276] Timestamp: P: 1773802288975230 usec, L: 0
0318 02:51:39.758925 (+ 116us) write_op.cc:270] Start()
0318 02:51:39.758944 (+ 19us) write_op.cc:276] Timestamp: P: 1773802289009019 usec, L: 0
0318 02:51:39.759065 (+ 121us) write_op.cc:270] Start()
0318 02:51:39.759083 (+ 18us) write_op.cc:276] Timestamp: P: 1773802289009730 usec, L: 0
0318 02:51:39.759218 (+ 135us) write_op.cc:270] Start()
0318 02:51:39.759247 (+ 29us) write_op.cc:276] Timestamp: P: 1773802289028066 usec, L: 0
0318 02:51:39.759357 (+ 110us) write_op.cc:270] Start()
0318 02:51:39.759374 (+ 17us) write_op.cc:276] Timestamp: P: 1773802289037887 usec, L: 0
0318 02:51:39.759493 (+ 119us) write_op.cc:270] Start()
0318 02:51:39.759509 (+ 16us) write_op.cc:276] Timestamp: P: 1773802289040367 usec, L: 0
0318 02:51:39.759606 (+ 97us) write_op.cc:270] Start()
0318 02:51:39.759630 (+ 24us) write_op.cc:276] Timestamp: P: 1773802289045358 usec, L: 0
0318 02:51:39.759750 (+ 120us) write_op.cc:270] Start()
0318 02:51:39.759771 (+ 21us) write_op.cc:276] Timestamp: P: 1773802289075026 usec, L: 0
0318 02:51:39.877002 (+117231us) write_op.cc:270] Start()
0318 02:51:39.877053 (+ 51us) write_op.cc:276] Timestamp: P: 1773802289083092 usec, L: 0
0318 02:51:39.877299 (+ 246us) write_op.cc:270] Start()
0318 02:51:39.877321 (+ 22us) write_op.cc:276] Timestamp: P: 1773802289091034 usec, L: 0
0318 02:51:39.877460 (+ 139us) write_op.cc:270] Start()
0318 02:51:39.877480 (+ 20us) write_op.cc:276] Timestamp: P: 1773802289097347 usec, L: 0
0318 02:51:39.877668 (+ 188us) write_op.cc:270] Start()
0318 02:51:39.877688 (+ 20us) write_op.cc:276] Timestamp: P: 1773802289099475 usec, L: 0
0318 02:51:39.877825 (+ 137us) write_op.cc:270] Start()
0318 02:51:39.877845 (+ 20us) write_op.cc:276] Timestamp: P: 1773802289102258 usec, L: 0
0318 02:51:39.877981 (+ 136us) write_op.cc:270] Start()
0318 02:51:39.877999 (+ 18us) write_op.cc:276] Timestamp: P: 1773802289128267 usec, L: 0
0318 02:51:39.878129 (+ 130us) write_op.cc:270] Start()
0318 02:51:39.878147 (+ 18us) write_op.cc:276] Timestamp: P: 1773802289129677 usec, L: 0
0318 02:51:39.878253 (+ 106us) write_op.cc:270] Start()
0318 02:51:39.878270 (+ 17us) write_op.cc:276] Timestamp: P: 1773802289162896 usec, L: 0
0318 02:51:39.878512 (+ 242us) write_op.cc:270] Start()
0318 02:51:39.878533 (+ 21us) write_op.cc:276] Timestamp: P: 1773802289198405 usec, L: 0
0318 02:51:39.878652 (+ 119us) write_op.cc:270] Start()
0318 02:51:39.878670 (+ 18us) write_op.cc:276] Timestamp: P: 1773802289224038 usec, L: 0
0318 02:51:39.878781 (+ 111us) write_op.cc:270] Start()
0318 02:51:39.878799 (+ 18us) write_op.cc:276] Timestamp: P: 1773802289274374 usec, L: 0
0318 02:51:39.878916 (+ 117us) write_op.cc:270] Start()
0318 02:51:39.878934 (+ 18us) write_op.cc:276] Timestamp: P: 1773802289295606 usec, L: 0
0318 02:51:39.879045 (+ 111us) write_op.cc:270] Start()
0318 02:51:39.879063 (+ 18us) write_op.cc:276] Timestamp: P: 1773802289302923 usec, L: 0
0318 02:51:39.879195 (+ 132us) write_op.cc:270] Start()
0318 02:51:39.879212 (+ 17us) write_op.cc:276] Timestamp: P: 1773802289303586 usec, L: 0
0318 02:51:39.879316 (+ 104us) write_op.cc:270] Start()
0318 02:51:39.879332 (+ 16us) write_op.cc:276] Timestamp: P: 1773802289334611 usec, L: 0
0318 02:51:39.879450 (+ 118us) write_op.cc:270] Start()
0318 02:51:39.879469 (+ 19us) write_op.cc:276] Timestamp: P: 1773802289343948 usec, L: 0
0318 02:51:39.879578 (+ 109us) write_op.cc:270] Start()
0318 02:51:39.879601 (+ 23us) write_op.cc:276] Timestamp: P: 1773802289353243 usec, L: 0
0318 02:51:39.879723 (+ 122us) write_op.cc:270] Start()
0318 02:51:39.879740 (+ 17us) write_op.cc:276] Timestamp: P: 1773802289361546 usec, L: 0
0318 02:51:39.879860 (+ 120us) write_op.cc:270] Start()
0318 02:51:39.879899 (+ 39us) write_op.cc:276] Timestamp: P: 1773802289381191 usec, L: 0
0318 02:51:39.880006 (+ 107us) write_op.cc:270] Start()
0318 02:51:39.880023 (+ 17us) write_op.cc:276] Timestamp: P: 1773802289396830 usec, L: 0
0318 02:51:39.880149 (+ 126us) write_op.cc:270] Start()
0318 02:51:39.880167 (+ 18us) write_op.cc:276] Timestamp: P: 1773802289405167 usec, L: 0
0318 02:51:39.880321 (+ 154us) write_op.cc:270] Start()
0318 02:51:39.880338 (+ 17us) write_op.cc:276] Timestamp: P: 1773802289417932 usec, L: 0
0318 02:51:39.880457 (+ 119us) write_op.cc:270] Start()
0318 02:51:39.880475 (+ 18us) write_op.cc:276] Timestamp: P: 1773802289419371 usec, L: 0
0318 02:51:39.880623 (+ 148us) write_op.cc:270] Start()
0318 02:51:39.880640 (+ 17us) write_op.cc:276] Timestamp: P: 1773802289420207 usec, L: 0
0318 02:51:39.974000 (+ 93360us) write_op.cc:270] Start()
0318 02:51:39.974044 (+ 44us) write_op.cc:276] Timestamp: P: 1773802289421049 usec, L: 0
0318 02:51:39.974256 (+ 212us) write_op.cc:270] Start()
0318 02:51:39.974278 (+ 22us) write_op.cc:276] Timestamp: P: 1773802289422008 usec, L: 0
0318 02:51:39.974397 (+ 119us) write_op.cc:270] Start()
0318 02:51:39.974416 (+ 19us) write_op.cc:276] Timestamp: P: 1773802289423235 usec, L: 0
0318 02:51:39.974551 (+ 135us) write_op.cc:270] Start()
0318 02:51:39.974569 (+ 18us) write_op.cc:276] Timestamp: P: 1773802289427763 usec, L: 0
0318 02:51:39.974690 (+ 121us) write_op.cc:270] Start()
0318 02:51:39.974715 (+ 25us) write_op.cc:276] Timestamp: P: 1773802289428336 usec, L: 0
0318 02:51:39.974819 (+ 104us) write_op.cc:270] Start()
0318 02:51:39.974835 (+ 16us) write_op.cc:276] Timestamp: P: 1773802289428894 usec, L: 0
0318 02:51:39.974931 (+ 96us) write_op.cc:270] Start()
0318 02:51:39.974948 (+ 17us) write_op.cc:276] Timestamp: P: 1773802289493094 usec, L: 0
0318 02:51:39.975055 (+ 107us) write_op.cc:270] Start()
0318 02:51:39.975153 (+ 98us) write_op.cc:276] Timestamp: P: 1773802289502019 usec, L: 0
0318 02:51:40.116863 (+141710us) write_op.cc:270] Start()
0318 02:51:40.116915 (+ 52us) write_op.cc:276] Timestamp: P: 1773802289508006 usec, L: 0
0318 02:51:40.117155 (+ 240us) write_op.cc:270] Start()
0318 02:51:40.117177 (+ 22us) write_op.cc:276] Timestamp: P: 1773802289524061 usec, L: 0
0318 02:51:40.117328 (+ 151us) write_op.cc:270] Start()
0318 02:51:40.117349 (+ 21us) write_op.cc:276] Timestamp: P: 1773802289533951 usec, L: 0
0318 02:51:40.117492 (+ 143us) write_op.cc:270] Start()
0318 02:51:40.117511 (+ 19us) write_op.cc:276] Timestamp: P: 1773802289542896 usec, L: 0
0318 02:51:40.117647 (+ 136us) write_op.cc:270] Start()
0318 02:51:40.117668 (+ 21us) write_op.cc:276] Timestamp: P: 1773802289551653 usec, L: 0
0318 02:51:40.117808 (+ 140us) write_op.cc:270] Start()
0318 02:51:40.117879 (+ 71us) write_op.cc:276] Timestamp: P: 1773802289561020 usec, L: 0
0318 02:51:40.118044 (+ 165us) write_op.cc:270] Start()
0318 02:51:40.118064 (+ 20us) write_op.cc:276] Timestamp: P: 1773802289639378 usec, L: 0
0318 02:51:40.118229 (+ 165us) write_op.cc:270] Start()
0318 02:51:40.118249 (+ 20us) write_op.cc:276] Timestamp: P: 1773802289649322 usec, L: 0
0318 02:51:40.119612 (+ 1363us) write_op.cc:270] Start()
0318 02:51:40.119640 (+ 28us) write_op.cc:276] Timestamp: P: 1773802289675309 usec, L: 0
0318 02:51:40.119767 (+ 127us) write_op.cc:270] Start()
0318 02:51:40.119787 (+ 20us) write_op.cc:276] Timestamp: P: 1773802289691120 usec, L: 0
0318 02:51:40.119904 (+ 117us) write_op.cc:270] Start()
0318 02:51:40.119920 (+ 16us) write_op.cc:276] Timestamp: P: 1773802289693609 usec, L: 0
0318 02:51:40.120050 (+ 130us) write_op.cc:270] Start()
0318 02:51:40.120071 (+ 21us) write_op.cc:276] Timestamp: P: 1773802289711318 usec, L: 0
0318 02:51:40.120219 (+ 148us) write_op.cc:270] Start()
0318 02:51:40.120241 (+ 22us) write_op.cc:276] Timestamp: P: 1773802289719598 usec, L: 0
0318 02:51:40.120366 (+ 125us) write_op.cc:270] Start()
0318 02:51:40.120387 (+ 21us) write_op.cc:276] Timestamp: P: 1773802289728960 usec, L: 0
0318 02:51:40.120514 (+ 127us) write_op.cc:270] Start()
0318 02:51:40.120531 (+ 17us) write_op.cc:276] Timestamp: P: 1773802289729926 usec, L: 0
0318 02:51:40.120643 (+ 112us) write_op.cc:270] Start()
0318 02:51:40.120659 (+ 16us) write_op.cc:276] Timestamp: P: 1773802289783801 usec, L: 0
0318 02:51:40.120826 (+ 167us) write_op.cc:270] Start()
0318 02:51:40.120844 (+ 18us) write_op.cc:276] Timestamp: P: 1773802289793921 usec, L: 0
0318 02:51:40.120966 (+ 122us) write_op.cc:270] Start()
0318 02:51:40.120984 (+ 18us) write_op.cc:276] Timestamp: P: 1773802289818251 usec, L: 0
0318 02:51:40.121103 (+ 119us) write_op.cc:270] Start()
0318 02:51:40.121133 (+ 30us) write_op.cc:276] Timestamp: P: 1773802289828550 usec, L: 0
0318 02:51:40.121256 (+ 123us) write_op.cc:270] Start()
0318 02:51:40.121272 (+ 16us) write_op.cc:276] Timestamp: P: 1773802289851496 usec, L: 0
0318 02:51:40.121384 (+ 112us) write_op.cc:270] Start()
0318 02:51:40.121401 (+ 17us) write_op.cc:276] Timestamp: P: 1773802289878789 usec, L: 0
0318 02:51:40.121519 (+ 118us) write_op.cc:270] Start()
0318 02:51:40.121535 (+ 16us) write_op.cc:276] Timestamp: P: 1773802289910513 usec, L: 0
0318 02:51:40.121654 (+ 119us) write_op.cc:270] Start()
0318 02:51:40.121671 (+ 17us) write_op.cc:276] Timestamp: P: 1773802289921907 usec, L: 0
0318 02:51:40.121777 (+ 106us) write_op.cc:270] Start()
0318 02:51:40.121794 (+ 17us) write_op.cc:276] Timestamp: P: 1773802289928607 usec, L: 0
0318 02:51:40.121911 (+ 117us) write_op.cc:270] Start()
0318 02:51:40.121928 (+ 17us) write_op.cc:276] Timestamp: P: 1773802289943434 usec, L: 0
0318 02:51:40.122035 (+ 107us) write_op.cc:270] Start()
0318 02:51:40.122053 (+ 18us) write_op.cc:276] Timestamp: P: 1773802289955825 usec, L: 0
0318 02:51:40.122189 (+ 136us) write_op.cc:270] Start()
0318 02:51:40.122207 (+ 18us) write_op.cc:276] Timestamp: P: 1773802289973552 usec, L: 0
0318 02:51:40.122366 (+ 159us) write_op.cc:270] Start()
0318 02:51:40.122388 (+ 22us) write_op.cc:276] Timestamp: P: 1773802289991191 usec, L: 0
0318 02:51:40.122506 (+ 118us) write_op.cc:270] Start()
0318 02:51:40.122522 (+ 16us) write_op.cc:276] Timestamp: P: 1773802290013019 usec, L: 0
0318 02:51:40.122627 (+ 105us) write_op.cc:270] Start()
0318 02:51:40.122643 (+ 16us) write_op.cc:276] Timestamp: P: 1773802290036798 usec, L: 0
0318 02:51:40.122744 (+ 101us) write_op.cc:270] Start()
0318 02:51:40.122759 (+ 15us) write_op.cc:276] Timestamp: P: 1773802290051167 usec, L: 0
0318 02:51:40.122873 (+ 114us) write_op.cc:270] Start()
0318 02:51:40.122889 (+ 16us) write_op.cc:276] Timestamp: P: 1773802290068740 usec, L: 0
0318 02:51:40.123007 (+ 118us) write_op.cc:270] Start()
0318 02:51:40.123024 (+ 17us) write_op.cc:276] Timestamp: P: 1773802290087555 usec, L: 0
0318 02:51:40.123145 (+ 121us) write_op.cc:270] Start()
0318 02:51:40.123162 (+ 17us) write_op.cc:276] Timestamp: P: 1773802290130358 usec, L: 0
0318 02:51:40.123263 (+ 101us) write_op.cc:270] Start()
0318 02:51:40.123279 (+ 16us) write_op.cc:276] Timestamp: P: 1773802290146178 usec, L: 0
0318 02:51:40.123394 (+ 115us) write_op.cc:270] Start()
0318 02:51:40.123412 (+ 18us) write_op.cc:276] Timestamp: P: 1773802290158306 usec, L: 0
0318 02:51:40.123537 (+ 125us) write_op.cc:270] Start()
0318 02:51:40.123556 (+ 19us) write_op.cc:276] Timestamp: P: 1773802290174080 usec, L: 0
0318 02:51:40.123716 (+ 160us) write_op.cc:270] Start()
0318 02:51:40.123733 (+ 17us) write_op.cc:276] Timestamp: P: 1773802290188521 usec, L: 0
0318 02:51:40.123838 (+ 105us) write_op.cc:270] Start()
0318 02:51:40.123854 (+ 16us) write_op.cc:276] Timestamp: P: 1773802290202691 usec, L: 0
0318 02:51:40.123951 (+ 97us) write_op.cc:270] Start()
0318 02:51:40.123967 (+ 16us) write_op.cc:276] Timestamp: P: 1773802290212983 usec, L: 0
0318 02:51:40.124078 (+ 111us) write_op.cc:270] Start()
0318 02:51:40.124095 (+ 17us) write_op.cc:276] Timestamp: P: 1773802290229001 usec, L: 0
0318 02:51:40.124237 (+ 142us) write_op.cc:270] Start()
0318 02:51:40.124258 (+ 21us) write_op.cc:276] Timestamp: P: 1773802290230690 usec, L: 0
0318 02:51:40.124388 (+ 130us) write_op.cc:270] Start()
0318 02:51:40.124409 (+ 21us) write_op.cc:276] Timestamp: P: 1773802290292251 usec, L: 0
0318 02:51:40.124557 (+ 148us) write_op.cc:270] Start()
0318 02:51:40.124583 (+ 26us) write_op.cc:276] Timestamp: P: 1773802290319327 usec, L: 0
0318 02:51:40.360759 (+236176us) write_op.cc:270] Start()
0318 02:51:40.360808 (+ 49us) write_op.cc:276] Timestamp: P: 1773802290337306 usec, L: 0
0318 02:51:40.361074 (+ 266us) write_op.cc:270] Start()
0318 02:51:40.361096 (+ 22us) write_op.cc:276] Timestamp: P: 1773802290377672 usec, L: 0
0318 02:51:40.361252 (+ 156us) write_op.cc:270] Start()
0318 02:51:40.361271 (+ 19us) write_op.cc:276] Timestamp: P: 1773802290378445 usec, L: 0
0318 02:51:40.361391 (+ 120us) write_op.cc:270] Start()
0318 02:51:40.361408 (+ 17us) write_op.cc:276] Timestamp: P: 1773802290379019 usec, L: 0
0318 02:51:40.361522 (+ 114us) write_op.cc:270] Start()
0318 02:51:40.361540 (+ 18us) write_op.cc:276] Timestamp: P: 1773802290406220 usec, L: 0
0318 02:51:40.361656 (+ 116us) write_op.cc:270] Start()
0318 02:51:40.361673 (+ 17us) write_op.cc:276] Timestamp: P: 1773802290415119 usec, L: 0
0318 02:51:40.361781 (+ 108us) write_op.cc:270] Start()
0318 02:51:40.361797 (+ 16us) write_op.cc:276] Timestamp: P: 1773802290415942 usec, L: 0
0318 02:51:40.361907 (+ 110us) write_op.cc:270] Start()
0318 02:51:40.361925 (+ 18us) write_op.cc:276] Timestamp: P: 1773802290416669 usec, L: 0
0318 02:51:40.362027 (+ 102us) write_op.cc:270] Start()
0318 02:51:40.362044 (+ 17us) write_op.cc:276] Timestamp: P: 1773802290422847 usec, L: 0
0318 02:51:40.362211 (+ 167us) write_op.cc:270] Start()
0318 02:51:40.362231 (+ 20us) write_op.cc:276] Timestamp: P: 1773802290423525 usec, L: 0
0318 02:51:40.362568 (+ 337us) write_op.cc:270] Start()
0318 02:51:40.362593 (+ 25us) write_op.cc:276] Timestamp: P: 1773802290542541 usec, L: 0
0318 02:51:40.362795 (+ 202us) write_op.cc:270] Start()
0318 02:51:40.362813 (+ 18us) write_op.cc:276] Timestamp: P: 1773802290544132 usec, L: 0
0318 02:51:40.362934 (+ 121us) write_op.cc:270] Start()
0318 02:51:40.362951 (+ 17us) write_op.cc:276] Timestamp: P: 1773802290546911 usec, L: 0
0318 02:51:40.363061 (+ 110us) write_op.cc:270] Start()
0318 02:51:40.363105 (+ 44us) write_op.cc:276] Timestamp: P: 1773802290548647 usec, L: 0
0318 02:51:40.363208 (+ 103us) write_op.cc:270] Start()
0318 02:51:40.363226 (+ 18us) write_op.cc:276] Timestamp: P: 1773802290552299 usec, L: 0
0318 02:51:40.363433 (+ 207us) write_op.cc:270] Start()
0318 02:51:40.363452 (+ 19us) write_op.cc:276] Timestamp: P: 1773802290552908 usec, L: 0
0318 02:51:40.363564 (+ 112us) write_op.cc:270] Start()
0318 02:51:40.363582 (+ 18us) write_op.cc:276] Timestamp: P: 1773802290554688 usec, L: 0
0318 02:51:40.363703 (+ 121us) write_op.cc:270] Start()
0318 02:51:40.363722 (+ 19us) write_op.cc:276] Timestamp: P: 1773802290627167 usec, L: 0
0318 02:51:40.363931 (+ 209us) write_op.cc:270] Start()
0318 02:51:40.363952 (+ 21us) write_op.cc:276] Timestamp: P: 1773802290628456 usec, L: 0
0318 02:51:40.364061 (+ 109us) write_op.cc:270] Start()
0318 02:51:40.364078 (+ 17us) write_op.cc:276] Timestamp: P: 1773802290630274 usec, L: 0
0318 02:51:40.364189 (+ 111us) write_op.cc:270] Start()
0318 02:51:40.364206 (+ 17us) write_op.cc:276] Timestamp: P: 1773802290636807 usec, L: 0
0318 02:51:40.364317 (+ 111us) write_op.cc:270] Start()
0318 02:51:40.364333 (+ 16us) write_op.cc:276] Timestamp: P: 1773802290701155 usec, L: 0
0318 02:51:40.364453 (+ 120us) write_op.cc:270] Start()
0318 02:51:40.364470 (+ 17us) write_op.cc:276] Timestamp: P: 1773802290709404 usec, L: 0
0318 02:51:40.364580 (+ 110us) write_op.cc:270] Start()
0318 02:51:40.364596 (+ 16us) write_op.cc:276] Timestamp: P: 1773802290710180 usec, L: 0
0318 02:51:40.385623 (+ 21027us) write_op.cc:270] Start()
0318 02:51:40.385666 (+ 43us) write_op.cc:276] Timestamp: P: 1773802290725158 usec, L: 0
0318 02:51:40.385916 (+ 250us) write_op.cc:270] Start()
0318 02:51:40.385942 (+ 26us) write_op.cc:276] Timestamp: P: 1773802290726053 usec, L: 0
0318 02:51:40.386092 (+ 150us) write_op.cc:270] Start()
0318 02:51:40.386113 (+ 21us) write_op.cc:276] Timestamp: P: 1773802290808438 usec, L: 0
0318 02:51:40.386238 (+ 125us) write_op.cc:270] Start()
0318 02:51:40.386258 (+ 20us) write_op.cc:276] Timestamp: P: 1773802290844270 usec, L: 0
0318 02:51:40.386397 (+ 139us) write_op.cc:270] Start()
0318 02:51:40.386416 (+ 19us) write_op.cc:276] Timestamp: P: 1773802290888057 usec, L: 0
0318 02:51:40.386586 (+ 170us) write_op.cc:270] Start()
0318 02:51:40.386607 (+ 21us) write_op.cc:276] Timestamp: P: 1773802290893702 usec, L: 0
0318 02:51:40.386748 (+ 141us) write_op.cc:270] Start()
0318 02:51:40.386768 (+ 20us) write_op.cc:276] Timestamp: P: 1773802290901196 usec, L: 0
0318 02:51:40.386902 (+ 134us) write_op.cc:270] Start()
0318 02:51:40.386921 (+ 19us) write_op.cc:276] Timestamp: P: 1773802290905501 usec, L: 0
0318 02:51:40.387053 (+ 132us) write_op.cc:270] Start()
0318 02:51:40.387073 (+ 20us) write_op.cc:276] Timestamp: P: 1773802290912934 usec, L: 0
0318 02:51:40.387208 (+ 135us) write_op.cc:270] Start()
0318 02:51:40.387230 (+ 22us) write_op.cc:276] Timestamp: P: 1773802290937348 usec, L: 0
0318 02:51:40.387402 (+ 172us) write_op.cc:270] Start()
0318 02:51:40.387425 (+ 23us) write_op.cc:276] Timestamp: P: 1773802290940308 usec, L: 0
0318 02:51:40.387549 (+ 124us) write_op.cc:270] Start()
0318 02:51:40.387568 (+ 19us) write_op.cc:276] Timestamp: P: 1773802290977353 usec, L: 0
0318 02:51:40.387682 (+ 114us) write_op.cc:270] Start()
0318 02:51:40.387700 (+ 18us) write_op.cc:276] Timestamp: P: 1773802290982723 usec, L: 0
0318 02:51:40.387821 (+ 121us) write_op.cc:270] Start()
0318 02:51:40.387839 (+ 18us) write_op.cc:276] Timestamp: P: 1773802291110847 usec, L: 0
0318 02:51:40.387968 (+ 129us) write_op.cc:270] Start()
0318 02:51:40.387987 (+ 19us) write_op.cc:276] Timestamp: P: 1773802291128376 usec, L: 0
0318 02:51:40.388117 (+ 130us) write_op.cc:270] Start()
0318 02:51:40.388138 (+ 21us) write_op.cc:276] Timestamp: P: 1773802291160537 usec, L: 0
0318 02:51:40.388263 (+ 125us) write_op.cc:270] Start()
0318 02:51:40.388282 (+ 19us) write_op.cc:276] Timestamp: P: 1773802291169886 usec, L: 0
0318 02:51:40.388432 (+ 150us) write_op.cc:270] Start()
0318 02:51:40.388453 (+ 21us) write_op.cc:276] Timestamp: P: 1773802291170892 usec, L: 0
0318 02:51:40.388595 (+ 142us) write_op.cc:270] Start()
0318 02:51:40.388615 (+ 20us) write_op.cc:276] Timestamp: P: 1773802291171427 usec, L: 0
0318 02:51:40.446188 (+ 57573us) write_op.cc:270] Start()
0318 02:51:40.446233 (+ 45us) write_op.cc:276] Timestamp: P: 1773802291187756 usec, L: 0
0318 02:51:40.446460 (+ 227us) write_op.cc:270] Start()
0318 02:51:40.446490 (+ 30us) write_op.cc:276] Timestamp: P: 1773802291190113 usec, L: 0
0318 02:51:40.446635 (+ 145us) write_op.cc:270] Start()
0318 02:51:40.446656 (+ 21us) write_op.cc:276] Timestamp: P: 1773802291191275 usec, L: 0
0318 02:51:40.446797 (+ 141us) write_op.cc:270] Start()
0318 02:51:40.446819 (+ 22us) write_op.cc:276] Timestamp: P: 1773802291203241 usec, L: 0
0318 02:51:40.446959 (+ 140us) write_op.cc:270] Start()
0318 02:51:40.446977 (+ 18us) write_op.cc:276] Timestamp: P: 1773802291206639 usec, L: 0
0318 02:51:40.447092 (+ 115us) write_op.cc:270] Start()
0318 02:51:40.447109 (+ 17us) write_op.cc:276] Timestamp: P: 1773802291209867 usec, L: 0
0318 02:51:40.447253 (+ 144us) write_op.cc:270] Start()
0318 02:51:40.447312 (+ 59us) write_op.cc:276] Timestamp: P: 1773802291227318 usec, L: 0
0318 02:51:40.447455 (+ 143us) write_op.cc:270] Start()
0318 02:51:40.447472 (+ 17us) write_op.cc:276] Timestamp: P: 1773802291227995 usec, L: 0
0318 02:51:40.447580 (+ 108us) write_op.cc:270] Start()
0318 02:51:40.447597 (+ 17us) write_op.cc:276] Timestamp: P: 1773802291303139 usec, L: 0
0318 02:51:40.447725 (+ 128us) write_op.cc:270] Start()
0318 02:51:40.447741 (+ 16us) write_op.cc:276] Timestamp: P: 1773802291303884 usec, L: 0
0318 02:51:40.447848 (+ 107us) write_op.cc:270] Start()
0318 02:51:40.447864 (+ 16us) write_op.cc:276] Timestamp: P: 1773802291304512 usec, L: 0
0318 02:51:40.447979 (+ 115us) write_op.cc:270] Start()
0318 02:51:40.447996 (+ 17us) write_op.cc:276] Timestamp: P: 1773802291306325 usec, L: 0
0318 02:51:40.448103 (+ 107us) write_op.cc:270] Start()
0318 02:51:40.448119 (+ 16us) write_op.cc:276] Timestamp: P: 1773802291306919 usec, L: 0
0318 02:51:40.448272 (+ 153us) write_op.cc:270] Start()
0318 02:51:40.448293 (+ 21us) write_op.cc:276] Timestamp: P: 1773802291307426 usec, L: 0
0318 02:51:40.448420 (+ 127us) write_op.cc:270] Start()
0318 02:51:40.448437 (+ 17us) write_op.cc:276] Timestamp: P: 1773802291308809 usec, L: 0
0318 02:51:40.448542 (+ 105us) write_op.cc:270] Start()
0318 02:51:40.448558 (+ 16us) write_op.cc:276] Timestamp: P: 1773802291309791 usec, L: 0
0318 02:51:40.448653 (+ 95us) write_op.cc:270] Start()
0318 02:51:40.448670 (+ 17us) write_op.cc:276] Timestamp: P: 1773802291310853 usec, L: 0
0318 02:51:40.448833 (+ 163us) write_op.cc:270] Start()
0318 02:51:40.448853 (+ 20us) write_op.cc:276] Timestamp: P: 1773802291395448 usec, L: 0
0318 02:51:40.448995 (+ 142us) write_op.cc:270] Start()
0318 02:51:40.449015 (+ 20us) write_op.cc:276] Timestamp: P: 1773802291679029 usec, L: 0
0318 02:51:40.449138 (+ 123us) write_op.cc:270] Start()
0318 02:51:40.449157 (+ 19us) write_op.cc:276] Timestamp: P: 1773802291679853 usec, L: 0
0318 02:51:40.449286 (+ 129us) write_op.cc:270] Start()
0318 02:51:40.449306 (+ 20us) write_op.cc:276] Timestamp: P: 1773802291680442 usec, L: 0
0318 02:51:40.449441 (+ 135us) write_op.cc:270] Start()
0318 02:51:40.449461 (+ 20us) write_op.cc:276] Timestamp: P: 1773802291797804 usec, L: 0
0318 02:51:40.449582 (+ 121us) write_op.cc:270] Start()
0318 02:51:40.449598 (+ 16us) write_op.cc:276] Timestamp: P: 1773802291815717 usec, L: 0
0318 02:51:40.449712 (+ 114us) write_op.cc:270] Start()
0318 02:51:40.449732 (+ 20us) write_op.cc:276] Timestamp: P: 1773802291864134 usec, L: 0
0318 02:51:40.449831 (+ 99us) write_op.cc:270] Start()
0318 02:51:40.449848 (+ 17us) write_op.cc:276] Timestamp: P: 1773802291877773 usec, L: 0
0318 02:51:40.449968 (+ 120us) write_op.cc:270] Start()
0318 02:51:40.449985 (+ 17us) write_op.cc:276] Timestamp: P: 1773802291878629 usec, L: 0
0318 02:51:40.450108 (+ 123us) write_op.cc:270] Start()
0318 02:51:40.450139 (+ 31us) write_op.cc:276] Timestamp: P: 1773802291879290 usec, L: 0
0318 02:51:40.450252 (+ 113us) write_op.cc:270] Start()
0318 02:51:40.450268 (+ 16us) write_op.cc:276] Timestamp: P: 1773802291879833 usec, L: 0
0318 02:51:40.450371 (+ 103us) write_op.cc:270] Start()
0318 02:51:40.450388 (+ 17us) write_op.cc:276] Timestamp: P: 1773802291880389 usec, L: 0
0318 02:51:40.450503 (+ 115us) write_op.cc:270] Start()
0318 02:51:40.450519 (+ 16us) write_op.cc:276] Timestamp: P: 1773802291921860 usec, L: 0
0318 02:51:40.450636 (+ 117us) write_op.cc:270] Start()
0318 02:51:40.450655 (+ 19us) write_op.cc:276] Timestamp: P: 1773802291923959 usec, L: 0
0318 02:51:40.450788 (+ 133us) write_op.cc:270] Start()
0318 02:51:40.450805 (+ 17us) write_op.cc:276] Timestamp: P: 1773802291939067 usec, L: 0
0318 02:51:40.450932 (+ 127us) write_op.cc:270] Start()
0318 02:51:40.450950 (+ 18us) write_op.cc:276] Timestamp: P: 1773802291947806 usec, L: 0
0318 02:51:40.451077 (+ 127us) write_op.cc:270] Start()
0318 02:51:40.451095 (+ 18us) write_op.cc:276] Timestamp: P: 1773802291957967 usec, L: 0
0318 02:51:40.451227 (+ 132us) write_op.cc:270] Start()
0318 02:51:40.451244 (+ 17us) write_op.cc:276] Timestamp: P: 1773802291981405 usec, L: 0
0318 02:51:40.451374 (+ 130us) write_op.cc:270] Start()
0318 02:51:40.451404 (+ 30us) write_op.cc:276] Timestamp: P: 1773802291985754 usec, L: 0
0318 02:51:40.577536 (+126132us) write_op.cc:270] Start()
0318 02:51:40.577582 (+ 46us) write_op.cc:276] Timestamp: P: 17738
I20260318 02:51:41.956322 451 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 061ebb62f4c54a2a8c24b90ec15402d3 (table default.Table_88caf570ec6a4dfea94952fb5718c9c6 [id=5a3571f0765948588578d8e5185807a8]). Expected version 1 got 0
I20260318 02:51:41.957046 923 raft_consensus.cc:3060] T 7c4eca5e16f84564b31933b8227fd980 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:41.963482 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 20c6f1790ed34581b7507ec63ec66718 with delete_type TABLET_DATA_DELETED (replaced by tablet ce82c595e30a4878be25be8eb3d30790) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:41.965651 452 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 061ebb62f4c54a2a8c24b90ec15402d3 (table default.Table_88caf570ec6a4dfea94952fb5718c9c6 [id=5a3571f0765948588578d8e5185807a8]). Expected version 1 got 0
I20260318 02:51:41.965727 895 tablet_service.cc:1558] Processing DeleteTablet for tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:41.966200 895 tablet_service.cc:1558] Processing DeleteTablet for tablet 42a6983dce4e476cae97b3ecb1133077 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:41.966637 2362 raft_consensus.cc:493] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:41.966796 457 master_service.cc:954] ReplaceTablet: received request to replace tablet 77a17ef7cfee4d65808b11e9cb51e7df from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:41.966786 2362 raft_consensus.cc:515] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.966833 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_420c4090dd86460db6ce0e7f8014ef94" } new_table_name: "default.Table_29abedfba984406c939677f4ea6dd227" modify_external_catalogs: true
I20260318 02:51:41.967226 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c732fb4a2d2f4001b7869a76cc1bd987" } modify_external_catalogs: true
I20260318 02:51:41.967350 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c732fb4a2d2f4001b7869a76cc1bd987" } modify_external_catalogs: true
I20260318 02:51:41.967401 2362 leader_election.cc:290] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:41.968436 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_15a4739258304320bbfc03fc6fb2f74d" } new_table_name: "default.Table_3b731fbefe4a4012b14d06edb32e1350" modify_external_catalogs: true
I20260318 02:51:41.970187 1173 tablet_bootstrap.cc:492] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:41.970403 1173 ts_tablet_manager.cc:1403] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.005s
I20260318 02:51:41.970757 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_56a4ce35e7ec45478baa1d807ae80349"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.971243 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56a4ce35e7ec45478baa1d807ae80349 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.971390 1173 raft_consensus.cc:359] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.971697 1173 raft_consensus.cc:385] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:41.971752 1173 raft_consensus.cc:740] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:41.971935 1173 consensus_queue.cc:260] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:41.972399 1173 ts_tablet_manager.cc:1434] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:41.972684 1173 tablet_bootstrap.cc:492] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:41.972872 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee5faed619d140fd99df5f104eb6adf9 consensus state has no leader
I20260318 02:51:41.973824 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_da86a39b826541a9972e82d6cb145a84" } new_table_name: "default.Table_7ad944da077644c0845bc4fd38c72ea2" modify_external_catalogs: true
I20260318 02:51:41.973790 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a6e5e0e08ba6492abc2c58baa87a1756"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.974282 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6e5e0e08ba6492abc2c58baa87a1756 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:41.974561 441 catalog_manager.cc:5075] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): alter failed for tablet b5c19bc5e07949088c84cedbf944dfdb (table default.Table_79bea80cab3d40f5bead32f2fdcf09fa [id=873432f002e14a4fa7065dcfe5caebd5]),no further retry: Not found: Tablet not found: b5c19bc5e07949088c84cedbf944dfdb
I20260318 02:51:41.974960 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_57dbd3d78d50438cb70fb8019c1521e8" } modify_external_catalogs: true
I20260318 02:51:41.975106 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_57dbd3d78d50438cb70fb8019c1521e8" } modify_external_catalogs: true
I20260318 02:51:41.975593 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c05f62a758b54e049039641416076e21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.975926 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20ecb11db30e409b9090ebfc4a4f0785 consensus state has no leader
W20260318 02:51:41.976089 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c05f62a758b54e049039641416076e21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.976274 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_96058704fc874517924223389d09a2cd" } new_table_name: "default.Table_0a8f30c79dd44034acbe3d7fc0b8b08e" modify_external_catalogs: true
W20260318 02:51:41.977246 860 leader_election.cc:343] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 20c6f1790ed34581b7507ec63ec66718
I20260318 02:51:41.979421 1173 tablet_bootstrap.cc:654] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:41.979663 862 leader_election.cc:343] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 20c6f1790ed34581b7507ec63ec66718
I20260318 02:51:41.981331 862 leader_election.cc:304] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:41.982468 2362 raft_consensus.cc:2749] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:41.982645 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8a18082bff4744809fe3fe184dc25788"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.983244 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a18082bff4744809fe3fe184dc25788 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.992147 466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8b701993861d4c11b3394a2d6588b3b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 972 } } ignore_live_leader: false dest_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" is_pre_election: true
W20260318 02:51:41.993513 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3aa05403966349ae9056777d913a0db6 consensus state has no leader
W20260318 02:51:41.994701 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ae2584d0b26b4783928a0b0a32a7f74d consensus state has no leader
I20260318 02:51:41.996935 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b388b964c5f402ea4485d266563d07a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.996935 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_636584fd33494a7d9fd584d2b6384496" } modify_external_catalogs: true
I20260318 02:51:41.997167 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_636584fd33494a7d9fd584d2b6384496" } modify_external_catalogs: true
I20260318 02:51:41.997563 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e9bb52155a63478ba4b650c36ee5412a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:41.998180 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9bb52155a63478ba4b650c36ee5412a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:41.999559 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_fe927bc33c094a8bbec3557ad85c8e15" } modify_external_catalogs: true
I20260318 02:51:41.999774 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_fe927bc33c094a8bbec3557ad85c8e15" } modify_external_catalogs: true
I20260318 02:51:41.999706 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bd0d028c717541a2803c9274d069d42f" } new_table_name: "default.Table_4d9d35043d4642988f8ab087996420c1" modify_external_catalogs: true
I20260318 02:51:42.003532 451 master_service.cc:954] ReplaceTablet: received request to replace tablet 88c0962c84624c3ea5f03c898f5ff348 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:42.004292 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_81d5251cb78d4efc811c7f615bf91ce4" } modify_external_catalogs: true
I20260318 02:51:42.004529 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_81d5251cb78d4efc811c7f615bf91ce4" } modify_external_catalogs: true
W20260318 02:51:42.005636 423 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 128595us
I20260318 02:51:42.014247 2500 tablet.cc:1723] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:42.015938 1175 ts_tablet_manager.cc:1929] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:42.016093 1175 log.cc:1199] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/9451d57fad72413c81443623c7995d4e
I20260318 02:51:42.016424 1175 ts_tablet_manager.cc:1950] T 9451d57fad72413c81443623c7995d4e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
W20260318 02:51:42.017706 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 77727d2bfb95488e943808a58920f20c consensus state has no leader
I20260318 02:51:42.019763 448 catalog_manager.cc:5671] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:42.020234 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 68b0f0cd89234e72a052f3f9f964aa35 (table default.Table_1068ed12c0774560af59c6eb9d2f292c [id=9a52b01ffd5b4f7e8a7a20a817aa842f]). Expected version 2 got 0
I20260318 02:51:42.021731 2443 tablet.cc:1723] T 7c4eca5e16f84564b31933b8227fd980 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:42.025521 1176 ts_tablet_manager.cc:1929] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:42.029712 456 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 7c4eca5e16f84564b31933b8227fd980 (table default.Table_4da517198db54744b96210b1f4438731 [id=541170c7c4bf49deb86cd4c15ffdd04f]). Expected version 1 got 0
I20260318 02:51:41.894145 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c4eca5e16f84564b31933b8227fd980" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:41.913772 1184 ts_tablet_manager.cc:1929] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:42.032018 1184 log.cc:1199] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/3dda9bd9befd427fac9dfde6f299a6ab
I20260318 02:51:42.032826 1184 ts_tablet_manager.cc:1950] T 3dda9bd9befd427fac9dfde6f299a6ab P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:42.033571 1449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8b701993861d4c11b3394a2d6588b3b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 972 } } ignore_live_leader: false dest_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" is_pre_election: true
I20260318 02:51:42.033717 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1007) took 3127 ms. Trace:
I20260318 02:51:42.033795 1184 rpcz_store.cc:276] 0318 02:51:38.906221 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.906381 (+ 160us) service_pool.cc:225] Handling call
0318 02:51:41.503792 (+2597411us) ts_tablet_manager.cc:1151] Deleting tablet 3dda9bd9befd427fac9dfde6f299a6ab
0318 02:51:41.503803 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:41.593806 (+ 90003us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:41.913626 (+319820us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:42.033694 (+120068us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2597220}
I20260318 02:51:42.034519 1969 leader_election.cc:304] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b701993861d4c11b3394a2d6588b3b7; no voters: 971baf5b9e4644c990dbf4d4fc7ba900, ee6aa91804a2401fa0ceb31b196ec40a
I20260318 02:51:42.036435 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 15f79ab1c38141adaed4bd381df26d9b
W20260318 02:51:41.918915 999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.129:46711, user_credentials={real_user=slave}} blocked reactor thread for 194976us
I20260318 02:51:41.956089 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet df499767dfee4fbd939d775db9d2577e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:41.956653 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 01d1892c446242efae8cc3ab4561f73f (DEFAULT_TABLE table=default.Table_5d0dbc23192742adaa65c0aa5f9da382 [id=17231955ba644d1eb12b16b34a9e5a97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.040318 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d1892c446242efae8cc3ab4561f73f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.957175 1039 tablet_service.cc:1511] Processing CreateTablet for tablet bc037f535c854063bee6d0a29f7c71ef (DEFAULT_TABLE table=default.Table_1f9399c6144e4eeab22c7c2219f29c03 [id=38bf687f7ca74c1fb72afece2ac00956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.043843 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc037f535c854063bee6d0a29f7c71ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.957695 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 17699eee74be4698b84ee6f604aec41a (DEFAULT_TABLE table=default.Table_7d8be37120444625a37452a9660aaa43 [id=7ccbabfaed4640f8bfb8adc8f60f7a73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.045022 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17699eee74be4698b84ee6f604aec41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.047866 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2332d8dabb79471e8c8ea545228c1d18
I20260318 02:51:41.958106 1025 tablet_service.cc:1511] Processing CreateTablet for tablet f8157efcbf83432cb46d924e013c0a98 (DEFAULT_TABLE table=default.Table_8a2e4f4c8bef459ab9c867dfd768d373 [id=e2a81b915679441cb3eeb749a89d7c2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.049028 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8157efcbf83432cb46d924e013c0a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:41.958364 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet fa077243d5634d888f3a191b7f9d2d19 with delete_type TABLET_DATA_DELETED (replaced by tablet f2c7972bf42744699012425706ac4667) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:41.959000 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 7b388b964c5f402ea4485d266563d07a (DEFAULT_TABLE table=default.Table_69553ca89bbd4df08e60a4ba2ea6840c [id=8ce43d1271b34b71a5187761a4e63994]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.006709 1111 heartbeater.cc:461] Registering TS with master...
I20260318 02:51:42.049856 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b388b964c5f402ea4485d266563d07a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.050107 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet d3b37df330984378b81b367446d34748
I20260318 02:51:42.050923 1173 tablet_bootstrap.cc:492] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:42.051076 1173 ts_tablet_manager.cc:1403] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.078s user 0.000s sys 0.008s
I20260318 02:51:42.052266 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet a7c35c13521b43789a1f0b6092b4d855
I20260318 02:51:42.028354 2494 raft_consensus.cc:493] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.052867 2494 raft_consensus.cc:515] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.053515 2494 leader_election.cc:290] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:42.056883 1173 raft_consensus.cc:359] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.057093 1173 raft_consensus.cc:385] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:42.057138 1173 raft_consensus.cc:740] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:42.058792 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 77a17ef7cfee4d65808b11e9cb51e7df
I20260318 02:51:42.059223 457 catalog_manager.cc:6741] ReplaceTablet: tablet 77a17ef7cfee4d65808b11e9cb51e7df deleted and replaced by tablet a6edb840adc6464cadfe58a98d51b5ff
I20260318 02:51:42.059657 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b8477c484db84187a3a576de6195a228
I20260318 02:51:42.068310 1173 consensus_queue.cc:260] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.076331 1173 ts_tablet_manager.cc:1434] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.025s user 0.002s sys 0.000s
I20260318 02:51:42.077308 456 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_510e870eb15a4ad2b685f4e565f310ca [id=9d4604e81d4a4c8394bf285ef36e07e2] alter complete (version 1)
I20260318 02:51:42.099819 456 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet a9c60ef260d049bea4ce729316a0d09f (table default.Table_d5ddb641ef9245ca92ab35d8ac25b157 [id=fb45f238426142faa79cbe89242c7418]). Expected version 1 got 0
I20260318 02:51:42.101423 2152 raft_consensus.cc:493] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.103425 2152 raft_consensus.cc:515] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.086851 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f0750985d947a3a9323944540abbac" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:42.104835 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608df0ce4e1d4ed6b7655802a6f7f6bc" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:42.105419 997 leader_election.cc:343] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:42.105664 997 leader_election.cc:343] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.106791 2152 leader_election.cc:290] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:42.107901 860 leader_election.cc:304] T 7c4eca5e16f84564b31933b8227fd980 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:42.108336 2362 raft_consensus.cc:2749] T 7c4eca5e16f84564b31933b8227fd980 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:42.116991 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet a9c60ef260d049bea4ce729316a0d09f (table default.Table_d5ddb641ef9245ca92ab35d8ac25b157 [id=fb45f238426142faa79cbe89242c7418]). Expected version 1 got 0
I20260318 02:51:42.119467 2494 consensus_queue.cc:1048] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:42.124998 1173 tablet_bootstrap.cc:492] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:42.124915 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1009) took 3175 ms. Trace:
I20260318 02:51:42.125095 1184 rpcz_store.cc:276] 0318 02:51:38.949801 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.949852 (+ 51us) service_pool.cc:225] Handling call
0318 02:51:42.124758 (+3174906us) ts_tablet_manager.cc:1151] Deleting tablet 7c3976c82c914fbaa88df25e1642ed6c
0318 02:51:42.124774 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.124885 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3122804}
I20260318 02:51:42.125658 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1010) took 3175 ms. Trace:
I20260318 02:51:42.126205 1184 rpcz_store.cc:276] 0318 02:51:38.950614 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.950665 (+ 51us) service_pool.cc:225] Handling call
0318 02:51:42.125541 (+3174876us) ts_tablet_manager.cc:1151] Deleting tablet 03dba645392b46c48cf543fefc6e4d53
0318 02:51:42.125552 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.125640 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3123524}
I20260318 02:51:42.126878 1184 tablet_replica.cc:333] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:42.127419 1173 tablet_bootstrap.cc:654] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:42.128521 2362 raft_consensus.cc:493] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.133651 2362 raft_consensus.cc:515] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.134362 2362 leader_election.cc:290] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:42.137121 862 leader_election.cc:343] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 7c0d87304c41481299f1e2ddfdfcfdec
I20260318 02:51:42.143616 456 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 6f8b5120633e4e0d8964f17d6d5f316d (table default.Table_ba6394a91baa4e3889ba7a14f2287aab [id=779018c836a14c518c02a844331ce251]). Expected version 1 got 0
W20260318 02:51:42.145661 860 leader_election.cc:343] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 7c0d87304c41481299f1e2ddfdfcfdec
I20260318 02:51:42.145825 860 leader_election.cc:304] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:42.146461 2362 raft_consensus.cc:2749] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:42.163595 1184 raft_consensus.cc:2243] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:42.163894 1184 raft_consensus.cc:2272] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:42.164512 1184 ts_tablet_manager.cc:1916] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:42.168188 441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.AlterSchema -> {remote=127.0.104.131:37025, user_credentials={real_user=slave}} blocked reactor thread for 193338us
W20260318 02:51:42.168640 441 catalog_manager.cc:5075] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): alter failed for tablet b5c19bc5e07949088c84cedbf944dfdb (table default.Table_79bea80cab3d40f5bead32f2fdcf09fa [id=873432f002e14a4fa7065dcfe5caebd5]),no further retry: Not found: Tablet not found: b5c19bc5e07949088c84cedbf944dfdb
I20260318 02:51:42.169057 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 3dda9bd9befd427fac9dfde6f299a6ab (table default.Table_a5974ba51eec46dfa733c7b066123d8e [id=be8bd5c24eda495abd4c05a866a2c194]) successfully deleted
W20260318 02:51:42.169926 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 7c3976c82c914fbaa88df25e1642ed6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c3976c82c914fbaa88df25e1642ed6c already in progress: creating tablet
I20260318 02:51:42.170331 1173 tablet_bootstrap.cc:492] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:42.170598 1173 ts_tablet_manager.cc:1403] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.046s user 0.005s sys 0.001s
I20260318 02:51:42.171464 1173 raft_consensus.cc:359] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.171744 1173 raft_consensus.cc:385] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:42.171836 1173 raft_consensus.cc:740] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:42.172133 1173 consensus_queue.cc:260] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.175881 2513 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260318 02:51:42.176682 1969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.188:41593, user_credentials={real_user=slave}} blocked reactor thread for 142285us
I20260318 02:51:42.180477 2492 tablet.cc:1723] T 6f8b5120633e4e0d8964f17d6d5f316d P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:42.187050 1173 ts_tablet_manager.cc:1434] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20260318 02:51:42.184592 1172 tablet_bootstrap.cc:492] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:42.193708 1172 ts_tablet_manager.cc:1403] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.376s user 0.001s sys 0.002s
I20260318 02:51:42.197212 1175 tablet_replica.cc:333] T 3d7b339a29ef456997d74a7a95d4c03a P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:42.197580 1175 raft_consensus.cc:2243] T 3d7b339a29ef456997d74a7a95d4c03a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:42.197867 1175 raft_consensus.cc:2272] T 3d7b339a29ef456997d74a7a95d4c03a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:42.199522 1995 ts_manager.cc:194] Registered new tserver with Master: 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:42.199817 1173 tablet_bootstrap.cc:492] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:42.204700 1173 tablet_bootstrap.cc:654] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:42.186416 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 6f8b5120633e4e0d8964f17d6d5f316d (table default.Table_ba6394a91baa4e3889ba7a14f2287aab [id=779018c836a14c518c02a844331ce251]). Expected version 1 got 0
W20260318 02:51:42.216679 441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.104.131:37025, user_credentials={real_user=slave}} blocked reactor thread for 46723us
W20260318 02:51:42.217042 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 03dba645392b46c48cf543fefc6e4d53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03dba645392b46c48cf543fefc6e4d53 already in progress: creating tablet
I20260318 02:51:42.225595 448 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 6f8b5120633e4e0d8964f17d6d5f316d (table default.Table_ba6394a91baa4e3889ba7a14f2287aab [id=779018c836a14c518c02a844331ce251]). Expected version 1 got 0
I20260318 02:51:42.232470 456 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_ba6394a91baa4e3889ba7a14f2287aab [id=779018c836a14c518c02a844331ce251] alter complete (version 1)
I20260318 02:51:42.239881 1173 tablet_bootstrap.cc:492] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:42.240363 1173 ts_tablet_manager.cc:1403] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.041s user 0.005s sys 0.001s
I20260318 02:51:42.241299 1173 raft_consensus.cc:359] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.241745 1173 raft_consensus.cc:385] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:42.241849 1173 raft_consensus.cc:740] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:42.242084 2488 raft_consensus.cc:493] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.242125 1173 consensus_queue.cc:260] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.242291 2488 raft_consensus.cc:515] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.244045 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461adcc8bbd94d30b9b84d1010430829" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:42.244607 997 leader_election.cc:343] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.244942 2488 leader_election.cc:290] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:42.245575 1172 raft_consensus.cc:359] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.245779 1172 raft_consensus.cc:385] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:42.248340 1172 raft_consensus.cc:740] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:42.248646 1172 consensus_queue.cc:260] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.252852 1173 ts_tablet_manager.cc:1434] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260318 02:51:42.253540 1175 ts_tablet_manager.cc:1916] T 3d7b339a29ef456997d74a7a95d4c03a P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:42.273684 441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.104.131:37025, user_credentials={real_user=slave}} blocked reactor thread for 56321.3us
I20260318 02:51:42.264444 1173 tablet_bootstrap.cc:492] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:42.291880 1173 tablet_bootstrap.cc:654] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:42.267413 926 raft_consensus.cc:3060] T 061ebb62f4c54a2a8c24b90ec15402d3 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:42.306882 2362 raft_consensus.cc:493] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.307057 2362 raft_consensus.cc:515] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.307642 2362 leader_election.cc:290] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:42.311622 860 leader_election.cc:343] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: b4ed28b9a7f2471aa4ed7cd2e1efda1a
W20260318 02:51:42.313015 862 leader_election.cc:343] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: b4ed28b9a7f2471aa4ed7cd2e1efda1a
I20260318 02:51:42.314764 862 leader_election.cc:304] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:42.315281 2362 raft_consensus.cc:2749] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:42.317869 1969 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.0.104.188:41593, user_credentials={real_user=slave}} blocked reactor thread for 48474.2us
I20260318 02:51:42.329816 2362 raft_consensus.cc:493] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.329996 2362 raft_consensus.cc:515] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.320837 2382 raft_consensus.cc:493] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.330474 2382 raft_consensus.cc:515] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.330575 2362 leader_election.cc:290] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:42.331032 2382 leader_election.cc:290] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:42.331600 860 leader_election.cc:343] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 3dda9bd9befd427fac9dfde6f299a6ab
I20260318 02:51:42.331974 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938a2eefe4471cb94a9544647f8e3e" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:42.336937 997 leader_election.cc:343] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.337801 1172 ts_tablet_manager.cc:1434] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.144s user 0.001s sys 0.000s
I20260318 02:51:42.338158 1172 tablet_bootstrap.cc:492] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:42.342731 862 leader_election.cc:343] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 3dda9bd9befd427fac9dfde6f299a6ab
I20260318 02:51:42.342880 862 leader_election.cc:304] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:42.309957 456 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 061ebb62f4c54a2a8c24b90ec15402d3 (table default.Table_88caf570ec6a4dfea94952fb5718c9c6 [id=5a3571f0765948588578d8e5185807a8]). Expected version 1 got 0
I20260318 02:51:42.345289 2362 raft_consensus.cc:2749] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:42.351205 448 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 061ebb62f4c54a2a8c24b90ec15402d3 (table default.Table_88caf570ec6a4dfea94952fb5718c9c6 [id=5a3571f0765948588578d8e5185807a8]). Expected version 1 got 0
I20260318 02:51:42.353159 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 9451d57fad72413c81443623c7995d4e (table default.Table_734eb14f943e4eab8ff7d14d00729858 [id=2d188e1de3394072a2327c0d08901bf5]) successfully deleted
W20260318 02:51:42.353415 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet c1b33758e7e546abba5b02c79db6c1d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1b33758e7e546abba5b02c79db6c1d2 already in progress: creating tablet
W20260318 02:51:42.353587 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet cce09767819441e599e7a62526d2cb75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cce09767819441e599e7a62526d2cb75 already in progress: creating tablet
W20260318 02:51:42.353753 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 5f63108c062348b1ba995ea16f40a695 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f63108c062348b1ba995ea16f40a695 already in progress: creating tablet
W20260318 02:51:42.353905 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 793a87e8bcb442c1b6fb0ecfcbc71480 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 793a87e8bcb442c1b6fb0ecfcbc71480 already in progress: creating tablet
W20260318 02:51:42.354074 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet c93e05eb5c9e4d5da1b688a03312ad8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c93e05eb5c9e4d5da1b688a03312ad8e already in progress: creating tablet
W20260318 02:51:42.356222 444 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 54ba25c5ad3747bf9845245e29561dc9 (table default.Table_4a368894951942b7be9928e9781a7378 [id=e924bfd8bcec4ee58f1b4d94208e0f80], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 54ba25c5ad3747bf9845245e29561dc9 consensus state has no leader
I20260318 02:51:42.361017 2382 raft_consensus.cc:493] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.037763 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 15f79ab1c38141adaed4bd381df26d9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:42.361193 2382 raft_consensus.cc:515] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.361642 754 tablet_service.cc:1511] Processing CreateTablet for tablet f5784c1c633045eaba000b7f0ea137c0 (DEFAULT_TABLE table=default.Table_f27228fc834e4dfa99011aca3fb3c5ea [id=ff5c2838c3e248cf87ce3e16ed155429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.361802 2382 leader_election.cc:290] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:42.362099 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5784c1c633045eaba000b7f0ea137c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.362741 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56335a4a2c294f67a22206e6a59e29a8" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:42.363240 997 leader_election.cc:343] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.051604 757 tablet_service.cc:1558] Processing DeleteTablet for tablet 2332d8dabb79471e8c8ea545228c1d18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:42.052062 752 tablet_service.cc:1558] Processing DeleteTablet for tablet d3b37df330984378b81b367446d34748 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:42.365103 752 tablet_service.cc:1511] Processing CreateTablet for tablet 6268a2a5b3ce4fc3a8fbe9f7f7ea2441 (DEFAULT_TABLE table=default.Table_b7ead4ffcc7c4b288dccc939e5013fea [id=eb4565d04298406187c89d07cab0fde3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.053102 748 tablet_service.cc:1558] Processing DeleteTablet for tablet a7c35c13521b43789a1f0b6092b4d855 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:42 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:42.056573 756 tablet_service.cc:1511] Processing CreateTablet for tablet 9c287cf49651439aa777e0d1524daf17 (DEFAULT_TABLE table=default.Table_ab97acbecde44e5185a408584586f845 [id=b144e991697e46f598f268903bb56a87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.365485 752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6268a2a5b3ce4fc3a8fbe9f7f7ea2441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.058341 759 tablet_service.cc:1511] Processing CreateTablet for tablet d6dc346742a643d0b9976f90fc7ce94f (DEFAULT_TABLE table=default.Table_bae1cb521c5c406db7f8073d5425e529 [id=d92a453d76cf4a5bbf969309b85c9c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.365571 748 tablet_service.cc:1511] Processing CreateTablet for tablet 3e1b6a6837714674b7e0450fcd679c9e (DEFAULT_TABLE table=default.Table_2245697c211947e68293c7d2b80e4837 [id=4fd1a896fabe4a089499c0c6e70a16eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.365758 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6dc346742a643d0b9976f90fc7ce94f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:42.329782 999 leader_election.cc:343] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 461adcc8bbd94d30b9b84d1010430829
I20260318 02:51:42.365103 757 tablet_service.cc:1511] Processing CreateTablet for tablet f2c7972bf42744699012425706ac4667 (DEFAULT_TABLE table=default.Table_33682c1fb3284897980e07d95f302cad [id=46bae779de56403ab810fc4dcde25233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.366120 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c7972bf42744699012425706ac4667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.059562 764 tablet_service.cc:1558] Processing DeleteTablet for tablet 77a17ef7cfee4d65808b11e9cb51e7df with delete_type TABLET_DATA_DELETED (replaced by tablet a6edb840adc6464cadfe58a98d51b5ff) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:42.060810 761 tablet_service.cc:1558] Processing DeleteTablet for tablet b8477c484db84187a3a576de6195a228 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:42.067312 751 tablet_service.cc:1511] Processing CreateTablet for tablet 558fe346f0864f4f8f4d86537575ce71 (DEFAULT_TABLE table=default.Table_441cbaff547544aba96bb83d7c61132a [id=9135446e060d4481b680fcd05a6449bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.368952 761 tablet_service.cc:1511] Processing CreateTablet for tablet a0812c94e1b4434bad968beff9e180a9 (DEFAULT_TABLE table=default.Table_c22bbb5e62d444b9ab1ccd977c2ac194 [id=9d335b22559d45f3ac19f0c3883ab3e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.067674 753 tablet_service.cc:1511] Processing CreateTablet for tablet 77b9e912d7fa447f83b63e27e70b71bd (DEFAULT_TABLE table=default.Table_35e1b87e35c947778dd94385977b5a25 [id=473fdfe2a0e94e389959f137de613141]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.067971 747 tablet_service.cc:1511] Processing CreateTablet for tablet a14cd4918b554cb2b0474f62871c054f (DEFAULT_TABLE table=default.Table_0017672117da4353a653457b466315b8 [id=65475f4d032840af8e5db620fadc3dbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.068256 760 tablet_service.cc:1511] Processing CreateTablet for tablet dd6973f619604692871ca39c8fb3b38e (DEFAULT_TABLE table=default.Table_596fb74e991f4ef8b81844cdf7522ea4 [id=4a2935154994474f864998e87ce19b20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.368952 764 tablet_service.cc:1511] Processing CreateTablet for tablet 26d4f568fb4f4a5d9b9f55c73f7ba1bf (DEFAULT_TABLE table=default.Table_8e99f9b321c347e5bbf237455c27ffd6 [id=3e1fc9923b534b35be5f30bd5eee2201]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.069574 766 tablet_service.cc:1511] Processing CreateTablet for tablet 69992d861bdd447db2b363b298245c58 (DEFAULT_TABLE table=default.Table_1f92e5cb67504f599ef161548211b85a [id=f0dd1938e3d746b49a39b4df050d81ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.076030 750 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1ee9867dba4b5e86af86b591935130 (DEFAULT_TABLE table=default.Table_c74ad47eacde4e2491f1e80f170a8cad [id=092bf009fac1433fa108252fb9c077e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.078259 755 tablet_service.cc:1511] Processing CreateTablet for tablet 91e09d5e691b4a0c876a3aaf40be2d44 (DEFAULT_TABLE table=default.Table_6134a522bf0f451994e720fe8644f4db [id=bdea889b1d424d848c9c4f13d0515509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.091215 763 tablet_service.cc:1511] Processing CreateTablet for tablet 452096c34eae4dddb822cb690e69a2b7 (DEFAULT_TABLE table=default.Table_fb13d51af88747b7870e81cc493396ea [id=ab7abb36abcd4b548a1f5f6c6d101934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.093348 762 tablet_service.cc:1511] Processing CreateTablet for tablet 9abb381f07e34c1a995d1d1ef2467fb5 (DEFAULT_TABLE table=default.Table_79bedc3624ae427a82d835cb058fa32a [id=38931bd076bf4fcdadf93683af5999d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.094841 765 tablet_service.cc:1511] Processing CreateTablet for tablet 28f06d6037fa426296ee68adbb6f689a (DEFAULT_TABLE table=default.Table_9d108b010bbd4cc69eed488a5356a87e [id=89d71b19af9547aeae2f9d3747052ace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.096482 758 tablet_service.cc:1511] Processing CreateTablet for tablet aa12fe852965419ab1803049e416c780 (DEFAULT_TABLE table=default.Table_0d2858909c654b5c9566dab7b33da1c3 [id=22c01966e3224406b3e3c039991da3c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.097888 749 tablet_service.cc:1511] Processing CreateTablet for tablet f93faa7ab523427da63b8db7e8757046 (DEFAULT_TABLE table=default.Table_4a0d32e1914846ec81bdfcb8a0fd758e [id=84a657155372475db438c6eb3119b595]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.129539 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f0750985d947a3a9323944540abbac" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:42.370471 783 raft_consensus.cc:2468] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:42.132556 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608df0ce4e1d4ed6b7655802a6f7f6bc" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:42.370733 777 raft_consensus.cc:2468] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:42.150592 2500 tablet.cc:1723] T d0652735b8c24c23ade92913c1c7ad0f P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:42.371244 999 leader_election.cc:304] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:42.371363 2478 raft_consensus.cc:493] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.371462 2478 raft_consensus.cc:515] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.372044 2478 leader_election.cc:290] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:42.372328 999 leader_election.cc:304] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:42.219091 2519 tablet.cc:1723] T 6f8b5120633e4e0d8964f17d6d5f316d P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:42.330981 1174 tablet_bootstrap.cc:492] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:42.373744 1174 ts_tablet_manager.cc:1403] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.449s user 0.093s sys 0.151s
I20260318 02:51:42.374451 1174 raft_consensus.cc:359] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.374639 1174 raft_consensus.cc:385] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:42.374694 1174 raft_consensus.cc:740] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:42.374867 1174 consensus_queue.cc:260] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.375334 1174 ts_tablet_manager.cc:1434] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:42.368587 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e1b6a6837714674b7e0450fcd679c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.375867 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b9e912d7fa447f83b63e27e70b71bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.376806 763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452096c34eae4dddb822cb690e69a2b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.376956 2521 tablet.cc:1723] T d6a08d8bbe3a4234b97203536db32078 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:42.380038 747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14cd4918b554cb2b0474f62871c054f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.372691 999 leader_election.cc:304] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:42.381923 755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e09d5e691b4a0c876a3aaf40be2d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.384346 757 tablet_service.cc:1511] Processing CreateTablet for tablet fed5aab6d9a64e59bdd86c1061c1a1ef (DEFAULT_TABLE table=default.Table_2625cc88249249458cdcf3b123670e70 [id=21856ec25faa40889df977be67b06943]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.384688 757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fed5aab6d9a64e59bdd86c1061c1a1ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.375051 2382 raft_consensus.cc:2749] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:42.385290 764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26d4f568fb4f4a5d9b9f55c73f7ba1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.385066 2488 raft_consensus.cc:2804] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:42.386478 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1ee9867dba4b5e86af86b591935130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.387414 748 tablet_service.cc:1511] Processing CreateTablet for tablet 821c1f9f90504d2580d311682fc19a5a (DEFAULT_TABLE table=default.Table_e9bb52155a63478ba4b650c36ee5412a [id=32c07a419b904aa3a10a0190c4652dac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.388558 1176 log.cc:1199] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/b9e0c54b3f1b44e4bea7253473714e94
I20260318 02:51:42.388813 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c287cf49651439aa777e0d1524daf17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.388916 1176 ts_tablet_manager.cc:1950] T b9e0c54b3f1b44e4bea7253473714e94 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:42.385865 2488 raft_consensus.cc:493] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:42.390991 2488 raft_consensus.cc:3060] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:42.392839 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69992d861bdd447db2b363b298245c58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.393834 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa05403966349ae9056777d913a0db6" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:42.394282 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa05403966349ae9056777d913a0db6" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:42.394680 719 leader_election.cc:343] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:42.394872 719 leader_election.cc:343] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.394937 719 leader_election.cc:304] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:42.395176 2467 raft_consensus.cc:2749] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:42.375743 2152 raft_consensus.cc:2804] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:42.395396 2152 raft_consensus.cc:493] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:42.395478 2152 raft_consensus.cc:3060] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:42.379191 1172 tablet_bootstrap.cc:654] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:42.375861 2492 tablet.cc:1723] T 3348b200e5ca4f6ebecb2c25ddbe27bf P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:42.396196 760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd6973f619604692871ca39c8fb3b38e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.396577 2382 consensus_queue.cc:1048] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260318 02:51:42.397311 999 leader_election.cc:343] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 56335a4a2c294f67a22206e6a59e29a8
I20260318 02:51:42.397409 999 leader_election.cc:304] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:42.397630 2382 raft_consensus.cc:2749] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:42.399574 2362 raft_consensus.cc:493] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.399786 2362 raft_consensus.cc:515] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.400494 2362 leader_election.cc:290] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:42.400835 751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 558fe346f0864f4f8f4d86537575ce71. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:42.401563 860 leader_election.cc:343] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 503386365f6a49f6b84c64b59b764c10
W20260318 02:51:42.401818 862 leader_election.cc:343] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 503386365f6a49f6b84c64b59b764c10
I20260318 02:51:42.401944 862 leader_election.cc:304] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:42.402369 2362 raft_consensus.cc:2749] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:42.412952 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0812c94e1b4434bad968beff9e180a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.414206 1173 tablet_bootstrap.cc:492] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:42.414863 1173 ts_tablet_manager.cc:1403] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.151s user 0.008s sys 0.001s
I20260318 02:51:42.417145 1173 raft_consensus.cc:359] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.417266 753 tablet_service.cc:1511] Processing CreateTablet for tablet 5947c34f2c8f4c5a9ad09703ca1bfed0 (DEFAULT_TABLE table=default.Table_8a18082bff4744809fe3fe184dc25788 [id=3d46dad0be0b463885fa769bece99854]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.417495 1173 raft_consensus.cc:385] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:42.417634 1173 raft_consensus.cc:740] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:42.417927 1173 consensus_queue.cc:260] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.421772 766 tablet_service.cc:1511] Processing CreateTablet for tablet c8c57d87e8624df8885b916c2e9daee9 (DEFAULT_TABLE table=default.Table_a6e5e0e08ba6492abc2c58baa87a1756 [id=789beaa5c775480dbc506f7595c963d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.425103 1174 tablet_bootstrap.cc:492] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:42.425974 759 tablet_service.cc:1511] Processing CreateTablet for tablet 9fbabe5fc68a4911ba4dc05fbe95f217 (DEFAULT_TABLE table=default.Table_c05f62a758b54e049039641416076e21 [id=57c7e9e86cd1465ea3b8433b171df52d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.426827 1174 tablet_bootstrap.cc:654] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:42.428278 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1102) took 1894 ms. Trace:
I20260318 02:51:42.428366 1176 rpcz_store.cc:276] 0318 02:51:40.533974 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.534560 (+ 586us) service_pool.cc:225] Handling call
0318 02:51:41.618337 (+1083777us) ts_tablet_manager.cc:1151] Deleting tablet b9e0c54b3f1b44e4bea7253473714e94
0318 02:51:41.819841 (+201504us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.019374 (+199533us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:42.025409 (+ 6035us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:42.428256 (+402847us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1083471}
I20260318 02:51:42.428833 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1108) took 1768 ms. Trace:
I20260318 02:51:42.428815 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet b9e0c54b3f1b44e4bea7253473714e94 (table default.Table_4a675721365c4600b0a6a7712c03db81 [id=96f382936c1d4b30a3c5e3a1b55b04d4]) successfully deleted
I20260318 02:51:42.428903 1176 rpcz_store.cc:276] 0318 02:51:40.660664 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.661681 (+ 1017us) service_pool.cc:225] Handling call
0318 02:51:42.428649 (+1766968us) ts_tablet_manager.cc:1151] Deleting tablet 20009aa96bf44ae88acfeef8e38bc204
0318 02:51:42.428659 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.428815 (+ 156us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1766783}
I20260318 02:51:42.429217 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1113) took 1744 ms. Trace:
I20260318 02:51:42.429277 1176 rpcz_store.cc:276] 0318 02:51:40.685056 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.685418 (+ 362us) service_pool.cc:225] Handling call
0318 02:51:42.429097 (+1743679us) ts_tablet_manager.cc:1151] Deleting tablet e993481bf55747b0a6a1c996c6917408
0318 02:51:42.429106 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.429201 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1743488}
I20260318 02:51:42.429577 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1112) took 1744 ms. Trace:
I20260318 02:51:42.429639 1176 rpcz_store.cc:276] 0318 02:51:40.684941 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.685657 (+ 716us) service_pool.cc:225] Handling call
0318 02:51:42.429460 (+1743803us) ts_tablet_manager.cc:1151] Deleting tablet 9ca9bad2b9aa4a41bb7801da61cd0d16
0318 02:51:42.429467 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.429563 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1742926}
I20260318 02:51:42.430171 757 tablet_service.cc:1558] Processing DeleteTablet for tablet a384923c86ee42d6a47ed3f68e6811df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:42.430269 756 tablet_service.cc:1511] Processing CreateTablet for tablet e960359dab0549c8a01281f4ace410b2 (DEFAULT_TABLE table=default.Table_56a4ce35e7ec45478baa1d807ae80349 [id=5da6fb44e35746dfbb16bbd36d860931]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.430269 754 tablet_service.cc:1511] Processing CreateTablet for tablet a6edb840adc6464cadfe58a98d51b5ff (DEFAULT_TABLE table=default.Table_4c6d7289bf5c4971892927a94cbf91f6 [id=94a6d43822c04d3ba847366297c204f9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:42.431347 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 20009aa96bf44ae88acfeef8e38bc204 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20009aa96bf44ae88acfeef8e38bc204 already in progress: creating tablet
W20260318 02:51:42.431604 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet e993481bf55747b0a6a1c996c6917408 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e993481bf55747b0a6a1c996c6917408 already in progress: creating tablet
W20260318 02:51:42.431797 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 9ca9bad2b9aa4a41bb7801da61cd0d16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ca9bad2b9aa4a41bb7801da61cd0d16 already in progress: creating tablet
I20260318 02:51:42.432493 2488 raft_consensus.cc:515] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.438102 1173 ts_tablet_manager.cc:1434] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260318 02:51:42.438139 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608df0ce4e1d4ed6b7655802a6f7f6bc" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:42.437548 2488 leader_election.cc:290] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
W20260318 02:51:42.439515 997 leader_election.cc:343] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.443230 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c0d87304c41481299f1e2ddfdfcfdec with delete_type TABLET_DATA_DELETED (replaced by tablet 565add8c21f343f2b11c12a9bb7ff111) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:42.443981 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 15f79ab1c38141adaed4bd381df26d9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:42.445186 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 2332d8dabb79471e8c8ea545228c1d18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:42.446549 901 tablet_service.cc:1511] Processing CreateTablet for tablet 91e09d5e691b4a0c876a3aaf40be2d44 (DEFAULT_TABLE table=default.Table_6134a522bf0f451994e720fe8644f4db [id=bdea889b1d424d848c9c4f13d0515509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.446981 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 2332d8dabb79471e8c8ea545228c1d18 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:42.447196 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e09d5e691b4a0c876a3aaf40be2d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.453454 904 tablet_service.cc:1558] Processing DeleteTablet for tablet d3b37df330984378b81b367446d34748 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:42.453867 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet d3b37df330984378b81b367446d34748 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:42.455075 904 tablet_service.cc:1558] Processing DeleteTablet for tablet a7c35c13521b43789a1f0b6092b4d855 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:42 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:42.455404 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet a7c35c13521b43789a1f0b6092b4d855 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:42 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:42.456701 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 91e09d5e691b4a0c876a3aaf40be2d44 (DEFAULT_TABLE table=default.Table_6134a522bf0f451994e720fe8644f4db [id=bdea889b1d424d848c9c4f13d0515509]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.457228 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e09d5e691b4a0c876a3aaf40be2d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.458030 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 15f79ab1c38141adaed4bd381df26d9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:42.431733 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1114) took 1746 ms. Trace:
I20260318 02:51:42.460840 1176 rpcz_store.cc:276] 0318 02:51:40.685142 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.692582 (+ 7440us) service_pool.cc:225] Handling call
0318 02:51:42.429866 (+1737284us) ts_tablet_manager.cc:1151] Deleting tablet 62af4992cca84830ab8317f734338365
0318 02:51:42.431607 (+ 1741us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.431715 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1920,"tablet-delete.queue_time_us":1737065}
I20260318 02:51:42.461433 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1118) took 1622 ms. Trace:
I20260318 02:51:42.461539 1176 rpcz_store.cc:276] 0318 02:51:40.838729 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.842514 (+ 3785us) service_pool.cc:225] Handling call
0318 02:51:42.461221 (+1618707us) ts_tablet_manager.cc:1151] Deleting tablet f5ce7b986536414099b53f61033a960d
0318 02:51:42.461237 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.461409 (+ 172us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1618508}
I20260318 02:51:42.461889 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1119) took 1616 ms. Trace:
I20260318 02:51:42.461977 1176 rpcz_store.cc:276] 0318 02:51:40.845045 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.845808 (+ 763us) service_pool.cc:225] Handling call
0318 02:51:42.461772 (+1615964us) ts_tablet_manager.cc:1151] Deleting tablet 4a60e189801440bca43f35fe787d3aa7
0318 02:51:42.461782 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.461872 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1615731}
I20260318 02:51:42.462337 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1122) took 1553 ms. Trace:
I20260318 02:51:42.462421 1176 rpcz_store.cc:276] 0318 02:51:40.908786 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.908844 (+ 58us) service_pool.cc:225] Handling call
0318 02:51:42.462221 (+1553377us) ts_tablet_manager.cc:1151] Deleting tablet 78aba0a60d494da9ac3b8b4fd3d5dc68
0318 02:51:42.462232 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.462321 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1553189}
I20260318 02:51:42.462730 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1123) took 1502 ms. Trace:
I20260318 02:51:42.462800 1176 rpcz_store.cc:276] 0318 02:51:40.960264 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.960499 (+ 235us) service_pool.cc:225] Handling call
0318 02:51:42.462620 (+1502121us) ts_tablet_manager.cc:1151] Deleting tablet 373a94164167431c87025ce82c9b88d9
0318 02:51:42.462634 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.462716 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1501918}
I20260318 02:51:42.463068 1176 tablet_replica.cc:333] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:42.433133 2478 raft_consensus.cc:493] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.463376 2478 raft_consensus.cc:515] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.463739 1176 raft_consensus.cc:2243] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:42.464056 2478 leader_election.cc:290] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:42.429630 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938a2eefe4471cb94a9544647f8e3e" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:42.464241 782 raft_consensus.cc:2468] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:42.443687 1174 tablet_bootstrap.cc:492] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:42.464586 1176 raft_consensus.cc:2272] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:42.464857 1174 ts_tablet_manager.cc:1403] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.040s user 0.007s sys 0.002s
I20260318 02:51:42.465034 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a492fdea6c44ba8439614b0dcc2ba6" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:42.465752 1174 raft_consensus.cc:359] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.465890 1174 raft_consensus.cc:385] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:42.465930 1174 raft_consensus.cc:740] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:42.453228 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608df0ce4e1d4ed6b7655802a6f7f6bc" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:42.431931 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9abb381f07e34c1a995d1d1ef2467fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.466112 1174 consensus_queue.cc:260] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.466401 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c57d87e8624df8885b916c2e9daee9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:42.466681 719 leader_election.cc:343] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.466944 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5947c34f2c8f4c5a9ad09703ca1bfed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.467245 999 leader_election.cc:304] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:42.467376 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e960359dab0549c8a01281f4ace410b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.467654 785 raft_consensus.cc:3060] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:42.467698 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821c1f9f90504d2580d311682fc19a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.467958 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a492fdea6c44ba8439614b0dcc2ba6" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:42.468261 423 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 75893.9us
W20260318 02:51:42.468478 719 leader_election.cc:343] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.468576 719 leader_election.cc:304] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:42.468952 2478 raft_consensus.cc:2749] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:42.469506 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa12fe852965419ab1803049e416c780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.469556 1174 ts_tablet_manager.cc:1434] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260318 02:51:42.469837 1174 tablet_bootstrap.cc:492] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:42.470023 2488 raft_consensus.cc:2804] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:42.470054 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f93faa7ab523427da63b8db7e8757046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.470435 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f06d6037fa426296ee68adbb6f689a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.471822 1174 tablet_bootstrap.cc:654] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:42.472630 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 62af4992cca84830ab8317f734338365 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62af4992cca84830ab8317f734338365 already in progress: creating tablet
I20260318 02:51:42.472831 2488 raft_consensus.cc:493] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:42.472962 2488 raft_consensus.cc:3060] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:42.472985 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f5ce7b986536414099b53f61033a960d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5ce7b986536414099b53f61033a960d already in progress: creating tablet
W20260318 02:51:42.473196 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 4a60e189801440bca43f35fe787d3aa7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a60e189801440bca43f35fe787d3aa7 already in progress: creating tablet
W20260318 02:51:42.473397 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 78aba0a60d494da9ac3b8b4fd3d5dc68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78aba0a60d494da9ac3b8b4fd3d5dc68 already in progress: creating tablet
W20260318 02:51:42.473618 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 373a94164167431c87025ce82c9b88d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 373a94164167431c87025ce82c9b88d9 already in progress: creating tablet
I20260318 02:51:42.474356 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fbabe5fc68a4911ba4dc05fbe95f217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.466113 1176 ts_tablet_manager.cc:1916] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:42.483242 1174 tablet_bootstrap.cc:492] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:42.483493 1174 ts_tablet_manager.cc:1403] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.007s
I20260318 02:51:42.484349 1174 raft_consensus.cc:359] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.484601 1174 raft_consensus.cc:385] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:42.487056 2478 raft_consensus.cc:493] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.488166 2478 raft_consensus.cc:515] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.488777 2478 leader_election.cc:290] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:42.489449 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df7d75e696a4aec981de3963c282b0d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:42.489672 448 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 68b0f0cd89234e72a052f3f9f964aa35 (table default.Table_1068ed12c0774560af59c6eb9d2f292c [id=9a52b01ffd5b4f7e8a7a20a817aa842f]). Expected version 2 got 0
I20260318 02:51:42.490149 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df7d75e696a4aec981de3963c282b0d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:42.490717 719 leader_election.cc:343] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:42.491135 719 leader_election.cc:343] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.491248 719 leader_election.cc:304] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:42.491425 1173 tablet_bootstrap.cc:492] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:42.491595 2478 raft_consensus.cc:2749] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:42.484700 1174 raft_consensus.cc:740] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:42.493314 1173 tablet_bootstrap.cc:654] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:42.493773 1174 consensus_queue.cc:260] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.494516 1174 ts_tablet_manager.cc:1434] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260318 02:51:42.496111 1174 tablet_bootstrap.cc:492] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:42.497970 1174 tablet_bootstrap.cc:654] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:42.503252 2152 raft_consensus.cc:515] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.504072 2152 leader_election.cc:290] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:42.504771 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f0750985d947a3a9323944540abbac" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:42.505695 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19f0750985d947a3a9323944540abbac" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:42.505884 782 raft_consensus.cc:3060] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:42.505877 997 leader_election.cc:343] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.506537 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 82858fd64d534d1abcad12bc4a93cda7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:42.509260 785 raft_consensus.cc:2468] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:42.509848 999 leader_election.cc:304] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:42.510517 2152 raft_consensus.cc:2804] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:42.510726 2152 raft_consensus.cc:697] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:42.511020 2152 consensus_queue.cc:237] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:42.515290 997 consensus_peers.cc:597] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:42.517388 2362 raft_consensus.cc:493] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.517566 2362 raft_consensus.cc:515] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.518353 2362 leader_election.cc:290] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:42.519917 860 leader_election.cc:343] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: e916c5419e3c457f98a47c6a1c6cdd56
W20260318 02:51:42.520951 862 leader_election.cc:343] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: e916c5419e3c457f98a47c6a1c6cdd56
I20260318 02:51:42.521077 862 leader_election.cc:304] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:42.521255 448 catalog_manager.cc:5671] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:42.521633 2362 raft_consensus.cc:2749] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:42.531499 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6edb840adc6464cadfe58a98d51b5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.552350 782 raft_consensus.cc:2468] T 19f0750985d947a3a9323944540abbac P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:42.555599 999 leader_election.cc:304] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:42.556128 2152 raft_consensus.cc:2804] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:42.556340 2152 raft_consensus.cc:697] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:42.556602 2152 consensus_queue.cc:237] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.560551 2488 raft_consensus.cc:515] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.561307 2488 leader_election.cc:290] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:42.562225 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938a2eefe4471cb94a9544647f8e3e" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:42.563055 997 leader_election.cc:343] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.565397 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d938a2eefe4471cb94a9544647f8e3e" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:42.565654 782 raft_consensus.cc:3060] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:42.572284 456 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 68b0f0cd89234e72a052f3f9f964aa35 (table default.Table_1068ed12c0774560af59c6eb9d2f292c [id=9a52b01ffd5b4f7e8a7a20a817aa842f]). Expected version 2 got 0
I20260318 02:51:42.573135 1184 ts_tablet_manager.cc:1929] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:42.574926 901 tablet_service.cc:1511] Processing CreateTablet for tablet 9c287cf49651439aa777e0d1524daf17 (DEFAULT_TABLE table=default.Table_ab97acbecde44e5185a408584586f845 [id=b144e991697e46f598f268903bb56a87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.576315 1184 log.cc:1199] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/2a7ddc0807d742cea258f889390e2142
I20260318 02:51:42.576187 1172 tablet_bootstrap.cc:492] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:42.577006 1172 ts_tablet_manager.cc:1403] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.239s user 0.032s sys 0.047s
I20260318 02:51:42.577860 904 tablet_service.cc:1511] Processing CreateTablet for tablet d6dc346742a643d0b9976f90fc7ce94f (DEFAULT_TABLE table=default.Table_bae1cb521c5c406db7f8073d5425e529 [id=d92a453d76cf4a5bbf969309b85c9c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.578331 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6dc346742a643d0b9976f90fc7ce94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.576071 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 9c287cf49651439aa777e0d1524daf17 (DEFAULT_TABLE table=default.Table_ab97acbecde44e5185a408584586f845 [id=b144e991697e46f598f268903bb56a87]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.579128 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c287cf49651439aa777e0d1524daf17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.580768 1172 raft_consensus.cc:359] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.580962 1172 raft_consensus.cc:385] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:42.581024 1172 raft_consensus.cc:740] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:42.581243 1172 consensus_queue.cc:260] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.581736 1172 ts_tablet_manager.cc:1434] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260318 02:51:42.582037 1172 tablet_bootstrap.cc:492] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:42.585141 456 catalog_manager.cc:5671] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:42.585719 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 68b0f0cd89234e72a052f3f9f964aa35 (table default.Table_1068ed12c0774560af59c6eb9d2f292c [id=9a52b01ffd5b4f7e8a7a20a817aa842f]). Expected version 2 got 0
I20260318 02:51:42.588637 1172 tablet_bootstrap.cc:654] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:42.596407 1176 ts_tablet_manager.cc:1929] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:42.596542 1176 log.cc:1199] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/6bb381f10d87414f9c1a99942216adc7
I20260318 02:51:42.596890 1176 ts_tablet_manager.cc:1950] T 6bb381f10d87414f9c1a99942216adc7 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:42.601091 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c287cf49651439aa777e0d1524daf17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.604288 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 77a17ef7cfee4d65808b11e9cb51e7df with delete_type TABLET_DATA_DELETED (replaced by tablet a6edb840adc6464cadfe58a98d51b5ff) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:42.577102 1184 ts_tablet_manager.cc:1950] T 2a7ddc0807d742cea258f889390e2142 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:42.602355 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 77a17ef7cfee4d65808b11e9cb51e7df with delete_type TABLET_DATA_DELETED (replaced by tablet a6edb840adc6464cadfe58a98d51b5ff) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:42.607110 904 tablet_service.cc:1558] Processing DeleteTablet for tablet b8477c484db84187a3a576de6195a228 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:42.608441 1036 tablet_service.cc:1511] Processing CreateTablet for tablet d6dc346742a643d0b9976f90fc7ce94f (DEFAULT_TABLE table=default.Table_bae1cb521c5c406db7f8073d5425e529 [id=d92a453d76cf4a5bbf969309b85c9c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.609010 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6dc346742a643d0b9976f90fc7ce94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.610852 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet b8477c484db84187a3a576de6195a228 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:42.611567 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 558fe346f0864f4f8f4d86537575ce71 (DEFAULT_TABLE table=default.Table_441cbaff547544aba96bb83d7c61132a [id=9135446e060d4481b680fcd05a6449bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.611692 904 tablet_service.cc:1511] Processing CreateTablet for tablet 558fe346f0864f4f8f4d86537575ce71 (DEFAULT_TABLE table=default.Table_441cbaff547544aba96bb83d7c61132a [id=9135446e060d4481b680fcd05a6449bd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.611855 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 77b9e912d7fa447f83b63e27e70b71bd (DEFAULT_TABLE table=default.Table_35e1b87e35c947778dd94385977b5a25 [id=473fdfe2a0e94e389959f137de613141]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.612020 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 558fe346f0864f4f8f4d86537575ce71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.612288 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b9e912d7fa447f83b63e27e70b71bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.612587 1025 tablet_service.cc:1511] Processing CreateTablet for tablet a14cd4918b554cb2b0474f62871c054f (DEFAULT_TABLE table=default.Table_0017672117da4353a653457b466315b8 [id=65475f4d032840af8e5db620fadc3dbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.612648 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 69992d861bdd447db2b363b298245c58 (DEFAULT_TABLE table=default.Table_1f92e5cb67504f599ef161548211b85a [id=f0dd1938e3d746b49a39b4df050d81ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.612854 907 tablet_service.cc:1511] Processing CreateTablet for tablet a14cd4918b554cb2b0474f62871c054f (DEFAULT_TABLE table=default.Table_0017672117da4353a653457b466315b8 [id=65475f4d032840af8e5db620fadc3dbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.612996 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14cd4918b554cb2b0474f62871c054f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.613211 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69992d861bdd447db2b363b298245c58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.613271 897 tablet_service.cc:1511] Processing CreateTablet for tablet dd6973f619604692871ca39c8fb3b38e (DEFAULT_TABLE table=default.Table_596fb74e991f4ef8b81844cdf7522ea4 [id=4a2935154994474f864998e87ce19b20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.613438 1031 tablet_service.cc:1511] Processing CreateTablet for tablet dd6973f619604692871ca39c8fb3b38e (DEFAULT_TABLE table=default.Table_596fb74e991f4ef8b81844cdf7522ea4 [id=4a2935154994474f864998e87ce19b20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.613657 899 tablet_service.cc:1511] Processing CreateTablet for tablet 69992d861bdd447db2b363b298245c58 (DEFAULT_TABLE table=default.Table_1f92e5cb67504f599ef161548211b85a [id=f0dd1938e3d746b49a39b4df050d81ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.613767 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd6973f619604692871ca39c8fb3b38e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.614187 888 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1ee9867dba4b5e86af86b591935130 (DEFAULT_TABLE table=default.Table_c74ad47eacde4e2491f1e80f170a8cad [id=092bf009fac1433fa108252fb9c077e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.616698 895 tablet_service.cc:1511] Processing CreateTablet for tablet 77b9e912d7fa447f83b63e27e70b71bd (DEFAULT_TABLE table=default.Table_35e1b87e35c947778dd94385977b5a25 [id=473fdfe2a0e94e389959f137de613141]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.619801 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 3dda9bd9befd427fac9dfde6f299a6ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:42.620540 903 tablet_service.cc:1511] Processing CreateTablet for tablet 452096c34eae4dddb822cb690e69a2b7 (DEFAULT_TABLE table=default.Table_fb13d51af88747b7870e81cc493396ea [id=ab7abb36abcd4b548a1f5f6c6d101934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.620919 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 9c1ee9867dba4b5e86af86b591935130 (DEFAULT_TABLE table=default.Table_c74ad47eacde4e2491f1e80f170a8cad [id=092bf009fac1433fa108252fb9c077e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.621039 891 tablet_service.cc:1511] Processing CreateTablet for tablet 9abb381f07e34c1a995d1d1ef2467fb5 (DEFAULT_TABLE table=default.Table_79bedc3624ae427a82d835cb058fa32a [id=38931bd076bf4fcdadf93683af5999d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.621024 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 452096c34eae4dddb822cb690e69a2b7 (DEFAULT_TABLE table=default.Table_fb13d51af88747b7870e81cc493396ea [id=ab7abb36abcd4b548a1f5f6c6d101934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.621419 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452096c34eae4dddb822cb690e69a2b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.621627 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1ee9867dba4b5e86af86b591935130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.622113 894 tablet_service.cc:1511] Processing CreateTablet for tablet 28f06d6037fa426296ee68adbb6f689a (DEFAULT_TABLE table=default.Table_9d108b010bbd4cc69eed488a5356a87e [id=89d71b19af9547aeae2f9d3747052ace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.624293 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 9abb381f07e34c1a995d1d1ef2467fb5 (DEFAULT_TABLE table=default.Table_79bedc3624ae427a82d835cb058fa32a [id=38931bd076bf4fcdadf93683af5999d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.625628 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9abb381f07e34c1a995d1d1ef2467fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.625782 898 tablet_service.cc:1511] Processing CreateTablet for tablet aa12fe852965419ab1803049e416c780 (DEFAULT_TABLE table=default.Table_0d2858909c654b5c9566dab7b33da1c3 [id=22c01966e3224406b3e3c039991da3c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.627028 1029 tablet_service.cc:1511] Processing CreateTablet for tablet 28f06d6037fa426296ee68adbb6f689a (DEFAULT_TABLE table=default.Table_9d108b010bbd4cc69eed488a5356a87e [id=89d71b19af9547aeae2f9d3747052ace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.627383 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f06d6037fa426296ee68adbb6f689a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.628970 1030 tablet_service.cc:1511] Processing CreateTablet for tablet aa12fe852965419ab1803049e416c780 (DEFAULT_TABLE table=default.Table_0d2858909c654b5c9566dab7b33da1c3 [id=22c01966e3224406b3e3c039991da3c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.628978 889 tablet_service.cc:1511] Processing CreateTablet for tablet f93faa7ab523427da63b8db7e8757046 (DEFAULT_TABLE table=default.Table_4a0d32e1914846ec81bdfcb8a0fd758e [id=84a657155372475db438c6eb3119b595]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.629406 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa12fe852965419ab1803049e416c780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.634272 2478 raft_consensus.cc:493] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.634438 2478 raft_consensus.cc:515] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.635080 2478 leader_election.cc:290] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:42.635722 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184ce58aa96d4e70ad7b2783f19ccdeb" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:42.636416 719 leader_election.cc:343] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.636670 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184ce58aa96d4e70ad7b2783f19ccdeb" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:42.639633 719 leader_election.cc:343] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.639770 719 leader_election.cc:304] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:42.640177 2478 raft_consensus.cc:2749] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:42.641559 1173 tablet_bootstrap.cc:492] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:42.641765 1173 ts_tablet_manager.cc:1403] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.150s user 0.004s sys 0.000s
I20260318 02:51:42.642539 2494 consensus_queue.cc:1048] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:42.642596 1173 raft_consensus.cc:359] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.642756 1173 raft_consensus.cc:385] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:42.642802 1173 raft_consensus.cc:740] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:42.642972 1173 consensus_queue.cc:260] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.643553 1173 ts_tablet_manager.cc:1434] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:42.644295 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1008) took 3695 ms. Trace:
I20260318 02:51:42.644399 1184 rpcz_store.cc:276] 0318 02:51:38.949027 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.952182 (+ 3155us) service_pool.cc:225] Handling call
0318 02:51:42.126832 (+3174650us) ts_tablet_manager.cc:1151] Deleting tablet 2a7ddc0807d742cea258f889390e2142
0318 02:51:42.126841 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.342910 (+216069us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:42.572996 (+230086us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:42.644248 (+ 71252us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3124772}
I20260318 02:51:42.644985 1041 tablet_service.cc:1511] Processing CreateTablet for tablet f2c7972bf42744699012425706ac4667 (DEFAULT_TABLE table=default.Table_33682c1fb3284897980e07d95f302cad [id=46bae779de56403ab810fc4dcde25233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.645177 1175 ts_tablet_manager.cc:1929] T 3d7b339a29ef456997d74a7a95d4c03a P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:42.645210 898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa12fe852965419ab1803049e416c780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.645283 1175 log.cc:1199] T 3d7b339a29ef456997d74a7a95d4c03a P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/3d7b339a29ef456997d74a7a95d4c03a
I20260318 02:51:42.645352 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c7972bf42744699012425706ac4667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.645604 1175 ts_tablet_manager.cc:1950] T 3d7b339a29ef456997d74a7a95d4c03a P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:42.645826 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 558fe346f0864f4f8f4d86537575ce71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.645871 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 6268a2a5b3ce4fc3a8fbe9f7f7ea2441 (DEFAULT_TABLE table=default.Table_b7ead4ffcc7c4b288dccc939e5013fea [id=eb4565d04298406187c89d07cab0fde3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.646200 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6268a2a5b3ce4fc3a8fbe9f7f7ea2441. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.646240 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14cd4918b554cb2b0474f62871c054f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.646587 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd6973f619604692871ca39c8fb3b38e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.646920 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69992d861bdd447db2b363b298245c58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.647265 888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c1ee9867dba4b5e86af86b591935130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.647596 891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9abb381f07e34c1a995d1d1ef2467fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.647912 894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f06d6037fa426296ee68adbb6f689a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.648236 889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f93faa7ab523427da63b8db7e8757046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.648619 895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b9e912d7fa447f83b63e27e70b71bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.648922 1184 tablet_replica.cc:333] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:42.649145 1184 raft_consensus.cc:2243] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:42.649318 1184 raft_consensus.cc:2272] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:42.649529 782 raft_consensus.cc:2468] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:42.649921 1184 ts_tablet_manager.cc:1916] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:42.650756 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452096c34eae4dddb822cb690e69a2b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.657760 892 tablet_service.cc:1511] Processing CreateTablet for tablet f5784c1c633045eaba000b7f0ea137c0 (DEFAULT_TABLE table=default.Table_f27228fc834e4dfa99011aca3fb3c5ea [id=ff5c2838c3e248cf87ce3e16ed155429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.658869 1035 tablet_service.cc:1511] Processing CreateTablet for tablet f5784c1c633045eaba000b7f0ea137c0 (DEFAULT_TABLE table=default.Table_f27228fc834e4dfa99011aca3fb3c5ea [id=ff5c2838c3e248cf87ce3e16ed155429]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.659266 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5784c1c633045eaba000b7f0ea137c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.660555 906 tablet_service.cc:1511] Processing CreateTablet for tablet f2c7972bf42744699012425706ac4667 (DEFAULT_TABLE table=default.Table_33682c1fb3284897980e07d95f302cad [id=46bae779de56403ab810fc4dcde25233]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.660962 902 tablet_service.cc:1511] Processing CreateTablet for tablet 6268a2a5b3ce4fc3a8fbe9f7f7ea2441 (DEFAULT_TABLE table=default.Table_b7ead4ffcc7c4b288dccc939e5013fea [id=eb4565d04298406187c89d07cab0fde3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.663292 999 leader_election.cc:304] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:42.663898 2488 raft_consensus.cc:2804] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:42.664077 2488 raft_consensus.cc:697] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:42.664325 2488 consensus_queue.cc:237] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.671933 890 tablet_service.cc:1511] Processing CreateTablet for tablet 3e1b6a6837714674b7e0450fcd679c9e (DEFAULT_TABLE table=default.Table_2245697c211947e68293c7d2b80e4837 [id=4fd1a896fabe4a089499c0c6e70a16eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.673161 900 tablet_service.cc:1511] Processing CreateTablet for tablet 26d4f568fb4f4a5d9b9f55c73f7ba1bf (DEFAULT_TABLE table=default.Table_8e99f9b321c347e5bbf237455c27ffd6 [id=3e1fc9923b534b35be5f30bd5eee2201]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.672900 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 3e1b6a6837714674b7e0450fcd679c9e (DEFAULT_TABLE table=default.Table_2245697c211947e68293c7d2b80e4837 [id=4fd1a896fabe4a089499c0c6e70a16eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.673498 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 26d4f568fb4f4a5d9b9f55c73f7ba1bf (DEFAULT_TABLE table=default.Table_8e99f9b321c347e5bbf237455c27ffd6 [id=3e1fc9923b534b35be5f30bd5eee2201]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.673954 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26d4f568fb4f4a5d9b9f55c73f7ba1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.674033 896 tablet_service.cc:1511] Processing CreateTablet for tablet a0812c94e1b4434bad968beff9e180a9 (DEFAULT_TABLE table=default.Table_c22bbb5e62d444b9ab1ccd977c2ac194 [id=9d335b22559d45f3ac19f0c3883ab3e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.674937 893 tablet_service.cc:1511] Processing CreateTablet for tablet fed5aab6d9a64e59bdd86c1061c1a1ef (DEFAULT_TABLE table=default.Table_2625cc88249249458cdcf3b123670e70 [id=21856ec25faa40889df977be67b06943]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.675523 1030 tablet_service.cc:1511] Processing CreateTablet for tablet f93faa7ab523427da63b8db7e8757046 (DEFAULT_TABLE table=default.Table_4a0d32e1914846ec81bdfcb8a0fd758e [id=84a657155372475db438c6eb3119b595]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.675779 1025 tablet_service.cc:1511] Processing CreateTablet for tablet fed5aab6d9a64e59bdd86c1061c1a1ef (DEFAULT_TABLE table=default.Table_2625cc88249249458cdcf3b123670e70 [id=21856ec25faa40889df977be67b06943]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.676251 905 tablet_service.cc:1558] Processing DeleteTablet for tablet 503386365f6a49f6b84c64b59b764c10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:42.676434 1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fed5aab6d9a64e59bdd86c1061c1a1ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.676951 1029 tablet_service.cc:1511] Processing CreateTablet for tablet a0812c94e1b4434bad968beff9e180a9 (DEFAULT_TABLE table=default.Table_c22bbb5e62d444b9ab1ccd977c2ac194 [id=9d335b22559d45f3ac19f0c3883ab3e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.676964 905 tablet_service.cc:1511] Processing CreateTablet for tablet 821c1f9f90504d2580d311682fc19a5a (DEFAULT_TABLE table=default.Table_e9bb52155a63478ba4b650c36ee5412a [id=32c07a419b904aa3a10a0190c4652dac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.675990 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 461adcc8bbd94d30b9b84d1010430829 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:42.677466 1029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0812c94e1b4434bad968beff9e180a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.678545 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 821c1f9f90504d2580d311682fc19a5a (DEFAULT_TABLE table=default.Table_e9bb52155a63478ba4b650c36ee5412a [id=32c07a419b904aa3a10a0190c4652dac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.678948 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821c1f9f90504d2580d311682fc19a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.680936 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 5947c34f2c8f4c5a9ad09703ca1bfed0 (DEFAULT_TABLE table=default.Table_8a18082bff4744809fe3fe184dc25788 [id=3d46dad0be0b463885fa769bece99854]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.680991 1037 tablet_service.cc:1511] Processing CreateTablet for tablet e960359dab0549c8a01281f4ace410b2 (DEFAULT_TABLE table=default.Table_56a4ce35e7ec45478baa1d807ae80349 [id=5da6fb44e35746dfbb16bbd36d860931]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.681176 1034 tablet_service.cc:1511] Processing CreateTablet for tablet a6edb840adc6464cadfe58a98d51b5ff (DEFAULT_TABLE table=default.Table_4c6d7289bf5c4971892927a94cbf91f6 [id=94a6d43822c04d3ba847366297c204f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.681401 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e960359dab0549c8a01281f4ace410b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.681511 1043 tablet_service.cc:1558] Processing DeleteTablet for tablet 46ce65cca47f48db94e70226494cfbae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:42.681809 1028 tablet_service.cc:1511] Processing CreateTablet for tablet c8c57d87e8624df8885b916c2e9daee9 (DEFAULT_TABLE table=default.Table_a6e5e0e08ba6492abc2c58baa87a1756 [id=789beaa5c775480dbc506f7595c963d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.682126 1028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c57d87e8624df8885b916c2e9daee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.680999 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 9fbabe5fc68a4911ba4dc05fbe95f217 (DEFAULT_TABLE table=default.Table_c05f62a758b54e049039641416076e21 [id=57c7e9e86cd1465ea3b8433b171df52d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.691114 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5947c34f2c8f4c5a9ad09703ca1bfed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.693212 2337 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:42.694684 2337 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: This master's current role is: LEADER
I20260318 02:51:42.711191 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1124) took 1750 ms. Trace:
I20260318 02:51:42.711319 1176 rpcz_store.cc:276] 0318 02:51:40.960398 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.960761 (+ 363us) service_pool.cc:225] Handling call
0318 02:51:42.463000 (+1502239us) ts_tablet_manager.cc:1151] Deleting tablet 6bb381f10d87414f9c1a99942216adc7
0318 02:51:42.463010 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.555694 (+ 92684us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:42.596278 (+ 40584us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:42.711153 (+114875us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1502099}
I20260318 02:51:42.711779 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1125) took 1748 ms. Trace:
I20260318 02:51:42.711859 1176 rpcz_store.cc:276] 0318 02:51:40.963298 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.963348 (+ 50us) service_pool.cc:225] Handling call
0318 02:51:42.711627 (+1748279us) ts_tablet_manager.cc:1151] Deleting tablet 916f7a2a31f843e39f8703ba72b78287
0318 02:51:42.711636 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.711759 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1748116}
I20260318 02:51:42.712220 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 6bb381f10d87414f9c1a99942216adc7 (table default.Table_944b58673e2348228ec36d8ba31e25b4 [id=b175f925e78640e586132f07ed6e44c0]) successfully deleted
I20260318 02:51:42.712533 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e1b6a6837714674b7e0450fcd679c9e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:42.712796 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 916f7a2a31f843e39f8703ba72b78287 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 916f7a2a31f843e39f8703ba72b78287 already in progress: creating tablet
I20260318 02:51:42.713958 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1126) took 1743 ms. Trace:
I20260318 02:51:42.714042 1176 rpcz_store.cc:276] 0318 02:51:40.970659 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.970710 (+ 51us) service_pool.cc:225] Handling call
0318 02:51:42.712173 (+1741463us) ts_tablet_manager.cc:1151] Deleting tablet 6a65ccfd73234e8fb2bea5b6911cb3f1
0318 02:51:42.712183 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.713937 (+ 1754us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1741303}
W20260318 02:51:42.714680 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 already in progress: creating tablet
I20260318 02:51:42.714849 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1142) took 1579 ms. Trace:
I20260318 02:51:42.716048 1176 rpcz_store.cc:276] 0318 02:51:41.135184 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.164258 (+ 29074us) service_pool.cc:225] Handling call
0318 02:51:42.714264 (+1550006us) ts_tablet_manager.cc:1151] Deleting tablet c1b33758e7e546abba5b02c79db6c1d2
0318 02:51:42.714274 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.714828 (+ 554us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1549790}
I20260318 02:51:42.716523 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1156) took 1465 ms. Trace:
I20260318 02:51:42.716590 1176 rpcz_store.cc:276] 0318 02:51:41.250677 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.251334 (+ 657us) service_pool.cc:225] Handling call
0318 02:51:42.716370 (+1465036us) ts_tablet_manager.cc:1151] Deleting tablet cce09767819441e599e7a62526d2cb75
0318 02:51:42.716381 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.716506 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1464269}
W20260318 02:51:42.717547 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet c1b33758e7e546abba5b02c79db6c1d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1b33758e7e546abba5b02c79db6c1d2 already in progress: creating tablet
W20260318 02:51:42.717872 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet cce09767819441e599e7a62526d2cb75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cce09767819441e599e7a62526d2cb75 already in progress: creating tablet
I20260318 02:51:42.718360 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1154) took 1467 ms. Trace:
I20260318 02:51:42.718506 1176 rpcz_store.cc:276] 0318 02:51:41.250523 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.251124 (+ 601us) service_pool.cc:225] Handling call
0318 02:51:42.716826 (+1465702us) ts_tablet_manager.cc:1151] Deleting tablet c93e05eb5c9e4d5da1b688a03312ad8e
0318 02:51:42.716836 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.718313 (+ 1477us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1464579}
I20260318 02:51:42.719486 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1155) took 1468 ms. Trace:
I20260318 02:51:42.719760 1176 rpcz_store.cc:276] 0318 02:51:41.250603 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.251151 (+ 548us) service_pool.cc:225] Handling call
0318 02:51:42.719214 (+1468063us) ts_tablet_manager.cc:1151] Deleting tablet 793a87e8bcb442c1b6fb0ecfcbc71480
0318 02:51:42.719226 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.719437 (+ 211us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1466572}
I20260318 02:51:42.720480 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1157) took 1459 ms. Trace:
I20260318 02:51:42.720700 1176 rpcz_store.cc:276] 0318 02:51:41.261249 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.261551 (+ 302us) service_pool.cc:225] Handling call
0318 02:51:42.720263 (+1458712us) ts_tablet_manager.cc:1151] Deleting tablet 5f63108c062348b1ba995ea16f40a695
0318 02:51:42.720273 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.720460 (+ 187us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1458455}
I20260318 02:51:42.721443 1176 tablet_replica.cc:333] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:42.725832 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fbabe5fc68a4911ba4dc05fbe95f217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.726161 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f93faa7ab523427da63b8db7e8757046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.726369 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6edb840adc6464cadfe58a98d51b5ff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:42.726706 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet c93e05eb5c9e4d5da1b688a03312ad8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c93e05eb5c9e4d5da1b688a03312ad8e already in progress: creating tablet
W20260318 02:51:42.726982 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 793a87e8bcb442c1b6fb0ecfcbc71480 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 793a87e8bcb442c1b6fb0ecfcbc71480 already in progress: creating tablet
W20260318 02:51:42.727166 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 5f63108c062348b1ba995ea16f40a695 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f63108c062348b1ba995ea16f40a695 already in progress: creating tablet
I20260318 02:51:42.733734 2478 raft_consensus.cc:493] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.733925 2478 raft_consensus.cc:515] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.734083 2362 raft_consensus.cc:493] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.734297 2362 raft_consensus.cc:515] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.734629 2478 leader_election.cc:290] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:42.734946 2362 leader_election.cc:290] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:42.735596 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aeffffd34f047eeaa9a8a5100c7aad2" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:42.736147 719 leader_election.cc:343] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:42.736159 860 leader_election.cc:343] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 2a7ddc0807d742cea258f889390e2142
W20260318 02:51:42.736569 862 leader_election.cc:343] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2a7ddc0807d742cea258f889390e2142
I20260318 02:51:42.736689 862 leader_election.cc:304] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:42.737121 2362 raft_consensus.cc:2749] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:42.739008 1176 raft_consensus.cc:2243] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:42.739459 1176 pending_rounds.cc:70] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad: Trying to abort 1 pending ops.
I20260318 02:51:42.739532 1176 pending_rounds.cc:77] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494227557515264 op_type: NO_OP noop_request { }
W20260318 02:51:42.740044 999 consensus_peers.cc:597] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d -> Peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Couldn't send request to peer 6a903d876086423b8016d705b98895ad. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:42.739629 1176 raft_consensus.cc:2889] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:42.740262 1176 raft_consensus.cc:2272] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:42.745661 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aeffffd34f047eeaa9a8a5100c7aad2" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:42.746465 719 leader_election.cc:343] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.746588 719 leader_election.cc:304] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:42.746876 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26d4f568fb4f4a5d9b9f55c73f7ba1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.747145 2478 raft_consensus.cc:2749] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:42.747644 1173 tablet_bootstrap.cc:492] T 0b39433a5a7f42c39139db0da77ae75f P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:42.749366 1173 tablet_bootstrap.cc:654] T 0b39433a5a7f42c39139db0da77ae75f P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:42.750396 456 catalog_manager.cc:5671] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
W20260318 02:51:42.751293 997 consensus_peers.cc:597] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:42.752599 1174 tablet_bootstrap.cc:492] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:42.752823 1174 ts_tablet_manager.cc:1403] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.257s user 0.019s sys 0.045s
I20260318 02:51:42.753628 1174 raft_consensus.cc:359] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.753919 1174 raft_consensus.cc:385] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:42.754299 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5784c1c633045eaba000b7f0ea137c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.755635 1174 raft_consensus.cc:740] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:42.756006 1174 consensus_queue.cc:260] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.756944 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c7972bf42744699012425706ac4667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.757556 1174 ts_tablet_manager.cc:1434] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260318 02:51:42.761636 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1124) took 1437 ms. Trace:
I20260318 02:51:42.761739 1175 rpcz_store.cc:276] 0318 02:51:41.323899 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.325335 (+ 1436us) service_pool.cc:225] Handling call
0318 02:51:42.197143 (+871808us) ts_tablet_manager.cc:1151] Deleting tablet 3d7b339a29ef456997d74a7a95d4c03a
0318 02:51:42.197157 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.326497 (+129340us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:42.645066 (+318569us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:42.761609 (+116543us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":871585}
I20260318 02:51:42.762229 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1125) took 1251 ms. Trace:
I20260318 02:51:42.762305 1175 rpcz_store.cc:276] 0318 02:51:41.510974 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.511041 (+ 67us) service_pool.cc:225] Handling call
0318 02:51:42.762056 (+1251015us) ts_tablet_manager.cc:1151] Deleting tablet cf73a9f8f67b42d9baf1396d70a1a3a9
0318 02:51:42.762066 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.762170 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1250759}
I20260318 02:51:42.762540 1175 tablet_replica.cc:333] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:42.762735 1175 raft_consensus.cc:2243] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:42.762925 1175 raft_consensus.cc:2272] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:42.763492 1175 ts_tablet_manager.cc:1916] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:42.764268 897 tablet_service.cc:1511] Processing CreateTablet for tablet c8c57d87e8624df8885b916c2e9daee9 (DEFAULT_TABLE table=default.Table_a6e5e0e08ba6492abc2c58baa87a1756 [id=789beaa5c775480dbc506f7595c963d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.764492 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6268a2a5b3ce4fc3a8fbe9f7f7ea2441. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:42.764775 441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.189:45933, user_credentials={real_user=slave}} blocked reactor thread for 75315us
I20260318 02:51:42.764912 904 tablet_service.cc:1511] Processing CreateTablet for tablet 9fbabe5fc68a4911ba4dc05fbe95f217 (DEFAULT_TABLE table=default.Table_c05f62a758b54e049039641416076e21 [id=57c7e9e86cd1465ea3b8433b171df52d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.765234 904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fbabe5fc68a4911ba4dc05fbe95f217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.765393 448 master_service.cc:954] ReplaceTablet: received request to replace tablet 1294e1ae2115471a8b605d38f1c26e60 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:42.767954 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1210b24bede242a0a3b439a15ffec0ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:42.768570 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1210b24bede242a0a3b439a15ffec0ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:42.769115 907 tablet_service.cc:1511] Processing CreateTablet for tablet a6edb840adc6464cadfe58a98d51b5ff (DEFAULT_TABLE table=default.Table_4c6d7289bf5c4971892927a94cbf91f6 [id=94a6d43822c04d3ba847366297c204f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.769443 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6edb840adc6464cadfe58a98d51b5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.770941 2540 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6aa91804a2401fa0ceb31b196ec40a)
I20260318 02:51:42.771131 2540 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:42.771464 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_244ca241adf044069b5c10b920250490"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:42.771952 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_244ca241adf044069b5c10b920250490 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:42.772254 466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8b701993861d4c11b3394a2d6588b3b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 972 } } ignore_live_leader: false dest_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" is_pre_election: true
I20260318 02:51:42.772290 906 tablet_service.cc:1511] Processing CreateTablet for tablet e960359dab0549c8a01281f4ace410b2 (DEFAULT_TABLE table=default.Table_56a4ce35e7ec45478baa1d807ae80349 [id=5da6fb44e35746dfbb16bbd36d860931]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.772667 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e960359dab0549c8a01281f4ace410b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.773090 2540 leader_election.cc:290] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6aa91804a2401fa0ceb31b196ec40a (127.0.104.190:39451), 971baf5b9e4644c990dbf4d4fc7ba900 (127.0.104.188:41593)
I20260318 02:51:42.774801 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a9f568c4445f4507b84191a5f08a74b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:42.775324 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9f568c4445f4507b84191a5f08a74b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:42.776084 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f27db9223f88459e8879c83e06263a3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:42.776546 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f27db9223f88459e8879c83e06263a3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:42.777000 888 tablet_service.cc:1558] Processing DeleteTablet for tablet e916c5419e3c457f98a47c6a1c6cdd56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:25 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:42.777810 1449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8b701993861d4c11b3394a2d6588b3b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 972 } } ignore_live_leader: false dest_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" is_pre_election: true
I20260318 02:51:42.777839 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_dd92209cbeed4e13b219f8c910e19bef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:42.777956 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 2a7ddc0807d742cea258f889390e2142 (table default.Table_23b963651b514aeaa69a42da8e6d2150 [id=ff1dddd3bf73410c816e618a9931c7cf]) successfully deleted
W20260318 02:51:42.778357 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd92209cbeed4e13b219f8c910e19bef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:42.779507 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2013b3bbb3474786b82fe42ceaf78627"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:42.780000 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2013b3bbb3474786b82fe42ceaf78627 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:42.783456 1969 leader_election.cc:304] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b701993861d4c11b3394a2d6588b3b7; no voters: 971baf5b9e4644c990dbf4d4fc7ba900, ee6aa91804a2401fa0ceb31b196ec40a
I20260318 02:51:42.764268 903 tablet_service.cc:1511] Processing CreateTablet for tablet 5947c34f2c8f4c5a9ad09703ca1bfed0 (DEFAULT_TABLE table=default.Table_8a18082bff4744809fe3fe184dc25788 [id=3d46dad0be0b463885fa769bece99854]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:42.783905 2540 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260318 02:51:42.784700 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1fb3a44bfb2f4aac917af6b4684d7668" } new_table_name: "default.Table_c0956e46e13c47bc95482c534f632c04" modify_external_catalogs: true
I20260318 02:51:42.789168 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1e7bd39aa78143a98dbbbb347da75cb9" } new_table_name: "default.Table_c6e059b5df104857a5812234429fe42a" modify_external_catalogs: true
I20260318 02:51:42.791875 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_629d056f6284466ea2f3fef7bc274074" } new_table_name: "default.Table_91e64c048d4048168906fcd3d1a5b3d0" modify_external_catalogs: true
I20260318 02:51:42.792032 1174 tablet_bootstrap.cc:492] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:42.794746 1174 tablet_bootstrap.cc:654] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:42.796579 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 64c2a579264e43b9a1e25ded000d4d9f with delete_type TABLET_DATA_DELETED (replaced by tablet 5ce282f91c2f44b59c0b6ea836ad5d0e) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:42.806087 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 1294e1ae2115471a8b605d38f1c26e60
I20260318 02:51:42.806651 448 catalog_manager.cc:6741] ReplaceTablet: tablet 1294e1ae2115471a8b605d38f1c26e60 deleted and replaced by tablet 115d4717824b46408d0787b657596155
I20260318 02:51:42.807992 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 1294e1ae2115471a8b605d38f1c26e60 with delete_type TABLET_DATA_DELETED (replaced by tablet 115d4717824b46408d0787b657596155) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:42.809201 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 1294e1ae2115471a8b605d38f1c26e60 with delete_type TABLET_DATA_DELETED (replaced by tablet 115d4717824b46408d0787b657596155) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:42.824900 2467 raft_consensus.cc:493] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.825070 2467 raft_consensus.cc:515] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.825790 2467 leader_election.cc:290] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:42.826610 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a384923c86ee42d6a47ed3f68e6811df" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:42.826804 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a384923c86ee42d6a47ed3f68e6811df" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:42.827251 719 leader_election.cc:343] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:42.828466 719 leader_election.cc:343] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.828585 719 leader_election.cc:304] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:42.828984 1172 tablet_bootstrap.cc:492] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:42.829104 2467 raft_consensus.cc:2749] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:42.829161 1172 ts_tablet_manager.cc:1403] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.247s user 0.018s sys 0.015s
I20260318 02:51:42.829799 1173 tablet_bootstrap.cc:492] T 0b39433a5a7f42c39139db0da77ae75f P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:42.829860 2467 raft_consensus.cc:493] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.829960 1173 ts_tablet_manager.cc:1403] T 0b39433a5a7f42c39139db0da77ae75f P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.082s user 0.000s sys 0.003s
I20260318 02:51:42.829877 1172 raft_consensus.cc:359] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.830046 1172 raft_consensus.cc:385] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:42.829977 2467 raft_consensus.cc:515] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.830112 1172 raft_consensus.cc:740] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:42.830341 1172 consensus_queue.cc:260] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.830615 2467 leader_election.cc:290] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:42.830693 1173 raft_consensus.cc:359] T 0b39433a5a7f42c39139db0da77ae75f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.830844 1173 raft_consensus.cc:385] T 0b39433a5a7f42c39139db0da77ae75f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:42.830899 1173 raft_consensus.cc:740] T 0b39433a5a7f42c39139db0da77ae75f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:42.831385 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82858fd64d534d1abcad12bc4a93cda7" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:42.831465 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82858fd64d534d1abcad12bc4a93cda7" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:42.831550 1184 ts_tablet_manager.cc:1929] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:42.831681 1184 log.cc:1199] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/8a0af3aecf4f485ebc54e1955eca8c92
W20260318 02:51:42.831916 719 leader_election.cc:343] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.832039 1184 ts_tablet_manager.cc:1950] T 8a0af3aecf4f485ebc54e1955eca8c92 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
W20260318 02:51:42.832968 719 leader_election.cc:343] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.833057 719 leader_election.cc:304] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:42.833468 2467 raft_consensus.cc:2749] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:42.835115 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 3d7b339a29ef456997d74a7a95d4c03a (table default.Table_2999327e014d4062a8e1aef2ba9ee277 [id=545ec19ee7a34ceb8e7adb93b6eaecf8]) successfully deleted
W20260318 02:51:42.835578 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet cf73a9f8f67b42d9baf1396d70a1a3a9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf73a9f8f67b42d9baf1396d70a1a3a9 already in progress: creating tablet
I20260318 02:51:42.837697 1173 consensus_queue.cc:260] T 0b39433a5a7f42c39139db0da77ae75f P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.838143 901 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a7ddc0807d742cea258f889390e2142 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:42.840837 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 1294e1ae2115471a8b605d38f1c26e60 with delete_type TABLET_DATA_DELETED (replaced by tablet 115d4717824b46408d0787b657596155) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:42.842290 901 tablet_service.cc:1558] Processing DeleteTablet for tablet ba3e7e9a85c94d7380b96a9373c1f503 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:42.849897 1173 ts_tablet_manager.cc:1434] T 0b39433a5a7f42c39139db0da77ae75f P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.020s user 0.000s sys 0.002s
I20260318 02:51:42.850493 1172 ts_tablet_manager.cc:1434] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:42.850878 1172 tablet_bootstrap.cc:492] T bcb731f97a764183aba7408bae969331 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:42.855760 1173 tablet_bootstrap.cc:492] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:42.859166 1174 tablet_bootstrap.cc:492] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:42.859714 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1012) took 3905 ms. Trace:
I20260318 02:51:42.861493 1174 ts_tablet_manager.cc:1403] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.070s user 0.004s sys 0.001s
I20260318 02:51:42.860617 1172 tablet_bootstrap.cc:654] T bcb731f97a764183aba7408bae969331 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:42.872190 1174 raft_consensus.cc:359] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.861749 1184 rpcz_store.cc:276] 0318 02:51:38.954575 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.954628 (+ 53us) service_pool.cc:225] Handling call
0318 02:51:42.644640 (+3690012us) ts_tablet_manager.cc:1151] Deleting tablet 8a0af3aecf4f485ebc54e1955eca8c92
0318 02:51:42.644650 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.741553 (+ 96903us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:42.831400 (+ 89847us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:42.859686 (+ 28286us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3639448}
I20260318 02:51:42.874191 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 8a0af3aecf4f485ebc54e1955eca8c92 (table default.Table_7671b3be1e0c4259a325679c394aae2c [id=688586df74e84dc0a4fc5dc50ef48f32]) successfully deleted
I20260318 02:51:42.875370 1184 tablet_replica.cc:333] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:42.877817 1184 raft_consensus.cc:2243] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:42.892549 927 raft_consensus.cc:3060] T 0b39433a5a7f42c39139db0da77ae75f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:42.898151 1184 raft_consensus.cc:2272] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:42.898995 1184 ts_tablet_manager.cc:1916] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:42.888151 1176 ts_tablet_manager.cc:1916] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:42.896768 2467 raft_consensus.cc:493] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.907001 2467 raft_consensus.cc:515] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:42.907727 2467 leader_election.cc:290] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:42.908304 1174 raft_consensus.cc:385] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:42.908444 1174 raft_consensus.cc:740] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:42.908665 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f37ab96f13444fcbb5cfc3ad92d53c35" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:42.909785 719 leader_election.cc:343] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.915546 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0812c94e1b4434bad968beff9e180a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.915967 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e1b6a6837714674b7e0450fcd679c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.916343 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821c1f9f90504d2580d311682fc19a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.916920 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5947c34f2c8f4c5a9ad09703ca1bfed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.916810 1174 consensus_queue.cc:260] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.917317 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fed5aab6d9a64e59bdd86c1061c1a1ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.917411 1173 tablet_bootstrap.cc:654] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:42.917622 1174 ts_tablet_manager.cc:1434] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.054s user 0.002s sys 0.000s
I20260318 02:51:42.917699 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c57d87e8624df8885b916c2e9daee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:42.917943 1174 tablet_bootstrap.cc:492] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:42.919615 1174 tablet_bootstrap.cc:654] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:42.927915 2467 raft_consensus.cc:493] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.928110 2467 raft_consensus.cc:515] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.909221 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f37ab96f13444fcbb5cfc3ad92d53c35" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:42.916496 1172 tablet_bootstrap.cc:492] T bcb731f97a764183aba7408bae969331 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:42.928751 2467 leader_election.cc:290] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:42.928812 1172 ts_tablet_manager.cc:1403] T bcb731f97a764183aba7408bae969331 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.078s user 0.003s sys 0.001s
W20260318 02:51:42.929608 719 leader_election.cc:343] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.929737 719 leader_election.cc:304] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:42.929728 1172 raft_consensus.cc:359] T bcb731f97a764183aba7408bae969331 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.929888 1172 raft_consensus.cc:385] T bcb731f97a764183aba7408bae969331 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:42.929931 1172 raft_consensus.cc:740] T bcb731f97a764183aba7408bae969331 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:42.930156 1172 consensus_queue.cc:260] T bcb731f97a764183aba7408bae969331 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.931066 2478 raft_consensus.cc:2749] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:42.931223 2478 raft_consensus.cc:493] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:42.931301 2478 raft_consensus.cc:515] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.931844 2478 leader_election.cc:290] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:42.933780 1172 ts_tablet_manager.cc:1434] T bcb731f97a764183aba7408bae969331 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:42.936861 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb731f97a764183aba7408bae969331" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:42.938194 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe82e581368c4d8a894f0283c1a710fe" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:42.941304 2469 catalog_manager.cc:1269] Loaded cluster ID: 97dfc1ee825e4087980ac883e1ff8527
I20260318 02:51:42.941289 1172 tablet_bootstrap.cc:492] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:42.941416 2469 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7: loading cluster ID for follower catalog manager: success
I20260318 02:51:42.941987 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe82e581368c4d8a894f0283c1a710fe" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:42.942101 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb731f97a764183aba7408bae969331" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:42.942236 1062 raft_consensus.cc:2468] T bcb731f97a764183aba7408bae969331 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 0.
W20260318 02:51:42.942782 719 leader_election.cc:343] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:42.944335 719 leader_election.cc:343] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.944520 719 leader_election.cc:304] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:42.944921 2478 raft_consensus.cc:2804] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:42.944993 2478 raft_consensus.cc:493] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:42.945043 2478 raft_consensus.cc:3060] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:42.972132 719 leader_election.cc:343] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:42.972304 719 leader_election.cc:304] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:42.972833 2467 raft_consensus.cc:2749] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:42.974191 1172 tablet_bootstrap.cc:654] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:42.974220 1174 tablet_bootstrap.cc:492] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:42.974344 1174 ts_tablet_manager.cc:1403] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.001s
I20260318 02:51:42.975340 1174 raft_consensus.cc:359] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.975608 1174 raft_consensus.cc:385] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:42.975703 1174 raft_consensus.cc:740] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:42.976035 1174 consensus_queue.cc:260] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:42.982218 1174 ts_tablet_manager.cc:1434] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260318 02:51:42.988344 1174 tablet_bootstrap.cc:492] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:42.991510 1174 tablet_bootstrap.cc:654] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.001287 1173 tablet_bootstrap.cc:492] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:43.001446 1173 ts_tablet_manager.cc:1403] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.146s user 0.013s sys 0.005s
I20260318 02:51:43.002161 1173 raft_consensus.cc:359] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:43.002341 1173 raft_consensus.cc:385] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.002386 1173 raft_consensus.cc:740] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.002578 1173 consensus_queue.cc:260] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:43.003093 1173 ts_tablet_manager.cc:1434] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:43.003146 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_cec5e56080a74bcfb26e8db22ccdfea7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:43.003372 1173 tablet_bootstrap.cc:492] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:43.003830 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cec5e56080a74bcfb26e8db22ccdfea7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.004871 1173 tablet_bootstrap.cc:654] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.005844 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8b9c5c2233ae4a5ca3fee201d3499e54"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.006996 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b9c5c2233ae4a5ca3fee201d3499e54 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.007328 2467 raft_consensus.cc:493] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:43.007494 2467 raft_consensus.cc:515] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.008107 2467 leader_election.cc:290] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:43.012900 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f80f29dfd814acd8b7e143a72231dfd" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:43.013592 719 leader_election.cc:343] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:43.014389 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f80f29dfd814acd8b7e143a72231dfd" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:43.014082 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6df2b6483e034cf19a5aeea667bcd579"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:43.015365 2469 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7: acquiring CA information for follower catalog manager: success
W20260318 02:51:43.015479 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6df2b6483e034cf19a5aeea667bcd579 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:43.015789 719 leader_election.cc:343] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:43.015913 719 leader_election.cc:304] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:43.016420 2467 raft_consensus.cc:2749] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:43.018325 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bb08c3624fb54b12a3295e6909a356ea" } new_table_name: "default.Table_06ed3378cf84407b9dad684e774a9944" modify_external_catalogs: true
I20260318 02:51:43.028779 1174 tablet_bootstrap.cc:492] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:43.029138 1174 ts_tablet_manager.cc:1403] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.041s user 0.007s sys 0.004s
I20260318 02:51:43.032054 1174 raft_consensus.cc:359] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.032603 2296 raft_consensus.cc:493] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:43.032805 2296 raft_consensus.cc:515] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.033412 2296 leader_election.cc:290] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:43.034075 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49afed40c7aa4f2d913daed8055a098e" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:43.034608 997 leader_election.cc:343] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:43.037112 999 leader_election.cc:343] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 49afed40c7aa4f2d913daed8055a098e
I20260318 02:51:43.037269 999 leader_election.cc:304] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:43.037926 2296 raft_consensus.cc:2749] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:43.038414 1174 raft_consensus.cc:385] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.038555 1174 raft_consensus.cc:740] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.038914 1174 consensus_queue.cc:260] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.043458 2478 raft_consensus.cc:515] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.044162 2478 leader_election.cc:290] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:43.044767 1175 ts_tablet_manager.cc:1929] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260318 02:51:43.045670 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb731f97a764183aba7408bae969331" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:43.045850 1062 raft_consensus.cc:3060] T bcb731f97a764183aba7408bae969331 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:43.047617 1176 ts_tablet_manager.cc:1929] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:43.047731 1176 log.cc:1199] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/cf73a9f8f67b42d9baf1396d70a1a3a9
I20260318 02:51:43.050786 1175 log.cc:1199] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/6b82751cbcbb4c39a6942b6856412fc8
I20260318 02:51:43.051133 1175 ts_tablet_manager.cc:1950] T 6b82751cbcbb4c39a6942b6856412fc8 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:43.045091 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb731f97a764183aba7408bae969331" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:43.051756 719 leader_election.cc:343] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:43.043591 1174 ts_tablet_manager.cc:1434] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20260318 02:51:43.058298 1174 tablet_bootstrap.cc:492] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:43.059944 1174 tablet_bootstrap.cc:654] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.060416 2362 raft_consensus.cc:493] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:43.060607 2362 raft_consensus.cc:515] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:43.061375 2362 leader_election.cc:290] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:43.063115 860 leader_election.cc:343] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: ba3e7e9a85c94d7380b96a9373c1f503
W20260318 02:51:43.063649 862 leader_election.cc:343] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: ba3e7e9a85c94d7380b96a9373c1f503
I20260318 02:51:43.063752 862 leader_election.cc:304] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:43.064616 2521 tablet.cc:1723] T 061ebb62f4c54a2a8c24b90ec15402d3 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:43.065834 2362 raft_consensus.cc:2749] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:43.073974 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 09917645d5dc415e8e9ffdb1eab477bd consensus state has no leader
W20260318 02:51:43.074898 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e6f40a5d3f14a779c26d73bf58f302b consensus state has no leader
I20260318 02:51:43.075975 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f88018436952478cb888ea867404843c" } modify_external_catalogs: true
I20260318 02:51:43.076090 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b9655ed49f8b477083a8c01c883616a1" } new_table_name: "default.Table_08fedaf52dde4f54b4a789b2c06880ad" modify_external_catalogs: true
I20260318 02:51:43.076175 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f88018436952478cb888ea867404843c" } modify_external_catalogs: true
W20260318 02:51:43.078161 997 consensus_peers.cc:597] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:43.078493 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2a220571935c4f34a14be87348a10cf8" } modify_external_catalogs: true
I20260318 02:51:43.078663 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2a220571935c4f34a14be87348a10cf8" } modify_external_catalogs: true
I20260318 02:51:43.078891 785 raft_consensus.cc:1275] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Refusing update from remote peer 9422bb7011f342b08be0b073a88c4c4d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:43.079406 2296 consensus_queue.cc:1048] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:43.082852 450 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet e998e290291c443394f478c4ac1cfbd2 (table default.Table_5d59b3f280d345a3937fff6df372fcff [id=00651cbebdb046c9975ecfa30f08fce5]). Expected version 2 got 0
I20260318 02:51:43.083141 450 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet fe82e581368c4d8a894f0283c1a710fe (table default.Table_551f61678d2f40bcb32bf1cd2e2c9f4e [id=831b3293b7eb44c6acb5de02d0769c1d]). Expected version 1 got 0
I20260318 02:51:43.085186 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8510ed9c86cf454ab5bfc99b2f84ad2d" } modify_external_catalogs: true
I20260318 02:51:43.086064 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f80f29dfd814acd8b7e143a72231dfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:43.086704 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_11c7af60ab934814bba72142286420a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.087340 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11c7af60ab934814bba72142286420a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.085619 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_997790cbbac74789b5c64a54d0c44ff3" } modify_external_catalogs: true
I20260318 02:51:43.088565 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_997790cbbac74789b5c64a54d0c44ff3" } modify_external_catalogs: true
I20260318 02:51:43.090400 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8510ed9c86cf454ab5bfc99b2f84ad2d" } modify_external_catalogs: true
I20260318 02:51:43.097146 452 master_service.cc:954] ReplaceTablet: received request to replace tablet 6a0c53d87ad84eebaa11f5b44dd7c0b5 from {username='slave'} at 127.0.0.1:47158
W20260318 02:51:43.099843 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a8c1a1e097d34126ada38cec2f3d34b6 consensus state has no leader
I20260318 02:51:43.100163 448 master_service.cc:954] ReplaceTablet: received request to replace tablet a384923c86ee42d6a47ed3f68e6811df from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:43.102622 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d82119158d114a78b7929b9a041b2496" } modify_external_catalogs: true
I20260318 02:51:43.102874 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d82119158d114a78b7929b9a041b2496" } modify_external_catalogs: true
I20260318 02:51:43.104228 2558 tablet.cc:1723] T 061ebb62f4c54a2a8c24b90ec15402d3 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:43.104478 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_39cd736f5f0347b09d35077664b3ea16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.105041 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39cd736f5f0347b09d35077664b3ea16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.105458 1173 tablet_bootstrap.cc:492] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:43.105594 1173 ts_tablet_manager.cc:1403] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.102s user 0.003s sys 0.023s
I20260318 02:51:43.107426 1173 raft_consensus.cc:359] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:43.107604 1173 raft_consensus.cc:385] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.107657 1173 raft_consensus.cc:740] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.107851 1173 consensus_queue.cc:260] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:43.108722 1173 ts_tablet_manager.cc:1434] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:43.109086 1173 tablet_bootstrap.cc:492] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:43.109730 2560 tablet.cc:1723] T 061ebb62f4c54a2a8c24b90ec15402d3 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:43.111076 1173 tablet_bootstrap.cc:654] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.113543 1172 tablet_bootstrap.cc:492] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:43.113745 1172 ts_tablet_manager.cc:1403] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.173s user 0.003s sys 0.001s
I20260318 02:51:43.114590 1172 raft_consensus.cc:359] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.114845 1172 raft_consensus.cc:385] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.114954 1172 raft_consensus.cc:740] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.115187 1172 consensus_queue.cc:260] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.115908 1172 ts_tablet_manager.cc:1434] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:43.116237 1172 tablet_bootstrap.cc:492] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:43.117162 1184 ts_tablet_manager.cc:1929] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:43.117347 1184 log.cc:1199] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/56335a4a2c294f67a22206e6a59e29a8
I20260318 02:51:43.117755 1184 ts_tablet_manager.cc:1950] T 56335a4a2c294f67a22206e6a59e29a8 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
W20260318 02:51:43.118852 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6eae03ae22c440e69502471b6d36f240 consensus state has no leader
I20260318 02:51:43.120115 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet c3f37e3d16f943e0aeeddafe1a955599
I20260318 02:51:43.121317 2559 tablet.cc:1723] T 6d938a2eefe4471cb94a9544647f8e3e P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:43.130945 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 89a225cb00d04582b2bf0f569ddab07f
I20260318 02:51:43.131896 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 89a225cb00d04582b2bf0f569ddab07f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:43.132745 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 89a225cb00d04582b2bf0f569ddab07f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:43.133762 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 89a225cb00d04582b2bf0f569ddab07f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:43.137010 2553 tablet.cc:1723] T 6d938a2eefe4471cb94a9544647f8e3e P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:43.137904 1173 tablet_bootstrap.cc:492] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:43.138062 1173 ts_tablet_manager.cc:1403] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.003s
I20260318 02:51:43.138799 1173 raft_consensus.cc:359] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:43.138990 1173 raft_consensus.cc:385] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.139046 1173 raft_consensus.cc:740] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.139262 1173 consensus_queue.cc:260] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:43.139744 1173 ts_tablet_manager.cc:1434] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:43.140038 1173 tablet_bootstrap.cc:492] T d2fb9c8f339444bc8d7c6479e7d87f44 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:43.141796 1062 raft_consensus.cc:2468] T bcb731f97a764183aba7408bae969331 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 1.
I20260318 02:51:43.142254 719 leader_election.cc:304] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:43.142371 1173 tablet_bootstrap.cc:654] T d2fb9c8f339444bc8d7c6479e7d87f44 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.142716 2467 raft_consensus.cc:2804] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:43.142839 2467 raft_consensus.cc:697] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Becoming Leader. State: Replica: 6a903d876086423b8016d705b98895ad, State: Running, Role: LEADER
I20260318 02:51:43.143093 2467 consensus_queue.cc:237] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.143824 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1126) took 1626 ms. Trace:
I20260318 02:51:43.143954 1175 rpcz_store.cc:276] 0318 02:51:41.517301 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.517358 (+ 57us) service_pool.cc:225] Handling call
0318 02:51:42.762498 (+1245140us) ts_tablet_manager.cc:1151] Deleting tablet 6b82751cbcbb4c39a6942b6856412fc8
0318 02:51:42.762506 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.951098 (+188592us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.044588 (+ 93490us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.143807 (+ 99219us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1244921}
W20260318 02:51:43.144379 719 consensus_peers.cc:597] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:43.144533 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 6b82751cbcbb4c39a6942b6856412fc8 (table default.Table_4a0d32e1914846ec81bdfcb8a0fd758e [id=84a657155372475db438c6eb3119b595]) successfully deleted
I20260318 02:51:43.144971 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1127) took 1625 ms. Trace:
I20260318 02:51:43.145059 1175 rpcz_store.cc:276] 0318 02:51:41.519320 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.519373 (+ 53us) service_pool.cc:225] Handling call
0318 02:51:43.144855 (+1625482us) ts_tablet_manager.cc:1151] Deleting tablet fae818515c7744899b80b87bd6dcd198
0318 02:51:43.144865 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.144955 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1625278}
W20260318 02:51:43.145459 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet fae818515c7744899b80b87bd6dcd198 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fae818515c7744899b80b87bd6dcd198 already in progress: creating tablet
I20260318 02:51:43.145815 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1128) took 1574 ms. Trace:
I20260318 02:51:43.145923 1175 rpcz_store.cc:276] 0318 02:51:41.571066 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.571138 (+ 72us) service_pool.cc:225] Handling call
0318 02:51:43.145703 (+1574565us) ts_tablet_manager.cc:1151] Deleting tablet 416d5d20d0f649ca872de02471fa9cf8
0318 02:51:43.145712 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.145799 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1574362}
W20260318 02:51:43.146310 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 416d5d20d0f649ca872de02471fa9cf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 416d5d20d0f649ca872de02471fa9cf8 already in progress: creating tablet
I20260318 02:51:43.146651 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1129) took 1557 ms. Trace:
I20260318 02:51:43.146731 1175 rpcz_store.cc:276] 0318 02:51:41.589721 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.589778 (+ 57us) service_pool.cc:225] Handling call
0318 02:51:43.146550 (+1556772us) ts_tablet_manager.cc:1151] Deleting tablet 9a0fe429edde49fe8702ffb13b034a6c
0318 02:51:43.146560 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.146636 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1556581}
W20260318 02:51:43.147078 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 9a0fe429edde49fe8702ffb13b034a6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a0fe429edde49fe8702ffb13b034a6c already in progress: creating tablet
I20260318 02:51:43.147406 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1132) took 1400 ms. Trace:
I20260318 02:51:43.147498 1175 rpcz_store.cc:276] 0318 02:51:41.747346 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.747410 (+ 64us) service_pool.cc:225] Handling call
0318 02:51:43.147317 (+1399907us) ts_tablet_manager.cc:1151] Deleting tablet df499767dfee4fbd939d775db9d2577e
0318 02:51:43.147326 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.147393 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1399681}
W20260318 02:51:43.147812 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet df499767dfee4fbd939d775db9d2577e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df499767dfee4fbd939d775db9d2577e already in progress: creating tablet
I20260318 02:51:43.148108 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1137) took 1228 ms. Trace:
I20260318 02:51:43.148186 1175 rpcz_store.cc:276] 0318 02:51:41.919686 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.919745 (+ 59us) service_pool.cc:225] Handling call
0318 02:51:43.148019 (+1228274us) ts_tablet_manager.cc:1151] Deleting tablet fa077243d5634d888f3a191b7f9d2d19
0318 02:51:43.148026 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.148094 (+ 68us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1227992}
W20260318 02:51:43.148522 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet fa077243d5634d888f3a191b7f9d2d19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa077243d5634d888f3a191b7f9d2d19 already in progress: creating tablet
I20260318 02:51:43.148880 2478 raft_consensus.cc:493] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:43.149042 2478 raft_consensus.cc:515] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.149761 2478 leader_election.cc:290] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:43.150347 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e998e290291c443394f478c4ac1cfbd2" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:43.150938 719 leader_election.cc:343] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:43.148814 1175 tablet_replica.cc:333] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:43.150520 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e998e290291c443394f478c4ac1cfbd2" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:43.153586 1175 raft_consensus.cc:2243] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:43.153734 1175 raft_consensus.cc:2272] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:43.154089 719 leader_election.cc:343] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:43.154233 719 leader_election.cc:304] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:43.154354 1175 ts_tablet_manager.cc:1916] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:43.155197 2152 raft_consensus.cc:493] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b25f4f05e0c94c8db825d5afa0b8bf18)
I20260318 02:51:43.155342 2152 raft_consensus.cc:515] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.155977 2152 leader_election.cc:290] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:43.157044 999 leader_election.cc:343] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: b9e0c54b3f1b44e4bea7253473714e94
W20260318 02:51:43.157198 997 leader_election.cc:343] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Not found: Tablet not found: b9e0c54b3f1b44e4bea7253473714e94
I20260318 02:51:43.157208 2478 raft_consensus.cc:2749] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:43.157279 997 leader_election.cc:304] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:43.157591 2152 raft_consensus.cc:2749] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260318 02:51:43.158803 754 tablet_service.cc:1558] Processing DeleteTablet for tablet c3f37e3d16f943e0aeeddafe1a955599 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:43.159665 897 tablet_service.cc:1558] Processing DeleteTablet for tablet c3f37e3d16f943e0aeeddafe1a955599 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:43.161486 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet c3f37e3d16f943e0aeeddafe1a955599 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:43.164661 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet ca765bc27f564ab9ab419bcf2aeda59f
I20260318 02:51:43.165616 754 tablet_service.cc:1558] Processing DeleteTablet for tablet ca765bc27f564ab9ab419bcf2aeda59f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:43.166677 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet ca765bc27f564ab9ab419bcf2aeda59f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:43.166994 897 tablet_service.cc:1558] Processing DeleteTablet for tablet ca765bc27f564ab9ab419bcf2aeda59f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:43.167805 1173 tablet_bootstrap.cc:492] T d2fb9c8f339444bc8d7c6479e7d87f44 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:43.168017 1173 ts_tablet_manager.cc:1403] T d2fb9c8f339444bc8d7c6479e7d87f44 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.028s user 0.009s sys 0.000s
I20260318 02:51:43.168787 1173 raft_consensus.cc:359] T d2fb9c8f339444bc8d7c6479e7d87f44 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.169174 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 82d2922edaae4dc0bd8bcf859d248a11
I20260318 02:51:43.170141 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d2922edaae4dc0bd8bcf859d248a11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:43.171803 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d2922edaae4dc0bd8bcf859d248a11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:43.172487 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1013) took 4217 ms. Trace:
I20260318 02:51:43.172586 1184 rpcz_store.cc:276] 0318 02:51:38.954998 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:38.955048 (+ 50us) service_pool.cc:225] Handling call
0318 02:51:42.875298 (+3920250us) ts_tablet_manager.cc:1151] Deleting tablet 56335a4a2c294f67a22206e6a59e29a8
0318 02:51:42.875322 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.962959 (+ 87637us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.117046 (+154087us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.172468 (+ 55422us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3869987}
I20260318 02:51:43.173029 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 56335a4a2c294f67a22206e6a59e29a8 (table default.Table_98ff851e3ed0463cb3ef7f1907fa7711 [id=3da3ae03107e44518a289e073abc0998]) successfully deleted
I20260318 02:51:43.175017 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet bdb950b9207d4528a86fac1da0ae6538
I20260318 02:51:43.175560 2152 raft_consensus.cc:493] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:43.175693 2152 raft_consensus.cc:515] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.176385 2152 leader_election.cc:290] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:43.178009 754 tablet_service.cc:1558] Processing DeleteTablet for tablet bdb950b9207d4528a86fac1da0ae6538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:43.179211 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet bdb950b9207d4528a86fac1da0ae6538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:43.180577 999 leader_election.cc:343] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 46ce65cca47f48db94e70226494cfbae
I20260318 02:51:43.189821 1172 tablet_bootstrap.cc:654] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.196744 1174 tablet_bootstrap.cc:492] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:43.197026 1174 ts_tablet_manager.cc:1403] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.139s user 0.002s sys 0.002s
I20260318 02:51:43.197921 1174 raft_consensus.cc:359] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.198210 1174 raft_consensus.cc:385] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.198309 1174 raft_consensus.cc:740] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.198618 1174 consensus_queue.cc:260] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.199462 1174 ts_tablet_manager.cc:1434] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:43.201990 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_27133deb6826433fbb808c7824950ec3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:43.202592 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d6caec70978b40caa5fae6a9d4261a5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.202809 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27133deb6826433fbb808c7824950ec3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:43.203223 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6caec70978b40caa5fae6a9d4261a5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.212882 1174 tablet_bootstrap.cc:492] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:43.215339 1174 tablet_bootstrap.cc:654] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.230429 1172 tablet_bootstrap.cc:492] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:43.230702 1172 ts_tablet_manager.cc:1403] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.115s user 0.004s sys 0.004s
I20260318 02:51:43.231213 2454 raft_consensus.cc:493] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:43.231423 2454 raft_consensus.cc:515] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.233515 2454 leader_election.cc:290] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:43.235332 1172 raft_consensus.cc:359] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.238745 1176 ts_tablet_manager.cc:1950] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:43.238940 1172 raft_consensus.cc:385] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.239110 1172 raft_consensus.cc:740] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.239455 1172 consensus_queue.cc:260] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.241326 1173 raft_consensus.cc:385] T d2fb9c8f339444bc8d7c6479e7d87f44 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.241415 1173 raft_consensus.cc:740] T d2fb9c8f339444bc8d7c6479e7d87f44 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.241730 1173 consensus_queue.cc:260] T d2fb9c8f339444bc8d7c6479e7d87f44 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.170611 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 82d2922edaae4dc0bd8bcf859d248a11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:43.179101 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ce65cca47f48db94e70226494cfbae" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:43.179433 890 tablet_service.cc:1558] Processing DeleteTablet for tablet bdb950b9207d4528a86fac1da0ae6538 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:43.231602 893 tablet_service.cc:1558] Processing DeleteTablet for tablet bf344c2361b7412c87a7c7f9a72a15b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:43.232604 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c2a579264e43b9a1e25ded000d4d9f" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:43.240458 905 tablet_service.cc:1558] Processing DeleteTablet for tablet 813702e53eee4a54a7d693fd6e03bbbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:43.240607 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 56335a4a2c294f67a22206e6a59e29a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:43.250583 455 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet d2fb9c8f339444bc8d7c6479e7d87f44 (table default.Table_278b10b38c074522b0e03e24d653346d [id=895bbd90cf47462ab116ee3f37e94982]). Expected version 3 got 0
I20260318 02:51:43.252346 1173 ts_tablet_manager.cc:1434] T d2fb9c8f339444bc8d7c6479e7d87f44 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.084s user 0.001s sys 0.000s
I20260318 02:51:43.252859 1173 tablet_bootstrap.cc:492] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:43.254565 1173 tablet_bootstrap.cc:654] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:43.247890 999 leader_election.cc:343] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 64c2a579264e43b9a1e25ded000d4d9f
W20260318 02:51:43.249050 997 leader_election.cc:343] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:43.255749 997 leader_election.cc:304] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:43.256227 997 leader_election.cc:343] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:43.256347 997 leader_election.cc:304] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:43.256572 2296 raft_consensus.cc:2749] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:43.256875 2296 raft_consensus.cc:2749] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:43.257421 997 consensus_peers.cc:597] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d7b339a29ef456997d74a7a95d4c03a. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:43.257829 1172 ts_tablet_manager.cc:1434] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20260318 02:51:43.263710 457 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet d2fb9c8f339444bc8d7c6479e7d87f44 (table default.Table_278b10b38c074522b0e03e24d653346d [id=895bbd90cf47462ab116ee3f37e94982]). Expected version 3 got 0
I20260318 02:51:43.269526 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1158) took 1820 ms. Trace:
I20260318 02:51:43.269660 1176 rpcz_store.cc:276] 0318 02:51:41.449218 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.449326 (+ 108us) service_pool.cc:225] Handling call
0318 02:51:42.721307 (+1271981us) ts_tablet_manager.cc:1151] Deleting tablet cf73a9f8f67b42d9baf1396d70a1a3a9
0318 02:51:42.721316 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:42.739363 (+ 18047us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x616000172f54. stack: 00007fc851dd2c56 00007fc851dd2a10 00007fc850dad3ad 0000000000986fb4 0000000000986f7d 000000000098694a 00007fc85dd05460 00007fc85f053b83 00007fc861c15957 00007fc861c48944 00007fc861c29440 00007fc861c291cd 0000000000a8b58c 00007fc851e18f7f 00007fc851e1c29b 00007fc851e1c118
0318 02:51:42.946606 (+207243us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.047511 (+100905us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.269496 (+221985us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":39224192,"tablet-delete.queue_time_us":1271709}
I20260318 02:51:43.269762 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_332860f760584d748b03287092362971"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:43.270126 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet cf73a9f8f67b42d9baf1396d70a1a3a9 (table default.Table_c0889091422144f8af318ab6f38afd05 [id=75621b04db1d4c67bd2d2f5fe76c8a25]) successfully deleted
W20260318 02:51:43.270417 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_332860f760584d748b03287092362971 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.270517 1176 tablet_replica.cc:333] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:43.270730 1176 raft_consensus.cc:2243] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:43.271080 1176 raft_consensus.cc:2272] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:43.271672 1176 ts_tablet_manager.cc:1916] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:43.277483 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7b569f5e5ddc404eaa3dbc3acc278b11" } new_table_name: "default.Table_c8dc10ae80aa4a9e8c3e8c6b2e31f452" modify_external_catalogs: true
I20260318 02:51:43.278880 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_15c3b48cb1a4451fabb1a33af422d491" } new_table_name: "default.Table_726f577b73a049eb8812ebac7d378d49" modify_external_catalogs: true
I20260318 02:51:43.280081 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1136fb5f74264862b0dee0926825df6a" } new_table_name: "default.Table_b6a7bb0423b64d13956861535520977d" modify_external_catalogs: true
I20260318 02:51:43.284843 1184 tablet_replica.cc:333] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:43.285157 1184 raft_consensus.cc:2243] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:43.285390 1184 raft_consensus.cc:2272] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:43.285979 1184 ts_tablet_manager.cc:1916] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:43.287591 1172 tablet_bootstrap.cc:492] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:43.289835 1172 tablet_bootstrap.cc:654] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:43.293879 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c9a32a6a0fa46938cdc85b656f4e562 consensus state has no leader
W20260318 02:51:43.294490 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 504a8ead5ba24f51bd26df90feb92d96 consensus state has no leader
W20260318 02:51:43.295006 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f7d7767fa514821981f7086ef152091 consensus state has no leader
I20260318 02:51:43.299224 2454 consensus_queue.cc:1048] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:43.300546 2469 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260318 02:51:43.320209 1174 tablet_bootstrap.cc:492] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:43.320521 1174 ts_tablet_manager.cc:1403] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.108s user 0.013s sys 0.020s
I20260318 02:51:43.321385 1174 raft_consensus.cc:359] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.321655 1174 raft_consensus.cc:385] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.321751 1174 raft_consensus.cc:740] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.322041 1174 consensus_queue.cc:260] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.322610 1174 ts_tablet_manager.cc:1434] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:43.322968 1174 tablet_bootstrap.cc:492] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:43.324467 1174 tablet_bootstrap.cc:654] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.346858 1176 ts_tablet_manager.cc:1929] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260318 02:51:43.347024 1176 log.cc:1199] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/6b82751cbcbb4c39a6942b6856412fc8
I20260318 02:51:43.347339 1176 ts_tablet_manager.cc:1950] T 6b82751cbcbb4c39a6942b6856412fc8 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:43.349663 924 raft_consensus.cc:3060] T d2fb9c8f339444bc8d7c6479e7d87f44 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:43.350159 2467 raft_consensus.cc:493] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:43.350297 2467 raft_consensus.cc:515] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.350888 2467 leader_election.cc:290] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:43.351595 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453a1c6f16194cab91c0223e2eeda7ab" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:43.352339 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453a1c6f16194cab91c0223e2eeda7ab" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:43.353097 719 leader_election.cc:343] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:43.353531 719 leader_election.cc:343] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:43.353626 719 leader_election.cc:304] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:43.354135 2467 raft_consensus.cc:2749] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:43.357973 1173 tablet_bootstrap.cc:492] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:43.358197 1173 ts_tablet_manager.cc:1403] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.105s user 0.003s sys 0.000s
I20260318 02:51:43.358927 1173 raft_consensus.cc:359] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:43.359215 1173 raft_consensus.cc:385] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.359298 1173 raft_consensus.cc:740] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.359578 1173 consensus_queue.cc:260] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:43.360203 1173 ts_tablet_manager.cc:1434] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:43.360512 1173 tablet_bootstrap.cc:492] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:43.362507 1173 tablet_bootstrap.cc:654] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:43.366588 441 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 5c9a32a6a0fa46938cdc85b656f4e562 (table default.Table_b6a7bb0423b64d13956861535520977d [id=65d1f791063046758931d2771b76e4f6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5c9a32a6a0fa46938cdc85b656f4e562 consensus state has no leader
I20260318 02:51:43.371119 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_69abcdb2f9e2437f88b48b572afea756"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.371775 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69abcdb2f9e2437f88b48b572afea756 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.373342 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_70f3dfdd5c0e4a8999c5983161a9bd4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.373492 997 consensus_peers.cc:597] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260318 02:51:43.373862 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70f3dfdd5c0e4a8999c5983161a9bd4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.374470 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7ad944da077644c0845bc4fd38c72ea2" } new_table_name: "default.Table_802a2d53f1c14a879d8737dad75f6252" modify_external_catalogs: true
I20260318 02:51:43.375644 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ed080a9e046748678b305e7797495548"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.376214 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed080a9e046748678b305e7797495548 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.376195 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f27db9223f88459e8879c83e06263a3a" } modify_external_catalogs: true
I20260318 02:51:43.376351 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f27db9223f88459e8879c83e06263a3a" } modify_external_catalogs: true
I20260318 02:51:43.376773 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1960d955ce3f45458d16f7f892da82fc" } new_table_name: "default.Table_036680cf6c2441fab0bf298140c29934" modify_external_catalogs: true
I20260318 02:51:43.378072 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1bfaeda8b6574307aa25ade4bbf6d9f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.378520 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1bfaeda8b6574307aa25ade4bbf6d9f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.379650 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7d15c7f8f6214d5aba96a8c9fd76cb35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.380071 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d15c7f8f6214d5aba96a8c9fd76cb35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.386648 2494 raft_consensus.cc:493] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:43.386812 2494 raft_consensus.cc:515] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.387450 2494 leader_election.cc:290] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:43.388078 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebcf120100349319d27615b6e0c7550" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:43.388613 997 leader_election.cc:343] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:43.389869 999 leader_election.cc:343] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2ebcf120100349319d27615b6e0c7550
I20260318 02:51:43.389990 999 leader_election.cc:304] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:43.390437 2494 raft_consensus.cc:2749] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:43.392398 451 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 6d938a2eefe4471cb94a9544647f8e3e (table default.Table_c0956e46e13c47bc95482c534f632c04 [id=d0c05683decb4a5bbf2e3eab386a1116]). Expected version 1 got 0
I20260318 02:51:43.396939 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c25bec5413624afaa09f6976c76b8a79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.397503 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c25bec5413624afaa09f6976c76b8a79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.398977 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f7c512acb00946069cb735b743f8b2af" } modify_external_catalogs: true
I20260318 02:51:43.399139 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f7c512acb00946069cb735b743f8b2af" } modify_external_catalogs: true
I20260318 02:51:43.399137 754 tablet_service.cc:1511] Processing CreateTablet for tablet 115d4717824b46408d0787b657596155 (DEFAULT_TABLE table=default.Table_6cec27214c2d4ab1bf225a47b1a0a445 [id=8e1b0836189c47cfa27e615a99fe2616]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.400774 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115d4717824b46408d0787b657596155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.401160 455 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 061ebb62f4c54a2a8c24b90ec15402d3 (table default.Table_88caf570ec6a4dfea94952fb5718c9c6 [id=5a3571f0765948588578d8e5185807a8]). Expected version 1 got 0
I20260318 02:51:43.401715 903 tablet_service.cc:1511] Processing CreateTablet for tablet 115d4717824b46408d0787b657596155 (DEFAULT_TABLE table=default.Table_6cec27214c2d4ab1bf225a47b1a0a445 [id=8e1b0836189c47cfa27e615a99fe2616]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.402208 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 115d4717824b46408d0787b657596155 (DEFAULT_TABLE table=default.Table_6cec27214c2d4ab1bf225a47b1a0a445 [id=8e1b0836189c47cfa27e615a99fe2616]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.403543 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f3b493164ec64405848518f3a11acab6" } modify_external_catalogs: true
I20260318 02:51:43.404249 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 49afed40c7aa4f2d913daed8055a098e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:43.404414 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f3b493164ec64405848518f3a11acab6" } modify_external_catalogs: true
W20260318 02:51:43.412472 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3aa05403966349ae9056777d913a0db6 consensus state has no leader
I20260318 02:51:43.413523 452 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 961d40bfdac34b25bcfc39c007a02b28
I20260318 02:51:43.415967 765 tablet_service.cc:1511] Processing CreateTablet for tablet 08f7b4665c8740df80ca4db72e0fe2b4 (DEFAULT_TABLE table=default.Table_1210b24bede242a0a3b439a15ffec0ec [id=d4ae3785c76f43dd97edf06b5e46f1c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.416388 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f7b4665c8740df80ca4db72e0fe2b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.416491 905 tablet_service.cc:1511] Processing CreateTablet for tablet 460b33860ebe4ecf940497c542ce391e (DEFAULT_TABLE table=default.Table_a9f568c4445f4507b84191a5f08a74b1 [id=f0a80020db2342d499b85ec075f4f721]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.416945 893 tablet_service.cc:1511] Processing CreateTablet for tablet 08f7b4665c8740df80ca4db72e0fe2b4 (DEFAULT_TABLE table=default.Table_1210b24bede242a0a3b439a15ffec0ec [id=d4ae3785c76f43dd97edf06b5e46f1c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.418067 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 460b33860ebe4ecf940497c542ce391e (DEFAULT_TABLE table=default.Table_a9f568c4445f4507b84191a5f08a74b1 [id=f0a80020db2342d499b85ec075f4f721]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.419592 1174 tablet_bootstrap.cc:492] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:43.419788 1174 ts_tablet_manager.cc:1403] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.097s user 0.005s sys 0.011s
I20260318 02:51:43.420506 1174 raft_consensus.cc:359] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.420759 1174 raft_consensus.cc:385] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.420854 1174 raft_consensus.cc:740] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.421144 1174 consensus_queue.cc:260] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.422298 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1159) took 1960 ms. Trace:
I20260318 02:51:43.426851 1176 rpcz_store.cc:276] 0318 02:51:41.461974 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.462509 (+ 535us) service_pool.cc:225] Handling call
0318 02:51:43.270458 (+1807949us) ts_tablet_manager.cc:1151] Deleting tablet 6b82751cbcbb4c39a6942b6856412fc8
0318 02:51:43.270469 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.342650 (+ 72181us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.346750 (+ 4100us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.422276 (+ 75526us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1807675}
I20260318 02:51:43.427325 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1161) took 1960 ms. Trace:
I20260318 02:51:43.427338 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_138374c056b841499f29fc539894ad68" } modify_external_catalogs: true
I20260318 02:51:43.427402 1176 rpcz_store.cc:276] 0318 02:51:41.467244 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.467348 (+ 104us) service_pool.cc:225] Handling call
0318 02:51:43.427185 (+1959837us) ts_tablet_manager.cc:1151] Deleting tablet fae818515c7744899b80b87bd6dcd198
0318 02:51:43.427197 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.427305 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1959566}
I20260318 02:51:43.427526 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_138374c056b841499f29fc539894ad68" } modify_external_catalogs: true
I20260318 02:51:43.427687 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1162) took 1867 ms. Trace:
I20260318 02:51:43.427749 1176 rpcz_store.cc:276] 0318 02:51:41.559895 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.560149 (+ 254us) service_pool.cc:225] Handling call
0318 02:51:43.427599 (+1867450us) ts_tablet_manager.cc:1151] Deleting tablet 416d5d20d0f649ca872de02471fa9cf8
0318 02:51:43.427608 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.427674 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1867226}
I20260318 02:51:43.428015 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1163) took 1865 ms. Trace:
I20260318 02:51:43.428081 1176 rpcz_store.cc:276] 0318 02:51:41.562941 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.562990 (+ 49us) service_pool.cc:225] Handling call
0318 02:51:43.427926 (+1864936us) ts_tablet_manager.cc:1151] Deleting tablet 9a0fe429edde49fe8702ffb13b034a6c
0318 02:51:43.427934 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.428000 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1864729}
I20260318 02:51:43.428354 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1166) took 1835 ms. Trace:
I20260318 02:51:43.428414 1176 rpcz_store.cc:276] 0318 02:51:41.593219 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.596760 (+ 3541us) service_pool.cc:225] Handling call
0318 02:51:43.428266 (+1831506us) ts_tablet_manager.cc:1151] Deleting tablet df499767dfee4fbd939d775db9d2577e
0318 02:51:43.428274 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.428341 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1831334}
I20260318 02:51:43.428658 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1170) took 1791 ms. Trace:
I20260318 02:51:43.428604 754 tablet_service.cc:1511] Processing CreateTablet for tablet 460b33860ebe4ecf940497c542ce391e (DEFAULT_TABLE table=default.Table_a9f568c4445f4507b84191a5f08a74b1 [id=f0a80020db2342d499b85ec075f4f721]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.428737 1176 rpcz_store.cc:276] 0318 02:51:41.637695 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.637766 (+ 71us) service_pool.cc:225] Handling call
0318 02:51:43.428576 (+1790810us) ts_tablet_manager.cc:1151] Deleting tablet fa077243d5634d888f3a191b7f9d2d19
0318 02:51:43.428584 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.428646 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1790545}
I20260318 02:51:43.428803 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_80307085aa604fe886f98a99c6e55fe7" } modify_external_catalogs: true
I20260318 02:51:43.428951 1176 tablet_replica.cc:333] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:43.428952 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_80307085aa604fe886f98a99c6e55fe7" } modify_external_catalogs: true
I20260318 02:51:43.429037 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 460b33860ebe4ecf940497c542ce391e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.429118 1176 raft_consensus.cc:2243] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:43.429265 1176 raft_consensus.cc:2272] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:43.429750 1176 ts_tablet_manager.cc:1916] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:43.430105 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0877f95d5a2c42d199d4563969d06c2e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.430600 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0877f95d5a2c42d199d4563969d06c2e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.433355 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 6b82751cbcbb4c39a6942b6856412fc8 (table default.Table_4a0d32e1914846ec81bdfcb8a0fd758e [id=84a657155372475db438c6eb3119b595]) successfully deleted
W20260318 02:51:43.433616 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet fae818515c7744899b80b87bd6dcd198 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fae818515c7744899b80b87bd6dcd198 already in progress: creating tablet
W20260318 02:51:43.433790 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 416d5d20d0f649ca872de02471fa9cf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 416d5d20d0f649ca872de02471fa9cf8 already in progress: creating tablet
W20260318 02:51:43.433938 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 9a0fe429edde49fe8702ffb13b034a6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a0fe429edde49fe8702ffb13b034a6c already in progress: creating tablet
W20260318 02:51:43.434091 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet df499767dfee4fbd939d775db9d2577e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df499767dfee4fbd939d775db9d2577e already in progress: creating tablet
W20260318 02:51:43.434257 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet fa077243d5634d888f3a191b7f9d2d19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa077243d5634d888f3a191b7f9d2d19 already in progress: creating tablet
I20260318 02:51:43.435396 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 184ce58aa96d4e70ad7b2783f19ccdeb
I20260318 02:51:43.436569 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 184ce58aa96d4e70ad7b2783f19ccdeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:43.437215 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 184ce58aa96d4e70ad7b2783f19ccdeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:43.437867 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 184ce58aa96d4e70ad7b2783f19ccdeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:43.438385 1174 ts_tablet_manager.cc:1434] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260318 02:51:43.439023 1174 tablet_bootstrap.cc:492] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:43.441511 765 tablet_service.cc:1511] Processing CreateTablet for tablet 309032d5d9134f799942721bee6555c0 (DEFAULT_TABLE table=default.Table_244ca241adf044069b5c10b920250490 [id=c1a981628fda4becb9afd313fb2bc12d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.443480 1175 ts_tablet_manager.cc:1929] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:43.443619 1175 log.cc:1199] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/20c6f1790ed34581b7507ec63ec66718
I20260318 02:51:43.443928 1175 ts_tablet_manager.cc:1950] T 20c6f1790ed34581b7507ec63ec66718 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:43.444221 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f7b4665c8740df80ca4db72e0fe2b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.444888 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 460b33860ebe4ecf940497c542ce391e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.445385 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115d4717824b46408d0787b657596155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.446388 1174 tablet_bootstrap.cc:654] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.452373 890 tablet_service.cc:1511] Processing CreateTablet for tablet 309032d5d9134f799942721bee6555c0 (DEFAULT_TABLE table=default.Table_244ca241adf044069b5c10b920250490 [id=c1a981628fda4becb9afd313fb2bc12d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.452862 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309032d5d9134f799942721bee6555c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.454677 1173 tablet_bootstrap.cc:492] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:43.454805 1173 ts_tablet_manager.cc:1403] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.094s user 0.003s sys 0.000s
I20260318 02:51:43.455556 1173 raft_consensus.cc:359] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:43.455749 1173 raft_consensus.cc:385] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.455798 1173 raft_consensus.cc:740] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.456050 1173 consensus_queue.cc:260] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:43.456658 1173 ts_tablet_manager.cc:1434] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:43.456981 1173 tablet_bootstrap.cc:492] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:43.457669 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 08f7b4665c8740df80ca4db72e0fe2b4 (DEFAULT_TABLE table=default.Table_1210b24bede242a0a3b439a15ffec0ec [id=d4ae3785c76f43dd97edf06b5e46f1c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.458212 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 309032d5d9134f799942721bee6555c0 (DEFAULT_TABLE table=default.Table_244ca241adf044069b5c10b920250490 [id=c1a981628fda4becb9afd313fb2bc12d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.458636 1173 tablet_bootstrap.cc:654] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.472589 2560 tablet.cc:1723] T d2fb9c8f339444bc8d7c6479e7d87f44 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:43.481662 450 master_service.cc:954] ReplaceTablet: received request to replace tablet 1294e1ae2115471a8b605d38f1c26e60 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:43.485957 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309032d5d9134f799942721bee6555c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.487227 2553 tablet.cc:1723] T ca23d4d0d3734fceb14966a4f2ad9c35 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260318 02:51:43.487424 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115d4717824b46408d0787b657596155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.487859 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 460b33860ebe4ecf940497c542ce391e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.488267 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08f7b4665c8740df80ca4db72e0fe2b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.488647 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309032d5d9134f799942721bee6555c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.502427 1184 ts_tablet_manager.cc:1929] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:43.502615 1184 log.cc:1199] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/2882569524e74a308e9fabf533a8a87c
I20260318 02:51:43.503032 1184 ts_tablet_manager.cc:1950] T 2882569524e74a308e9fabf533a8a87c P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:43.506289 1172 tablet_bootstrap.cc:492] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:43.506494 1172 ts_tablet_manager.cc:1403] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.219s user 0.000s sys 0.012s
I20260318 02:51:43.507308 1172 raft_consensus.cc:359] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.507584 1172 raft_consensus.cc:385] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.507681 1172 raft_consensus.cc:740] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.509076 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet a1ea3329a317495792d26bd31fcd3b43
I20260318 02:51:43.510191 758 tablet_service.cc:1558] Processing DeleteTablet for tablet a1ea3329a317495792d26bd31fcd3b43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:43.511346 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet a1ea3329a317495792d26bd31fcd3b43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:43.511673 905 tablet_service.cc:1558] Processing DeleteTablet for tablet a1ea3329a317495792d26bd31fcd3b43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:43.512241 1172 consensus_queue.cc:260] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.513674 1172 ts_tablet_manager.cc:1434] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260318 02:51:43.515815 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5d77e76788f047a2a13fc7e7c66a863a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.516400 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d77e76788f047a2a13fc7e7c66a863a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.519731 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ca9ce0c2522f46caaaf7d3081ec90c71" } new_table_name: "default.Table_69f964fff92647408c72789961bebf99" modify_external_catalogs: true
I20260318 02:51:43.521404 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_350a0da6de9147aeb8ec20a8d661d892"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.521983 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_350a0da6de9147aeb8ec20a8d661d892 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.523097 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_671052eea68c4fdba772ff0b23394897"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.523952 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_671052eea68c4fdba772ff0b23394897 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.525188 454 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_88caf570ec6a4dfea94952fb5718c9c6 [id=5a3571f0765948588578d8e5185807a8] alter complete (version 1)
I20260318 02:51:43.529053 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c22bbb5e62d444b9ab1ccd977c2ac194" } new_table_name: "default.Table_7fa46e8c68514c059af454cbbff2041d" modify_external_catalogs: true
I20260318 02:51:43.545910 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1023) took 4481 ms. Trace:
I20260318 02:51:43.548202 453 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet c58290c2d1c742d3b45dfb5caf52c75b (table default.Table_944521fea0294e3381643693804fd723 [id=18d79b10f75b43efa4946ca8979a4235]). Expected version 1 got 0
I20260318 02:51:43.546136 1184 rpcz_store.cc:276] 0318 02:51:39.064797 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:39.064925 (+ 128us) service_pool.cc:225] Handling call
0318 02:51:43.173259 (+4108334us) ts_tablet_manager.cc:1151] Deleting tablet 2882569524e74a308e9fabf533a8a87c
0318 02:51:43.284741 (+111482us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.354672 (+ 69931us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.502307 (+147635us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.545880 (+ 43573us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4038635}
I20260318 02:51:43.548540 453 catalog_manager.cc:5671] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a903d876086423b8016d705b98895ad (127.0.104.129). New cstate: current_term: 1 leader_uuid: "6a903d876086423b8016d705b98895ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:43.548862 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1031) took 4381 ms. Trace:
I20260318 02:51:43.548943 1184 rpcz_store.cc:276] 0318 02:51:39.166976 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:39.167165 (+ 189us) service_pool.cc:225] Handling call
0318 02:51:43.548689 (+4381524us) ts_tablet_manager.cc:1151] Deleting tablet c9d09130cded4b2b9478a85066379e25
0318 02:51:43.548701 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.548840 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4381315}
I20260318 02:51:43.549288 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1032) took 4381 ms. Trace:
I20260318 02:51:43.549360 1184 rpcz_store.cc:276] 0318 02:51:39.167664 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:39.167845 (+ 181us) service_pool.cc:225] Handling call
0318 02:51:43.549162 (+4381317us) ts_tablet_manager.cc:1151] Deleting tablet 6b0be67e8f064e879f9a790a87d8b27b
0318 02:51:43.549184 (+ 22us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.549270 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4381139}
I20260318 02:51:43.549641 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1025) took 4411 ms. Trace:
I20260318 02:51:43.549705 1184 rpcz_store.cc:276] 0318 02:51:39.138338 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:39.168277 (+ 29939us) service_pool.cc:225] Handling call
0318 02:51:43.549543 (+4381266us) ts_tablet_manager.cc:1151] Deleting tablet 1814c903ba4f456098f862e9490aa05e
0318 02:51:43.549551 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.549625 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4381111}
I20260318 02:51:43.549966 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1033) took 4381 ms. Trace:
I20260318 02:51:43.550027 1184 rpcz_store.cc:276] 0318 02:51:39.168622 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:39.168669 (+ 47us) service_pool.cc:225] Handling call
0318 02:51:43.549871 (+4381202us) ts_tablet_manager.cc:1151] Deleting tablet ccbe2acf3be0434385d3caae31399f4c
0318 02:51:43.549878 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.549951 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4381033}
I20260318 02:51:43.550299 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1034) took 4354 ms. Trace:
I20260318 02:51:43.550359 1184 rpcz_store.cc:276] 0318 02:51:39.195882 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:39.195945 (+ 63us) service_pool.cc:225] Handling call
0318 02:51:43.550209 (+4354264us) ts_tablet_manager.cc:1151] Deleting tablet 31b6c2df8e1b47c3980f2c2a4295e659
0318 02:51:43.550217 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.550284 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4354048}
I20260318 02:51:43.550576 1184 tablet_replica.cc:333] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:43.550758 1184 raft_consensus.cc:2243] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:43.552001 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 2882569524e74a308e9fabf533a8a87c (table default.Table_28a12ac7769744d1ba2c07c2b335e41e [id=a2aa1e87cbae4de99a4d6ba96b5ec04d]) successfully deleted
W20260318 02:51:43.552263 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet c9d09130cded4b2b9478a85066379e25 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9d09130cded4b2b9478a85066379e25 already in progress: creating tablet
W20260318 02:51:43.552453 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 6b0be67e8f064e879f9a790a87d8b27b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b0be67e8f064e879f9a790a87d8b27b already in progress: creating tablet
W20260318 02:51:43.552688 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet ccbe2acf3be0434385d3caae31399f4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ccbe2acf3be0434385d3caae31399f4c already in progress: creating tablet
W20260318 02:51:43.552930 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 31b6c2df8e1b47c3980f2c2a4295e659 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31b6c2df8e1b47c3980f2c2a4295e659 already in progress: creating tablet
I20260318 02:51:43.551047 1184 raft_consensus.cc:2272] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:43.554756 1184 ts_tablet_manager.cc:1916] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:43.585016 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet c5afbb4fd4b146ed9e0e8ff46aecc465
I20260318 02:51:43.586306 758 tablet_service.cc:1558] Processing DeleteTablet for tablet c5afbb4fd4b146ed9e0e8ff46aecc465 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:43.587410 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet c5afbb4fd4b146ed9e0e8ff46aecc465 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:43.587818 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2fe517a0498e4ac3b0bb52a0eea7448d
I20260318 02:51:43.589644 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fe517a0498e4ac3b0bb52a0eea7448d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:43.590020 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fe517a0498e4ac3b0bb52a0eea7448d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:43.590829 1184 ts_tablet_manager.cc:1929] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:43.591421 449 master_service.cc:954] ReplaceTablet: received request to replace tablet a7c35c13521b43789a1f0b6092b4d855 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:43.591598 1184 log.cc:1199] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/105326aea9f744779ca76e0cbb2448cd
I20260318 02:51:43.595603 1184 ts_tablet_manager.cc:1950] T 105326aea9f744779ca76e0cbb2448cd P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:43.598111 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1035) took 4399 ms. Trace:
I20260318 02:51:43.598312 1184 rpcz_store.cc:276] 0318 02:51:39.198380 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:39.198435 (+ 55us) service_pool.cc:225] Handling call
0318 02:51:43.550536 (+4352101us) ts_tablet_manager.cc:1151] Deleting tablet 105326aea9f744779ca76e0cbb2448cd
0318 02:51:43.550544 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.567170 (+ 16626us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.590720 (+ 23550us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.598090 (+ 7370us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4351931}
I20260318 02:51:43.599987 452 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_c0956e46e13c47bc95482c534f632c04 [id=d0c05683decb4a5bbf2e3eab386a1116] alter complete (version 1)
I20260318 02:51:43.601491 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 105326aea9f744779ca76e0cbb2448cd (table default.Table_268e9858449d471ca088f8b1f2492fe6 [id=58354360683d422dbdcc43826b39dbc8]) successfully deleted
I20260318 02:51:43.602147 1184 tablet_replica.cc:333] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:43.602384 1184 raft_consensus.cc:2243] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:43.602612 1184 raft_consensus.cc:2272] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:43.603156 1184 ts_tablet_manager.cc:1916] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:43.599021 1172 tablet_bootstrap.cc:492] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:43.607686 1172 tablet_bootstrap.cc:654] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.526913 905 tablet_service.cc:1558] Processing DeleteTablet for tablet d1a67e637d934c0f99c00d04fb26df0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:43.535796 2560 tablet.cc:1723] T ca23d4d0d3734fceb14966a4f2ad9c35 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260318 02:51:43.561769 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1138) took 1598 ms. Trace:
I20260318 02:51:43.611927 1175 rpcz_store.cc:276] 0318 02:51:41.963361 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.963414 (+ 53us) service_pool.cc:225] Handling call
0318 02:51:43.148770 (+1185356us) ts_tablet_manager.cc:1151] Deleting tablet 20c6f1790ed34581b7507ec63ec66718
0318 02:51:43.148778 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.251898 (+103120us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.443352 (+191454us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.561743 (+118391us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1185026}
I20260318 02:51:43.612263 1175 tablet_replica.cc:333] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:43.612447 1175 raft_consensus.cc:2243] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:43.612588 1175 raft_consensus.cc:2272] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:43.612696 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3b731fbefe4a4012b14d06edb32e1350" } new_table_name: "default.Table_b3730368efe147a4bdca8e4e3a07fd98" modify_external_catalogs: true
I20260318 02:51:43.613163 1175 ts_tablet_manager.cc:1916] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:43.587121 893 tablet_service.cc:1558] Processing DeleteTablet for tablet c5afbb4fd4b146ed9e0e8ff46aecc465 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:43.589291 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fe517a0498e4ac3b0bb52a0eea7448d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:43.623665 1172 tablet_bootstrap.cc:492] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:43.623891 1172 ts_tablet_manager.cc:1403] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.003s
I20260318 02:51:43.624675 1172 raft_consensus.cc:359] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.624959 1172 raft_consensus.cc:385] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.625056 1172 raft_consensus.cc:740] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.625357 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 20c6f1790ed34581b7507ec63ec66718 (table default.Table_cf5f0ff49fa24bf18b21a4ebbe45d2e4 [id=c532f0623efe4c3f8d9c90ae9c3d02c3]) successfully deleted
I20260318 02:51:43.625337 1172 consensus_queue.cc:260] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.625662 890 tablet_service.cc:1558] Processing DeleteTablet for tablet b383fd49049c4c1daba3f1ed60899f3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:38 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:43.626057 1172 ts_tablet_manager.cc:1434] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:43.626389 1172 tablet_bootstrap.cc:492] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:43.630293 1172 tablet_bootstrap.cc:654] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.632243 1175 ts_tablet_manager.cc:1929] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:43.632453 1175 log.cc:1199] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/b4ed28b9a7f2471aa4ed7cd2e1efda1a
I20260318 02:51:43.632843 1175 ts_tablet_manager.cc:1950] T b4ed28b9a7f2471aa4ed7cd2e1efda1a P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:43.633196 1184 ts_tablet_manager.cc:1929] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:43.633729 1184 log.cc:1199] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/d1a67e637d934c0f99c00d04fb26df0d
I20260318 02:51:43.633754 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1139) took 1668 ms. Trace:
I20260318 02:51:43.633890 1175 rpcz_store.cc:276] 0318 02:51:41.965627 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.965677 (+ 50us) service_pool.cc:225] Handling call
0318 02:51:43.612207 (+1646530us) ts_tablet_manager.cc:1151] Deleting tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a
0318 02:51:43.612218 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.622437 (+ 10219us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.632117 (+ 9680us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.633732 (+ 1615us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1646363}
I20260318 02:51:43.634061 1184 ts_tablet_manager.cc:1950] T d1a67e637d934c0f99c00d04fb26df0d P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:43.634435 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet b4ed28b9a7f2471aa4ed7cd2e1efda1a (table default.Table_8d6d4b35c7754174adfe3a4d4889cdae [id=9dc5f3bbe7a34ffab1bd5105bac98325]) successfully deleted
I20260318 02:51:43.634732 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1046) took 4369 ms. Trace:
I20260318 02:51:43.634869 1175 tablet_replica.cc:333] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:43.635115 1175 raft_consensus.cc:2243] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:43.636250 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 90e188d8dc3d44c7a342aebd9aa0e299 consensus state has no leader
W20260318 02:51:43.638393 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a0812c94e1b4434bad968beff9e180a9 consensus state has no leader
I20260318 02:51:43.638712 1184 rpcz_store.cc:276] 0318 02:51:39.265048 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:39.267872 (+ 2824us) service_pool.cc:225] Handling call
0318 02:51:43.602094 (+4334222us) ts_tablet_manager.cc:1151] Deleting tablet d1a67e637d934c0f99c00d04fb26df0d
0318 02:51:43.602106 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.616890 (+ 14784us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.633081 (+ 16191us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.634712 (+ 1631us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4334038}
I20260318 02:51:43.639241 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet d1a67e637d934c0f99c00d04fb26df0d (table default.Table_d7033fee66fc4e33b922723a18a78236 [id=5d7bac7ca89d4b11ab8a882731f9b858]) successfully deleted
I20260318 02:51:43.639662 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1049) took 4309 ms. Trace:
I20260318 02:51:43.639775 1184 rpcz_store.cc:276] 0318 02:51:39.329952 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:39.356736 (+ 26784us) service_pool.cc:225] Handling call
0318 02:51:43.639535 (+4282799us) ts_tablet_manager.cc:1151] Deleting tablet de38fe3eb88147eab65f3dfed37fbf7d
0318 02:51:43.639546 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.639647 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4282377}
W20260318 02:51:43.640204 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet de38fe3eb88147eab65f3dfed37fbf7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de38fe3eb88147eab65f3dfed37fbf7d already in progress: creating tablet
I20260318 02:51:43.640543 1184 tablet_replica.cc:333] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:43.640792 1184 raft_consensus.cc:2243] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:43.640985 1184 raft_consensus.cc:2272] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:43.641546 1184 ts_tablet_manager.cc:1916] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:43.642534 1175 raft_consensus.cc:2272] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:43.512912 1173 tablet_bootstrap.cc:492] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:43.643110 1173 ts_tablet_manager.cc:1403] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.186s user 0.001s sys 0.007s
I20260318 02:51:43.650931 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f527a0ba0914924bc7f604ae8a48393 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:43.653554 1175 ts_tablet_manager.cc:1916] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:43.654145 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8854e049411f4e6f88db15613e09aa46" } modify_external_catalogs: true
I20260318 02:51:43.654353 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8854e049411f4e6f88db15613e09aa46" } modify_external_catalogs: true
I20260318 02:51:43.654652 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0758e83d0e5a415c9ad3564b069691b4" } new_table_name: "default.Table_95d75b01fb714edab905964e6cb3d17a" modify_external_catalogs: true
I20260318 02:51:43.655905 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_49d26a0539be438a970f563e500346b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.656419 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49d26a0539be438a970f563e500346b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.658871 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5f8d8d7adcdc49db92fa83977b6be5ec" } new_table_name: "default.Table_fff7b123108f4904b549721804760a52" modify_external_catalogs: true
I20260318 02:51:43.660106 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e31a9cb72cdc4e19801984222e014d7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:43.660181 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ab58e545a9bc4de9831cbc9029078cee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.660641 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e31a9cb72cdc4e19801984222e014d7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.663404 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8de5959d46654370a20f284e22d05049"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.663892 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8de5959d46654370a20f284e22d05049 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:43.660640 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab58e545a9bc4de9831cbc9029078cee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.669162 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dd894706cc2466a8cd4e4df67856862 with delete_type TABLET_DATA_DELETED (replaced by tablet fc96b13affd442eca3b671a3741b6000) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:43.671088 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f740414db84848c89a3bf2821b7999a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.671648 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f740414db84848c89a3bf2821b7999a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:43.673658 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e5f91dfe1a6e4777bb0ae530255191d2 consensus state has no leader
W20260318 02:51:43.673702 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20ecb11db30e409b9090ebfc4a4f0785 consensus state has no leader
I20260318 02:51:43.674216 1172 tablet_bootstrap.cc:492] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:43.674413 1172 ts_tablet_manager.cc:1403] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.048s user 0.005s sys 0.000s
I20260318 02:51:43.674536 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 7f2c321032c34a1596c37981f8c95cd5
I20260318 02:51:43.675050 454 master_service.cc:954] ReplaceTablet: received request to replace tablet 4ff090fadc6b47d6ba551dc59d4dad2c from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:43.675184 1172 raft_consensus.cc:359] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.675340 1172 raft_consensus.cc:385] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.675380 1172 raft_consensus.cc:740] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.675777 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f2c321032c34a1596c37981f8c95cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:43.676000 1172 consensus_queue.cc:260] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.677304 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f2c321032c34a1596c37981f8c95cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:43.678807 1172 ts_tablet_manager.cc:1434] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260318 02:51:43.679097 1172 tablet_bootstrap.cc:492] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:43.681857 1172 tablet_bootstrap.cc:654] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.684406 1184 ts_tablet_manager.cc:1929] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:43.684509 1184 log.cc:1199] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/a6f42462ed9c49c797f5115b3ca6c423
I20260318 02:51:43.684795 1184 ts_tablet_manager.cc:1950] T a6f42462ed9c49c797f5115b3ca6c423 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:43.685524 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1052) took 4213 ms. Trace:
I20260318 02:51:43.685614 1184 rpcz_store.cc:276] 0318 02:51:39.472515 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:39.477136 (+ 4621us) service_pool.cc:225] Handling call
0318 02:51:43.640497 (+4163361us) ts_tablet_manager.cc:1151] Deleting tablet a6f42462ed9c49c797f5115b3ca6c423
0318 02:51:43.640506 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.655281 (+ 14775us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.684301 (+ 29020us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.685504 (+ 1203us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4163017}
I20260318 02:51:43.687223 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet a6f42462ed9c49c797f5115b3ca6c423 (table default.Table_9573754c7e3b4c0b8200f0cc47b2182d [id=01cdfd48166b4ea79e00c77b1deb5eca]) successfully deleted
I20260318 02:51:43.690207 2488 consensus_queue.cc:1048] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:43.693925 1174 tablet_bootstrap.cc:492] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:43.694070 1174 ts_tablet_manager.cc:1403] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.255s user 0.002s sys 0.002s
I20260318 02:51:43.694767 1174 raft_consensus.cc:359] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.694921 1174 raft_consensus.cc:385] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.694965 1174 raft_consensus.cc:740] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.703519 1174 consensus_queue.cc:260] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.704133 1174 ts_tablet_manager.cc:1434] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260318 02:51:43.704459 1174 tablet_bootstrap.cc:492] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:43.706792 1174 tablet_bootstrap.cc:654] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.709932 1184 tablet_replica.cc:333] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:43.710161 1184 raft_consensus.cc:2243] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:43.710510 1184 raft_consensus.cc:2272] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:43.711079 1184 ts_tablet_manager.cc:1916] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:43.712028 1176 ts_tablet_manager.cc:1929] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:43.712129 1176 log.cc:1199] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/20a492fdea6c44ba8439614b0dcc2ba6
I20260318 02:51:43.712388 1176 ts_tablet_manager.cc:1950] T 20a492fdea6c44ba8439614b0dcc2ba6 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:43.716964 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1172) took 1861 ms. Trace:
I20260318 02:51:43.717087 1176 rpcz_store.cc:276] 0318 02:51:41.855959 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.874895 (+ 18936us) service_pool.cc:225] Handling call
0318 02:51:43.428917 (+1554022us) ts_tablet_manager.cc:1151] Deleting tablet 20a492fdea6c44ba8439614b0dcc2ba6
0318 02:51:43.428924 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.486550 (+ 57626us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.711917 (+225367us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.716935 (+ 5018us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1553583}
I20260318 02:51:43.717475 1176 tablet_replica.cc:333] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:43.717650 1176 raft_consensus.cc:2243] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:43.717782 1176 raft_consensus.cc:2272] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:43.718313 1176 ts_tablet_manager.cc:1916] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:43.722851 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b6fa9c5afc045368223aefa962baca5 consensus state has no leader
I20260318 02:51:43.723363 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 20a492fdea6c44ba8439614b0dcc2ba6 (table default.Table_d2f73355578d4f4391b25e72718cfa1e [id=0bd115a0960941ff9d49b4566fe1c666]) successfully deleted
I20260318 02:51:43.727802 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_402673bdfb764fe681dfe66dc2c1ba48" } modify_external_catalogs: true
I20260318 02:51:43.728014 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_402673bdfb764fe681dfe66dc2c1ba48" } modify_external_catalogs: true
I20260318 02:51:43.729135 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c1fbf81fbfa04f579e4d547c959dccd1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.729686 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c1fbf81fbfa04f579e4d547c959dccd1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.731350 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b9a6151bd93c40cc9930c1116c12c1ec" } modify_external_catalogs: true
I20260318 02:51:43.660845 1173 raft_consensus.cc:359] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:43.731509 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b9a6151bd93c40cc9930c1116c12c1ec" } modify_external_catalogs: true
I20260318 02:51:43.731582 1173 raft_consensus.cc:385] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.731658 1173 raft_consensus.cc:740] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.731884 1173 consensus_queue.cc:260] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:43.676081 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f2c321032c34a1596c37981f8c95cd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:43.728814 2362 raft_consensus.cc:493] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:43.732818 2362 raft_consensus.cc:515] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:43.733512 2362 leader_election.cc:290] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:43.734884 860 leader_election.cc:343] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: bf344c2361b7412c87a7c7f9a72a15b6
W20260318 02:51:43.735889 997 consensus_peers.cc:597] T 19f0750985d947a3a9323944540abbac P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260318 02:51:43.736362 862 leader_election.cc:343] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: bf344c2361b7412c87a7c7f9a72a15b6
I20260318 02:51:43.736493 862 leader_election.cc:304] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:43.736994 2362 raft_consensus.cc:2749] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:43.739105 2467 raft_consensus.cc:493] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:43.739274 2467 raft_consensus.cc:515] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.739890 2467 leader_election.cc:290] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:43.740849 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169f97b2320e4a5baae1dec29a1c7c36" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:43.741406 719 leader_election.cc:343] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:43.741855 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169f97b2320e4a5baae1dec29a1c7c36" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:43.742528 719 leader_election.cc:343] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:43.742635 719 leader_election.cc:304] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:43.743108 2467 raft_consensus.cc:2749] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:43.757118 454 master_service.cc:954] ReplaceTablet: received request to replace tablet 1be09e67b9d94e669f28a7cd236b48a4 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:43.758512 449 master_service.cc:954] ReplaceTablet: received request to replace tablet aa12fe852965419ab1803049e416c780 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:43.759773 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f5f53ee0015740a5a32a858e798c592e
I20260318 02:51:43.760507 890 tablet_service.cc:1558] Processing DeleteTablet for tablet f5f53ee0015740a5a32a858e798c592e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:43.761237 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet f5f53ee0015740a5a32a858e798c592e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:43.761574 765 tablet_service.cc:1558] Processing DeleteTablet for tablet f5f53ee0015740a5a32a858e798c592e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:43.762181 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet e96b662de89a48018920544e9abb66c7
I20260318 02:51:43.763257 765 tablet_service.cc:1558] Processing DeleteTablet for tablet e96b662de89a48018920544e9abb66c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:43.763289 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet e96b662de89a48018920544e9abb66c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:43.763963 890 tablet_service.cc:1558] Processing DeleteTablet for tablet e96b662de89a48018920544e9abb66c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:43.769125 1176 ts_tablet_manager.cc:1929] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:43.769276 1176 log.cc:1199] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/f37ab96f13444fcbb5cfc3ad92d53c35
I20260318 02:51:43.770404 1175 ts_tablet_manager.cc:1929] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:43.773679 1176 ts_tablet_manager.cc:1950] T f37ab96f13444fcbb5cfc3ad92d53c35 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:43.774550 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1173) took 1839 ms. Trace:
I20260318 02:51:43.774657 1176 rpcz_store.cc:276] 0318 02:51:41.935290 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.935408 (+ 118us) service_pool.cc:225] Handling call
0318 02:51:43.717422 (+1782014us) ts_tablet_manager.cc:1151] Deleting tablet f37ab96f13444fcbb5cfc3ad92d53c35
0318 02:51:43.717433 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.730436 (+ 13003us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.769004 (+ 38568us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.774522 (+ 5518us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1781703}
I20260318 02:51:43.774777 1175 log.cc:1199] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/42a6983dce4e476cae97b3ecb1133077
I20260318 02:51:43.775138 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet f37ab96f13444fcbb5cfc3ad92d53c35 (table default.Table_a9ca2b8e5b9042279576e9b9c6701069 [id=3066ad66b0914b759c32fe9296ca90bc]) successfully deleted
I20260318 02:51:43.775224 1175 ts_tablet_manager.cc:1950] T 42a6983dce4e476cae97b3ecb1133077 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:43.775337 1172 tablet_bootstrap.cc:492] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:43.775554 1172 ts_tablet_manager.cc:1403] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.097s user 0.015s sys 0.006s
I20260318 02:51:43.775619 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1140) took 1809 ms. Trace:
I20260318 02:51:43.776032 1175 rpcz_store.cc:276] 0318 02:51:41.966118 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.966161 (+ 43us) service_pool.cc:225] Handling call
0318 02:51:43.634817 (+1668656us) ts_tablet_manager.cc:1151] Deleting tablet 42a6983dce4e476cae97b3ecb1133077
0318 02:51:43.634829 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.755166 (+120337us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.770289 (+ 15123us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.775602 (+ 5313us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1668501}
I20260318 02:51:43.777030 1172 raft_consensus.cc:359] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.777284 1172 raft_consensus.cc:385] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.777374 1172 raft_consensus.cc:740] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.777657 1172 consensus_queue.cc:260] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.779965 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 42a6983dce4e476cae97b3ecb1133077 (table default.Table_c14f375645d84629b54e18e482938be5 [id=a2001813279f4449abf9bceaa75bcf76]) successfully deleted
I20260318 02:51:43.780328 1175 tablet_replica.cc:333] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:43.780568 1175 raft_consensus.cc:2243] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:43.780998 1172 ts_tablet_manager.cc:1434] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:43.781279 1172 tablet_bootstrap.cc:492] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:43.783018 1172 tablet_bootstrap.cc:654] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.790040 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f4cd103bfd1d46beb3655a4dc4c8c3b8" } modify_external_catalogs: true
I20260318 02:51:43.790241 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f4cd103bfd1d46beb3655a4dc4c8c3b8" } modify_external_catalogs: true
I20260318 02:51:43.790634 1175 raft_consensus.cc:2272] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:43.790725 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_98ee8782f42f4fcfb097b49984ee99cc" } modify_external_catalogs: true
I20260318 02:51:43.790894 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_98ee8782f42f4fcfb097b49984ee99cc" } modify_external_catalogs: true
I20260318 02:51:43.791558 1175 ts_tablet_manager.cc:1916] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:43.793139 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_cfd0d4de76d7477491c09d9212370fc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.793663 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfd0d4de76d7477491c09d9212370fc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.803387 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7bcf13e9740d4c79a280135b653670e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:43.803972 1172 tablet_bootstrap.cc:492] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
W20260318 02:51:43.804042 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7bcf13e9740d4c79a280135b653670e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.804105 1172 ts_tablet_manager.cc:1403] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260318 02:51:43.804849 1172 raft_consensus.cc:359] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.804999 1172 raft_consensus.cc:385] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.805040 1172 raft_consensus.cc:740] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.805258 1172 consensus_queue.cc:260] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.810459 1172 ts_tablet_manager.cc:1434] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260318 02:51:43.810781 1172 tablet_bootstrap.cc:492] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:43.812454 1172 tablet_bootstrap.cc:654] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.829754 1174 tablet_bootstrap.cc:492] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:43.830016 1174 ts_tablet_manager.cc:1403] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.126s user 0.009s sys 0.000s
I20260318 02:51:43.830832 1174 raft_consensus.cc:359] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.831441 1172 tablet_bootstrap.cc:492] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:43.832350 1172 ts_tablet_manager.cc:1403] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260318 02:51:43.833484 1174 raft_consensus.cc:385] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.833508 1172 raft_consensus.cc:359] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.833635 1174 raft_consensus.cc:740] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.833882 1174 consensus_queue.cc:260] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.834899 1172 raft_consensus.cc:385] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.835135 1172 raft_consensus.cc:740] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.835525 2593 raft_consensus.cc:493] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:43.835606 1172 consensus_queue.cc:260] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.835791 2593 raft_consensus.cc:515] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:43.838016 862 leader_election.cc:343] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 813702e53eee4a54a7d693fd6e03bbbb
I20260318 02:51:43.838752 1174 ts_tablet_manager.cc:1434] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260318 02:51:43.839068 1174 tablet_bootstrap.cc:492] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:43.840188 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6c6385d211234b01b123afe1213bc9fe" } new_table_name: "default.Table_6ebb17e9fec5412f80981fa17b6bed1d" modify_external_catalogs: true
I20260318 02:51:43.840279 1172 ts_tablet_manager.cc:1434] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260318 02:51:43.840236 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b5b721ed331a4c519ab844bceff17911"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:43.840555 1172 tablet_bootstrap.cc:492] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:43.840812 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5b721ed331a4c519ab844bceff17911 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.841563 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_11c7af60ab934814bba72142286420a4" } new_table_name: "default.Table_0beb67db16454e77b7db32d7e0d7452d" modify_external_catalogs: true
I20260318 02:51:43.843000 1172 tablet_bootstrap.cc:654] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.846629 2597 tablet.cc:1723] T ca23d4d0d3734fceb14966a4f2ad9c35 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260318 02:51:43.848570 1174 tablet_bootstrap.cc:654] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.849720 1175 ts_tablet_manager.cc:1929] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:43.849848 1175 log.cc:1199] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/7c0d87304c41481299f1e2ddfdfcfdec
I20260318 02:51:43.844458 2494 raft_consensus.cc:493] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260318 02:51:43.850630 860 leader_election.cc:343] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 813702e53eee4a54a7d693fd6e03bbbb
I20260318 02:51:43.850752 860 leader_election.cc:304] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:43.850749 2494 raft_consensus.cc:515] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.851161 2362 raft_consensus.cc:2749] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:43.851322 2494 leader_election.cc:290] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:43.844496 2488 raft_consensus.cc:493] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:43.851469 2488 raft_consensus.cc:515] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:43.851922 2488 leader_election.cc:290] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:43.853612 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7c4257a54d3487aa520531a64fc721c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:43.854034 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa05403966349ae9056777d913a0db6" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:43.854600 2467 raft_consensus.cc:493] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:43.854738 2467 raft_consensus.cc:515] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.855319 2467 leader_election.cc:290] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:43.855839 1175 ts_tablet_manager.cc:1950] T 7c0d87304c41481299f1e2ddfdfcfdec P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:43.855970 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd894706cc2466a8cd4e4df67856862" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:43.856195 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1141) took 1413 ms. Trace:
W20260318 02:51:43.857045 997 leader_election.cc:343] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:43.857259 997 leader_election.cc:343] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:43.857815 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd894706cc2466a8cd4e4df67856862" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:43.856626 719 leader_election.cc:343] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:43.858686 999 leader_election.cc:343] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: c7c4257a54d3487aa520531a64fc721c
I20260318 02:51:43.858779 999 leader_election.cc:304] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:43.858857 719 leader_election.cc:343] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:43.858956 719 leader_election.cc:304] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:43.859161 2488 raft_consensus.cc:2749] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:43.859442 2467 raft_consensus.cc:2749] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:43.863125 783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa05403966349ae9056777d913a0db6" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:43.863554 783 raft_consensus.cc:2468] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:43.864037 999 leader_election.cc:304] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:43.856271 1175 rpcz_store.cc:276] 0318 02:51:42.443100 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.443163 (+ 63us) service_pool.cc:225] Handling call
0318 02:51:43.780271 (+1337108us) ts_tablet_manager.cc:1151] Deleting tablet 7c0d87304c41481299f1e2ddfdfcfdec
0318 02:51:43.780284 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.801223 (+ 20939us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.849589 (+ 48366us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.856181 (+ 6592us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1336878}
I20260318 02:51:43.864432 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 7c0d87304c41481299f1e2ddfdfcfdec (table default.Table_b735de7cc516403da40f10ec36cf25f1 [id=e3979c7eefe84cd7bb1dd36fa9351b7e]) successfully deleted
I20260318 02:51:43.864460 2488 raft_consensus.cc:2804] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:43.864557 2488 raft_consensus.cc:493] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:43.864625 2488 raft_consensus.cc:3060] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:43.865077 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1142) took 1421 ms. Trace:
I20260318 02:51:43.865180 1175 rpcz_store.cc:276] 0318 02:51:42.443802 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.443917 (+ 115us) service_pool.cc:225] Handling call
0318 02:51:43.864812 (+1420895us) ts_tablet_manager.cc:1151] Deleting tablet 15f79ab1c38141adaed4bd381df26d9b
0318 02:51:43.864825 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.865048 (+ 223us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1420657}
W20260318 02:51:43.865622 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 15f79ab1c38141adaed4bd381df26d9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15f79ab1c38141adaed4bd381df26d9b already in progress: creating tablet
I20260318 02:51:43.866042 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1143) took 1421 ms. Trace:
I20260318 02:51:43.866124 1175 rpcz_store.cc:276] 0318 02:51:42.445083 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.445138 (+ 55us) service_pool.cc:225] Handling call
0318 02:51:43.865907 (+1420769us) ts_tablet_manager.cc:1151] Deleting tablet 2332d8dabb79471e8c8ea545228c1d18
0318 02:51:43.865919 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.866022 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1420578}
W20260318 02:51:43.866312 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8bf3de42fd247bf8b44b1fbd67ce005 consensus state has no leader
W20260318 02:51:43.866786 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2332d8dabb79471e8c8ea545228c1d18 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2332d8dabb79471e8c8ea545228c1d18 already in progress: creating tablet
I20260318 02:51:43.867121 2488 raft_consensus.cc:515] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.867727 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1145) took 1414 ms. Trace:
I20260318 02:51:43.867740 2488 leader_election.cc:290] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:43.867805 1175 rpcz_store.cc:276] 0318 02:51:42.453299 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.453380 (+ 81us) service_pool.cc:225] Handling call
0318 02:51:43.867606 (+1414226us) ts_tablet_manager.cc:1151] Deleting tablet d3b37df330984378b81b367446d34748
0318 02:51:43.867617 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.867709 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1413989}
W20260318 02:51:43.868352 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet d3b37df330984378b81b367446d34748 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3b37df330984378b81b367446d34748 already in progress: creating tablet
I20260318 02:51:43.868789 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa05403966349ae9056777d913a0db6" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:43.868783 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1146) took 1413 ms. Trace:
W20260318 02:51:43.869613 997 leader_election.cc:343] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:43.870860 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa05403966349ae9056777d913a0db6" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:43.871433 785 raft_consensus.cc:3060] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:43.869424 2362 raft_consensus.cc:493] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:43.872365 2362 raft_consensus.cc:515] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:43.873019 2362 leader_election.cc:290] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:43.873509 1175 rpcz_store.cc:276] 0318 02:51:42.454910 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.455008 (+ 98us) service_pool.cc:225] Handling call
0318 02:51:43.868645 (+1413637us) ts_tablet_manager.cc:1151] Deleting tablet a7c35c13521b43789a1f0b6092b4d855
0318 02:51:43.868656 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.868766 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1413416}
I20260318 02:51:43.874027 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1149) took 1271 ms. Trace:
I20260318 02:51:43.875290 1175 rpcz_store.cc:276] 0318 02:51:42.602227 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.602283 (+ 56us) service_pool.cc:225] Handling call
0318 02:51:43.873908 (+1271625us) ts_tablet_manager.cc:1151] Deleting tablet 77a17ef7cfee4d65808b11e9cb51e7df
0318 02:51:43.873919 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.874011 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1268148}
I20260318 02:51:43.875463 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3728303752c24f76b34471c6dea7725c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:43.875826 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1150) took 1268 ms. Trace:
I20260318 02:51:43.875905 1175 rpcz_store.cc:276] 0318 02:51:42.606925 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.607051 (+ 126us) service_pool.cc:225] Handling call
0318 02:51:43.875706 (+1268655us) ts_tablet_manager.cc:1151] Deleting tablet b8477c484db84187a3a576de6195a228
0318 02:51:43.875717 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.875810 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1268455}
W20260318 02:51:43.876104 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3728303752c24f76b34471c6dea7725c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.876144 1175 tablet_replica.cc:333] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
W20260318 02:51:43.874068 860 leader_election.cc:343] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 56335a4a2c294f67a22206e6a59e29a8
W20260318 02:51:43.877918 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet a7c35c13521b43789a1f0b6092b4d855 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7c35c13521b43789a1f0b6092b4d855 already in progress: creating tablet
W20260318 02:51:43.878182 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 77a17ef7cfee4d65808b11e9cb51e7df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77a17ef7cfee4d65808b11e9cb51e7df already in progress: creating tablet
W20260318 02:51:43.878346 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet b8477c484db84187a3a576de6195a228 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8477c484db84187a3a576de6195a228 already in progress: creating tablet
I20260318 02:51:43.878649 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6188e1840e124ad0814b689b5887e654" } modify_external_catalogs: true
I20260318 02:51:43.878813 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6188e1840e124ad0814b689b5887e654" } modify_external_catalogs: true
W20260318 02:51:43.879180 862 leader_election.cc:343] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 56335a4a2c294f67a22206e6a59e29a8
I20260318 02:51:43.879312 862 leader_election.cc:304] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:43.879668 2362 raft_consensus.cc:2749] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:43.884773 1175 raft_consensus.cc:2243] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:43.885090 1175 raft_consensus.cc:2272] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:43.886121 1174 tablet_bootstrap.cc:492] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:43.886368 1174 ts_tablet_manager.cc:1403] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.047s user 0.000s sys 0.003s
W20260318 02:51:43.886847 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b8afd668613441889212a2badb780b8 consensus state has no leader
I20260318 02:51:43.887246 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_fb13d51af88747b7870e81cc493396ea" } new_table_name: "default.Table_65b40a5c037247faa7a45e15345ff742" modify_external_catalogs: true
I20260318 02:51:43.889657 457 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 3aa05403966349ae9056777d913a0db6 (table default.Table_802a2d53f1c14a879d8737dad75f6252 [id=5b2e7b122a394e058dc5b2fd84a0f558]). Expected version 3 got 0
I20260318 02:51:43.890256 450 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_036680cf6c2441fab0bf298140c29934 [id=61241ff920584692bba476799b6a60e7] alter complete (version 4)
I20260318 02:51:43.890682 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e81309b34b2e485c9a338cb71f28c12a" } new_table_name: "default.Table_16ca21e0634245ffa1847f1034dca8b0" modify_external_catalogs: true
I20260318 02:51:43.893427 456 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet bac04b3e4ad448b09a1a25a754b44aad (table default.Table_c0a9aae588ef49148c04338c906dab4a [id=1532d6dc2cc641998f9c120075fa04b4]). Expected version 1 got 0
I20260318 02:51:43.901440 1184 ts_tablet_manager.cc:1929] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:43.903477 1184 log.cc:1199] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/3d7b339a29ef456997d74a7a95d4c03a
I20260318 02:51:43.905730 1184 ts_tablet_manager.cc:1950] T 3d7b339a29ef456997d74a7a95d4c03a P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:43.910174 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1053) took 4354 ms. Trace:
I20260318 02:51:43.896049 785 raft_consensus.cc:2468] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:43.910535 1176 tablet_replica.cc:333] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:43.911391 1176 raft_consensus.cc:2243] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:43.911638 1176 raft_consensus.cc:2272] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:43.911818 1174 raft_consensus.cc:359] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.911996 1174 raft_consensus.cc:385] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.912050 1174 raft_consensus.cc:740] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.920259 1174 consensus_queue.cc:260] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.920749 765 tablet_service.cc:1511] Processing CreateTablet for tablet 79305262278b46f99eba713fa153e9d5 (DEFAULT_TABLE table=default.Table_1bfaeda8b6574307aa25ade4bbf6d9f0 [id=18eb403e107d4baead758f985abc9ac7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.920868 1174 ts_tablet_manager.cc:1434] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260318 02:51:43.921433 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79305262278b46f99eba713fa153e9d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.927675 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_677331592d5441dfb4aea1f996121ddb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.928252 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_677331592d5441dfb4aea1f996121ddb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:43.928258 754 tablet_service.cc:1511] Processing CreateTablet for tablet 77ee4ee3904b405da7fdb90b6da0e9f8 (DEFAULT_TABLE table=default.Table_ed080a9e046748678b305e7797495548 [id=da19e399e7be4f6bb80958a6305fff17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.928694 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ee4ee3904b405da7fdb90b6da0e9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.929387 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:43.945896 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bf41e4bbbe2e4a3bbf8740b2ab558311" } new_table_name: "default.Table_09afd1f32c6f4c3a9e15e96dcc10e767" modify_external_catalogs: true
I20260318 02:51:43.946444 1174 tablet_bootstrap.cc:492] T 33d90a619ae54227aaf95acd180af119 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:43.897940 1173 ts_tablet_manager.cc:1434] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.255s user 0.006s sys 0.004s
I20260318 02:51:43.952198 1173 tablet_bootstrap.cc:492] T 5b49b066f27b43829c8f922649744303 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:43.911513 999 leader_election.cc:304] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:43.917178 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 60dedba077d34435b30061bfba737412 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:43.917361 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 783c886a99994d6c8d9add724277819a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:43.917577 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 85e6ad2a9817444caecb78eabde5d222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:43.917865 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 21e6e89e5a0a4d1bb952e74be1b7e551 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:43.917997 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 59c6741a6d154d8f99d487c6590d2d26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:43.918785 1172 tablet_bootstrap.cc:492] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:43.901718 2593 leader_election.cc:290] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:43.954442 1172 ts_tablet_manager.cc:1403] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.114s user 0.010s sys 0.004s
I20260318 02:51:43.907599 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 2882569524e74a308e9fabf533a8a87c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:43.910233 893 tablet_service.cc:1511] Processing CreateTablet for tablet 79305262278b46f99eba713fa153e9d5 (DEFAULT_TABLE table=default.Table_1bfaeda8b6574307aa25ade4bbf6d9f0 [id=18eb403e107d4baead758f985abc9ac7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.920334 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 79305262278b46f99eba713fa153e9d5 (DEFAULT_TABLE table=default.Table_1bfaeda8b6574307aa25ade4bbf6d9f0 [id=18eb403e107d4baead758f985abc9ac7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.926282 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 77ee4ee3904b405da7fdb90b6da0e9f8 (DEFAULT_TABLE table=default.Table_ed080a9e046748678b305e7797495548 [id=da19e399e7be4f6bb80958a6305fff17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.955103 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79305262278b46f99eba713fa153e9d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.921978 905 tablet_service.cc:1511] Processing CreateTablet for tablet 77ee4ee3904b405da7fdb90b6da0e9f8 (DEFAULT_TABLE table=default.Table_ed080a9e046748678b305e7797495548 [id=da19e399e7be4f6bb80958a6305fff17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.955302 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ee4ee3904b405da7fdb90b6da0e9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.955227 1172 raft_consensus.cc:359] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.955391 1172 raft_consensus.cc:385] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:43.955437 1172 raft_consensus.cc:740] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:43.955643 1172 consensus_queue.cc:260] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:43.956192 1172 ts_tablet_manager.cc:1434] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:43.956470 1172 tablet_bootstrap.cc:492] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:43.956795 2494 raft_consensus.cc:2804] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:43.957821 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79305262278b46f99eba713fa153e9d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.958886 1172 tablet_bootstrap.cc:654] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.961086 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ee4ee3904b405da7fdb90b6da0e9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.961844 1184 rpcz_store.cc:276] 0318 02:51:39.555444 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:39.569637 (+ 14193us) service_pool.cc:225] Handling call
0318 02:51:43.695986 (+4126349us) ts_tablet_manager.cc:1151] Deleting tablet 3d7b339a29ef456997d74a7a95d4c03a
0318 02:51:43.705063 (+ 9077us) spinlock_profiling.cc:243] Waited 8.67 ms on lock 0x61800000c918. stack: 00007fb72b236c56 00007fb72b236a10 00007fb72a2113ad 0000000000986fb4 0000000000986f7d 000000000098694a 00007fb72b21f58d 00007fb72b2205fe 00007fb73eedf9cd 00007fb73ee5e753 00007fb73b077d06 00007fb73b079099 00007fb73b0ac944 00007fb73b08d440 00007fb73b08d1cd 0000000000a8b58c
0318 02:51:43.709855 (+ 4792us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.770877 (+ 61022us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.901314 (+130437us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.910143 (+ 8829us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":19947264,"tablet-delete.queue_time_us":4126164}
I20260318 02:51:43.963102 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1056) took 4341 ms. Trace:
I20260318 02:51:43.963325 1184 rpcz_store.cc:276] 0318 02:51:39.622101 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:39.622342 (+ 241us) service_pool.cc:225] Handling call
0318 02:51:43.962953 (+4340611us) ts_tablet_manager.cc:1151] Deleting tablet e51e65aee63a453b848d79feaf83307e
0318 02:51:43.962963 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.963070 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4340393}
I20260318 02:51:43.963754 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1057) took 4341 ms. Trace:
I20260318 02:51:43.963876 1184 rpcz_store.cc:276] 0318 02:51:39.622203 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:39.622587 (+ 384us) service_pool.cc:225] Handling call
0318 02:51:43.963649 (+4341062us) ts_tablet_manager.cc:1151] Deleting tablet 2295aef8f25f433ab8248940319fce3e
0318 02:51:43.963658 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.963739 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4340962}
I20260318 02:51:43.964457 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1058) took 4342 ms. Trace:
I20260318 02:51:43.964593 1184 rpcz_store.cc:276] 0318 02:51:39.622299 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:39.622706 (+ 407us) service_pool.cc:225] Handling call
0318 02:51:43.964324 (+4341618us) ts_tablet_manager.cc:1151] Deleting tablet 82d1e4cc5af6416ea6db123cfa321a53
0318 02:51:43.964332 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.964439 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4341531}
I20260318 02:51:43.965005 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1055) took 4347 ms. Trace:
I20260318 02:51:43.965144 1184 rpcz_store.cc:276] 0318 02:51:39.617972 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:39.632166 (+ 14194us) service_pool.cc:225] Handling call
0318 02:51:43.964883 (+4332717us) ts_tablet_manager.cc:1151] Deleting tablet 31ac876d59554349b897a9d2cb7c2c41
0318 02:51:43.964892 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.964989 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4332348}
I20260318 02:51:43.965641 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1059) took 4301 ms. Trace:
I20260318 02:51:43.966679 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 3d7b339a29ef456997d74a7a95d4c03a (table default.Table_2999327e014d4062a8e1aef2ba9ee277 [id=545ec19ee7a34ceb8e7adb93b6eaecf8]) successfully deleted
W20260318 02:51:43.966933 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet e51e65aee63a453b848d79feaf83307e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e51e65aee63a453b848d79feaf83307e already in progress: creating tablet
W20260318 02:51:43.967099 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2295aef8f25f433ab8248940319fce3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2295aef8f25f433ab8248940319fce3e already in progress: creating tablet
W20260318 02:51:43.967248 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 82d1e4cc5af6416ea6db123cfa321a53 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82d1e4cc5af6416ea6db123cfa321a53 already in progress: creating tablet
W20260318 02:51:43.967473 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 31ac876d59554349b897a9d2cb7c2c41 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31ac876d59554349b897a9d2cb7c2c41 already in progress: creating tablet
I20260318 02:51:43.965762 1184 rpcz_store.cc:276] 0318 02:51:39.664472 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:39.664542 (+ 70us) service_pool.cc:225] Handling call
0318 02:51:43.965518 (+4300976us) ts_tablet_manager.cc:1151] Deleting tablet 9eb15de8387248f1b2359c08230ff034
0318 02:51:43.965527 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.965623 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4300721}
W20260318 02:51:43.967882 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 9eb15de8387248f1b2359c08230ff034 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9eb15de8387248f1b2359c08230ff034 already in progress: creating tablet
I20260318 02:51:43.968212 1184 tablet_replica.cc:333] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:43.968408 1184 raft_consensus.cc:2243] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:43.968581 1184 raft_consensus.cc:2272] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:43.973837 1184 ts_tablet_manager.cc:1916] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:43.980010 1184 ts_tablet_manager.cc:1929] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:43.981307 1173 tablet_bootstrap.cc:654] T 5b49b066f27b43829c8f922649744303 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:43.984122 1994 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.104.130:45211 (request call id 113) took 802 ms (client timeout 1000 ms). Trace:
W20260318 02:51:43.984266 1994 rpcz_store.cc:269] 0318 02:51:43.181768 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.181831 (+ 63us) service_pool.cc:225] Handling call
0318 02:51:43.983087 (+801256us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x616000070954. stack: 00007f3d51731c56 00007f3d51731a10 00007f3d5070c3ad 0000000000986fb4 0000000000986f7d 00007f3d60aa16bd 00007f3d60aa17b3 00007f3d5d6677a1 00007f3d6533df2d 00007f3d654c45d8 00007f3d5bfbaca6 00007f3d5bfba9d5 00007f3d5873355e 00007f3d5873243e 00007f3d58738675 00007f3d58738f9f
0318 02:51:43.984063 (+ 976us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1840945024}
I20260318 02:51:43.984974 1175 ts_tablet_manager.cc:1916] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:43.988950 1995 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.104.131:37663 (request call id 102) took 1055 ms (client timeout 1000 ms). Trace:
W20260318 02:51:43.989085 1995 rpcz_store.cc:269] 0318 02:51:42.933481 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.933553 (+ 72us) service_pool.cc:225] Handling call
0318 02:51:43.987671 (+1054118us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x616000070954. stack: 00007f3d51731c56 00007f3d51731a10 00007f3d5070c3ad 0000000000986fb4 0000000000986f7d 00007f3d60aa16bd 00007f3d60aa17b3 00007f3d5d6677a1 00007f3d6533df2d 00007f3d654c45d8 00007f3d5bfbaca6 00007f3d5bfba9d5 00007f3d5873355e 00007f3d5873243e 00007f3d58738675 00007f3d58738f9f
0318 02:51:43.988875 (+ 1204us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2422742912}
W20260318 02:51:43.989687 1996 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.104.129:43863 (request call id 106) took 1053 ms (client timeout 1000 ms). Trace:
W20260318 02:51:43.989800 1996 rpcz_store.cc:269] 0318 02:51:42.936373 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.937570 (+ 1197us) service_pool.cc:225] Handling call
0318 02:51:43.988583 (+1051013us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x616000070954. stack: 00007f3d51731c56 00007f3d51731a10 00007f3d5070c3ad 0000000000986fb4 0000000000986f7d 00007f3d60aa16bd 00007f3d60aa17b3 00007f3d5d6677a1 00007f3d6533df2d 00007f3d654c45d8 00007f3d5bfbaca6 00007f3d5bfba9d5 00007f3d5873355e 00007f3d5873243e 00007f3d58738675 00007f3d58738f9f
0318 02:51:43.989627 (+ 1044us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2415887744}
I20260318 02:51:43.990090 2591 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee6aa91804a2401fa0ceb31b196ec40a)
I20260318 02:51:43.990267 2591 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } }
I20260318 02:51:43.990952 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a875cf0d4d504b64b3a2a6dc15fc6416"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:43.991181 2591 leader_election.cc:290] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee6aa91804a2401fa0ceb31b196ec40a (127.0.104.190:39451), 971baf5b9e4644c990dbf4d4fc7ba900 (127.0.104.188:41593)
I20260318 02:51:43.992031 905 tablet_service.cc:1511] Processing CreateTablet for tablet 34644de57b8444058096eefc093e851a (DEFAULT_TABLE table=default.Table_332860f760584d748b03287092362971 [id=f2482b1107384bbb9871d892eacd0f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:43.995410 1174 tablet_bootstrap.cc:654] T 33d90a619ae54227aaf95acd180af119 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:43.996672 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34644de57b8444058096eefc093e851a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.991560 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 1be09e67b9d94e669f28a7cd236b48a4
I20260318 02:51:43.998430 454 catalog_manager.cc:6741] ReplaceTablet: tablet 1be09e67b9d94e669f28a7cd236b48a4 deleted and replaced by tablet 6fda88f28e4447029cfeab1b197d27ff
I20260318 02:51:43.998777 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b872c48be3524444a502d18e2f82aa30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:43.999333 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b872c48be3524444a502d18e2f82aa30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:43.991834 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 452096c34eae4dddb822cb690e69a2b7 consensus state has no leader
I20260318 02:51:44.000735 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_66fa6d94e51e46949400bad6f425ca56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:44.001259 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66fa6d94e51e46949400bad6f425ca56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.006223 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 1be09e67b9d94e669f28a7cd236b48a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6fda88f28e4447029cfeab1b197d27ff) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.006426 897 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8afd668613441889212a2badb780b8 (DEFAULT_TABLE table=default.Table_0beb67db16454e77b7db32d7e0d7452d [id=ee525cebff96434693840ac684a28ac4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.006495 890 tablet_service.cc:1511] Processing CreateTablet for tablet d9a97ffa670e4e488264f993218ebe0f (DEFAULT_TABLE table=default.Table_39cd736f5f0347b09d35077664b3ea16 [id=1b566c804fa5412bb5045675b683970c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.006841 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8afd668613441889212a2badb780b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.007038 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9a97ffa670e4e488264f993218ebe0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.007045 418 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu pid 1280
I20260318 02:51:44.006237 903 tablet_service.cc:1511] Processing CreateTablet for tablet 97b6ea03070e4821bae10800936856b8 (DEFAULT_TABLE table=default.Table_6df2b6483e034cf19a5aeea667bcd579 [id=c21788045b74414e99820f0772502511]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.007434 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b6ea03070e4821bae10800936856b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:43.953922 1176 ts_tablet_manager.cc:1916] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:43.967468 2467 raft_consensus.cc:493] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.015439 2467 raft_consensus.cc:515] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.016660 2467 leader_election.cc:290] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:44.017355 1448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8b701993861d4c11b3394a2d6588b3b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1433 } } ignore_live_leader: false dest_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" is_pre_election: true
I20260318 02:51:44.017622 893 tablet_service.cc:1511] Processing CreateTablet for tablet 43844dd8883e45dbaa92d4058e9af9fb (DEFAULT_TABLE table=default.Table_7d15c7f8f6214d5aba96a8c9fd76cb35 [id=e5c6febd18af467fb69bec2ef3e729ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.017998 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43844dd8883e45dbaa92d4058e9af9fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:44.004601 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a875cf0d4d504b64b3a2a6dc15fc6416 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.025545 1176 ts_tablet_manager.cc:1929] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.026963 2593 raft_consensus.cc:493] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.027148 2593 raft_consensus.cc:515] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:44.029110 862 leader_election.cc:343] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2882569524e74a308e9fabf533a8a87c
I20260318 02:51:44.030433 2593 leader_election.cc:290] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:44.031385 860 leader_election.cc:343] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 2882569524e74a308e9fabf533a8a87c
I20260318 02:51:44.031519 860 leader_election.cc:304] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:44.031737 2593 raft_consensus.cc:2749] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.032411 1176 log.cc:1199] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/4df7d75e696a4aec981de3963c282b0d
I20260318 02:51:44.032938 903 tablet_service.cc:1511] Processing CreateTablet for tablet 360f411cca654bfa884a299bdf1bc37d (DEFAULT_TABLE table=default.Table_8b9c5c2233ae4a5ca3fee201d3499e54 [id=216b786dd9d24ff691dfe82e9e800d72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.033030 1176 ts_tablet_manager.cc:1950] T 4df7d75e696a4aec981de3963c282b0d P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:44.033869 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1174) took 2098 ms. Trace:
I20260318 02:51:44.033929 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 360f411cca654bfa884a299bdf1bc37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.036206 1176 rpcz_store.cc:276] 0318 02:51:41.935729 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.935773 (+ 44us) service_pool.cc:225] Handling call
0318 02:51:43.910472 (+1974699us) ts_tablet_manager.cc:1151] Deleting tablet 4df7d75e696a4aec981de3963c282b0d
0318 02:51:43.910486 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.014364 (+103878us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.025401 (+ 11037us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.033845 (+ 8444us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1974432}
I20260318 02:51:44.039776 466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8b701993861d4c11b3394a2d6588b3b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1433 } } ignore_live_leader: false dest_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" is_pre_election: true
I20260318 02:51:44.037940 1174 tablet_bootstrap.cc:492] T 33d90a619ae54227aaf95acd180af119 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:44.040328 1174 ts_tablet_manager.cc:1403] T 33d90a619ae54227aaf95acd180af119 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.094s user 0.004s sys 0.000s
I20260318 02:51:44.040355 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1175) took 2002 ms. Trace:
I20260318 02:51:44.040447 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 1be09e67b9d94e669f28a7cd236b48a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6fda88f28e4447029cfeab1b197d27ff) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.040373 749 tablet_service.cc:1511] Processing CreateTablet for tablet 43844dd8883e45dbaa92d4058e9af9fb (DEFAULT_TABLE table=default.Table_7d15c7f8f6214d5aba96a8c9fd76cb35 [id=e5c6febd18af467fb69bec2ef3e729ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.040468 1176 rpcz_store.cc:276] 0318 02:51:42.037628 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.037694 (+ 66us) service_pool.cc:225] Handling call
0318 02:51:44.040232 (+2002538us) ts_tablet_manager.cc:1151] Deleting tablet 15f79ab1c38141adaed4bd381df26d9b
0318 02:51:44.040242 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.040337 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1678919}
I20260318 02:51:44.040373 754 tablet_service.cc:1511] Processing CreateTablet for tablet 34644de57b8444058096eefc093e851a (DEFAULT_TABLE table=default.Table_332860f760584d748b03287092362971 [id=f2482b1107384bbb9871d892eacd0f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.041040 748 tablet_service.cc:1511] Processing CreateTablet for tablet 97b6ea03070e4821bae10800936856b8 (DEFAULT_TABLE table=default.Table_6df2b6483e034cf19a5aeea667bcd579 [id=c21788045b74414e99820f0772502511]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.040823 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1176) took 1989 ms. Trace:
I20260318 02:51:44.041338 1176 rpcz_store.cc:276] 0318 02:51:42.051465 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.051525 (+ 60us) service_pool.cc:225] Handling call
0318 02:51:44.040697 (+1989172us) ts_tablet_manager.cc:1151] Deleting tablet 2332d8dabb79471e8c8ea545228c1d18
0318 02:51:44.040727 (+ 30us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.040810 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1675874}
I20260318 02:51:44.041473 759 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8afd668613441889212a2badb780b8 (DEFAULT_TABLE table=default.Table_0beb67db16454e77b7db32d7e0d7452d [id=ee525cebff96434693840ac684a28ac4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.040812 758 tablet_service.cc:1511] Processing CreateTablet for tablet d9a97ffa670e4e488264f993218ebe0f (DEFAULT_TABLE table=default.Table_39cd736f5f0347b09d35077664b3ea16 [id=1b566c804fa5412bb5045675b683970c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.041505 1174 raft_consensus.cc:359] T 33d90a619ae54227aaf95acd180af119 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.041930 1174 raft_consensus.cc:385] T 33d90a619ae54227aaf95acd180af119 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.041996 1174 raft_consensus.cc:740] T 33d90a619ae54227aaf95acd180af119 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.042218 1174 consensus_queue.cc:260] T 33d90a619ae54227aaf95acd180af119 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.040809 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43844dd8883e45dbaa92d4058e9af9fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.042601 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34644de57b8444058096eefc093e851a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.042769 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b6ea03070e4821bae10800936856b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.044545 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 4df7d75e696a4aec981de3963c282b0d (table default.Table_5ed5970032fe44119b015cb6bbcd91d0 [id=5b9c6b78b2a94e55af6944b71dd51850]) successfully deleted
I20260318 02:51:44.044842 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8afd668613441889212a2badb780b8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:44.044871 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 15f79ab1c38141adaed4bd381df26d9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15f79ab1c38141adaed4bd381df26d9b already in progress: creating tablet
W20260318 02:51:44.045061 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2332d8dabb79471e8c8ea545228c1d18 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2332d8dabb79471e8c8ea545228c1d18 already in progress: creating tablet
I20260318 02:51:44.045871 1174 ts_tablet_manager.cc:1434] T 33d90a619ae54227aaf95acd180af119 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260318 02:51:44.046150 1174 tablet_bootstrap.cc:492] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:44.046607 1184 log.cc:1199] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/c7c4257a54d3487aa520531a64fc721c
I20260318 02:51:44.046932 1184 ts_tablet_manager.cc:1950] T c7c4257a54d3487aa520531a64fc721c P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:44.047719 1174 tablet_bootstrap.cc:654] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.047724 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1070) took 4233 ms. Trace:
I20260318 02:51:44.047806 1184 rpcz_store.cc:276] 0318 02:51:39.814212 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:39.838510 (+ 24298us) service_pool.cc:225] Handling call
0318 02:51:43.968156 (+4129646us) ts_tablet_manager.cc:1151] Deleting tablet c7c4257a54d3487aa520531a64fc721c
0318 02:51:43.968168 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:43.977102 (+ 8934us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:43.979894 (+ 2792us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.047697 (+ 67803us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4129398}
I20260318 02:51:44.048277 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1071) took 4212 ms. Trace:
I20260318 02:51:44.048352 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9a97ffa670e4e488264f993218ebe0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.048350 1184 rpcz_store.cc:276] 0318 02:51:39.835966 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:39.840085 (+ 4119us) service_pool.cc:225] Handling call
0318 02:51:44.048133 (+4208048us) ts_tablet_manager.cc:1151] Deleting tablet fb5d1d828899472e8f48723b35e94d62
0318 02:51:44.048143 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.048259 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4207850}
I20260318 02:51:44.048473 1970 leader_election.cc:304] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b701993861d4c11b3394a2d6588b3b7; no voters: 971baf5b9e4644c990dbf4d4fc7ba900, ee6aa91804a2401fa0ceb31b196ec40a
I20260318 02:51:44.049043 2591 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8b701993861d4c11b3394a2d6588b3b7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260318 02:51:44.050665 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1177) took 1998 ms. Trace:
I20260318 02:51:44.050741 1176 rpcz_store.cc:276] 0318 02:51:42.051963 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.052018 (+ 55us) service_pool.cc:225] Handling call
0318 02:51:44.042163 (+1990145us) ts_tablet_manager.cc:1151] Deleting tablet d3b37df330984378b81b367446d34748
0318 02:51:44.042264 (+ 101us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.050646 (+ 8382us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1677080}
I20260318 02:51:44.051074 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1178) took 1998 ms. Trace:
I20260318 02:51:44.051144 1176 rpcz_store.cc:276] 0318 02:51:42.053010 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.053063 (+ 53us) service_pool.cc:225] Handling call
0318 02:51:44.050964 (+1997901us) ts_tablet_manager.cc:1151] Deleting tablet a7c35c13521b43789a1f0b6092b4d855
0318 02:51:44.050974 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.051061 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1685601}
I20260318 02:51:44.051388 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1182) took 1991 ms. Trace:
I20260318 02:51:44.051437 1176 rpcz_store.cc:276] 0318 02:51:42.059465 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.059513 (+ 48us) service_pool.cc:225] Handling call
0318 02:51:44.051307 (+1991794us) ts_tablet_manager.cc:1151] Deleting tablet 77a17ef7cfee4d65808b11e9cb51e7df
0318 02:51:44.051314 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.051378 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1682632}
I20260318 02:51:44.051653 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1183) took 1991 ms. Trace:
I20260318 02:51:44.051700 1176 rpcz_store.cc:276] 0318 02:51:42.060236 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.060763 (+ 527us) service_pool.cc:225] Handling call
0318 02:51:44.051583 (+1990820us) ts_tablet_manager.cc:1151] Deleting tablet b8477c484db84187a3a576de6195a228
0318 02:51:44.051589 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.051644 (+ 55us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1682886}
I20260318 02:51:44.051877 1176 tablet_replica.cc:333] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:44.052030 1176 raft_consensus.cc:2243] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.052157 1176 raft_consensus.cc:2272] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:44.053558 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet d3b37df330984378b81b367446d34748 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3b37df330984378b81b367446d34748 already in progress: creating tablet
W20260318 02:51:44.053764 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet a7c35c13521b43789a1f0b6092b4d855 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7c35c13521b43789a1f0b6092b4d855 already in progress: creating tablet
W20260318 02:51:44.053934 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 77a17ef7cfee4d65808b11e9cb51e7df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77a17ef7cfee4d65808b11e9cb51e7df already in progress: creating tablet
W20260318 02:51:44.054075 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet b8477c484db84187a3a576de6195a228 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8477c484db84187a3a576de6195a228 already in progress: creating tablet
I20260318 02:51:44.048681 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1096) took 3858 ms. Trace:
I20260318 02:51:44.055358 1184 rpcz_store.cc:276] 0318 02:51:40.190641 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.192464 (+ 1823us) service_pool.cc:225] Handling call
0318 02:51:44.048574 (+3856110us) ts_tablet_manager.cc:1151] Deleting tablet 5c89f413a26a43ef95c850d7c44f85b2
0318 02:51:44.048583 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.048665 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11426,"tablet-delete.queue_time_us":3855871}
I20260318 02:51:44.056648 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1097) took 3865 ms. Trace:
I20260318 02:51:44.056777 1184 rpcz_store.cc:276] 0318 02:51:40.190793 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.194023 (+ 3230us) service_pool.cc:225] Handling call
0318 02:51:44.056180 (+3862157us) ts_tablet_manager.cc:1151] Deleting tablet 0cda13385dbb4c6daa211e933c1f93a1
0318 02:51:44.056192 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.056624 (+ 432us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9925,"tablet-delete.queue_time_us":3861891}
I20260318 02:51:44.057163 2494 raft_consensus.cc:697] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:44.057439 2494 consensus_queue.cc:237] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.058161 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1098) took 3824 ms. Trace:
I20260318 02:51:44.058233 1184 rpcz_store.cc:276] 0318 02:51:40.233883 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.236761 (+ 2878us) service_pool.cc:225] Handling call
0318 02:51:44.057814 (+3821053us) ts_tablet_manager.cc:1151] Deleting tablet e918bb008e0743a9bf7ada170812146e
0318 02:51:44.057823 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.058144 (+ 321us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3820840}
I20260318 02:51:44.058355 1173 tablet_bootstrap.cc:492] T 5b49b066f27b43829c8f922649744303 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:44.058494 1173 ts_tablet_manager.cc:1403] T 5b49b066f27b43829c8f922649744303 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.106s user 0.010s sys 0.000s
I20260318 02:51:44.058980 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1099) took 3824 ms. Trace:
I20260318 02:51:44.059048 1184 rpcz_store.cc:276] 0318 02:51:40.234030 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.237004 (+ 2974us) service_pool.cc:225] Handling call
0318 02:51:44.058860 (+3821856us) ts_tablet_manager.cc:1151] Deleting tablet 54b8f3520a4e4a5987bb7a6732c7b882
0318 02:51:44.058869 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.058966 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3821739}
I20260318 02:51:44.059126 1172 tablet_bootstrap.cc:492] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:44.059278 1172 ts_tablet_manager.cc:1403] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.103s user 0.002s sys 0.006s
I20260318 02:51:44.059243 1173 raft_consensus.cc:359] T 5b49b066f27b43829c8f922649744303 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.059419 1173 raft_consensus.cc:385] T 5b49b066f27b43829c8f922649744303 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.059468 1173 raft_consensus.cc:740] T 5b49b066f27b43829c8f922649744303 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.059670 1173 consensus_queue.cc:260] T 5b49b066f27b43829c8f922649744303 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.060074 1172 raft_consensus.cc:359] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.060210 1173 ts_tablet_manager.cc:1434] T 5b49b066f27b43829c8f922649744303 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:44.060245 1172 raft_consensus.cc:385] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.060293 1172 raft_consensus.cc:740] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.065014 2007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40520 (request call id 1) took 1286 ms. Trace:
I20260318 02:51:44.069774 1176 ts_tablet_manager.cc:1916] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.075428 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet c7c4257a54d3487aa520531a64fc721c (table default.Table_ebd103e5fbf4484597076b02ffd82044 [id=4067c18ce85f44d7993786a3e9bda883]) successfully deleted
W20260318 02:51:44.075757 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet fb5d1d828899472e8f48723b35e94d62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb5d1d828899472e8f48723b35e94d62 already in progress: creating tablet
I20260318 02:51:44.075796 1172 consensus_queue.cc:260] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:44.075980 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 5c89f413a26a43ef95c850d7c44f85b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c89f413a26a43ef95c850d7c44f85b2 already in progress: creating tablet
W20260318 02:51:44.076152 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 0cda13385dbb4c6daa211e933c1f93a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0cda13385dbb4c6daa211e933c1f93a1 already in progress: creating tablet
W20260318 02:51:44.076309 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet e918bb008e0743a9bf7ada170812146e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e918bb008e0743a9bf7ada170812146e already in progress: creating tablet
I20260318 02:51:44.076896 2152 raft_consensus.cc:493] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.077025 2152 raft_consensus.cc:515] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.077473 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 4052eede3f404b84ac27e21a204bf5a9
I20260318 02:51:44.077596 2152 leader_election.cc:290] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:44.078217 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184ce58aa96d4e70ad7b2783f19ccdeb" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:44.078725 997 leader_election.cc:343] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:44.079736 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f047e256dea04affa752abf1452d970f consensus state has no leader
I20260318 02:51:44.081229 450 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 5b49b066f27b43829c8f922649744303 (table default.Table_e7633153163443ce97eeb8423db6d4ea [id=6f4e96b5a043423b95bfdf37a2411644]). Expected version 1 got 0
I20260318 02:51:43.993449 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 34644de57b8444058096eefc093e851a (DEFAULT_TABLE table=default.Table_332860f760584d748b03287092362971 [id=f2482b1107384bbb9871d892eacd0f6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.082155 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34644de57b8444058096eefc093e851a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.082157 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_614e1c29256e4ddbb9a5dfb12f4a27f2" } modify_external_catalogs: true
I20260318 02:51:44.082301 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_614e1c29256e4ddbb9a5dfb12f4a27f2" } modify_external_catalogs: true
I20260318 02:51:44.083410 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 7253dcb3d73c4297bf444defd3ef6e74
I20260318 02:51:44.083973 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5e53f15adf3f483f892dd81b106bbe56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:44.084488 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e53f15adf3f483f892dd81b106bbe56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.006188 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 1be09e67b9d94e669f28a7cd236b48a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6fda88f28e4447029cfeab1b197d27ff) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.006237 1027 tablet_service.cc:1511] Processing CreateTablet for tablet d9a97ffa670e4e488264f993218ebe0f (DEFAULT_TABLE table=default.Table_39cd736f5f0347b09d35077664b3ea16 [id=1b566c804fa5412bb5045675b683970c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.006590 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 97b6ea03070e4821bae10800936856b8 (DEFAULT_TABLE table=default.Table_6df2b6483e034cf19a5aeea667bcd579 [id=c21788045b74414e99820f0772502511]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.015014 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 1b8afd668613441889212a2badb780b8 (DEFAULT_TABLE table=default.Table_0beb67db16454e77b7db32d7e0d7452d [id=ee525cebff96434693840ac684a28ac4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.016108 2488 raft_consensus.cc:493] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.025312 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 43844dd8883e45dbaa92d4058e9af9fb (DEFAULT_TABLE table=default.Table_7d15c7f8f6214d5aba96a8c9fd76cb35 [id=e5c6febd18af467fb69bec2ef3e729ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.086432 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9a97ffa670e4e488264f993218ebe0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.086380 2488 raft_consensus.cc:515] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.086681 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43844dd8883e45dbaa92d4058e9af9fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.086999 2488 leader_election.cc:290] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:44.087594 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783c886a99994d6c8d9add724277819a" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:44.088196 997 leader_election.cc:343] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.089275 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b6ea03070e4821bae10800936856b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.092829 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8afd668613441889212a2badb780b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.094472 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184ce58aa96d4e70ad7b2783f19ccdeb" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:44.095291 782 raft_consensus.cc:2468] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:44.095697 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet aa12fe852965419ab1803049e416c780
I20260318 02:51:44.095623 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b735de7cc516403da40f10ec36cf25f1" } modify_external_catalogs: true
I20260318 02:51:44.095805 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b735de7cc516403da40f10ec36cf25f1" } modify_external_catalogs: true
I20260318 02:51:44.096151 449 catalog_manager.cc:6741] ReplaceTablet: tablet aa12fe852965419ab1803049e416c780 deleted and replaced by tablet 369e952736e44a92a242b2b5cfa29074
I20260318 02:51:44.096448 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a265fa502cd54457b39b55d7c9e7b0b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:44.096990 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a265fa502cd54457b39b55d7c9e7b0b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.099779 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 33d90a619ae54227aaf95acd180af119
I20260318 02:51:44.099792 999 leader_election.cc:304] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:44.100418 999 leader_election.cc:343] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 783c886a99994d6c8d9add724277819a
I20260318 02:51:44.100528 999 leader_election.cc:304] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.100445 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_4822eac87bd94e139cf4b94ab7edede3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:44.100901 2488 raft_consensus.cc:2804] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:44.100975 2488 raft_consensus.cc:493] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:44.101032 2488 raft_consensus.cc:3060] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:44.101092 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4822eac87bd94e139cf4b94ab7edede3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.103295 2152 raft_consensus.cc:2749] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.103515 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_bbc75d75a0824c3786615a4c0dab452c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:44.104097 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbc75d75a0824c3786615a4c0dab452c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.109159 897 tablet_service.cc:1558] Processing DeleteTablet for tablet aa12fe852965419ab1803049e416c780 with delete_type TABLET_DATA_DELETED (replaced by tablet 369e952736e44a92a242b2b5cfa29074) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.109227 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 33d90a619ae54227aaf95acd180af119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.109920 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 7253dcb3d73c4297bf444defd3ef6e74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.110188 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 33d90a619ae54227aaf95acd180af119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.110275 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 7253dcb3d73c4297bf444defd3ef6e74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.110373 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 4052eede3f404b84ac27e21a204bf5a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.110189 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet aa12fe852965419ab1803049e416c780 with delete_type TABLET_DATA_DELETED (replaced by tablet 369e952736e44a92a242b2b5cfa29074) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.111330 2488 raft_consensus.cc:515] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.111996 2488 leader_election.cc:290] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:44.112246 2467 raft_consensus.cc:493] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.112381 2467 raft_consensus.cc:515] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.112999 2467 leader_election.cc:290] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:44.113911 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184ce58aa96d4e70ad7b2783f19ccdeb" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:44.114413 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 33d90a619ae54227aaf95acd180af119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:44.114552 997 leader_election.cc:343] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.115228 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 4052eede3f404b84ac27e21a204bf5a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.115415 749 tablet_service.cc:1558] Processing DeleteTablet for tablet aa12fe852965419ab1803049e416c780 with delete_type TABLET_DATA_DELETED (replaced by tablet 369e952736e44a92a242b2b5cfa29074) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.115415 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184ce58aa96d4e70ad7b2783f19ccdeb" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:44.115572 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 7253dcb3d73c4297bf444defd3ef6e74 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.115598 785 raft_consensus.cc:3060] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:44.118696 785 raft_consensus.cc:2468] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:44.119278 999 leader_election.cc:304] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.120290 1176 ts_tablet_manager.cc:1929] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.120404 1176 log.cc:1199] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/a384923c86ee42d6a47ed3f68e6811df
I20260318 02:51:44.120699 1176 ts_tablet_manager.cc:1950] T a384923c86ee42d6a47ed3f68e6811df P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:44.124003 2362 raft_consensus.cc:493] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.124229 2362 raft_consensus.cc:515] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.124948 2362 leader_election.cc:290] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:44.126344 860 leader_election.cc:343] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: d1a67e637d934c0f99c00d04fb26df0d
I20260318 02:51:44.126579 1172 ts_tablet_manager.cc:1434] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.067s user 0.006s sys 0.002s
W20260318 02:51:44.129945 862 leader_election.cc:343] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: d1a67e637d934c0f99c00d04fb26df0d
I20260318 02:51:44.130079 862 leader_election.cc:304] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:44.130550 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1208) took 1719 ms. Trace:
I20260318 02:51:44.130581 2362 raft_consensus.cc:2749] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.130663 1176 rpcz_store.cc:276] 0318 02:51:42.411002 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.430120 (+ 19118us) service_pool.cc:225] Handling call
0318 02:51:44.051843 (+1621723us) ts_tablet_manager.cc:1151] Deleting tablet a384923c86ee42d6a47ed3f68e6811df
0318 02:51:44.051850 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.098308 (+ 46458us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.120174 (+ 21866us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.130521 (+ 10347us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1621559}
I20260318 02:51:44.131301 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet a384923c86ee42d6a47ed3f68e6811df (table default.Table_594a288e26f245c8a9c365f583bced74 [id=a653573522fe43da9c796fc1c7c638f9]) successfully deleted
I20260318 02:51:44.126776 2614 raft_consensus.cc:2804] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:44.131773 2614 raft_consensus.cc:697] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:44.132128 2614 consensus_queue.cc:237] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.131870 1172 tablet_bootstrap.cc:492] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:44.135388 1484 generic_service.cc:196] Checking for leaks (request via RPC)
I20260318 02:51:44.139483 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 4052eede3f404b84ac27e21a204bf5a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.139747 1176 tablet_replica.cc:333] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:44.139969 1176 raft_consensus.cc:2243] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.140141 1176 raft_consensus.cc:2272] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.140669 1176 ts_tablet_manager.cc:1916] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.146028 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_41b35eb8bd42409cbe13e96d577de423" } new_table_name: "default.Table_edb1e761aa5a4a8686ff491c14d529a8" modify_external_catalogs: true
I20260318 02:51:44.147809 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9497c2ca1edd40ec8ab79a75552b87d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:44.148614 2152 raft_consensus.cc:493] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.148795 2152 raft_consensus.cc:515] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.148895 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9ab2eed2c17e4f67b591a7dcf3cb0044" } new_table_name: "default.Table_0d01c6187ba344fdb7a7180f3cfbbec5" modify_external_catalogs: true
I20260318 02:51:44.149459 2152 leader_election.cc:290] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:44.150326 453 master_service.cc:954] ReplaceTablet: received request to replace tablet a7c35c13521b43789a1f0b6092b4d855 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:44.150429 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85e6ad2a9817444caecb78eabde5d222" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:44.151012 997 leader_election.cc:343] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.151273 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 036c17d033b145a681843d14f67ab575
I20260318 02:51:44.152107 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet ffa9d9dcc70e402099b414029f062d6e
W20260318 02:51:44.155977 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9497c2ca1edd40ec8ab79a75552b87d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.156559 759 tablet_service.cc:1558] Processing DeleteTablet for tablet ffa9d9dcc70e402099b414029f062d6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:44.159812 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c207ffbbf36d46ff9755e3f739b3a25c consensus state has no leader
W20260318 02:51:44.160742 999 leader_election.cc:343] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 85e6ad2a9817444caecb78eabde5d222
I20260318 02:51:44.160984 999 leader_election.cc:304] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.161684 2488 raft_consensus.cc:2749] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.162014 2593 raft_consensus.cc:493] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.162209 2593 raft_consensus.cc:515] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:44.164100 860 leader_election.cc:343] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: b383fd49049c4c1daba3f1ed60899f3e
I20260318 02:51:44.164311 2593 leader_election.cc:290] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:44.164860 862 leader_election.cc:343] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: b383fd49049c4c1daba3f1ed60899f3e
I20260318 02:51:44.164999 862 leader_election.cc:304] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:44.165589 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 036c17d033b145a681843d14f67ab575 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.168136 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 036c17d033b145a681843d14f67ab575 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.168612 890 tablet_service.cc:1558] Processing DeleteTablet for tablet ffa9d9dcc70e402099b414029f062d6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.169237 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet ffa9d9dcc70e402099b414029f062d6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.170497 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 036c17d033b145a681843d14f67ab575 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.170755 2593 raft_consensus.cc:2749] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.176921 1172 tablet_bootstrap.cc:654] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.180058 758 tablet_service.cc:1511] Processing CreateTablet for tablet 360f411cca654bfa884a299bdf1bc37d (DEFAULT_TABLE table=default.Table_8b9c5c2233ae4a5ca3fee201d3499e54 [id=216b786dd9d24ff691dfe82e9e800d72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.180680 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 360f411cca654bfa884a299bdf1bc37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.185849 457 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 5b49b066f27b43829c8f922649744303 (table default.Table_e7633153163443ce97eeb8423db6d4ea [id=6f4e96b5a043423b95bfdf37a2411644]). Expected version 1 got 0
I20260318 02:51:44.187814 1173 tablet_bootstrap.cc:492] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:44.188868 1176 ts_tablet_manager.cc:1929] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.189033 1176 log.cc:1199] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/82858fd64d534d1abcad12bc4a93cda7
I20260318 02:51:44.189383 1176 ts_tablet_manager.cc:1950] T 82858fd64d534d1abcad12bc4a93cda7 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:44.190402 1173 tablet_bootstrap.cc:654] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.190810 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1209) took 1684 ms. Trace:
I20260318 02:51:44.190912 1176 rpcz_store.cc:276] 0318 02:51:42.506437 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.506486 (+ 49us) service_pool.cc:225] Handling call
0318 02:51:44.139681 (+1633195us) ts_tablet_manager.cc:1151] Deleting tablet 82858fd64d534d1abcad12bc4a93cda7
0318 02:51:44.139695 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.164362 (+ 24667us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.170157 (+ 5795us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.190783 (+ 20626us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1632957}
I20260318 02:51:44.191377 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 82858fd64d534d1abcad12bc4a93cda7 (table default.Table_e81f3622048c415e977ce897e4edcacf [id=74f992023abb491eb564bdfd68b19b98]) successfully deleted
I20260318 02:51:44.205068 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9ea103c1629a45baa8d4804f11679100"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:44.205847 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ea103c1629a45baa8d4804f11679100 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.206980 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1210) took 1397 ms. Trace:
I20260318 02:51:44.207082 1176 rpcz_store.cc:276] 0318 02:51:42.809099 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.809149 (+ 50us) service_pool.cc:225] Handling call
0318 02:51:44.206818 (+1397669us) ts_tablet_manager.cc:1151] Deleting tablet 1294e1ae2115471a8b605d38f1c26e60
0318 02:51:44.206833 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.206953 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1397480}
I20260318 02:51:44.207345 457 catalog_manager.cc:5671] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
W20260318 02:51:44.207625 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 1294e1ae2115471a8b605d38f1c26e60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1294e1ae2115471a8b605d38f1c26e60 already in progress: creating tablet
I20260318 02:51:44.207738 457 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 3aa05403966349ae9056777d913a0db6 (table default.Table_802a2d53f1c14a879d8737dad75f6252 [id=5b2e7b122a394e058dc5b2fd84a0f558]). Expected version 3 got 0
I20260318 02:51:44.208057 2593 raft_consensus.cc:493] T 5b49b066f27b43829c8f922649744303 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.208267 2593 raft_consensus.cc:515] T 5b49b066f27b43829c8f922649744303 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.210654 2593 leader_election.cc:290] T 5b49b066f27b43829c8f922649744303 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:44.210750 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49b066f27b43829c8f922649744303" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:44.211064 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49b066f27b43829c8f922649744303" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:44.211992 862 leader_election.cc:304] T 5b49b066f27b43829c8f922649744303 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:44.212460 2593 raft_consensus.cc:2749] T 5b49b066f27b43829c8f922649744303 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.212747 1176 tablet_replica.cc:333] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:44.212885 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b361769933b047a094f2220b0eb496c3" } new_table_name: "default.Table_3c703c59a09d493d8c132dd9a026135f" modify_external_catalogs: true
I20260318 02:51:44.213385 1176 raft_consensus.cc:2243] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.213547 1176 raft_consensus.cc:2272] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.215258 759 tablet_service.cc:1511] Processing CreateTablet for tablet b9044a438a9b488d9ce687c4b388735d (DEFAULT_TABLE table=default.Table_27133deb6826433fbb808c7824950ec3 [id=ac81019c3fb64b92b97c3b0be9384bbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.215659 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9044a438a9b488d9ce687c4b388735d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.219446 1034 tablet_service.cc:1511] Processing CreateTablet for tablet b9044a438a9b488d9ce687c4b388735d (DEFAULT_TABLE table=default.Table_27133deb6826433fbb808c7824950ec3 [id=ac81019c3fb64b92b97c3b0be9384bbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.219831 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9044a438a9b488d9ce687c4b388735d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.219873 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab37050e1114389957f830e9d4f982e (DEFAULT_TABLE table=default.Table_69abcdb2f9e2437f88b48b572afea756 [id=55811cf4cea94c6d901c80776844def7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.220232 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab37050e1114389957f830e9d4f982e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.220151 890 tablet_service.cc:1511] Processing CreateTablet for tablet d53487073c50420c8fd0c7059754fc3d (DEFAULT_TABLE table=default.Table_70f3dfdd5c0e4a8999c5983161a9bd4f [id=ec765c598e3c4b52a6dbe48231c0e1d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.220505 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53487073c50420c8fd0c7059754fc3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.221529 749 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab37050e1114389957f830e9d4f982e (DEFAULT_TABLE table=default.Table_69abcdb2f9e2437f88b48b572afea756 [id=55811cf4cea94c6d901c80776844def7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.221879 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab37050e1114389957f830e9d4f982e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.225445 1030 tablet_service.cc:1511] Processing CreateTablet for tablet d53487073c50420c8fd0c7059754fc3d (DEFAULT_TABLE table=default.Table_70f3dfdd5c0e4a8999c5983161a9bd4f [id=ec765c598e3c4b52a6dbe48231c0e1d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.225448 893 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab37050e1114389957f830e9d4f982e (DEFAULT_TABLE table=default.Table_69abcdb2f9e2437f88b48b572afea756 [id=55811cf4cea94c6d901c80776844def7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.225811 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53487073c50420c8fd0c7059754fc3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.225831 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab37050e1114389957f830e9d4f982e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.228399 748 tablet_service.cc:1511] Processing CreateTablet for tablet da7a36233a244908a5183a7d78e94d6d (DEFAULT_TABLE table=default.Table_2013b3bbb3474786b82fe42ceaf78627 [id=6e039ea545484754a6223343cc4ae555]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.228816 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da7a36233a244908a5183a7d78e94d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.229307 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f527a0ba0914924bc7f604ae8a48393" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:44.230129 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f527a0ba0914924bc7f604ae8a48393" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:44.231197 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c58290c2d1c742d3b45dfb5caf52c75b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:44.231920 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c58290c2d1c742d3b45dfb5caf52c75b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:44.233568 754 tablet_service.cc:1511] Processing CreateTablet for tablet b54248ad606643a292dff193c35d6a00 (DEFAULT_TABLE table=default.Table_d6caec70978b40caa5fae6a9d4261a5d [id=eaad96cc64104d2a9d42102c05d28305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.233974 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54248ad606643a292dff193c35d6a00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.235766 1034 tablet_service.cc:1511] Processing CreateTablet for tablet da7a36233a244908a5183a7d78e94d6d (DEFAULT_TABLE table=default.Table_2013b3bbb3474786b82fe42ceaf78627 [id=6e039ea545484754a6223343cc4ae555]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.236061 896 tablet_service.cc:1511] Processing CreateTablet for tablet b54248ad606643a292dff193c35d6a00 (DEFAULT_TABLE table=default.Table_d6caec70978b40caa5fae6a9d4261a5d [id=eaad96cc64104d2a9d42102c05d28305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.236198 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da7a36233a244908a5183a7d78e94d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.236425 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54248ad606643a292dff193c35d6a00. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:44.236637 719 leader_election.cc:343] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:44.236989 719 leader_election.cc:343] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.240799 2467 raft_consensus.cc:493] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.240968 2467 raft_consensus.cc:515] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.241489 2467 leader_election.cc:290] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:44.241640 2467 consensus_queue.cc:1048] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260318 02:51:44.242352 423 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 47716.6us
I20260318 02:51:44.243170 749 tablet_service.cc:1511] Processing CreateTablet for tablet d53487073c50420c8fd0c7059754fc3d (DEFAULT_TABLE table=default.Table_70f3dfdd5c0e4a8999c5983161a9bd4f [id=ec765c598e3c4b52a6dbe48231c0e1d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.245157 890 tablet_service.cc:1511] Processing CreateTablet for tablet da7a36233a244908a5183a7d78e94d6d (DEFAULT_TABLE table=default.Table_2013b3bbb3474786b82fe42ceaf78627 [id=6e039ea545484754a6223343cc4ae555]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.245636 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da7a36233a244908a5183a7d78e94d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.246013 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53487073c50420c8fd0c7059754fc3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.246340 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 360f411cca654bfa884a299bdf1bc37d (DEFAULT_TABLE table=default.Table_8b9c5c2233ae4a5ca3fee201d3499e54 [id=216b786dd9d24ff691dfe82e9e800d72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.246773 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 360f411cca654bfa884a299bdf1bc37d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.251928 905 tablet_service.cc:1511] Processing CreateTablet for tablet b9044a438a9b488d9ce687c4b388735d (DEFAULT_TABLE table=default.Table_27133deb6826433fbb808c7824950ec3 [id=ac81019c3fb64b92b97c3b0be9384bbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.252431 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9044a438a9b488d9ce687c4b388735d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.252985 1176 ts_tablet_manager.cc:1916] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.255879 1034 tablet_service.cc:1511] Processing CreateTablet for tablet b54248ad606643a292dff193c35d6a00 (DEFAULT_TABLE table=default.Table_d6caec70978b40caa5fae6a9d4261a5d [id=eaad96cc64104d2a9d42102c05d28305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.258983 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54248ad606643a292dff193c35d6a00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.261552 1172 tablet_bootstrap.cc:492] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:44.261780 1172 ts_tablet_manager.cc:1403] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.130s user 0.002s sys 0.002s
I20260318 02:51:44.262639 1172 raft_consensus.cc:359] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.262961 1172 raft_consensus.cc:385] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.263053 1172 raft_consensus.cc:740] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.263346 1172 consensus_queue.cc:260] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.263769 2494 raft_consensus.cc:493] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.263886 2494 raft_consensus.cc:515] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.264472 2494 leader_election.cc:290] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:44.265910 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317cc133346412fb981b1c8e5b99c4d" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:44.265990 1172 ts_tablet_manager.cc:1434] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260318 02:51:44.266274 1172 tablet_bootstrap.cc:492] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:44.267756 1172 tablet_bootstrap.cc:654] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:44.267987 999 leader_election.cc:343] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: b317cc133346412fb981b1c8e5b99c4d
W20260318 02:51:44.269632 997 leader_election.cc:343] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.269814 997 leader_election.cc:304] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.270080 2152 raft_consensus.cc:2749] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.271373 924 raft_consensus.cc:3060] T 5b49b066f27b43829c8f922649744303 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:44.272413 1175 ts_tablet_manager.cc:1929] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.272573 1175 log.cc:1199] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/3dda9bd9befd427fac9dfde6f299a6ab
I20260318 02:51:44.273881 2152 raft_consensus.cc:493] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.274019 2152 raft_consensus.cc:515] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.274701 2152 leader_election.cc:290] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
W20260318 02:51:44.275956 999 leader_election.cc:343] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: b8973d8930ef4b65be7b4ff990bf9d72
I20260318 02:51:44.278294 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8973d8930ef4b65be7b4ff990bf9d72" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:44.280884 997 leader_election.cc:343] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.281193 997 leader_election.cc:304] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.281414 2152 raft_consensus.cc:2749] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.284171 1175 ts_tablet_manager.cc:1950] T 3dda9bd9befd427fac9dfde6f299a6ab P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:44.284734 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1157) took 1665 ms. Trace:
I20260318 02:51:44.284896 1175 rpcz_store.cc:276] 0318 02:51:42.619663 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.619743 (+ 80us) service_pool.cc:225] Handling call
0318 02:51:43.876101 (+1256358us) ts_tablet_manager.cc:1151] Deleting tablet 3dda9bd9befd427fac9dfde6f299a6ab
0318 02:51:43.876110 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.011355 (+135245us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.272303 (+260948us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.284691 (+ 12388us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1256161}
I20260318 02:51:44.285466 1175 tablet_replica.cc:333] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:44.285701 1175 raft_consensus.cc:2243] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.285905 1175 raft_consensus.cc:2272] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.286656 1175 ts_tablet_manager.cc:1916] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.286877 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 3dda9bd9befd427fac9dfde6f299a6ab (table default.Table_a5974ba51eec46dfa733c7b066123d8e [id=be8bd5c24eda495abd4c05a866a2c194]) successfully deleted
I20260318 02:51:44.287066 1176 ts_tablet_manager.cc:1929] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.287204 1176 log.cc:1199] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/2f80f29dfd814acd8b7e143a72231dfd
I20260318 02:51:44.287508 1176 ts_tablet_manager.cc:1950] T 2f80f29dfd814acd8b7e143a72231dfd P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:44.288332 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1211) took 1202 ms. Trace:
I20260318 02:51:44.288430 1176 rpcz_store.cc:276] 0318 02:51:43.085942 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.086003 (+ 61us) service_pool.cc:225] Handling call
0318 02:51:44.212666 (+1126663us) ts_tablet_manager.cc:1151] Deleting tablet 2f80f29dfd814acd8b7e143a72231dfd
0318 02:51:44.212679 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.255894 (+ 43215us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.286936 (+ 31042us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.288306 (+ 1370us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1126451}
I20260318 02:51:44.288940 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 2f80f29dfd814acd8b7e143a72231dfd (table default.Table_103c65f4b0d64732bb96cb99459082e6 [id=4dee1f40fb2b4b698dba47eb6c70cab2]) successfully deleted
W20260318 02:51:44.288743 719 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.131:37025, user_credentials={real_user=slave}} blocked reactor thread for 51512.1us
W20260318 02:51:44.289184 719 leader_election.cc:343] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.289284 719 leader_election.cc:304] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.290274 2467 raft_consensus.cc:2749] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:44.290688 719 leader_election.cc:343] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.291159 719 leader_election.cc:304] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.293598 1174 tablet_bootstrap.cc:492] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:44.298856 1174 ts_tablet_manager.cc:1403] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.253s user 0.010s sys 0.016s
I20260318 02:51:44.299623 2467 raft_consensus.cc:2749] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.300014 1174 raft_consensus.cc:359] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.300384 1174 raft_consensus.cc:385] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.300516 1174 raft_consensus.cc:740] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.300963 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2a586892a24c71a956dbbe382484c9" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:44.301470 1174 consensus_queue.cc:260] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.307097 450 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 895aa252b9f243d89e972d1b717ee910 (table default.Table_2afe66e6b2374e3c9b8e4692abb54d07 [id=6f9eb9fbda9846d495f3e70e229a5590]). Expected version 1 got 0
I20260318 02:51:44.309388 1174 ts_tablet_manager.cc:1434] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260318 02:51:44.313879 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1212) took 1181 ms. Trace:
I20260318 02:51:44.313999 1176 rpcz_store.cc:276] 0318 02:51:43.132607 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.132664 (+ 57us) service_pool.cc:225] Handling call
0318 02:51:44.313713 (+1181049us) ts_tablet_manager.cc:1151] Deleting tablet 89a225cb00d04582b2bf0f569ddab07f
0318 02:51:44.313726 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.313853 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1180819}
I20260318 02:51:44.314429 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1213) took 1155 ms. Trace:
I20260318 02:51:44.314498 1176 rpcz_store.cc:276] 0318 02:51:43.158698 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.158751 (+ 53us) service_pool.cc:225] Handling call
0318 02:51:44.314311 (+1155560us) ts_tablet_manager.cc:1151] Deleting tablet c3f37e3d16f943e0aeeddafe1a955599
0318 02:51:44.314321 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.314411 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1155371}
I20260318 02:51:44.314785 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1214) took 1149 ms. Trace:
I20260318 02:51:44.314850 1176 rpcz_store.cc:276] 0318 02:51:43.165513 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.165565 (+ 52us) service_pool.cc:225] Handling call
0318 02:51:44.314689 (+1149124us) ts_tablet_manager.cc:1151] Deleting tablet ca765bc27f564ab9ab419bcf2aeda59f
0318 02:51:44.314698 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.314768 (+ 70us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1148929}
I20260318 02:51:44.315120 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1215) took 1145 ms. Trace:
I20260318 02:51:44.315186 1176 rpcz_store.cc:276] 0318 02:51:43.170033 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.170091 (+ 58us) service_pool.cc:225] Handling call
0318 02:51:44.315023 (+1144932us) ts_tablet_manager.cc:1151] Deleting tablet 82d2922edaae4dc0bd8bcf859d248a11
0318 02:51:44.315031 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.315106 (+ 75us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1144727}
I20260318 02:51:44.315456 1176 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49862 (request call id 1216) took 1137 ms. Trace:
I20260318 02:51:44.315518 1176 rpcz_store.cc:276] 0318 02:51:43.177828 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.177940 (+ 112us) service_pool.cc:225] Handling call
0318 02:51:44.315370 (+1137430us) ts_tablet_manager.cc:1151] Deleting tablet bdb950b9207d4528a86fac1da0ae6538
0318 02:51:44.315377 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.315443 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1137216}
I20260318 02:51:44.315783 1176 tablet_replica.cc:333] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:44.315965 1176 raft_consensus.cc:2243] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:44.314528 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 89a225cb00d04582b2bf0f569ddab07f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89a225cb00d04582b2bf0f569ddab07f already in progress: creating tablet
I20260318 02:51:44.316140 1176 raft_consensus.cc:2272] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:44.316322 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet c3f37e3d16f943e0aeeddafe1a955599 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3f37e3d16f943e0aeeddafe1a955599 already in progress: creating tablet
W20260318 02:51:44.316509 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet ca765bc27f564ab9ab419bcf2aeda59f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca765bc27f564ab9ab419bcf2aeda59f already in progress: creating tablet
W20260318 02:51:44.316663 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 82d2922edaae4dc0bd8bcf859d248a11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82d2922edaae4dc0bd8bcf859d248a11 already in progress: creating tablet
I20260318 02:51:44.316758 1176 ts_tablet_manager.cc:1916] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:44.316905 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet bdb950b9207d4528a86fac1da0ae6538 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bdb950b9207d4528a86fac1da0ae6538 already in progress: creating tablet
I20260318 02:51:44.318007 450 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 895aa252b9f243d89e972d1b717ee910 (table default.Table_2afe66e6b2374e3c9b8e4692abb54d07 [id=6f9eb9fbda9846d495f3e70e229a5590]). Expected version 1 got 0
I20260318 02:51:44.319940 1174 tablet_bootstrap.cc:492] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:44.321066 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c6e059b5df104857a5812234429fe42a" } new_table_name: "default.Table_233c84a59621449193b84a882812f0c6" modify_external_catalogs: true
I20260318 02:51:44.321656 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c41a7b6dc05048439b0883d5077f5421" } modify_external_catalogs: true
I20260318 02:51:44.321823 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c41a7b6dc05048439b0883d5077f5421" } modify_external_catalogs: true
I20260318 02:51:44.300642 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2a586892a24c71a956dbbe382484c9" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:44.322402 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a5569b02165b42ca97657d6dfa34433a" } modify_external_catalogs: true
I20260318 02:51:44.322526 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a5569b02165b42ca97657d6dfa34433a" } modify_external_catalogs: true
I20260318 02:51:44.321756 903 tablet_service.cc:1511] Processing CreateTablet for tablet a28bc3a361c34fe7976834935bb7155a (DEFAULT_TABLE table=default.Table_cec5e56080a74bcfb26e8db22ccdfea7 [id=6c6085c69d634884b89ef1d27ad6dfda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.322042 749 tablet_service.cc:1511] Processing CreateTablet for tablet a28bc3a361c34fe7976834935bb7155a (DEFAULT_TABLE table=default.Table_cec5e56080a74bcfb26e8db22ccdfea7 [id=6c6085c69d634884b89ef1d27ad6dfda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.323274 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a28bc3a361c34fe7976834935bb7155a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.323647 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e34821e167a74d5f9b309576e5ae88fe" } modify_external_catalogs: true
I20260318 02:51:44.323776 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e34821e167a74d5f9b309576e5ae88fe" } modify_external_catalogs: true
I20260318 02:51:44.326426 1174 tablet_bootstrap.cc:654] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.328444 1172 tablet_bootstrap.cc:492] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:44.328660 1172 ts_tablet_manager.cc:1403] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.062s user 0.001s sys 0.002s
I20260318 02:51:44.329476 1172 raft_consensus.cc:359] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.329810 1172 raft_consensus.cc:385] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.329905 1172 raft_consensus.cc:740] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.330169 1172 consensus_queue.cc:260] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.330909 1172 ts_tablet_manager.cc:1434] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
W20260318 02:51:44.332939 719 leader_election.cc:343] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.333129 1030 tablet_service.cc:1511] Processing CreateTablet for tablet c6efbcaf4943488a9adb1dc611c81d5a (DEFAULT_TABLE table=default.Table_dd92209cbeed4e13b219f8c910e19bef [id=078367d832aa4b86b635a451c90bd1e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.333568 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6efbcaf4943488a9adb1dc611c81d5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.337581 893 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd77d6480524a558ce7fbeb8be26b3b (DEFAULT_TABLE table=default.Table_c25bec5413624afaa09f6976c76b8a79 [id=3e5ea2928f2a4fbbbe91433eee6fddc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.339000 2467 raft_consensus.cc:493] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.339162 2467 raft_consensus.cc:515] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.339761 2467 leader_election.cc:290] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:44.340181 1027 tablet_service.cc:1511] Processing CreateTablet for tablet a28bc3a361c34fe7976834935bb7155a (DEFAULT_TABLE table=default.Table_cec5e56080a74bcfb26e8db22ccdfea7 [id=6c6085c69d634884b89ef1d27ad6dfda]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.340597 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a28bc3a361c34fe7976834935bb7155a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.322280 758 tablet_service.cc:1511] Processing CreateTablet for tablet c6efbcaf4943488a9adb1dc611c81d5a (DEFAULT_TABLE table=default.Table_dd92209cbeed4e13b219f8c910e19bef [id=078367d832aa4b86b635a451c90bd1e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.345157 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6efbcaf4943488a9adb1dc611c81d5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.345849 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd77d6480524a558ce7fbeb8be26b3b (DEFAULT_TABLE table=default.Table_c25bec5413624afaa09f6976c76b8a79 [id=3e5ea2928f2a4fbbbe91433eee6fddc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.346238 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd77d6480524a558ce7fbeb8be26b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.348654 2625 tablet.cc:1723] T 5b49b066f27b43829c8f922649744303 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:44.348484 749 tablet_service.cc:1511] Processing CreateTablet for tablet 0dd77d6480524a558ce7fbeb8be26b3b (DEFAULT_TABLE table=default.Table_c25bec5413624afaa09f6976c76b8a79 [id=3e5ea2928f2a4fbbbe91433eee6fddc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.351321 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd77d6480524a558ce7fbeb8be26b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.354130 890 tablet_service.cc:1511] Processing CreateTablet for tablet c6efbcaf4943488a9adb1dc611c81d5a (DEFAULT_TABLE table=default.Table_dd92209cbeed4e13b219f8c910e19bef [id=078367d832aa4b86b635a451c90bd1e2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:44.355154 719 leader_election.cc:343] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.356232 719 leader_election.cc:304] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.356551 2467 raft_consensus.cc:2749] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.357710 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac04b3e4ad448b09a1a25a754b44aad" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:44.356036 1173 tablet_bootstrap.cc:492] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:44.360926 1172 tablet_bootstrap.cc:492] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:44.361627 1174 tablet_bootstrap.cc:492] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:44.361833 1174 ts_tablet_manager.cc:1403] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.003s
I20260318 02:51:44.362411 1172 tablet_bootstrap.cc:654] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.362702 1174 raft_consensus.cc:359] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.362936 1174 raft_consensus.cc:385] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.363039 1174 raft_consensus.cc:740] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.363857 1174 consensus_queue.cc:260] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.364436 1174 ts_tablet_manager.cc:1434] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:44.362933 1176 ts_tablet_manager.cc:1929] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.365996 2605 raft_consensus.cc:493] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.366205 2605 raft_consensus.cc:515] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.366505 1174 tablet_bootstrap.cc:492] T 824b9dc6982f425c9518c0ea3560bf84 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:44.367954 2605 leader_election.cc:290] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:44.369657 999 leader_election.cc:343] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 20a492fdea6c44ba8439614b0dcc2ba6
I20260318 02:51:44.363015 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dd77d6480524a558ce7fbeb8be26b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.370913 1173 ts_tablet_manager.cc:1403] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.183s user 0.003s sys 0.008s
I20260318 02:51:44.371635 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6efbcaf4943488a9adb1dc611c81d5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.371857 1173 raft_consensus.cc:359] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:44.372668 719 leader_election.cc:343] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:44.376884 441 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 1294e1ae2115471a8b605d38f1c26e60 (table default.Table_6cec27214c2d4ab1bf225a47b1a0a445 [id=8e1b0836189c47cfa27e615a99fe2616], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1294e1ae2115471a8b605d38f1c26e60 consensus state has no leader
I20260318 02:51:44.377931 1174 tablet_bootstrap.cc:654] T 824b9dc6982f425c9518c0ea3560bf84 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.373167 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a28bc3a361c34fe7976834935bb7155a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:44.387773 719 consensus_peers.cc:597] T bcb731f97a764183aba7408bae969331 P 6a903d876086423b8016d705b98895ad -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:44.363678 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac04b3e4ad448b09a1a25a754b44aad" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:44.397161 719 leader_election.cc:343] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.397712 719 leader_election.cc:304] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.398593 2467 raft_consensus.cc:2749] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.398779 1172 tablet_bootstrap.cc:492] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:44.398939 1172 ts_tablet_manager.cc:1403] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.003s
I20260318 02:51:44.399816 1172 raft_consensus.cc:359] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.400007 1172 raft_consensus.cc:385] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.400074 1172 raft_consensus.cc:740] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.400301 1172 consensus_queue.cc:260] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.400862 1184 tablet_replica.cc:333] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
W20260318 02:51:44.400995 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 54b8f3520a4e4a5987bb7a6732c7b882 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54b8f3520a4e4a5987bb7a6732c7b882 already in progress: creating tablet
I20260318 02:51:44.401553 1184 raft_consensus.cc:2243] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.364831 1176 log.cc:1199] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/184ce58aa96d4e70ad7b2783f19ccdeb
I20260318 02:51:44.405130 1176 ts_tablet_manager.cc:1950] T 184ce58aa96d4e70ad7b2783f19ccdeb P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:44.406283 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 184ce58aa96d4e70ad7b2783f19ccdeb (table default.Table_f7c512acb00946069cb735b743f8b2af [id=3e7b4f46e6c04379b32c2d39de6aa759]) successfully deleted
W20260318 02:51:44.415062 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet a1ea3329a317495792d26bd31fcd3b43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1ea3329a317495792d26bd31fcd3b43 already in progress: creating tablet
W20260318 02:51:44.416110 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet c5afbb4fd4b146ed9e0e8ff46aecc465 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5afbb4fd4b146ed9e0e8ff46aecc465 already in progress: creating tablet
W20260318 02:51:44.417322 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2fe517a0498e4ac3b0bb52a0eea7448d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2fe517a0498e4ac3b0bb52a0eea7448d already in progress: creating tablet
I20260318 02:51:44.418859 1176 tablet_replica.cc:333] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:44.419153 1176 raft_consensus.cc:2243] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.419371 1176 raft_consensus.cc:2272] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.420130 1176 ts_tablet_manager.cc:1916] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.383323 1175 ts_tablet_manager.cc:1929] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.386858 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20a492fdea6c44ba8439614b0dcc2ba6" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:44.387522 1173 raft_consensus.cc:385] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.420982 1173 raft_consensus.cc:740] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.421268 1173 consensus_queue.cc:260] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.421469 1175 log.cc:1199] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/503386365f6a49f6b84c64b59b764c10
I20260318 02:51:44.421806 1173 ts_tablet_manager.cc:1434] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.051s user 0.001s sys 0.001s
I20260318 02:51:44.421825 1175 ts_tablet_manager.cc:1950] T 503386365f6a49f6b84c64b59b764c10 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:44.422111 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1170) took 1745 ms. Trace:
I20260318 02:51:44.422201 1175 rpcz_store.cc:276] 0318 02:51:42.676154 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.676214 (+ 60us) service_pool.cc:225] Handling call
0318 02:51:44.285417 (+1609203us) ts_tablet_manager.cc:1151] Deleting tablet 503386365f6a49f6b84c64b59b764c10
0318 02:51:44.285428 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.359885 (+ 74457us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.383197 (+ 23312us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.422092 (+ 38895us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1609043}
I20260318 02:51:44.422111 1173 tablet_bootstrap.cc:492] T a9c60ef260d049bea4ce729316a0d09f P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:44.423831 1173 tablet_bootstrap.cc:654] T a9c60ef260d049bea4ce729316a0d09f P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:44.426170 997 leader_election.cc:343] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.426654 997 leader_election.cc:304] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.428779 1176 ts_tablet_manager.cc:1929] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.430212 1184 raft_consensus.cc:2272] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.430821 1184 ts_tablet_manager.cc:1916] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.432988 1172 ts_tablet_manager.cc:1434] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.034s user 0.001s sys 0.001s
I20260318 02:51:44.433461 2614 raft_consensus.cc:493] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.441643 2614 raft_consensus.cc:515] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.442256 2614 leader_election.cc:290] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:44.433665 2152 raft_consensus.cc:2749] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.438429 1184 ts_tablet_manager.cc:1929] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.442456 1184 log.cc:1199] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/41646d513e834600a209761392ac7fb1
I20260318 02:51:44.443106 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21e6e89e5a0a4d1bb952e74be1b7e551" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:44.443478 999 leader_election.cc:343] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 21e6e89e5a0a4d1bb952e74be1b7e551
W20260318 02:51:44.443692 997 leader_election.cc:343] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.443806 997 leader_election.cc:304] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.443971 1184 ts_tablet_manager.cc:1950] T 41646d513e834600a209761392ac7fb1 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:44.444061 2152 raft_consensus.cc:2749] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.444672 1172 tablet_bootstrap.cc:492] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:44.444778 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1113) took 3971 ms. Trace:
I20260318 02:51:44.444890 1184 rpcz_store.cc:276] 0318 02:51:40.473662 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.473719 (+ 57us) service_pool.cc:225] Handling call
0318 02:51:44.400791 (+3927072us) ts_tablet_manager.cc:1151] Deleting tablet 41646d513e834600a209761392ac7fb1
0318 02:51:44.400813 (+ 22us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.435342 (+ 34529us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.438326 (+ 2984us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.444761 (+ 6435us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28175,"tablet-delete.queue_time_us":3926860}
I20260318 02:51:44.445320 1184 tablet_replica.cc:333] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:44.445554 1184 raft_consensus.cc:2243] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.445749 1184 raft_consensus.cc:2272] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.446234 1172 tablet_bootstrap.cc:654] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.446283 1184 ts_tablet_manager.cc:1916] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.446514 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 41646d513e834600a209761392ac7fb1 (table default.Table_8a612850d1784dda9f09b14b7e12b28c [id=717896f5560d483e94054f017eaa9a6f]) successfully deleted
I20260318 02:51:44.442201 1174 tablet_bootstrap.cc:492] T 824b9dc6982f425c9518c0ea3560bf84 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:44.450007 1174 ts_tablet_manager.cc:1403] T 824b9dc6982f425c9518c0ea3560bf84 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.084s user 0.003s sys 0.003s
I20260318 02:51:44.450932 1174 raft_consensus.cc:359] T 824b9dc6982f425c9518c0ea3560bf84 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.449818 1176 log.cc:1199] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/6f527a0ba0914924bc7f604ae8a48393
I20260318 02:51:44.451704 1176 ts_tablet_manager.cc:1950] T 6f527a0ba0914924bc7f604ae8a48393 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:44.452234 1184 ts_tablet_manager.cc:1929] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.452361 1184 log.cc:1199] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/c0c33cfa1c194a65bfc64d0e1e9434ff
I20260318 02:51:44.452620 1184 ts_tablet_manager.cc:1950] T c0c33cfa1c194a65bfc64d0e1e9434ff P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:44.453066 1175 tablet_replica.cc:333] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:44.453034 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 6f527a0ba0914924bc7f604ae8a48393 (table default.Table_3064939f4dfb44dba19bb6f8f9c6f250 [id=b56547120b2645cc9c7cbd6078f7a039]) successfully deleted
I20260318 02:51:44.453254 1175 raft_consensus.cc:2243] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.453408 1175 raft_consensus.cc:2272] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.453439 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 503386365f6a49f6b84c64b59b764c10 (table default.Table_9a44c965ec574cae8cced06f58d02bff [id=f3b5bd76bc0945119db3449ce8ce5998]) successfully deleted
I20260318 02:51:44.453794 1176 tablet_replica.cc:333] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:44.454000 1175 ts_tablet_manager.cc:1916] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.454015 1176 raft_consensus.cc:2243] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.454442 1176 raft_consensus.cc:2272] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.455031 1176 ts_tablet_manager.cc:1916] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.458252 1173 tablet_bootstrap.cc:492] T a9c60ef260d049bea4ce729316a0d09f P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:44.458400 1173 ts_tablet_manager.cc:1403] T a9c60ef260d049bea4ce729316a0d09f P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.001s
I20260318 02:51:44.459053 1173 raft_consensus.cc:359] T a9c60ef260d049bea4ce729316a0d09f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.459237 1173 raft_consensus.cc:385] T a9c60ef260d049bea4ce729316a0d09f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.459290 1173 raft_consensus.cc:740] T a9c60ef260d049bea4ce729316a0d09f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.459522 1173 consensus_queue.cc:260] T a9c60ef260d049bea4ce729316a0d09f P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.459997 1173 ts_tablet_manager.cc:1434] T a9c60ef260d049bea4ce729316a0d09f P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:44.460315 1173 tablet_bootstrap.cc:492] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:44.461716 1173 tablet_bootstrap.cc:654] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.474506 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1114) took 4000 ms. Trace:
I20260318 02:51:44.476531 1184 rpcz_store.cc:276] 0318 02:51:40.474084 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.474122 (+ 38us) service_pool.cc:225] Handling call
0318 02:51:44.445274 (+3971152us) ts_tablet_manager.cc:1151] Deleting tablet c0c33cfa1c194a65bfc64d0e1e9434ff
0318 02:51:44.445283 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.449296 (+ 4013us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.452127 (+ 2831us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.474476 (+ 22349us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3971017}
I20260318 02:51:44.477197 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet c0c33cfa1c194a65bfc64d0e1e9434ff (table default.Table_c8ea19bed9e54eaf91af95c365e46851 [id=551f7031c6b84904836a915c07704492]) successfully deleted
I20260318 02:51:44.477712 1184 tablet_replica.cc:333] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:44.477988 1184 raft_consensus.cc:2243] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.478123 2467 raft_consensus.cc:493] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.478292 1184 raft_consensus.cc:2272] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.478263 2467 raft_consensus.cc:515] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.478891 2467 leader_election.cc:290] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:44.478919 1184 ts_tablet_manager.cc:1916] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.479657 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a65ccfd73234e8fb2bea5b6911cb3f1" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:44.479823 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a65ccfd73234e8fb2bea5b6911cb3f1" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:44.480218 719 leader_election.cc:343] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:44.480413 719 leader_election.cc:343] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.480481 719 leader_election.cc:304] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.480999 2467 raft_consensus.cc:2749] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.484100 1175 ts_tablet_manager.cc:1929] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.487257 1172 tablet_bootstrap.cc:492] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:44.487461 1172 ts_tablet_manager.cc:1403] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.000s
I20260318 02:51:44.488890 1175 log.cc:1199] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/e916c5419e3c457f98a47c6a1c6cdd56
I20260318 02:51:44.488929 1172 raft_consensus.cc:359] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.489202 1172 raft_consensus.cc:385] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.489297 1175 ts_tablet_manager.cc:1950] T e916c5419e3c457f98a47c6a1c6cdd56 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:44.489296 1172 raft_consensus.cc:740] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.489535 1172 consensus_queue.cc:260] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.489645 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1177) took 1809 ms. Trace:
I20260318 02:51:44.489778 1175 rpcz_store.cc:276] 0318 02:51:42.680294 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.776937 (+ 96643us) service_pool.cc:225] Handling call
0318 02:51:44.453009 (+1676072us) ts_tablet_manager.cc:1151] Deleting tablet e916c5419e3c457f98a47c6a1c6cdd56
0318 02:51:44.453021 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.475101 (+ 22080us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.484000 (+ 8899us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.489627 (+ 5627us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1675877}
I20260318 02:51:44.490209 1172 ts_tablet_manager.cc:1434] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:44.490306 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet e916c5419e3c457f98a47c6a1c6cdd56 (table default.Table_1ca30903a9ca4d31b9ad481adc6e3016 [id=b22ba2f393644e99b2b74ff6236325c5]) successfully deleted
I20260318 02:51:44.065155 2007 rpcz_store.cc:276] 0318 02:51:42.778214 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.778324 (+ 110us) service_pool.cc:225] Handling call
0318 02:51:42.910301 (+131977us) raft_consensus.cc:1471] Updating replica for 461 ops
0318 02:51:43.195404 (+285103us) raft_consensus.cc:1534] Early marking committed up to index 972
0318 02:51:43.258001 (+ 62597us) write_op.cc:489] Releasing partition, row and schema locks
0318 02:51:43.258012 (+ 11us) write_op.cc:454] Released schema lock
0318 02:51:43.260772 (+ 2760us) write_op.cc:489] Releasing partition, row and schema locks
0318 02:51:43.260777 (+ 5us) write_op.cc:454] Released schema lock
0318 02:51:43.260951 (+ 174us) raft_consensus.cc:1539] Triggering prepare for 461 ops
0318 02:51:43.261085 (+ 134us) write_op.cc:270] Start()
0318 02:51:43.261118 (+ 33us) write_op.cc:276] Timestamp: P: 1773802293985409 usec, L: 0
0318 02:51:43.268863 (+ 7745us) write_op.cc:270] Start()
0318 02:51:43.268905 (+ 42us) write_op.cc:276] Timestamp: P: 1773802293987044 usec, L: 0
0318 02:51:43.269118 (+ 213us) write_op.cc:270] Start()
0318 02:51:43.269142 (+ 24us) write_op.cc:276] Timestamp: P: 1773802294098597 usec, L: 0
0318 02:51:43.269280 (+ 138us) write_op.cc:270] Start()
0318 02:51:43.269299 (+ 19us) write_op.cc:276] Timestamp: P: 1773802294160888 usec, L: 0
0318 02:51:43.270263 (+ 964us) write_op.cc:270] Start()
0318 02:51:43.270292 (+ 29us) write_op.cc:276] Timestamp: P: 1773802294285376 usec, L: 0
0318 02:51:43.270461 (+ 169us) write_op.cc:270] Start()
0318 02:51:43.270482 (+ 21us) write_op.cc:276] Timestamp: P: 1773802294286063 usec, L: 0
0318 02:51:43.270660 (+ 178us) write_op.cc:270] Start()
0318 02:51:43.270681 (+ 21us) write_op.cc:276] Timestamp: P: 1773802294296063 usec, L: 0
0318 02:51:43.270814 (+ 133us) write_op.cc:270] Start()
0318 02:51:43.270834 (+ 20us) write_op.cc:276] Timestamp: P: 1773802294355477 usec, L: 0
0318 02:51:43.270993 (+ 159us) write_op.cc:270] Start()
0318 02:51:43.271012 (+ 19us) write_op.cc:276] Timestamp: P: 1773802294356179 usec, L: 0
0318 02:51:43.271141 (+ 129us) write_op.cc:270] Start()
0318 02:51:43.271160 (+ 19us) write_op.cc:276] Timestamp: P: 1773802294360652 usec, L: 0
0318 02:51:43.271303 (+ 143us) write_op.cc:270] Start()
0318 02:51:43.271322 (+ 19us) write_op.cc:276] Timestamp: P: 1773802294361939 usec, L: 0
0318 02:51:43.271460 (+ 138us) write_op.cc:270] Start()
0318 02:51:43.271479 (+ 19us) write_op.cc:276] Timestamp: P: 1773802294362590 usec, L: 0
0318 02:51:43.271633 (+ 154us) write_op.cc:270] Start()
0318 02:51:43.271651 (+ 18us) write_op.cc:276] Timestamp: P: 1773802294396076 usec, L: 0
0318 02:51:43.271769 (+ 118us) write_op.cc:270] Start()
0318 02:51:43.271787 (+ 18us) write_op.cc:276] Timestamp: P: 1773802294396760 usec, L: 0
0318 02:51:43.271928 (+ 141us) write_op.cc:270] Start()
0318 02:51:43.271946 (+ 18us) write_op.cc:276] Timestamp: P: 1773802294400908 usec, L: 0
0318 02:51:43.272070 (+ 124us) write_op.cc:270] Start()
0318 02:51:43.272088 (+ 18us) write_op.cc:276] Timestamp: P: 1773802294415998 usec, L: 0
0318 02:51:43.272236 (+ 148us) write_op.cc:270] Start()
0318 02:51:43.272254 (+ 18us) write_op.cc:276] Timestamp: P: 1773802294419852 usec, L: 0
0318 02:51:43.272402 (+ 148us) write_op.cc:270] Start()
0318 02:51:43.272419 (+ 17us) write_op.cc:276] Timestamp: P: 1773802294422553 usec, L: 0
0318 02:51:43.272534 (+ 115us) write_op.cc:270] Start()
0318 02:51:43.272551 (+ 17us) write_op.cc:276] Timestamp: P: 1773802294497212 usec, L: 0
0318 02:51:43.273105 (+ 554us) write_op.cc:270] Start()
0318 02:51:43.273130 (+ 25us) write_op.cc:276] Timestamp: P: 1773802294497880 usec, L: 0
0318 02:51:43.273321 (+ 191us) write_op.cc:270] Start()
0318 02:51:43.273343 (+ 22us) write_op.cc:276] Timestamp: P: 1773802294498423 usec, L: 0
0318 02:51:43.273469 (+ 126us) write_op.cc:270] Start()
0318 02:51:43.273506 (+ 37us) write_op.cc:276] Timestamp: P: 1773802294499007 usec, L: 0
0318 02:51:43.273634 (+ 128us) write_op.cc:270] Start()
0318 02:51:43.273653 (+ 19us) write_op.cc:276] Timestamp: P: 1773802294502949 usec, L: 0
0318 02:51:43.273798 (+ 145us) write_op.cc:270] Start()
0318 02:51:43.273817 (+ 19us) write_op.cc:276] Timestamp: P: 1773802294503500 usec, L: 0
0318 02:51:43.273947 (+ 130us) write_op.cc:270] Start()
0318 02:51:43.273964 (+ 17us) write_op.cc:276] Timestamp: P: 1773802294513754 usec, L: 0
0318 02:51:43.274165 (+ 201us) write_op.cc:270] Start()
0318 02:51:43.274196 (+ 31us) write_op.cc:276] Timestamp: P: 1773802294522085 usec, L: 0
0318 02:51:43.274321 (+ 125us) write_op.cc:270] Start()
0318 02:51:43.274341 (+ 20us) write_op.cc:276] Timestamp: P: 1773802294558846 usec, L: 0
0318 02:51:43.274490 (+ 149us) write_op.cc:270] Start()
0318 02:51:43.274510 (+ 20us) write_op.cc:276] Timestamp: P: 1773802294612622 usec, L: 0
0318 02:51:43.274631 (+ 121us) write_op.cc:270] Start()
0318 02:51:43.274650 (+ 19us) write_op.cc:276] Timestamp: P: 1773802294620474 usec, L: 0
0318 02:51:43.274775 (+ 125us) write_op.cc:270] Start()
0318 02:51:43.274794 (+ 19us) write_op.cc:276] Timestamp: P: 1773802294621913 usec, L: 0
0318 02:51:43.274919 (+ 125us) write_op.cc:270] Start()
0318 02:51:43.275320 (+ 401us) write_op.cc:276] Timestamp: P: 1773802294746847 usec, L: 0
0318 02:51:43.275480 (+ 160us) write_op.cc:270] Start()
0318 02:51:43.275502 (+ 22us) write_op.cc:276] Timestamp: P: 1773802294766594 usec, L: 0
0318 02:51:43.275633 (+ 131us) write_op.cc:270] Start()
0318 02:51:43.275652 (+ 19us) write_op.cc:276] Timestamp: P: 1773802294828949 usec, L: 0
0318 02:51:43.275819 (+ 167us) write_op.cc:270] Start()
0318 02:51:43.275838 (+ 19us) write_op.cc:276] Timestamp: P: 1773802294829648 usec, L: 0
0318 02:51:43.275955 (+ 117us) write_op.cc:270] Start()
0318 02:51:43.275971 (+ 16us) write_op.cc:276] Timestamp: P: 1773802294883596 usec, L: 0
0318 02:51:43.276101 (+ 130us) write_op.cc:270] Start()
0318 02:51:43.276123 (+ 22us) write_op.cc:276] Timestamp: P: 1773802294884406 usec, L: 0
0318 02:51:43.276273 (+ 150us) write_op.cc:270] Start()
0318 02:51:43.276292 (+ 19us) write_op.cc:276] Timestamp: P: 1773802294885060 usec, L: 0
0318 02:51:43.276436 (+ 144us) write_op.cc:270] Start()
0318 02:51:43.276456 (+ 20us) write_op.cc:276] Timestamp: P: 1773802294885633 usec, L: 0
0318 02:51:43.276590 (+ 134us) write_op.cc:270] Start()
0318 02:51:43.276613 (+ 23us) write_op.cc:276] Timestamp: P: 1773802294886190 usec, L: 0
0318 02:51:43.276778 (+ 165us) write_op.cc:270] Start()
0318 02:51:43.276800 (+ 22us) write_op.cc:276] Timestamp: P: 1773802294963022 usec, L: 0
0318 02:51:43.276950 (+ 150us) write_op.cc:270] Start()
0318 02:51:43.276969 (+ 19us) write_op.cc:276] Timestamp: P: 1773802294964191 usec, L: 0
0318 02:51:43.277111 (+ 142us) write_op.cc:270] Start()
0318 02:51:43.277145 (+ 34us) write_op.cc:276] Timestamp: P: 1773802294967047 usec, L: 0
0318 02:51:43.283561 (+ 6416us) write_op.cc:270] Start()
0318 02:51:43.283596 (+ 35us) write_op.cc:276] Timestamp: P: 1773802294967982 usec, L: 0
0318 02:51:43.283829 (+ 233us) write_op.cc:270] Start()
0318 02:51:43.283853 (+ 24us) write_op.cc:276] Timestamp: P: 1773802294999142 usec, L: 0
0318 02:51:43.283984 (+ 131us) write_op.cc:270] Start()
0318 02:51:43.284004 (+ 20us) write_op.cc:276] Timestamp: P: 1773802295079120 usec, L: 0
0318 02:51:43.284134 (+ 130us) write_op.cc:270] Start()
0318 02:51:43.284153 (+ 19us) write_op.cc:276] Timestamp: P: 1773802295185710 usec, L: 0
0318 02:51:43.284298 (+ 145us) write_op.cc:270] Start()
0318 02:51:43.284318 (+ 20us) write_op.cc:276] Timestamp: P: 1773802295405119 usec, L: 0
0318 02:51:43.284474 (+ 156us) write_op.cc:270] Start()
0318 02:51:43.284505 (+ 31us) write_op.cc:276] Timestamp: P: 1773802295405795 usec, L: 0
0318 02:51:43.329609 (+ 45104us) write_op.cc:270] Start()
0318 02:51:43.329663 (+ 54us) write_op.cc:276] Timestamp: P: 1773802295413700 usec, L: 0
0318 02:51:43.329933 (+ 270us) write_op.cc:270] Start()
0318 02:51:43.329960 (+ 27us) write_op.cc:276] Timestamp: P: 1773802295514546 usec, L: 0
0318 02:51:43.330242 (+ 282us) write_op.cc:270] Start()
0318 02:51:43.330267 (+ 25us) write_op.cc:276] Timestamp: P: 1773802295563266 usec, L: 0
0318 02:51:43.330517 (+ 250us) write_op.cc:270] Start()
0318 02:51:43.330543 (+ 26us) write_op.cc:276] Timestamp: P: 1773802295566874 usec, L: 0
0318 02:51:43.330703 (+ 160us) write_op.cc:270] Start()
0318 02:51:43.330725 (+ 22us) write_op.cc:276] Timestamp: P: 1773802295567439 usec, L: 0
0318 02:51:43.330862 (+ 137us) write_op.cc:270] Start()
0318 02:51:43.330883 (+ 21us) write_op.cc:276] Timestamp: P: 1773802295571560 usec, L: 0
0318 02:51:43.331009 (+ 126us) write_op.cc:270] Start()
0318 02:51:43.331028 (+ 19us) write_op.cc:276] Timestamp: P: 1773802295572179 usec, L: 0
0318 02:51:43.331185 (+ 157us) write_op.cc:270] Start()
0318 02:51:43.331206 (+ 21us) write_op.cc:276] Timestamp: P: 1773802295574665 usec, L: 0
0318 02:51:43.331360 (+ 154us) write_op.cc:270] Start()
0318 02:51:43.331381 (+ 21us) write_op.cc:276] Timestamp: P: 1773802295649965 usec, L: 0
0318 02:51:43.331558 (+ 177us) write_op.cc:270] Start()
0318 02:51:43.331580 (+ 22us) write_op.cc:276] Timestamp: P: 1773802295712478 usec, L: 0
0318 02:51:43.331723 (+ 143us) write_op.cc:270] Start()
0318 02:51:43.331744 (+ 21us) write_op.cc:276] Timestamp: P: 1773802295714800 usec, L: 0
0318 02:51:43.331910 (+ 166us) write_op.cc:270] Start()
0318 02:51:43.331930 (+ 20us) write_op.cc:276] Timestamp: P: 1773802295715412 usec, L: 0
0318 02:51:43.332045 (+ 115us) write_op.cc:270] Start()
0318 02:51:43.332168 (+ 123us) write_op.cc:276] Timestamp: P: 1773802295729294 usec, L: 0
0318 02:51:43.332309 (+ 141us) write_op.cc:270] Start()
0318 02:51:43.332327 (+ 18us) write_op.cc:276] Timestamp: P: 1773802295810450 usec, L: 0
0318 02:51:43.332425 (+ 98us) write_op.cc:270] Start()
0318 02:51:43.332446 (+ 21us) write_op.cc:276] Timestamp: P: 1773802295821260 usec, L: 0
0318 02:51:43.332562 (+ 116us) write_op.cc:270] Start()
0318 02:51:43.332577 (+ 15us) write_op.cc:276] Timestamp: P: 1773802295821869 usec, L: 0
0318 02:51:43.332733 (+ 156us) write_op.cc:270] Start()
0318 02:51:43.332751 (+ 18us) write_op.cc:276] Timestamp: P: 1773802295822382 usec, L: 0
0318 02:51:43.332898 (+ 147us) write_op.cc:270] Start()
0318 02:51:43.332916 (+ 18us) write_op.cc:276] Timestamp: P: 1773802295822901 usec, L: 0
0318 02:51:43.333020 (+ 104us) write_op.cc:270] Start()
0318 02:51:43.333035 (+ 15us) write_op.cc:276] Timestamp: P: 1773802295823467 usec, L: 0
0318 02:51:43.333147 (+ 112us) write_op.cc:270] Start()
0318 02:51:43.333163 (+ 16us) write_op.cc:276] Timestamp: P: 1773802295823932 usec, L: 0
0318 02:51:43.333260 (+ 97us) write_op.cc:270] Start()
0318 02:51:43.333275 (+ 15us) write_op.cc:276] Timestamp: P: 1773802295851143 usec, L: 0
0318 02:51:43.333385 (+ 110us) write_op.cc:270] Start()
0318 02:51:43.333401 (+ 16us) write_op.cc:276] Timestamp: P: 1773802295851864 usec, L: 0
0318 02:51:43.333498 (+ 97us) write_op.cc:270] Start()
0318 02:51:43.333515 (+ 17us) write_op.cc:276] Timestamp: P: 1773802295874938 usec, L: 0
0318 02:51:43.333636 (+ 121us) write_op.cc:270] Start()
0318 02:51:43.333655 (+ 19us) write_op.cc:276] Timestamp: P: 1773802295929490 usec, L: 0
0318 02:51:43.333806 (+ 151us) write_op.cc:270] Start()
0318 02:51:43.333826 (+ 20us) write_op.cc:276] Timestamp: P: 1773802295956576 usec, L: 0
0318 02:51:43.333945 (+ 119us) write_op.cc:270] Start()
0318 02:51:43.333963 (+ 18us) write_op.cc:276] Timestamp: P: 1773802295964046 usec, L: 0
0318 02:51:43.334105 (+ 142us) write_op.cc:270] Start()
0318 02:51:43.334141 (+ 36us) write_op.cc:276] Timestamp: P: 1773802295991116 usec, L: 0
0318 02:51:43.334264 (+ 123us) write_op.cc:270] Start()
0318 02:51:43.334283 (+ 19us) write_op.cc:276] Timestamp: P: 1773802295992942 usec, L: 0
0318 02:51:43.334391 (+ 108us) write_op.cc:270] Start()
0318 02:51:43.334410 (+ 19us) write_op.cc:276] Timestamp: P: 1773802295993608 usec, L: 0
0318 02:51:43.334531 (+ 121us) write_op.cc:270] Start()
0318 02:51:43.334552 (+ 21us) write_op.cc:276] Timestamp: P: 1773802295994128 usec, L: 0
0318 02:51:43.515161 (+180609us) write_op.cc:270] Start()
0318 02:51:43.515207 (+ 46us) write_op.cc:276] Timestamp: P: 1773802295994572 usec, L: 0
0318 02:51:43.515419 (+ 212us) write_op.cc:270] Start()
0318 02:51:43.515445 (+ 26us) write_op.cc:276] Timestamp: P: 1773802295996555 usec, L: 0
0318 02:51:43.515606 (+ 161us) write_op.cc:270] Start()
0318 02:51:43.515629 (+ 23us) write_op.cc:276] Timestamp: P: 1773802295999488 usec, L: 0
0318 02:51:43.515789 (+ 160us) write_op.cc:270] Start()
0318 02:51:43.515809 (+ 20us) write_op.cc:276] Timestamp: P: 1773802296142876 usec, L: 0
0318 02:51:43.515951 (+ 142us) write_op.cc:270] Start()
0318 02:51:43.515972 (+ 21us) write_op.cc:276] Timestamp: P: 1773802296143526 usec, L: 0
0318 02:51:43.516140 (+ 168us) write_op.cc:270] Start()
0318 02:51:43.516161 (+ 21us) write_op.cc:276] Timestamp: P: 1773802296144080 usec, L: 0
0318 02:51:43.516285 (+ 124us) write_op.cc:270] Start()
0318 02:51:43.516303 (+ 18us) write_op.cc:276] Timestamp: P: 1773802296144589 usec, L: 0
0318 02:51:43.516437 (+ 134us) write_op.cc:270] Start()
0318 02:51:43.516457 (+ 20us) write_op.cc:276] Timestamp: P: 1773802296151783 usec, L: 0
0318 02:51:43.516588 (+ 131us) write_op.cc:270] Start()
0318 02:51:43.516610 (+ 22us) write_op.cc:276] Timestamp: P: 1773802296152400 usec, L: 0
0318 02:51:43.516782 (+ 172us) write_op.cc:270] Start()
0318 02:51:43.516803 (+ 21us) write_op.cc:276] Timestamp: P: 1773802296152974 usec, L: 0
0318 02:51:43.517002 (+ 199us) write_op.cc:270] Start()
0318 02:51:43.517065 (+ 63us) write_op.cc:276] Timestamp: P: 1773802296153514 usec, L: 0
0318 02:51:43.531435 (+ 14370us) write_op.cc:270] Start()
0318 02:51:43.531551 (+ 116us) write_op.cc:276] Timestamp: P: 1773802296157138 usec, L: 0
0318 02:51:43.532041 (+ 490us) write_op.cc:270] Start()
0318 02:51:43.532099 (+ 58us) write_op.cc:276] Timestamp: P: 1773802296204762 usec, L: 0
0318 02:51:43.532526 (+ 427us) write_op.cc:270] Start()
0318 02:51:43.532584 (+ 58us) write_op.cc:276] Timestamp: P: 1773802296205741 usec, L: 0
0318 02:51:43.532902 (+ 318us) write_op.cc:270] Start()
0318 02:51:43.533035 (+ 133us) write_op.cc:276] Timestamp: P: 1773802296206611 usec, L: 0
0318 02:51:43.573129 (+ 40094us) write_op.cc:270] Start()
0318 02:51:43.573183 (+ 54us) write_op.cc:276] Timestamp: P: 1773802296207491 usec, L: 0
0318 02:51:43.573354 (+ 171us) write_op.cc:270] Start()
0318 02:51:43.578682 (+ 5328us) write_op.cc:276] Timestamp: P: 1773802296208489 usec, L: 0
0318 02:51:43.578959 (+ 277us) write_op.cc:270] Start()
0318 02:51:43.578988 (+ 29us) write_op.cc:276] Timestamp: P: 1773802296209866 usec, L: 0
0318 02:51:43.579145 (+ 157us) write_op.cc:270] Start()
0318 02:51:43.579176 (+ 31us) write_op.cc:276] Timestamp: P: 1773802296351584 usec, L: 0
0318 02:51:43.579287 (+ 111us) write_op.cc:270] Start()
0318 02:51:43.579303 (+ 16us) write_op.cc:276] Timestamp: P: 1773802296358703 usec, L: 0
0318 02:51:43.579440 (+ 137us) write_op.cc:270] Start()
0318 02:51:43.579458 (+ 18us) write_op.cc:276] Timestamp: P: 1773802296359375 usec, L: 0
0318 02:51:43.579580 (+ 122us) write_op.cc:270] Start()
0318 02:51:43.579599 (+ 19us) write_op.cc:276] Timestamp: P: 1773802296359975 usec, L: 0
0318 02:51:43.579718 (+ 119us) write_op.cc:270] Start()
0318 02:51:43.579735 (+ 17us) write_op.cc:276] Timestamp: P: 1773802296360463 usec, L: 0
0318 02:51:43.579853 (+ 118us) write_op.cc:270] Start()
0318 02:51:43.579869 (+ 16us) write_op.cc:276] Timestamp: P: 1773802296387967 usec, L: 0
0318 02:51:43.579962 (+ 93us) write_op.cc:270] Start()
0318 02:51:43.579978 (+ 16us) write_op.cc:276] Timestamp: P: 1773802296388576 usec, L: 0
0318 02:51:43.580087 (+ 109us) write_op.cc:270] Start()
0318 02:51:43.580102 (+ 15us) write_op.cc:276] Timestamp: P: 1773802296389580 usec, L: 0
0318 02:51:43.580226 (+ 124us) write_op.cc:270] Start()
0318 02:51:43.580245 (+ 19us) write_op.cc:276] Timestamp: P: 1773802296390064 usec, L: 0
0318 02:51:43.580352 (+ 107us) write_op.cc:270] Start()
0318 02:51:43.580368 (+ 16us) write_op.cc:276] Timestamp: P: 1773802296390524 usec, L: 0
0318 02:51:43.580470 (+ 102us) write_op.cc:270] Start()
0318 02:51:43.580485 (+ 15us) write_op.cc:276] Timestamp: P: 1773802296390985 usec, L: 0
0318 02:51:43.580603 (+ 118us) write_op.cc:270] Start()
0318 02:51:43.580618 (+ 15us) write_op.cc:276] Timestamp: P: 1773802296421661 usec, L: 0
0318 02:51:43.580738 (+ 120us) write_op.cc:270] Start()
0318 02:51:43.580756 (+ 18us) write_op.cc:276] Timestamp: P: 1773802296423250 usec, L: 0
0318 02:51:43.580877 (+ 121us) write_op.cc:270] Start()
0318 02:51:43.580894 (+ 17us) write_op.cc:276] Timestamp: P: 1773802296424291 usec, L: 0
0318 02:51:43.581002 (+ 108us) write_op.cc:270] Start()
0318 02:51:43.581018 (+ 16us) write_op.cc:276] Timestamp: P: 1773802296425134 usec, L: 0
0318 02:51:43.581142 (+ 124us) write_op.cc:270] Start()
0318 02:51:43.581160 (+ 18us) write_op.cc:276] Timestamp: P: 1773802296432516 usec, L: 0
0318 02:51:43.581302 (+ 142us) write_op.cc:270] Start()
0318 02:51:43.581321 (+ 19us) write_op.cc:276] Timestamp: P: 1773802296440658 usec, L: 0
0318 02:51:43.581433 (+ 112us) write_op.cc:270] Start()
0318 02:51:43.581450 (+ 17us) write_op.cc:276] Timestamp: P: 1773802296441917 usec, L: 0
0318 02:51:43.581562 (+ 112us) write_op.cc:270] Start()
0318 02:51:43.581577 (+ 15us) write_op.cc:276] Timestamp: P: 1773802296493207 usec, L: 0
0318 02:51:43.581687 (+ 110us) write_op.cc:270] Start()
0318 02:51:43.581704 (+ 17us) write_op.cc:276] Timestamp: P: 1773802296506475 usec, L: 0
0318 02:51:43.581804 (+ 100us) write_op.cc:270] Start()
0318 02:51:43.581821 (+ 17us) write_op.cc:276] Timestamp: P: 1773802296510846 usec, L: 0
0318 02:51:43.581944 (+ 123us) write_op.cc:270] Start()
0318 02:51:43.581960 (+ 16us) write_op.cc:276] Timestamp: P: 1773802296523586 usec, L: 0
0318 02:51:43.582077 (+ 117us) write_op.cc:270] Start()
0318 02:51:43.582094 (+ 17us) write_op.cc:276] Timestamp: P: 1773802296524238 usec, L: 0
0318 02:51:43.582236 (+ 142us) write_op.cc:270] Start()
0318 02:51:43.582255 (+ 19us) write_op.cc:276] Timestamp: P: 1773802296601932 usec, L: 0
0318 02:51:43.582371 (+ 116us) write_op.cc:270] Start()
0318 02:51:43.582389 (+ 18us) write_op.cc:276] Timestamp: P: 1773802296602791 usec, L: 0
0318 02:51:43.582502 (+ 113us) write_op.cc:270] Start()
0318 02:51:43.582518 (+ 16us) write_op.cc:276] Timestamp: P: 1773802296608626 usec, L: 0
0318 02:51:43.582637 (+ 119us) write_op.cc:270] Start()
0318 02:51:43.582655 (+ 18us) write_op.cc:276] Timestamp: P: 1773802296609272 usec, L: 0
0318 02:51:43.582792 (+ 137us) write_op.cc:270] Start()
0318 02:51:43.582808 (+ 16us) write_op.cc:276] Timestamp: P: 1773802296618761 usec, L: 0
0318 02:51:43.582911 (+ 103us) write_op.cc:270] Start()
0318 02:51:43.582926 (+ 15us) write_op.cc:276] Timestamp: P: 1773802296619379 usec, L: 0
0318 02:51:43.583042 (+ 116us) write_op.cc:270] Start()
0318 02:51:43.583060 (+ 18us) write_op.cc:276] Timestamp: P: 1773802296621813 usec, L: 0
0318 02:51:43.583171 (+ 111us) write_op.cc:270] Start()
0318 02:51:43.583188 (+ 17us) write_op.cc:276] Timestamp: P: 1773802296622384 usec, L: 0
0318 02:51:43.583291 (+ 103us) write_op.cc:270] Start()
0318 02:51:43.583306 (+ 15us) write_op.cc:276] Timestamp: P: 1773802296651423 usec, L: 0
0318 02:51:43.583452 (+ 146us) write_op.cc:270] Start()
0318 02:51:43.583469 (+ 17us) write_op.cc:276] Timestamp: P: 1773802296657217 usec, L: 0
0318 02:51:43.583578 (+ 109us) write_op.cc:270] Start()
0318 02:51:43.583595 (+ 17us) write_op.cc:276] Timestamp: P: 1773802296676226 usec, L: 0
0318 02:51:43.583707 (+ 112us) write_op.cc:270] Start()
0318 02:51:43.583724 (+ 17us) write_op.cc:276] Timestamp: P: 1773802296727498 usec, L: 0
0318 02:51:43.583850 (+ 126us) write_op.cc:270] Start()
0318 02:51:43.583866 (+ 16us) write_op.cc:276] Timestamp: P: 1773802296728186 usec, L: 0
0318 02:51:43.583977 (+ 111us) write_op.cc:270] Start()
0318 02:51:43.583995 (+ 18us) write_op.cc:276] Timestamp: P: 1773802296728694 usec, L: 0
0318 02:51:43.584110 (+ 115us) write_op.cc:270] Start()
0318 02:51:43.584126 (+ 16us) write_op.cc:276] Timestamp: P: 1773802296731469 usec, L: 0
0318 02:51:43.584230 (+ 104us) write_op.cc:270] Start()
0318 02:51:43.584245 (+ 15us) write_op.cc:276] Timestamp: P: 1773802296751987 usec, L: 0
0318 02:51:43.584395 (+ 150us) write_op.cc:270] Start()
0318 02:51:43.584417 (+ 22us) write_op.cc:276] Timestamp: P: 1773802296753361 usec, L: 0
0318 02:51:43.584541 (+ 124us) write_op.cc:270] Start()
0318 02:51:43.584557 (+ 16us) write_op.cc:276] Timestamp: P: 1773802296756622 usec, L: 0
0318 02:51:43.584669 (+ 112us) write_op.cc:270] Start()
0318 02:51:43.584685 (+ 16us) write_op.cc:276] Timestamp: P: 1773802296762197 usec, L: 0
0318 02:51:43.598849 (+ 14164us) write_op.cc:270] Start()
0318 02:51:43.598889 (+ 40us) write_op.cc:276] Timestamp: P: 1773802296779010 usec, L: 0
0318 02:51:43.599070 (+ 181us) write_op.cc:270] Start()
0318 02:51:43.599092 (+ 22us) write_op.cc:276] Timestamp: P: 1773802296788326 usec, L: 0
0318 02:51:43.599225 (+ 133us) write_op.cc:270] Start()
0318 02:51:43.599245 (+ 20us) write_op.cc:276] Timestamp: P: 1773802296806083 usec, L: 0
0318 02:51:43.599383 (+ 138us) write_op.cc:270] Start()
0318 02:51:43.599402 (+ 19us) write_op.cc:276] Timestamp: P: 1773802296833904 usec, L: 0
0318 02:51:43.599522 (+ 120us) write_op.cc:270] Start()
0318 02:51:43.599539 (+ 17us) write_op.cc:276] Timestamp: P: 1773802296849190 usec, L: 0
0318 02:51:43.599700 (+ 161us) write_op.cc:270] Start()
0318 02:51:43.599720 (+ 20us) write_op.cc:276] Timestamp: P: 1773802296855766 usec, L: 0
0318 02:51:43.599849 (+ 129us) write_op.cc:270] Start()
0318 02:51:43.599867 (+ 18us) write_op.cc:276] Timestamp: P: 1773802296901924 usec, L: 0
0318 02:51:43.608114 (+ 8247us) write_op.cc:270] Start()
0318 02:51:43.608154 (+ 40us) write_op.cc:276] Timestamp: P: 1773802296910084 usec, L: 0
0318 02:51:43.608332 (+ 178us) write_op.cc:270] Start()
0318 02:51:43.608358 (+ 26us) write_op.cc:276] Timestamp: P: 1773802296910678 usec, L: 0
0318 02:51:43.608590 (+ 232us) write_op.cc:270] Start()
0318 02:51:43.608616 (+ 26us) write_op.cc:276] Timestamp: P: 1773802296911148 usec, L: 0
0318 02:51:43.608786 (+ 170us) write_op.cc:270] Start()
0318 02:51:43.608807 (+ 21us) write_op.cc:276] Timestamp: P: 1773802296911669 usec, L: 0
0318 02:51:43.608977 (+ 170us) write_op.cc:270] Start()
0318 02:51:43.608997 (+ 20us) write_op.cc:276] Timestamp: P: 1773802296918847 usec, L: 0
0318 02:51:43.609124 (+ 127us) write_op.cc:270] Start()
0318 02:51:43.609143 (+ 19us) write_op.cc:276] Timestamp: P: 1773802296928539 usec, L: 0
0318 02:51:43.610284 (+ 1141us) write_op.cc:270] Start()
0318 02:51:43.610310 (+ 26us) write_op.cc:276] Timestamp: P: 1773802296949145 usec, L: 0
0318 02:51:43.610455 (+ 145us) write_op.cc:270] Start()
0318 02:51:43.610479 (+ 24us) write_op.cc:276] Timestamp: P: 1773802296950992 usec, L: 0
0318 02:51:43.610613 (+ 134us) write_op.cc:270] Start()
0318 02:51:43.610631 (+ 18us) write_op.cc:276] Timestamp: P: 1773802296972732 usec, L: 0
0318 02:51:43.610743 (+ 112us) write_op.cc:270] Start()
0318 02:51:43.610761 (+ 18us) write_op.cc:276] Timestamp: P: 1773802297001074 usec, L: 0
0318 02:51:43.610885 (+ 124us) write_op.cc:270] Start()
0318 02:51:43.610904 (+ 19us) write_op.cc:276] Timestamp: P: 1773802297003186 usec, L: 0
0318 02:51:43.611037 (+ 133us) write_op.cc:270] Start()
0318 02:51:43.611058 (+ 21us) write_op.cc:276] Timestamp: P: 1773802297003845 usec, L: 0
0318 02:51:43.611214 (+ 156us) write_op.cc:270] Start()
0318 02:51:43.611233 (+ 19us) write_op.cc:276] Timestamp: P: 1773802297004454 usec, L: 0
0318 02:51:43.611362 (+ 129us) write_op.cc:270] Start()
0318 02:51:43.611382 (+ 20us) write_op.cc:276] Timestamp: P: 1773802297010492 usec, L: 0
0318 02:51:43.611512 (+ 130us) write_op.cc:270] Start()
0318 02:51:43.611532 (+ 20us) write_op.cc:276] Timestamp: P: 1773802297038667 usec, L: 0
0318 02:51:43.611711 (+ 179us) write_op.cc:270] Start()
0318 02:51:43.611732 (+ 21us) write_op.cc:276] Timestamp: P: 1773802297121738 usec, L: 0
0318 02:51:43.611862 (+ 130us) write_op.cc:270] Start()
0318 02:51:43.611885 (+ 23us) write_op.cc:276] Timestamp: P: 1773802297123072 usec, L: 0
0318 02:51:43.611995 (+ 110us) write_op.cc:270] Start()
0318 02:51:43.612014 (+ 19us) write_op.cc:276] Timestamp: P: 1773802297125716 usec, L: 0
0318 02:51:43.612156 (+ 142us) write_op.cc:270] Start()
0318 02:51:43.612217 (+ 61us) write_op.cc:276] Timestamp: P: 1773802297142851 usec, L: 0
0318 02:51:43.612371 (+ 154us) write_op.cc:270] Start()
0318 02:51:43.612392 (+ 21us) write_op.cc:276] Timestamp: P: 1773802297143497 usec, L: 0
0318 02:51:43.618754 (+ 6362us) write_op.cc:270] Start()
0318 02:51:43.618798 (+ 44us) write_op.cc:276] Timestamp: P: 1773802297144027 usec, L: 0
0318 02:51:43.618967 (+ 169us) write_op.cc:270] Start()
0318 02:51:43.618988 (+ 21us) write_op.cc:276] Timestamp: P: 1773802297172109 usec, L: 0
0318 02:51:43.619123 (+ 135us) write_op.cc:270] Start()
0318 02:51:43.619140 (+ 17us) write_op.cc:276] Timestamp: P: 1773802297172762 usec, L: 0
0318 02:51:43.619257 (+ 117us) write_op.cc:270] Start()
0318 02:51:43.619273 (+ 16us) write_op.cc:276] Timestamp: P: 1773802297178820 usec, L: 0
0318 02:51:43.619373 (+ 100us) write_op.cc:270] Start()
0318 02:51:43.619388 (+ 15us) write_op.cc:276] Timestamp: P: 1773802297179371 usec, L: 0
0318 02:51:43.619484 (+ 96us) write_op.cc:270] Start()
0318 02:51:43.619499 (+ 15us) write_op.cc:276] Timestamp: P: 1773802297179811 usec, L: 0
0318 02:51:43.619601 (+ 102us) write_op.cc:270] Start()
0318 02:51:43.619618 (+ 17us) write_op.cc:276] Timestamp: P: 1773802297196826 usec, L: 0
0318 02:51:43.619740 (+ 122us) write_op.cc:270] Start()
0318 02:51:43.619760 (+ 20us) write_op.cc:276] Timestamp: P: 1773802297228893 usec, L: 0
0318 02:51:43.619887 (+ 127us) write_op.cc:270] Start()
0318 02:51:43.619903 (+ 16us) write_op.cc:276] Timestamp: P: 1773802297230135 usec, L: 0
0318 02:51:43.620037 (+ 134us) write_op.cc:270] Start()
0318 02:51:43.620053 (+ 16us) write_op.cc:276] Timestamp: P: 1773802297231221 usec, L: 0
0318 02:51:43.620158 (+ 105us) write_op.cc:270] Start()
0318 02:51:43.620187 (+ 29us) write_op.cc:276] Timestamp: P: 1773802297324325 usec, L: 0
0318 02:51:43.620316 (+ 129us) write_op.cc:270] Start()
0318 02:51:43.620333 (+ 17us) write_op.cc:276] Timestamp: P: 1773802297332727 usec, L: 0
0318 02:51:43.620445 (+ 112us) write_op.cc:270] Start()
0318 02:51:43.620461 (+ 16us) write_op.cc:276] Timestamp: P: 1773802297342947 usec, L: 0
0318 02:51:43.620555 (+ 94us) write_op.cc:270] Start()
0318 02:51:43.620570 (+ 15us) write_op.cc:276] Timestamp: P: 1773802297370382 usec, L: 0
0318 02:51:43.620667 (+ 97us) write_op.cc:270] Start()
0318 02:51:43.620689 (+ 22us) write_op.cc:276] Timestamp: P: 1773802297373518 usec, L: 0
0318 02:51:43.631777 (+ 11088us) write_op.cc:270] Start()
0318 02:51:43.631819 (+ 42us) write_op.cc:276] Timestamp: P: 1773802297397042 usec, L: 0
0318 02:51:43.632018 (+ 199us) write_op.cc:270] Start()
0318 02:51:43.632041 (+ 23us) write_op.cc:276] Timestamp: P: 1773802297405773 usec, L: 0
0318 02:51:43.632174 (+ 133us) write_op.cc:270] Start()
0318 02:51:43.632198 (+ 24us) write_op.cc:276] Timestamp: P: 1773802297406384 usec, L: 0
0318 02:51:43.632341 (+ 143us) write_op.cc:270] Start()
0318 02:51:43.632363 (+ 22us) write_op.cc:276] Timestamp: P: 1773802297407845 usec, L: 0
0318 02:51:43.632509 (+ 146us) write_op.cc:270] Start()
0318 02:51:43.632532 (+ 23us) write_op.cc:276] Timestamp: P: 1773802297426991 usec, L: 0
0318 02:51:43.632681 (+ 149us) write_op.cc:270] Start()
0318 02:51:43.634881 (+ 2200us) write_op.cc:276] Timestamp: P: 1773802297429049 usec, L: 0
0318 02:51:43.635098 (+ 217us) write_op.cc:270] Start()
0318 02:51:43.635130 (+ 32us) write_op.cc:276] Timestamp: P: 1773802297506927 usec, L: 0
0318 02:51:43.635336 (+ 206us) write_op.cc:270] Start()
0318 02:51:43.635361 (+ 25us) write_op.cc:276] Timestamp: P: 1773802297508490 usec, L: 0
0318 02:51:43.635491 (+ 130us) write_op.cc:270] Start()
0318 02:51:43.635508 (+ 17us) write_op.cc:276] Timestamp: P: 1773802297509434 usec, L: 0
0318 02:51:43.635637 (+ 129us) write_op.cc:270] Start()
0318 02:51:43.635654 (+ 17us) write_op.cc:276] Timestamp: P: 1773802297510235 usec, L: 0
0318 02:51:43.635790 (+ 136us) write_op.cc:270] Start()
0318 02:51:43.635807 (+ 17us) write_op.cc:276] Timestamp: P: 1773802297510929 usec, L: 0
0318 02:51:43.635937 (+ 130us) write_op.cc:270] Start()
0318 02:51:43.635956 (+ 19us) write_op.cc:276] Timestamp: P: 1773802297534806 usec, L: 0
0318 02:51:43.636082 (+ 126us) write_op.cc:270] Start()
0318 02:51:43.636101 (+ 19us) write_op.cc:276] Timestamp: P: 1773802297535965 usec, L: 0
0318 02:51:43.636260 (+ 159us) write_op.cc:270] Start()
0318 02:51:43.636282 (+ 22us) write_op.cc:276] Timestamp: P: 1773802297548893 usec, L: 0
0318 02:51:43.636414 (+ 132us) write_op.cc:270] Start()
0318 02:51:43.636437 (+ 23us) write_op.cc
I20260318 02:51:44.492244 1172 tablet_bootstrap.cc:492] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:44.493315 1175 tablet_replica.cc:333] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:44.493582 1175 raft_consensus.cc:2243] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.493818 1175 raft_consensus.cc:2272] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.494030 1172 tablet_bootstrap.cc:654] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.494441 1175 ts_tablet_manager.cc:1916] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.497004 1184 ts_tablet_manager.cc:1929] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.498656 1184 log.cc:1199] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/a0a6f4b34ff14714892ed9e9b3604dc9
I20260318 02:51:44.499095 1184 ts_tablet_manager.cc:1950] T a0a6f4b34ff14714892ed9e9b3604dc9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:44.499842 1176 ts_tablet_manager.cc:1929] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.499967 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1115) took 4025 ms. Trace:
I20260318 02:51:44.503753 1176 log.cc:1199] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/5dd894706cc2466a8cd4e4df67856862
I20260318 02:51:44.504277 1176 ts_tablet_manager.cc:1950] T 5dd894706cc2466a8cd4e4df67856862 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:44.505611 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 5dd894706cc2466a8cd4e4df67856862 (table default.Table_d1bc10f5a27b4fee93fafa3a93ee9d05 [id=f4308b8efe454170bce7eff85fab0959]) successfully deleted
W20260318 02:51:44.506379 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 7f2c321032c34a1596c37981f8c95cd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f2c321032c34a1596c37981f8c95cd5 already in progress: creating tablet
W20260318 02:51:44.507015 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f5f53ee0015740a5a32a858e798c592e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5f53ee0015740a5a32a858e798c592e already in progress: creating tablet
W20260318 02:51:44.507622 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet e96b662de89a48018920544e9abb66c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e96b662de89a48018920544e9abb66c7 already in progress: creating tablet
I20260318 02:51:44.507934 1176 tablet_replica.cc:333] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:44.508189 1176 raft_consensus.cc:2243] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.509084 1176 raft_consensus.cc:2272] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.509769 1176 ts_tablet_manager.cc:1916] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.514652 1175 ts_tablet_manager.cc:1929] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.516989 1175 log.cc:1199] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/2a7ddc0807d742cea258f889390e2142
I20260318 02:51:44.517400 1175 ts_tablet_manager.cc:1950] T 2a7ddc0807d742cea258f889390e2142 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:44.515961 1173 tablet_bootstrap.cc:492] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:44.517665 1173 ts_tablet_manager.cc:1403] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.057s user 0.003s sys 0.000s
I20260318 02:51:44.518442 1173 raft_consensus.cc:359] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.518875 1173 raft_consensus.cc:385] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.518977 1173 raft_consensus.cc:740] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.519268 1173 consensus_queue.cc:260] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.522852 1173 ts_tablet_manager.cc:1434] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260318 02:51:44.523274 1173 tablet_bootstrap.cc:492] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:44.524439 1176 ts_tablet_manager.cc:1929] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.524645 1176 log.cc:1199] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/6a65ccfd73234e8fb2bea5b6911cb3f1
I20260318 02:51:44.516041 2152 raft_consensus.cc:493] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.525090 1173 tablet_bootstrap.cc:654] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.525094 1176 ts_tablet_manager.cc:1950] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:44.525099 2152 raft_consensus.cc:515] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.525835 2152 leader_election.cc:290] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:44.526005 1184 rpcz_store.cc:276] 0318 02:51:40.474360 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.474406 (+ 46us) service_pool.cc:225] Handling call
0318 02:51:44.477653 (+4003247us) ts_tablet_manager.cc:1151] Deleting tablet a0a6f4b34ff14714892ed9e9b3604dc9
0318 02:51:44.477665 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.486820 (+ 9155us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.496888 (+ 10068us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.499947 (+ 3059us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4003107}
I20260318 02:51:44.526269 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a36a7fd4742c9827b334ce31d4a7c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:44.526487 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1117) took 3969 ms. Trace:
I20260318 02:51:44.526567 1184 rpcz_store.cc:276] 0318 02:51:40.557164 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.557262 (+ 98us) service_pool.cc:225] Handling call
0318 02:51:44.526352 (+3969090us) ts_tablet_manager.cc:1151] Deleting tablet 5433e0aebdd34666a655c21a77fe2654
0318 02:51:44.526365 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.526468 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3968889}
W20260318 02:51:44.526759 999 leader_election.cc:343] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2a3a36a7fd4742c9827b334ce31d4a7c
I20260318 02:51:44.526757 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet a0a6f4b34ff14714892ed9e9b3604dc9 (table default.Table_7692f02c62f94771bc39331507161bb2 [id=60f0afdd0f9f4c5196ea491b90991241]) successfully deleted
I20260318 02:51:44.526835 1184 tablet_replica.cc:333] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:44.527010 1184 raft_consensus.cc:2243] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.527231 1184 raft_consensus.cc:2272] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:44.527539 997 leader_election.cc:343] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.527639 997 leader_election.cc:304] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.527848 2152 raft_consensus.cc:2749] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.528013 1184 ts_tablet_manager.cc:1916] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:44.528193 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 5433e0aebdd34666a655c21a77fe2654 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5433e0aebdd34666a655c21a77fe2654 already in progress: creating tablet
I20260318 02:51:44.528561 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 (table default.Table_ce996d68b1144b3aa44ab9618af7d43e [id=aa309b4ad7d6425d853518c95e0e0461]) successfully deleted
I20260318 02:51:44.528784 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1178) took 1691 ms. Trace:
I20260318 02:51:44.528921 1175 rpcz_store.cc:276] 0318 02:51:42.837744 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.837916 (+ 172us) service_pool.cc:225] Handling call
0318 02:51:44.490603 (+1652687us) ts_tablet_manager.cc:1151] Deleting tablet 2a7ddc0807d742cea258f889390e2142
0318 02:51:44.493258 (+ 2655us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.500207 (+ 6949us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.514526 (+ 14319us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.528765 (+ 14239us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1652066}
I20260318 02:51:44.529182 2152 raft_consensus.cc:493] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260318 02:51:44.529309 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 1be09e67b9d94e669f28a7cd236b48a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1be09e67b9d94e669f28a7cd236b48a4 already in progress: creating tablet
I20260318 02:51:44.529304 2152 raft_consensus.cc:515] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.529461 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 2a7ddc0807d742cea258f889390e2142 (table default.Table_23b963651b514aeaa69a42da8e6d2150 [id=ff1dddd3bf73410c816e618a9931c7cf]) successfully deleted
I20260318 02:51:44.529579 1176 tablet_replica.cc:333] T 33d90a619ae54227aaf95acd180af119 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:44.529758 1176 raft_consensus.cc:2243] T 33d90a619ae54227aaf95acd180af119 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.529780 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1180) took 1689 ms. Trace:
I20260318 02:51:44.529914 2152 leader_election.cc:290] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:44.529843 1175 rpcz_store.cc:276] 0318 02:51:42.840564 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.840629 (+ 65us) service_pool.cc:225] Handling call
0318 02:51:44.529664 (+1689035us) ts_tablet_manager.cc:1151] Deleting tablet 1294e1ae2115471a8b605d38f1c26e60
0318 02:51:44.529673 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.529765 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1687884}
W20260318 02:51:44.530208 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 1294e1ae2115471a8b605d38f1c26e60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1294e1ae2115471a8b605d38f1c26e60 already in progress: creating tablet
W20260318 02:51:44.530697 999 leader_election.cc:343] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 59c6741a6d154d8f99d487c6590d2d26
I20260318 02:51:44.530663 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c6741a6d154d8f99d487c6590d2d26" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:44.531178 997 leader_election.cc:343] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.531272 997 leader_election.cc:304] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.531653 2152 raft_consensus.cc:2749] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.531975 1175 tablet_replica.cc:333] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:44.532200 1175 raft_consensus.cc:2243] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.532843 1175 raft_consensus.cc:2272] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.533598 1175 ts_tablet_manager.cc:1916] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.534428 1174 raft_consensus.cc:385] T 824b9dc6982f425c9518c0ea3560bf84 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.534863 1174 raft_consensus.cc:740] T 824b9dc6982f425c9518c0ea3560bf84 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.535791 1172 tablet_bootstrap.cc:492] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:44.535989 1172 ts_tablet_manager.cc:1403] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.000s
I20260318 02:51:44.537834 1172 raft_consensus.cc:359] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.538110 1172 raft_consensus.cc:385] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.538208 1172 raft_consensus.cc:740] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.538511 1172 consensus_queue.cc:260] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.539188 1172 ts_tablet_manager.cc:1434] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:44.539515 1172 tablet_bootstrap.cc:492] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:44.541211 1172 tablet_bootstrap.cc:654] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.541674 1173 tablet_bootstrap.cc:492] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:44.541883 1173 ts_tablet_manager.cc:1403] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260318 02:51:44.542614 1173 raft_consensus.cc:359] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.542850 1173 raft_consensus.cc:385] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.542939 1173 raft_consensus.cc:740] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.543287 1173 consensus_queue.cc:260] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.543834 1173 ts_tablet_manager.cc:1434] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:44.544155 1173 tablet_bootstrap.cc:492] T 6f8b5120633e4e0d8964f17d6d5f316d P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:44.545876 1173 tablet_bootstrap.cc:654] T 6f8b5120633e4e0d8964f17d6d5f316d P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.546594 1175 ts_tablet_manager.cc:1929] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.547735 1175 log.cc:1199] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/ba3e7e9a85c94d7380b96a9373c1f503
I20260318 02:51:44.548107 1175 ts_tablet_manager.cc:1950] T ba3e7e9a85c94d7380b96a9373c1f503 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:44.548450 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1179) took 1708 ms. Trace:
I20260318 02:51:44.548584 1175 rpcz_store.cc:276] 0318 02:51:42.840454 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.841903 (+ 1449us) service_pool.cc:225] Handling call
0318 02:51:44.531931 (+1690028us) ts_tablet_manager.cc:1151] Deleting tablet ba3e7e9a85c94d7380b96a9373c1f503
0318 02:51:44.531941 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.541416 (+ 9475us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.546480 (+ 5064us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.548432 (+ 1952us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1689278}
I20260318 02:51:44.549203 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet ba3e7e9a85c94d7380b96a9373c1f503 (table default.Table_51d490345e9f497ca6b3076edf95c90f [id=fbbe8921ed4344c18e2276270fcaf24f]) successfully deleted
I20260318 02:51:44.549775 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1181) took 1417 ms. Trace:
I20260318 02:51:44.549904 1175 rpcz_store.cc:276] 0318 02:51:43.131996 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.133694 (+ 1698us) service_pool.cc:225] Handling call
0318 02:51:44.549611 (+1415917us) ts_tablet_manager.cc:1151] Deleting tablet 89a225cb00d04582b2bf0f569ddab07f
0318 02:51:44.549625 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.549752 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1415686}
W20260318 02:51:44.550508 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 89a225cb00d04582b2bf0f569ddab07f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89a225cb00d04582b2bf0f569ddab07f already in progress: creating tablet
I20260318 02:51:44.551000 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1182) took 1391 ms. Trace:
I20260318 02:51:44.551126 1175 rpcz_store.cc:276] 0318 02:51:43.159550 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.159608 (+ 58us) service_pool.cc:225] Handling call
0318 02:51:44.550882 (+1391274us) ts_tablet_manager.cc:1151] Deleting tablet c3f37e3d16f943e0aeeddafe1a955599
0318 02:51:44.550893 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.550983 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1391078}
W20260318 02:51:44.551580 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet c3f37e3d16f943e0aeeddafe1a955599 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3f37e3d16f943e0aeeddafe1a955599 already in progress: creating tablet
I20260318 02:51:44.551966 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1183) took 1385 ms. Trace:
I20260318 02:51:44.552086 1175 rpcz_store.cc:276] 0318 02:51:43.166881 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.166939 (+ 58us) service_pool.cc:225] Handling call
0318 02:51:44.551861 (+1384922us) ts_tablet_manager.cc:1151] Deleting tablet ca765bc27f564ab9ab419bcf2aeda59f
0318 02:51:44.551871 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.551950 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1384738}
W20260318 02:51:44.552479 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet ca765bc27f564ab9ab419bcf2aeda59f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca765bc27f564ab9ab419bcf2aeda59f already in progress: creating tablet
I20260318 02:51:44.535988 1176 raft_consensus.cc:2272] T 33d90a619ae54227aaf95acd180af119 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.552863 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1184) took 1382 ms. Trace:
I20260318 02:51:44.552925 1175 rpcz_store.cc:276] 0318 02:51:43.170448 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.170566 (+ 118us) service_pool.cc:225] Handling call
0318 02:51:44.552767 (+1382201us) ts_tablet_manager.cc:1151] Deleting tablet 82d2922edaae4dc0bd8bcf859d248a11
0318 02:51:44.552776 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.552847 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1308276}
I20260318 02:51:44.553023 1174 consensus_queue.cc:260] T 824b9dc6982f425c9518c0ea3560bf84 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:44.553262 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 82d2922edaae4dc0bd8bcf859d248a11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82d2922edaae4dc0bd8bcf859d248a11 already in progress: creating tablet
I20260318 02:51:44.553352 1176 ts_tablet_manager.cc:1916] T 33d90a619ae54227aaf95acd180af119 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.553558 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1185) took 1374 ms. Trace:
I20260318 02:51:44.553618 1175 rpcz_store.cc:276] 0318 02:51:43.179325 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.179385 (+ 60us) service_pool.cc:225] Handling call
0318 02:51:44.553467 (+1374082us) ts_tablet_manager.cc:1151] Deleting tablet bdb950b9207d4528a86fac1da0ae6538
0318 02:51:44.553475 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.553544 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1308193}
W20260318 02:51:44.553926 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet bdb950b9207d4528a86fac1da0ae6538 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bdb950b9207d4528a86fac1da0ae6538 already in progress: creating tablet
I20260318 02:51:44.554171 1175 tablet_replica.cc:333] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:44.554339 1175 raft_consensus.cc:2243] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.554464 1175 raft_consensus.cc:2272] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.554927 1175 ts_tablet_manager.cc:1916] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.553678 1174 ts_tablet_manager.cc:1434] T 824b9dc6982f425c9518c0ea3560bf84 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.104s user 0.017s sys 0.000s
I20260318 02:51:44.558367 1174 tablet_bootstrap.cc:492] T 2dab268da5e843cab5c28a521217df97 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:44.558705 2593 raft_consensus.cc:493] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.558826 2593 raft_consensus.cc:515] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.559418 2593 leader_election.cc:290] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:44.560563 862 leader_election.cc:343] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 254b8722e7ff4ccabc6d16f04daf85aa
I20260318 02:51:44.560925 1174 tablet_bootstrap.cc:654] T 2dab268da5e843cab5c28a521217df97 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:44.562119 860 leader_election.cc:343] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 254b8722e7ff4ccabc6d16f04daf85aa
I20260318 02:51:44.562258 860 leader_election.cc:304] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:44.562608 2593 raft_consensus.cc:2749] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.565493 1172 tablet_bootstrap.cc:492] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:44.565714 1172 ts_tablet_manager.cc:1403] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260318 02:51:44.566497 1172 raft_consensus.cc:359] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.566751 1172 raft_consensus.cc:385] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.568203 1175 ts_tablet_manager.cc:1929] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.568635 1176 ts_tablet_manager.cc:1929] T 33d90a619ae54227aaf95acd180af119 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.569937 1175 log.cc:1199] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/bf344c2361b7412c87a7c7f9a72a15b6
I20260318 02:51:44.570459 1175 ts_tablet_manager.cc:1950] T bf344c2361b7412c87a7c7f9a72a15b6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:44.571173 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1186) took 1339 ms. Trace:
I20260318 02:51:44.571516 1172 raft_consensus.cc:740] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.571763 1175 rpcz_store.cc:276] 0318 02:51:43.231422 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.231496 (+ 74us) service_pool.cc:225] Handling call
0318 02:51:44.554129 (+1322633us) ts_tablet_manager.cc:1151] Deleting tablet bf344c2361b7412c87a7c7f9a72a15b6
0318 02:51:44.554137 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.562643 (+ 8506us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.568090 (+ 5447us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.571157 (+ 3067us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1306413}
I20260318 02:51:44.571890 1172 consensus_queue.cc:260] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.572438 1172 ts_tablet_manager.cc:1434] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260318 02:51:44.572536 1184 ts_tablet_manager.cc:1929] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.572623 1184 log.cc:1199] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/2ebcf120100349319d27615b6e0c7550
I20260318 02:51:44.572580 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet bf344c2361b7412c87a7c7f9a72a15b6 (table default.Table_67969be821524f06922e86b98527c45b [id=d22d61a1d07149c3bf62dd9412aaa9c6]) successfully deleted
I20260318 02:51:44.572746 1172 tablet_bootstrap.cc:492] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:44.572925 1184 ts_tablet_manager.cc:1950] T 2ebcf120100349319d27615b6e0c7550 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:44.573186 1175 tablet_replica.cc:333] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:44.573470 1176 log.cc:1199] T 33d90a619ae54227aaf95acd180af119 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/33d90a619ae54227aaf95acd180af119
I20260318 02:51:44.573637 1175 raft_consensus.cc:2243] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.573804 1175 raft_consensus.cc:2272] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.574185 1176 ts_tablet_manager.cc:1950] T 33d90a619ae54227aaf95acd180af119 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:44.574369 1175 ts_tablet_manager.cc:1916] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.575419 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1116) took 4018 ms. Trace:
I20260318 02:51:44.575546 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 33d90a619ae54227aaf95acd180af119 (table default.Table_6188e1840e124ad0814b689b5887e654 [id=5d3de8b6b902412f900bbc2c35a4c2b9]) successfully deleted
I20260318 02:51:44.575975 2152 raft_consensus.cc:493] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.576032 2614 raft_consensus.cc:493] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.576228 2614 raft_consensus.cc:515] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.575649 1184 rpcz_store.cc:276] 0318 02:51:40.557032 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.563374 (+ 6342us) service_pool.cc:225] Handling call
0318 02:51:44.526789 (+3963415us) ts_tablet_manager.cc:1151] Deleting tablet 2ebcf120100349319d27615b6e0c7550
0318 02:51:44.526799 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.549990 (+ 23191us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.572429 (+ 22439us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.575396 (+ 2967us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3963184}
I20260318 02:51:44.576681 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 2ebcf120100349319d27615b6e0c7550 (table default.Table_1424aa1a08ae4f3584a9f415cd41b6e7 [id=566d84b4953c4753a0b3a2bc060aae3b]) successfully deleted
I20260318 02:51:44.576894 2614 leader_election.cc:290] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:44.577158 1184 tablet_replica.cc:333] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:44.577443 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6f40a5d3f14a779c26d73bf58f302b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:44.577580 1184 raft_consensus.cc:2243] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.577638 785 raft_consensus.cc:2468] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:44.577687 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6f40a5d3f14a779c26d73bf58f302b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:44.577741 1184 raft_consensus.cc:2272] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.576103 2152 raft_consensus.cc:515] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:44.578101 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 4052eede3f404b84ac27e21a204bf5a9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4052eede3f404b84ac27e21a204bf5a9 already in progress: creating tablet
I20260318 02:51:44.578310 1184 ts_tablet_manager.cc:1916] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.578506 999 leader_election.cc:304] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
W20260318 02:51:44.578933 997 leader_election.cc:343] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.578966 2605 raft_consensus.cc:2804] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:44.579219 2605 raft_consensus.cc:493] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:44.579299 2605 raft_consensus.cc:3060] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:44.579530 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de2bc2f79e8b49248de3e7eca1a600cf" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:44.579959 997 leader_election.cc:343] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.578523 2152 leader_election.cc:290] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
W20260318 02:51:44.582023 999 leader_election.cc:343] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: de2bc2f79e8b49248de3e7eca1a600cf
I20260318 02:51:44.582124 999 leader_election.cc:304] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.582521 2614 raft_consensus.cc:2749] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.584930 2605 raft_consensus.cc:515] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.585600 2605 leader_election.cc:290] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:44.585960 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6f40a5d3f14a779c26d73bf58f302b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:44.586375 785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e6f40a5d3f14a779c26d73bf58f302b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
W20260318 02:51:44.586527 997 leader_election.cc:343] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.586555 785 raft_consensus.cc:3060] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:44.587531 1172 tablet_bootstrap.cc:654] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.588980 2467 raft_consensus.cc:493] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.589116 2467 raft_consensus.cc:515] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.589706 2467 leader_election.cc:290] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:44.590649 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895aa252b9f243d89e972d1b717ee910" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:44.591349 719 leader_election.cc:343] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.592898 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895aa252b9f243d89e972d1b717ee910" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:44.597648 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0d45c2c6d1314e7db0d54a9659276e73 consensus state has no leader
W20260318 02:51:44.597697 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 09917645d5dc415e8e9ffdb1eab477bd consensus state has no leader
W20260318 02:51:44.598062 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4fd5884046c14e688c18f6cb173d176d consensus state has no leader
I20260318 02:51:44.599298 456 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 5b49b066f27b43829c8f922649744303 (table default.Table_e7633153163443ce97eeb8423db6d4ea [id=6f4e96b5a043423b95bfdf37a2411644]). Expected version 1 got 0
I20260318 02:51:44.600358 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d7d8654621644ac7a6b0fa1a093c0f8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:44.600492 452 master_service.cc:954] ReplaceTablet: received request to replace tablet c0349def0e4045f2b1e9a02dd654a174 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:44.600921 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 495c8ace1cdb4741aa2ffa1f85dfb25e
I20260318 02:51:44.601176 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b6bc70833af0498d8ec1b7e98aff1c64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:44.601521 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7f2b4c79603342a2b19f5b755a16fafc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:44.601727 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6bc70833af0498d8ec1b7e98aff1c64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:44.601953 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f2b4c79603342a2b19f5b755a16fafc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.603119 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2b818b2d7f194db2bbd0cc4ad837fb00
I20260318 02:51:44.603233 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1c16727d959149009c4d63b308305db7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:44.603698 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c16727d959149009c4d63b308305db7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.603911 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0c0ba4c3df1348149d99921eddf79c1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:44.604395 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c0ba4c3df1348149d99921eddf79c1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.605552 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3c5185412638410fb9c5356e8cb5d84d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:44.606011 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c5185412638410fb9c5356e8cb5d84d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.607695 1175 ts_tablet_manager.cc:1929] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.607816 1175 log.cc:1199] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/813702e53eee4a54a7d693fd6e03bbbb
I20260318 02:51:44.608125 1175 ts_tablet_manager.cc:1950] T 813702e53eee4a54a7d693fd6e03bbbb P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:44.611092 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b818b2d7f194db2bbd0cc4ad837fb00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.611263 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet b317cc133346412fb981b1c8e5b99c4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:44.611646 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 053efeef673f4535993b29d102884408 consensus state has no leader
I20260318 02:51:44.611706 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 495c8ace1cdb4741aa2ffa1f85dfb25e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.611892 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b818b2d7f194db2bbd0cc4ad837fb00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.612012 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4e770bc308894d9094b88315d9093ba5" } modify_external_catalogs: true
I20260318 02:51:44.612165 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 495c8ace1cdb4741aa2ffa1f85dfb25e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.612183 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4e770bc308894d9094b88315d9093ba5" } modify_external_catalogs: true
I20260318 02:51:44.614681 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1187) took 1374 ms. Trace:
I20260318 02:51:44.615204 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 0abb9045d6394fd4a9e294269387dfc9
I20260318 02:51:44.618687 451 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet a9c60ef260d049bea4ce729316a0d09f (table default.Table_d5ddb641ef9245ca92ab35d8ac25b157 [id=fb45f238426142faa79cbe89242c7418]). Expected version 1 got 0
I20260318 02:51:44.619344 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a88d7cf1e136439093308e8ba6a02904" } modify_external_catalogs: true
I20260318 02:51:44.619510 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a88d7cf1e136439093308e8ba6a02904" } modify_external_catalogs: true
I20260318 02:51:44.620663 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e4f76e7e6a3f45a9a367b7c2874f85e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:44.621273 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4f76e7e6a3f45a9a367b7c2874f85e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.622407 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 495c8ace1cdb4741aa2ffa1f85dfb25e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.622637 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b818b2d7f194db2bbd0cc4ad837fb00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.622767 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 0abb9045d6394fd4a9e294269387dfc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.622901 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 824b9dc6982f425c9518c0ea3560bf84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.623855 1172 tablet_bootstrap.cc:492] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:44.623979 1172 ts_tablet_manager.cc:1403] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.051s user 0.005s sys 0.000s
I20260318 02:51:44.624799 1172 raft_consensus.cc:359] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.624995 1172 raft_consensus.cc:385] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.625099 1172 raft_consensus.cc:740] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.625291 1172 consensus_queue.cc:260] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.626272 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 0abb9045d6394fd4a9e294269387dfc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.626503 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 254b8722e7ff4ccabc6d16f04daf85aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.626653 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 41646d513e834600a209761392ac7fb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.626663 893 tablet_service.cc:1558] Processing DeleteTablet for tablet a0a6f4b34ff14714892ed9e9b3604dc9 with delete_type TABLET_DATA_DELETED (replaced by tablet fb5d1d828899472e8f48723b35e94d62) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.626972 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 0abb9045d6394fd4a9e294269387dfc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.627925 2614 raft_consensus.cc:493] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.628053 2614 raft_consensus.cc:515] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.628279 1172 ts_tablet_manager.cc:1434] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:44.628574 1172 tablet_bootstrap.cc:492] T d7f21df58fac437da5747becfa3f28b4 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:44.628633 2614 leader_election.cc:290] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:44.629419 719 leader_election.cc:343] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.629542 719 leader_election.cc:304] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.630373 2467 raft_consensus.cc:2749] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.630676 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60dedba077d34435b30061bfba737412" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:44.631996 997 leader_election.cc:343] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.633977 1184 ts_tablet_manager.cc:1929] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:44.637470 1184 log.cc:1199] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/b9e0c54b3f1b44e4bea7253473714e94
I20260318 02:51:44.638049 1184 ts_tablet_manager.cc:1950] T b9e0c54b3f1b44e4bea7253473714e94 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
W20260318 02:51:44.638772 999 leader_election.cc:343] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 60dedba077d34435b30061bfba737412
I20260318 02:51:44.638904 999 leader_election.cc:304] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.639328 2614 raft_consensus.cc:2749] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:44.639840 1172 tablet_bootstrap.cc:654] T d7f21df58fac437da5747becfa3f28b4 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:44.640498 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7d8654621644ac7a6b0fa1a093c0f8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.614779 1175 rpcz_store.cc:276] 0318 02:51:43.240225 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.240401 (+ 176us) service_pool.cc:225] Handling call
0318 02:51:44.573125 (+1332724us) ts_tablet_manager.cc:1151] Deleting tablet 813702e53eee4a54a7d693fd6e03bbbb
0318 02:51:44.573138 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.601873 (+ 28735us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.607572 (+ 5699us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.614657 (+ 7085us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1324864}
I20260318 02:51:44.641371 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 813702e53eee4a54a7d693fd6e03bbbb (table default.Table_1acdeb444a404cb0b89ac6450e835639 [id=9278db75ac0f4aa59c4af2f13a58e314]) successfully deleted
I20260318 02:51:44.641786 1175 tablet_replica.cc:333] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:44.642225 1175 raft_consensus.cc:2243] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.642527 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_824f5a8c5da1479297ff211029e64fe6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:44.642671 1175 raft_consensus.cc:2272] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:44.643144 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_824f5a8c5da1479297ff211029e64fe6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.643244 1175 ts_tablet_manager.cc:1916] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.643232 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5ff5f71a1bec45fdb637b5846419efdb" } new_table_name: "default.Table_fef680b63ffe4b32a6a477d2f98ad498" modify_external_catalogs: true
I20260318 02:51:44.644577 457 master_service.cc:954] ReplaceTablet: received request to replace tablet 5b1527c9ce014e819d03330486e8ef3b from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:44.645547 454 master_service.cc:954] ReplaceTablet: received request to replace tablet 75c4ba372960496880405e5dffe11d60 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:44.647650 785 raft_consensus.cc:2468] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
W20260318 02:51:44.650920 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet aa12fe852965419ab1803049e416c780 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aa12fe852965419ab1803049e416c780 already in progress: creating tablet
I20260318 02:51:44.648277 999 leader_election.cc:304] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.652990 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 1516525b471540288c6cb5d61120d430
I20260318 02:51:44.653189 2614 raft_consensus.cc:2804] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:44.653311 2614 raft_consensus.cc:697] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:44.653549 2614 consensus_queue.cc:237] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.654067 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 1516525b471540288c6cb5d61120d430 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.654714 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 1516525b471540288c6cb5d61120d430 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.655726 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 1516525b471540288c6cb5d61120d430 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:44.659888 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3feb3a76a7b947f5a35baae379e8754d consensus state has no leader
W20260318 02:51:44.656944 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 7253dcb3d73c4297bf444defd3ef6e74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7253dcb3d73c4297bf444defd3ef6e74 already in progress: creating tablet
W20260318 02:51:44.664130 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet ffa9d9dcc70e402099b414029f062d6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffa9d9dcc70e402099b414029f062d6e already in progress: creating tablet
W20260318 02:51:44.664844 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 036c17d033b145a681843d14f67ab575 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 036c17d033b145a681843d14f67ab575 already in progress: creating tablet
W20260318 02:51:44.668406 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 495c8ace1cdb4741aa2ffa1f85dfb25e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 495c8ace1cdb4741aa2ffa1f85dfb25e already in progress: creating tablet
W20260318 02:51:44.670446 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2b818b2d7f194db2bbd0cc4ad837fb00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b818b2d7f194db2bbd0cc4ad837fb00 already in progress: creating tablet
I20260318 02:51:44.672616 1176 tablet_replica.cc:333] T 824b9dc6982f425c9518c0ea3560bf84 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:44.673053 1175 ts_tablet_manager.cc:1929] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.674487 1175 log.cc:1199] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/56335a4a2c294f67a22206e6a59e29a8
I20260318 02:51:44.674127 1176 raft_consensus.cc:2243] T 824b9dc6982f425c9518c0ea3560bf84 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.675064 1175 ts_tablet_manager.cc:1950] T 56335a4a2c294f67a22206e6a59e29a8 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:44.675766 1176 raft_consensus.cc:2272] T 824b9dc6982f425c9518c0ea3560bf84 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.676313 1172 tablet_bootstrap.cc:492] T d7f21df58fac437da5747becfa3f28b4 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:44.676383 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1188) took 1436 ms. Trace:
I20260318 02:51:44.676476 1172 ts_tablet_manager.cc:1403] T d7f21df58fac437da5747becfa3f28b4 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.048s user 0.005s sys 0.000s
I20260318 02:51:44.676481 1175 rpcz_store.cc:276] 0318 02:51:43.240348 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.240567 (+ 219us) service_pool.cc:225] Handling call
0318 02:51:44.641723 (+1401156us) ts_tablet_manager.cc:1151] Deleting tablet 56335a4a2c294f67a22206e6a59e29a8
0318 02:51:44.641737 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.661003 (+ 19266us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.672905 (+ 11902us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.676357 (+ 3452us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1393423}
I20260318 02:51:44.676931 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1192) took 1240 ms. Trace:
I20260318 02:51:44.677037 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 56335a4a2c294f67a22206e6a59e29a8 (table default.Table_98ff851e3ed0463cb3ef7f1907fa7711 [id=3da3ae03107e44518a289e073abc0998]) successfully deleted
W20260318 02:51:44.671643 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 0abb9045d6394fd4a9e294269387dfc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0abb9045d6394fd4a9e294269387dfc9 already in progress: creating tablet
I20260318 02:51:44.679217 1174 tablet_bootstrap.cc:492] T 2dab268da5e843cab5c28a521217df97 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:44.679412 1174 ts_tablet_manager.cc:1403] T 2dab268da5e843cab5c28a521217df97 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.121s user 0.011s sys 0.011s
I20260318 02:51:44.651515 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1118) took 4094 ms. Trace:
I20260318 02:51:44.679616 1184 rpcz_store.cc:276] 0318 02:51:40.557252 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.571648 (+ 14396us) service_pool.cc:225] Handling call
0318 02:51:44.577108 (+4005460us) ts_tablet_manager.cc:1151] Deleting tablet b9e0c54b3f1b44e4bea7253473714e94
0318 02:51:44.577119 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.624324 (+ 47205us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.633864 (+ 9540us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.651493 (+ 17629us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3999972}
I20260318 02:51:44.680128 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet b9e0c54b3f1b44e4bea7253473714e94 (table default.Table_4a675721365c4600b0a6a7712c03db81 [id=96f382936c1d4b30a3c5e3a1b55b04d4]) successfully deleted
I20260318 02:51:44.680353 1174 raft_consensus.cc:359] T 2dab268da5e843cab5c28a521217df97 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.680608 1174 raft_consensus.cc:385] T 2dab268da5e843cab5c28a521217df97 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.680733 1174 raft_consensus.cc:740] T 2dab268da5e843cab5c28a521217df97 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.681028 1172 raft_consensus.cc:359] T d7f21df58fac437da5747becfa3f28b4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.681028 1174 consensus_queue.cc:260] T 2dab268da5e843cab5c28a521217df97 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.681196 1172 raft_consensus.cc:385] T d7f21df58fac437da5747becfa3f28b4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.681248 1172 raft_consensus.cc:740] T d7f21df58fac437da5747becfa3f28b4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.681514 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1123) took 4071 ms. Trace:
I20260318 02:51:44.681649 1184 rpcz_store.cc:276] 0318 02:51:40.609977 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.610379 (+ 402us) service_pool.cc:225] Handling call
0318 02:51:44.679929 (+4069550us) ts_tablet_manager.cc:1151] Deleting tablet 20009aa96bf44ae88acfeef8e38bc204
0318 02:51:44.681367 (+ 1438us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.681494 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4069380}
W20260318 02:51:44.682201 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 20009aa96bf44ae88acfeef8e38bc204 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 20009aa96bf44ae88acfeef8e38bc204 already in progress: creating tablet
I20260318 02:51:44.682610 1172 consensus_queue.cc:260] T d7f21df58fac437da5747becfa3f28b4 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.683504 1175 rpcz_store.cc:276] 0318 02:51:43.436457 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.436514 (+ 57us) service_pool.cc:225] Handling call
0318 02:51:44.676780 (+1240266us) ts_tablet_manager.cc:1151] Deleting tablet 184ce58aa96d4e70ad7b2783f19ccdeb
0318 02:51:44.676790 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.676916 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1240034}
W20260318 02:51:44.684268 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 184ce58aa96d4e70ad7b2783f19ccdeb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 184ce58aa96d4e70ad7b2783f19ccdeb already in progress: creating tablet
I20260318 02:51:44.684387 1172 ts_tablet_manager.cc:1434] T d7f21df58fac437da5747becfa3f28b4 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260318 02:51:44.684656 1172 tablet_bootstrap.cc:492] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:44.684819 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1194) took 1173 ms. Trace:
I20260318 02:51:44.687567 1172 tablet_bootstrap.cc:654] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.687767 1175 rpcz_store.cc:276] 0318 02:51:43.510951 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.511617 (+ 666us) service_pool.cc:225] Handling call
0318 02:51:44.684645 (+1173028us) ts_tablet_manager.cc:1151] Deleting tablet a1ea3329a317495792d26bd31fcd3b43
0318 02:51:44.684657 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.684798 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1172770}
I20260318 02:51:44.683126 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1129) took 3988 ms. Trace:
I20260318 02:51:44.688457 1184 rpcz_store.cc:276] 0318 02:51:40.694732 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.694790 (+ 58us) service_pool.cc:225] Handling call
0318 02:51:44.682508 (+3987718us) ts_tablet_manager.cc:1151] Deleting tablet 62af4992cca84830ab8317f734338365
0318 02:51:44.682982 (+ 474us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.683098 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3987533}
W20260318 02:51:44.688547 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet a1ea3329a317495792d26bd31fcd3b43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1ea3329a317495792d26bd31fcd3b43 already in progress: creating tablet
I20260318 02:51:44.688782 1184 tablet_replica.cc:333] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:44.689062 1175 tablet_replica.cc:333] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
W20260318 02:51:44.689116 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 62af4992cca84830ab8317f734338365 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 62af4992cca84830ab8317f734338365 already in progress: creating tablet
I20260318 02:51:44.689198 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 2dab268da5e843cab5c28a521217df97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.689515 1175 raft_consensus.cc:2243] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.689966 1175 raft_consensus.cc:2272] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.690778 1175 ts_tablet_manager.cc:1916] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.694082 1184 raft_consensus.cc:2243] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.695362 1174 ts_tablet_manager.cc:1434] T 2dab268da5e843cab5c28a521217df97 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.016s user 0.001s sys 0.000s
I20260318 02:51:44.697046 1184 raft_consensus.cc:2272] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.697674 1184 ts_tablet_manager.cc:1916] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.702569 2646 tablet.cc:1723] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:44.703454 1174 tablet_bootstrap.cc:492] T ce82c595e30a4878be25be8eb3d30790 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:44.705343 1174 tablet_bootstrap.cc:654] T ce82c595e30a4878be25be8eb3d30790 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.711004 893 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3a272697ff410dade2fb4ebf9795ba (DEFAULT_TABLE table=default.Table_a265fa502cd54457b39b55d7c9e7b0b5 [id=c3d2f06bcc43445aba2acf24adb83a36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.711486 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3a272697ff410dade2fb4ebf9795ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.715543 453 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 3aa05403966349ae9056777d913a0db6 (table default.Table_802a2d53f1c14a879d8737dad75f6252 [id=5b2e7b122a394e058dc5b2fd84a0f558]). Expected version 3 got 0
I20260318 02:51:44.716348 453 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 7e6f40a5d3f14a779c26d73bf58f302b (table default.Table_91e64c048d4048168906fcd3d1a5b3d0 [id=05445eb067cb46a5803415774772c91e]). Expected version 2 got 0
I20260318 02:51:44.719889 453 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet a9c60ef260d049bea4ce729316a0d09f (table default.Table_d5ddb641ef9245ca92ab35d8ac25b157 [id=fb45f238426142faa79cbe89242c7418]). Expected version 1 got 0
I20260318 02:51:44.720968 453 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 68b0f0cd89234e72a052f3f9f964aa35 (table default.Table_1068ed12c0774560af59c6eb9d2f292c [id=9a52b01ffd5b4f7e8a7a20a817aa842f]). Expected version 2 got 0
I20260318 02:51:44.721680 1176 ts_tablet_manager.cc:1916] T 824b9dc6982f425c9518c0ea3560bf84 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.722715 1184 ts_tablet_manager.cc:1929] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.722847 1184 log.cc:1199] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/2a3a36a7fd4742c9827b334ce31d4a7c
I20260318 02:51:44.723635 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 75c4ba372960496880405e5dffe11d60
I20260318 02:51:44.724138 454 catalog_manager.cc:6741] ReplaceTablet: tablet 75c4ba372960496880405e5dffe11d60 deleted and replaced by tablet bf6517e55af54c3dae05ed6bceaa7638
I20260318 02:51:44.724517 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 5b1527c9ce014e819d03330486e8ef3b
I20260318 02:51:44.724900 457 catalog_manager.cc:6741] ReplaceTablet: tablet 5b1527c9ce014e819d03330486e8ef3b deleted and replaced by tablet a5a4c494c20044d280cf43c89d9e3ce2
I20260318 02:51:44.725548 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 407b6b2f451e43aaaba4f6cebb80fac7
I20260318 02:51:44.728060 903 tablet_service.cc:1511] Processing CreateTablet for tablet af3a0bb6133f4778b0897f22fe5e6a66 (DEFAULT_TABLE table=default.Table_bbc75d75a0824c3786615a4c0dab452c [id=caa2005495e84d7b83f7815df55be1ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.728502 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3a0bb6133f4778b0897f22fe5e6a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.728693 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b1527c9ce014e819d03330486e8ef3b with delete_type TABLET_DATA_DELETED (replaced by tablet a5a4c494c20044d280cf43c89d9e3ce2) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.731150 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 75c4ba372960496880405e5dffe11d60 with delete_type TABLET_DATA_DELETED (replaced by tablet bf6517e55af54c3dae05ed6bceaa7638) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.731652 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b1527c9ce014e819d03330486e8ef3b with delete_type TABLET_DATA_DELETED (replaced by tablet a5a4c494c20044d280cf43c89d9e3ce2) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.732318 748 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3a272697ff410dade2fb4ebf9795ba (DEFAULT_TABLE table=default.Table_a265fa502cd54457b39b55d7c9e7b0b5 [id=c3d2f06bcc43445aba2acf24adb83a36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.732694 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3a272697ff410dade2fb4ebf9795ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.732828 905 tablet_service.cc:1558] Processing DeleteTablet for tablet 407b6b2f451e43aaaba4f6cebb80fac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.733199 896 tablet_service.cc:1511] Processing CreateTablet for tablet 4787e93dc239455d88b36e00801f29b0 (DEFAULT_TABLE table=default.Table_66fa6d94e51e46949400bad6f425ca56 [id=4edbca20d9994fa7a3ebf95a10867d02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.733544 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4787e93dc239455d88b36e00801f29b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.733660 759 tablet_service.cc:1511] Processing CreateTablet for tablet af3a0bb6133f4778b0897f22fe5e6a66 (DEFAULT_TABLE table=default.Table_bbc75d75a0824c3786615a4c0dab452c [id=caa2005495e84d7b83f7815df55be1ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.733968 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 407b6b2f451e43aaaba4f6cebb80fac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.734352 754 tablet_service.cc:1511] Processing CreateTablet for tablet 1b430b8ea4f84cdd8fef010db315d5f0 (DEFAULT_TABLE table=default.Table_b872c48be3524444a502d18e2f82aa30 [id=6538d0d899034e9f8aecca82cfde32bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.734359 749 tablet_service.cc:1511] Processing CreateTablet for tablet 4787e93dc239455d88b36e00801f29b0 (DEFAULT_TABLE table=default.Table_66fa6d94e51e46949400bad6f425ca56 [id=4edbca20d9994fa7a3ebf95a10867d02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.722966 2648 tablet.cc:1723] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:44.728081 897 tablet_service.cc:1511] Processing CreateTablet for tablet 1b430b8ea4f84cdd8fef010db315d5f0 (DEFAULT_TABLE table=default.Table_b872c48be3524444a502d18e2f82aa30 [id=6538d0d899034e9f8aecca82cfde32bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.741458 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b430b8ea4f84cdd8fef010db315d5f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.743508 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3a0bb6133f4778b0897f22fe5e6a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.744016 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4787e93dc239455d88b36e00801f29b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.745850 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b430b8ea4f84cdd8fef010db315d5f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.727594 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 4787e93dc239455d88b36e00801f29b0 (DEFAULT_TABLE table=default.Table_66fa6d94e51e46949400bad6f425ca56 [id=4edbca20d9994fa7a3ebf95a10867d02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.754815 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4787e93dc239455d88b36e00801f29b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.727860 1036 tablet_service.cc:1511] Processing CreateTablet for tablet af3a0bb6133f4778b0897f22fe5e6a66 (DEFAULT_TABLE table=default.Table_bbc75d75a0824c3786615a4c0dab452c [id=caa2005495e84d7b83f7815df55be1ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.757045 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3a0bb6133f4778b0897f22fe5e6a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.757670 1028 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f04e5699531479d8b76edb0e2d2873c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.757925 1029 tablet_service.cc:1558] Processing DeleteTablet for tablet c4051c8e4d3d49829f9eac8e36baab2f with delete_type TABLET_DATA_DELETED (replaced by tablet 258dc29e4e4245289b7e450837edcd24) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.758095 1025 tablet_service.cc:1558] Processing DeleteTablet for tablet f37ab96f13444fcbb5cfc3ad92d53c35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.758273 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 75c4ba372960496880405e5dffe11d60 with delete_type TABLET_DATA_DELETED (replaced by tablet bf6517e55af54c3dae05ed6bceaa7638) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.760368 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 9777963ff20c4a799de2870555f6b335 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.728336 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 75c4ba372960496880405e5dffe11d60 with delete_type TABLET_DATA_DELETED (replaced by tablet bf6517e55af54c3dae05ed6bceaa7638) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.728474 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b1527c9ce014e819d03330486e8ef3b with delete_type TABLET_DATA_DELETED (replaced by tablet a5a4c494c20044d280cf43c89d9e3ce2) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.728569 1034 tablet_service.cc:1558] Processing DeleteTablet for tablet 407b6b2f451e43aaaba4f6cebb80fac7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.730007 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 1b430b8ea4f84cdd8fef010db315d5f0 (DEFAULT_TABLE table=default.Table_b872c48be3524444a502d18e2f82aa30 [id=6538d0d899034e9f8aecca82cfde32bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.761200 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b430b8ea4f84cdd8fef010db315d5f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.761960 1173 tablet_bootstrap.cc:492] T 6f8b5120633e4e0d8964f17d6d5f316d P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:44.762126 1173 ts_tablet_manager.cc:1403] T 6f8b5120633e4e0d8964f17d6d5f316d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.218s user 0.021s sys 0.015s
I20260318 02:51:44.763055 1174 tablet_bootstrap.cc:492] T ce82c595e30a4878be25be8eb3d30790 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:44.763190 1174 ts_tablet_manager.cc:1403] T ce82c595e30a4878be25be8eb3d30790 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.000s
I20260318 02:51:44.764065 1174 raft_consensus.cc:359] T ce82c595e30a4878be25be8eb3d30790 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:44.764240 1174 raft_consensus.cc:385] T ce82c595e30a4878be25be8eb3d30790 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.764294 1174 raft_consensus.cc:740] T ce82c595e30a4878be25be8eb3d30790 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.764537 1174 consensus_queue.cc:260] T ce82c595e30a4878be25be8eb3d30790 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:44.739459 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 20a492fdea6c44ba8439614b0dcc2ba6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.727594 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3a272697ff410dade2fb4ebf9795ba (DEFAULT_TABLE table=default.Table_a265fa502cd54457b39b55d7c9e7b0b5 [id=c3d2f06bcc43445aba2acf24adb83a36]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.765126 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3a272697ff410dade2fb4ebf9795ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.762810 1173 raft_consensus.cc:359] T 6f8b5120633e4e0d8964f17d6d5f316d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.766790 1173 raft_consensus.cc:385] T 6f8b5120633e4e0d8964f17d6d5f316d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.766863 1173 raft_consensus.cc:740] T 6f8b5120633e4e0d8964f17d6d5f316d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.767118 1173 consensus_queue.cc:260] T 6f8b5120633e4e0d8964f17d6d5f316d P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.769608 1176 ts_tablet_manager.cc:1929] T 824b9dc6982f425c9518c0ea3560bf84 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.772595 448 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 6f8b5120633e4e0d8964f17d6d5f316d (table default.Table_ba6394a91baa4e3889ba7a14f2287aab [id=779018c836a14c518c02a844331ce251]). Expected version 1 got 0
I20260318 02:51:44.776949 1173 ts_tablet_manager.cc:1434] T 6f8b5120633e4e0d8964f17d6d5f316d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260318 02:51:44.743954 1172 tablet_bootstrap.cc:492] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:44.778893 1172 ts_tablet_manager.cc:1403] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.094s user 0.003s sys 0.002s
I20260318 02:51:44.779791 1172 raft_consensus.cc:359] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.780068 1172 raft_consensus.cc:385] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.780170 1172 raft_consensus.cc:740] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.780457 1172 consensus_queue.cc:260] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.781224 1172 ts_tablet_manager.cc:1434] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:44.781955 1172 tablet_bootstrap.cc:492] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:44.784292 1172 tablet_bootstrap.cc:654] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.785246 1173 tablet_bootstrap.cc:492] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:44.786424 457 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet d7f21df58fac437da5747becfa3f28b4 (table default.Table_357b13fa64234ab49f2349df67f8a0e2 [id=48b004d4295f40f0ac9ff77d7bb31720]). Expected version 3 got 0
I20260318 02:51:44.786888 1173 tablet_bootstrap.cc:654] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.786764 457 catalog_manager.cc:5671] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:44.787127 457 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 7e6f40a5d3f14a779c26d73bf58f302b (table default.Table_91e64c048d4048168906fcd3d1a5b3d0 [id=05445eb067cb46a5803415774772c91e]). Expected version 2 got 0
I20260318 02:51:44.788007 1175 ts_tablet_manager.cc:1929] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.788110 1175 log.cc:1199] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/d1a67e637d934c0f99c00d04fb26df0d
I20260318 02:51:44.788383 1175 ts_tablet_manager.cc:1950] T d1a67e637d934c0f99c00d04fb26df0d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:44.784678 1184 ts_tablet_manager.cc:1950] T 2a3a36a7fd4742c9827b334ce31d4a7c P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:44.790951 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1130) took 4096 ms. Trace:
I20260318 02:51:44.791534 448 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_1068ed12c0774560af59c6eb9d2f292c [id=9a52b01ffd5b4f7e8a7a20a817aa842f] alter complete (version 2)
I20260318 02:51:44.792034 453 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 6f8b5120633e4e0d8964f17d6d5f316d (table default.Table_ba6394a91baa4e3889ba7a14f2287aab [id=779018c836a14c518c02a844331ce251]). Expected version 1 got 0
I20260318 02:51:44.793975 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1195) took 1267 ms. Trace:
I20260318 02:51:44.794138 1175 rpcz_store.cc:276] 0318 02:51:43.526761 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.526837 (+ 76us) service_pool.cc:225] Handling call
0318 02:51:44.688999 (+1162162us) ts_tablet_manager.cc:1151] Deleting tablet d1a67e637d934c0f99c00d04fb26df0d
0318 02:51:44.689010 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.695717 (+ 6707us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.787888 (+ 92171us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.793948 (+ 6060us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1077738}
I20260318 02:51:44.794625 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet d1a67e637d934c0f99c00d04fb26df0d (table default.Table_d7033fee66fc4e33b922723a18a78236 [id=5d7bac7ca89d4b11ab8a882731f9b858]) successfully deleted
I20260318 02:51:44.794864 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1196) took 1207 ms. Trace:
I20260318 02:51:44.795992 893 tablet_service.cc:1511] Processing CreateTablet for tablet 708127379215482ca4146309c2ac23c1 (DEFAULT_TABLE table=default.Table_677331592d5441dfb4aea1f996121ddb [id=043fe2e73bbc413ebda4746ef439050d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.796392 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 708127379215482ca4146309c2ac23c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.791122 1184 rpcz_store.cc:276] 0318 02:51:40.694833 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.694881 (+ 48us) service_pool.cc:225] Handling call
0318 02:51:44.688733 (+3993852us) ts_tablet_manager.cc:1151] Deleting tablet 2a3a36a7fd4742c9827b334ce31d4a7c
0318 02:51:44.688742 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.718442 (+ 29700us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.722606 (+ 4164us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.790925 (+ 68319us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3993670}
I20260318 02:51:44.800894 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bb381f10d87414f9c1a99942216adc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.801548 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 2a3a36a7fd4742c9827b334ce31d4a7c (table default.Table_607fac50cf4a4239bff8616d7176493d [id=f84167772dc74b15a01306e41817f3d1]) successfully deleted
I20260318 02:51:44.803123 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 4df7d75e696a4aec981de3963c282b0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.803380 1184 tablet_replica.cc:333] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:44.803570 1184 raft_consensus.cc:2243] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.803714 1184 raft_consensus.cc:2272] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.803668 1175 rpcz_store.cc:276] 0318 02:51:43.587009 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.587068 (+ 59us) service_pool.cc:225] Handling call
0318 02:51:44.794633 (+1207565us) ts_tablet_manager.cc:1151] Deleting tablet c5afbb4fd4b146ed9e0e8ff46aecc465
0318 02:51:44.794645 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.794845 (+ 200us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1173607}
I20260318 02:51:44.804212 1184 ts_tablet_manager.cc:1916] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:44.804220 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet c5afbb4fd4b146ed9e0e8ff46aecc465 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5afbb4fd4b146ed9e0e8ff46aecc465 already in progress: creating tablet
I20260318 02:51:44.805881 2593 raft_consensus.cc:493] T a9c60ef260d049bea4ce729316a0d09f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.804667 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1197) took 1215 ms. Trace:
I20260318 02:51:44.806008 2593 raft_consensus.cc:515] T a9c60ef260d049bea4ce729316a0d09f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.806068 1175 rpcz_store.cc:276] 0318 02:51:43.589172 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.589238 (+ 66us) service_pool.cc:225] Handling call
0318 02:51:44.804536 (+1215298us) ts_tablet_manager.cc:1151] Deleting tablet 2fe517a0498e4ac3b0bb52a0eea7448d
0318 02:51:44.804546 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.804650 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1183386}
W20260318 02:51:44.806453 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2fe517a0498e4ac3b0bb52a0eea7448d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2fe517a0498e4ac3b0bb52a0eea7448d already in progress: creating tablet
I20260318 02:51:44.806617 2593 leader_election.cc:290] T a9c60ef260d049bea4ce729316a0d09f P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:44.807265 1175 tablet_replica.cc:333] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:44.807440 1175 raft_consensus.cc:2243] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.807586 1175 raft_consensus.cc:2272] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.807768 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c60ef260d049bea4ce729316a0d09f" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:44.808121 1175 ts_tablet_manager.cc:1916] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.810238 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_551f61678d2f40bcb32bf1cd2e2c9f4e" } new_table_name: "default.Table_676a667361dd4f23afbda31df87958fb" modify_external_catalogs: true
I20260318 02:51:44.811305 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 708127379215482ca4146309c2ac23c1 (DEFAULT_TABLE table=default.Table_677331592d5441dfb4aea1f996121ddb [id=043fe2e73bbc413ebda4746ef439050d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.811571 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_011412ca9e304055969a0ba44b82c555" } new_table_name: "default.Table_85c16d674e834595911be295a8222653" modify_external_catalogs: true
I20260318 02:51:44.811687 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 708127379215482ca4146309c2ac23c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.809170 893 tablet_service.cc:1511] Processing CreateTablet for tablet 5e57a9cc2ea145148478f3ed8fe3e297 (DEFAULT_TABLE table=default.Table_f740414db84848c89a3bf2821b7999a4 [id=181c4203845240c39789a97a500c8065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.812696 896 tablet_service.cc:1511] Processing CreateTablet for tablet 5c515b5afd964ef8b8213f4b57a9046c (DEFAULT_TABLE table=default.Table_ab58e545a9bc4de9831cbc9029078cee [id=cecabf48696f4659b3c892d2c0617916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.813122 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c515b5afd964ef8b8213f4b57a9046c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.813256 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 5e57a9cc2ea145148478f3ed8fe3e297 (DEFAULT_TABLE table=default.Table_f740414db84848c89a3bf2821b7999a4 [id=181c4203845240c39789a97a500c8065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.814388 454 master_service.cc:954] ReplaceTablet: received request to replace tablet f8e428b700044eaf9e360f74c751a206 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:44.814528 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e57a9cc2ea145148478f3ed8fe3e297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.771842 748 tablet_service.cc:1558] Processing DeleteTablet for tablet ce82c595e30a4878be25be8eb3d30790 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.817013 1176 log.cc:1199] T 824b9dc6982f425c9518c0ea3560bf84 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/824b9dc6982f425c9518c0ea3560bf84
I20260318 02:51:44.778082 1174 ts_tablet_manager.cc:1434] T ce82c595e30a4878be25be8eb3d30790 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260318 02:51:44.817392 1176 ts_tablet_manager.cc:1950] T 824b9dc6982f425c9518c0ea3560bf84 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:44.817550 1174 tablet_bootstrap.cc:492] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:44.818363 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 824b9dc6982f425c9518c0ea3560bf84 (table default.Table_d20052125a004fa088aea68c2ec6d98f [id=64bdf02991a64246b7431e6e3c0e1268]) successfully deleted
I20260318 02:51:44.818851 1174 tablet_bootstrap.cc:654] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.819096 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1ac62abf756c4328933c7bf6db14a7f2" } modify_external_catalogs: true
I20260318 02:51:44.819254 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1ac62abf756c4328933c7bf6db14a7f2" } modify_external_catalogs: true
I20260318 02:51:44.819563 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_06e84fa324c3410197903c4ea0c6056b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:44.819829 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8f6fc03338164c69badf6ecce1f3e2b1" } modify_external_catalogs: true
I20260318 02:51:44.819967 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8f6fc03338164c69badf6ecce1f3e2b1" } modify_external_catalogs: true
W20260318 02:51:44.820109 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_06e84fa324c3410197903c4ea0c6056b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.805619 749 tablet_service.cc:1511] Processing CreateTablet for tablet 708127379215482ca4146309c2ac23c1 (DEFAULT_TABLE table=default.Table_677331592d5441dfb4aea1f996121ddb [id=043fe2e73bbc413ebda4746ef439050d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.807209 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c60ef260d049bea4ce729316a0d09f" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:44.821924 862 leader_election.cc:304] T a9c60ef260d049bea4ce729316a0d09f P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:44.822381 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_50962224abd7467492507d0af7c6a030"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:44.822528 2593 raft_consensus.cc:2749] T a9c60ef260d049bea4ce729316a0d09f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:44.822840 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50962224abd7467492507d0af7c6a030 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.810379 759 tablet_service.cc:1511] Processing CreateTablet for tablet 5e57a9cc2ea145148478f3ed8fe3e297 (DEFAULT_TABLE table=default.Table_f740414db84848c89a3bf2821b7999a4 [id=181c4203845240c39789a97a500c8065]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.823096 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 708127379215482ca4146309c2ac23c1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:44.825357 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fa68d30736044b71b38938fded1b314b consensus state has no leader
W20260318 02:51:44.826030 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fe82e581368c4d8a894f0283c1a710fe consensus state has no leader
I20260318 02:51:44.826550 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e57a9cc2ea145148478f3ed8fe3e297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.826694 927 raft_consensus.cc:3060] T 6f8b5120633e4e0d8964f17d6d5f316d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:44.827307 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e57a9cc2ea145148478f3ed8fe3e297. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.834746 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7e830a261b9b4dadae5dc42d69c292ca" } modify_external_catalogs: true
I20260318 02:51:44.834961 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7e830a261b9b4dadae5dc42d69c292ca" } modify_external_catalogs: true
I20260318 02:51:44.836181 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet fca751e8fa5e4098b33093766e80d933
I20260318 02:51:44.836870 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f8e428b700044eaf9e360f74c751a206
I20260318 02:51:44.837350 454 catalog_manager.cc:6741] ReplaceTablet: tablet f8e428b700044eaf9e360f74c751a206 deleted and replaced by tablet 2fcfbac8dcfe4a23b7be892a4d758b22
I20260318 02:51:44.837735 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 0f499c464eb14164a2df3abc2d4a47c7
I20260318 02:51:44.838831 903 tablet_service.cc:1558] Processing DeleteTablet for tablet f8e428b700044eaf9e360f74c751a206 with delete_type TABLET_DATA_DELETED (replaced by tablet 2fcfbac8dcfe4a23b7be892a4d758b22) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.839079 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f499c464eb14164a2df3abc2d4a47c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.839226 748 tablet_service.cc:1558] Processing DeleteTablet for tablet f8e428b700044eaf9e360f74c751a206 with delete_type TABLET_DATA_DELETED (replaced by tablet 2fcfbac8dcfe4a23b7be892a4d758b22) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.839440 754 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f499c464eb14164a2df3abc2d4a47c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.839696 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f499c464eb14164a2df3abc2d4a47c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.839972 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet f8e428b700044eaf9e360f74c751a206 with delete_type TABLET_DATA_DELETED (replaced by tablet 2fcfbac8dcfe4a23b7be892a4d758b22) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.840121 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ad02fb74a8e54e76ba7370a1d85c60b8" } new_table_name: "default.Table_a08fb7078dfc4ab9b85ef5701d3a9e33" modify_external_catalogs: true
I20260318 02:51:44.841140 896 tablet_service.cc:1558] Processing DeleteTablet for tablet fca751e8fa5e4098b33093766e80d933 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.838680 759 tablet_service.cc:1558] Processing DeleteTablet for tablet fca751e8fa5e4098b33093766e80d933 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.842235 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 443e6018aed94077a38aa80bafee7264
I20260318 02:51:44.843287 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 443e6018aed94077a38aa80bafee7264 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:44.843290 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 443e6018aed94077a38aa80bafee7264 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:44.843619 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 443e6018aed94077a38aa80bafee7264 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:44.810853 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bf9631ddcae948d899f328bac240c567" } new_table_name: "default.Table_5d78084524e04752a1d95e16642d880d" modify_external_catalogs: true
I20260318 02:51:44.849951 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c16e719f5ec444dfbf8cc9fd019945e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:44.850190 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c31b6e1619f5437cadef729724fc2468"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:44.850277 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_57cf0fee93474e9ebf2fb7c515c7aaf5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:44.850553 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c16e719f5ec444dfbf8cc9fd019945e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:44.850674 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c31b6e1619f5437cadef729724fc2468 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:44.850674 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57cf0fee93474e9ebf2fb7c515c7aaf5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.855581 1176 tablet_replica.cc:333] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:44.856527 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 5c515b5afd964ef8b8213f4b57a9046c (DEFAULT_TABLE table=default.Table_ab58e545a9bc4de9831cbc9029078cee [id=cecabf48696f4659b3c892d2c0617916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.856854 1176 raft_consensus.cc:2243] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.856871 896 tablet_service.cc:1511] Processing CreateTablet for tablet 91898e36c5624185aca9249c2b2ce0d2 (DEFAULT_TABLE table=default.Table_49d26a0539be438a970f563e500346b2 [id=d96c22711ef64e788c5aa00e2b2ad0fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.857014 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c515b5afd964ef8b8213f4b57a9046c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.856961 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_484f25ecd6914954923ed82621c50371"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:44.857252 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91898e36c5624185aca9249c2b2ce0d2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:44.857477 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_484f25ecd6914954923ed82621c50371 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.859994 758 tablet_service.cc:1511] Processing CreateTablet for tablet 9ace9983e8eb4726905b0cb7e77caba6 (DEFAULT_TABLE table=default.Table_c1fbf81fbfa04f579e4d547c959dccd1 [id=af32c621f241480fa8b5c89319884d2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.860425 748 tablet_service.cc:1511] Processing CreateTablet for tablet 14b22c427f1e4c4cb40427b423f26792 (DEFAULT_TABLE table=default.Table_5d77e76788f047a2a13fc7e7c66a863a [id=856db28f2f774edd8aa420d49d98418d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.860503 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ace9983e8eb4726905b0cb7e77caba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.860765 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b22c427f1e4c4cb40427b423f26792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.860090 754 tablet_service.cc:1511] Processing CreateTablet for tablet 8b1078c849a745c4808cf48d71e23ff8 (DEFAULT_TABLE table=default.Table_671052eea68c4fdba772ff0b23394897 [id=4f33344e773243b5aba51b31f346061f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.861323 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b1078c849a745c4808cf48d71e23ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.863564 759 tablet_service.cc:1511] Processing CreateTablet for tablet 91898e36c5624185aca9249c2b2ce0d2 (DEFAULT_TABLE table=default.Table_49d26a0539be438a970f563e500346b2 [id=d96c22711ef64e788c5aa00e2b2ad0fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.863898 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91898e36c5624185aca9249c2b2ce0d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.864007 1172 tablet_bootstrap.cc:492] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:44.864135 1172 ts_tablet_manager.cc:1403] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.082s user 0.003s sys 0.001s
I20260318 02:51:44.865885 2467 raft_consensus.cc:493] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.866011 2467 raft_consensus.cc:515] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.866554 2467 leader_election.cc:290] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:44.867311 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f21df58fac437da5747becfa3f28b4" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:44.867327 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f21df58fac437da5747becfa3f28b4" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:44.867508 1064 raft_consensus.cc:2468] T d7f21df58fac437da5747becfa3f28b4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 0.
I20260318 02:51:44.867421 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_da8501c40a7c4e079c81ee43aecca824"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:44.867946 719 leader_election.cc:343] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:44.868041 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da8501c40a7c4e079c81ee43aecca824 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.869500 719 leader_election.cc:304] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.869745 897 tablet_service.cc:1511] Processing CreateTablet for tablet 8b1078c849a745c4808cf48d71e23ff8 (DEFAULT_TABLE table=default.Table_671052eea68c4fdba772ff0b23394897 [id=4f33344e773243b5aba51b31f346061f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.870148 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b1078c849a745c4808cf48d71e23ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.870239 2467 raft_consensus.cc:2804] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:44.870311 2467 raft_consensus.cc:493] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:44.870363 2467 raft_consensus.cc:3060] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:44.872961 2467 raft_consensus.cc:515] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.873518 2467 leader_election.cc:290] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:44.874338 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f21df58fac437da5747becfa3f28b4" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:44.874851 719 leader_election.cc:343] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.860147 749 tablet_service.cc:1511] Processing CreateTablet for tablet 5c515b5afd964ef8b8213f4b57a9046c (DEFAULT_TABLE table=default.Table_ab58e545a9bc4de9831cbc9029078cee [id=cecabf48696f4659b3c892d2c0617916]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.875814 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c515b5afd964ef8b8213f4b57a9046c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.876087 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f21df58fac437da5747becfa3f28b4" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:44.876260 1064 raft_consensus.cc:3060] T d7f21df58fac437da5747becfa3f28b4 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:44.876554 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 91898e36c5624185aca9249c2b2ce0d2 (DEFAULT_TABLE table=default.Table_49d26a0539be438a970f563e500346b2 [id=d96c22711ef64e788c5aa00e2b2ad0fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.876976 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 14b22c427f1e4c4cb40427b423f26792 (DEFAULT_TABLE table=default.Table_5d77e76788f047a2a13fc7e7c66a863a [id=856db28f2f774edd8aa420d49d98418d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.877290 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b22c427f1e4c4cb40427b423f26792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.877281 903 tablet_service.cc:1511] Processing CreateTablet for tablet 9ace9983e8eb4726905b0cb7e77caba6 (DEFAULT_TABLE table=default.Table_c1fbf81fbfa04f579e4d547c959dccd1 [id=af32c621f241480fa8b5c89319884d2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.877624 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ace9983e8eb4726905b0cb7e77caba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.878875 1064 raft_consensus.cc:2468] T d7f21df58fac437da5747becfa3f28b4 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 1.
I20260318 02:51:44.879216 1173 tablet_bootstrap.cc:492] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:44.879281 719 leader_election.cc:304] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:44.879458 1173 ts_tablet_manager.cc:1403] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.094s user 0.003s sys 0.000s
I20260318 02:51:44.880306 1176 raft_consensus.cc:2272] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.880366 1173 raft_consensus.cc:359] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.880656 1173 raft_consensus.cc:385] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:44.883260 2467 raft_consensus.cc:2804] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:44.883407 2467 raft_consensus.cc:697] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Becoming Leader. State: Replica: 6a903d876086423b8016d705b98895ad, State: Running, Role: LEADER
I20260318 02:51:44.883388 1173 raft_consensus.cc:740] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:44.883625 1173 consensus_queue.cc:260] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.883648 2467 consensus_queue.cc:237] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.883857 897 tablet_service.cc:1511] Processing CreateTablet for tablet 14b22c427f1e4c4cb40427b423f26792 (DEFAULT_TABLE table=default.Table_5d77e76788f047a2a13fc7e7c66a863a [id=856db28f2f774edd8aa420d49d98418d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.884110 1176 ts_tablet_manager.cc:1916] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.884249 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b22c427f1e4c4cb40427b423f26792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.887724 1173 ts_tablet_manager.cc:1434] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260318 02:51:44.888651 1173 tablet_bootstrap.cc:492] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:44.891103 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 9ace9983e8eb4726905b0cb7e77caba6 (DEFAULT_TABLE table=default.Table_c1fbf81fbfa04f579e4d547c959dccd1 [id=af32c621f241480fa8b5c89319884d2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.891510 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ace9983e8eb4726905b0cb7e77caba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.893648 1173 tablet_bootstrap.cc:654] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:44.894291 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8b18f758538e4645aa8c5ad6341c4f93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:44.894820 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b18f758538e4645aa8c5ad6341c4f93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.895165 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 8b1078c849a745c4808cf48d71e23ff8 (DEFAULT_TABLE table=default.Table_671052eea68c4fdba772ff0b23394897 [id=4f33344e773243b5aba51b31f346061f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.895514 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b1078c849a745c4808cf48d71e23ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.896199 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8d234aec26b24c4d8aeca66b6539c362" } new_table_name: "default.Table_7e83a50e6b984e6c980fbbbf0ea38c05" modify_external_catalogs: true
I20260318 02:51:44.896950 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3f853afbb0104fe0a6e0652ccc682718"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:44.897497 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f853afbb0104fe0a6e0652ccc682718 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.899727 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8a690b74a1804277b7f6584b8900ac0a" } modify_external_catalogs: true
I20260318 02:51:44.902645 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_448e0cc41ff047c4ab15e7fe7fd1305e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:44.903210 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_448e0cc41ff047c4ab15e7fe7fd1305e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:44.905669 1176 ts_tablet_manager.cc:1929] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:44.905802 1176 log.cc:1199] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/1516525b471540288c6cb5d61120d430
I20260318 02:51:44.906116 1176 ts_tablet_manager.cc:1950] T 1516525b471540288c6cb5d61120d430 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:44.899886 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8a690b74a1804277b7f6584b8900ac0a" } modify_external_catalogs: true
W20260318 02:51:44.908862 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7c40c4cda934922ba7df2775ce892fe consensus state has no leader
I20260318 02:51:44.910205 1176 tablet_replica.cc:333] T 2dab268da5e843cab5c28a521217df97 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
W20260318 02:51:44.911156 997 consensus_peers.cc:597] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:44.911520 1176 raft_consensus.cc:2243] T 2dab268da5e843cab5c28a521217df97 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.911784 1176 raft_consensus.cc:2272] T 2dab268da5e843cab5c28a521217df97 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.913715 1176 ts_tablet_manager.cc:1916] T 2dab268da5e843cab5c28a521217df97 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.914641 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 6fda88f28e4447029cfeab1b197d27ff (DEFAULT_TABLE table=default.Table_dde65a0e8449460f970a61ce1e8d80df [id=5e6e3859b4f64874b3dc1657cdbe0d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.915071 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fda88f28e4447029cfeab1b197d27ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.919958 896 tablet_service.cc:1511] Processing CreateTablet for tablet 44dbf7e728f54b49b884d32d9e12aa72 (DEFAULT_TABLE table=default.Table_8de5959d46654370a20f284e22d05049 [id=bae69a46bcd54bb784c2e53cb33cb9a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.908529 1175 ts_tablet_manager.cc:1929] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.910624 893 tablet_service.cc:1511] Processing CreateTablet for tablet 6fda88f28e4447029cfeab1b197d27ff (DEFAULT_TABLE table=default.Table_dde65a0e8449460f970a61ce1e8d80df [id=5e6e3859b4f64874b3dc1657cdbe0d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.920394 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44dbf7e728f54b49b884d32d9e12aa72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.920640 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fda88f28e4447029cfeab1b197d27ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.921005 1034 tablet_service.cc:1511] Processing CreateTablet for tablet ee1e0887692e412a89834e5c146fe72b (DEFAULT_TABLE table=default.Table_cfd0d4de76d7477491c09d9212370fc2 [id=3d6dc1d849014edcb278242033bb7faf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.921383 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee1e0887692e412a89834e5c146fe72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.927642 1176 ts_tablet_manager.cc:1929] T 2dab268da5e843cab5c28a521217df97 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.927760 1176 log.cc:1199] T 2dab268da5e843cab5c28a521217df97 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/2dab268da5e843cab5c28a521217df97
I20260318 02:51:44.928030 1176 ts_tablet_manager.cc:1950] T 2dab268da5e843cab5c28a521217df97 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:44.915985 897 tablet_service.cc:1511] Processing CreateTablet for tablet ee1e0887692e412a89834e5c146fe72b (DEFAULT_TABLE table=default.Table_cfd0d4de76d7477491c09d9212370fc2 [id=3d6dc1d849014edcb278242033bb7faf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.929056 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee1e0887692e412a89834e5c146fe72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.929215 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 44dbf7e728f54b49b884d32d9e12aa72 (DEFAULT_TABLE table=default.Table_8de5959d46654370a20f284e22d05049 [id=bae69a46bcd54bb784c2e53cb33cb9a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.929370 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_666699f265dc4783bc3c8315e742e806" } modify_external_catalogs: true
I20260318 02:51:44.929569 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44dbf7e728f54b49b884d32d9e12aa72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.929550 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_666699f265dc4783bc3c8315e742e806" } modify_external_catalogs: true
I20260318 02:51:44.931806 1176 tablet_replica.cc:333] T ce82c595e30a4878be25be8eb3d30790 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:44.932005 903 tablet_service.cc:1511] Processing CreateTablet for tablet 369e952736e44a92a242b2b5cfa29074 (DEFAULT_TABLE table=default.Table_0d2858909c654b5c9566dab7b33da1c3 [id=22c01966e3224406b3e3c039991da3c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.932361 1176 raft_consensus.cc:2243] T ce82c595e30a4878be25be8eb3d30790 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.932410 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369e952736e44a92a242b2b5cfa29074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.934194 2605 raft_consensus.cc:493] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.934329 2605 raft_consensus.cc:515] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.934902 2605 leader_election.cc:290] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:44.935010 2605 raft_consensus.cc:493] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.935094 2605 raft_consensus.cc:515] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:44.935627 2605 leader_election.cc:290] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:44.936275 2605 raft_consensus.cc:493] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.936388 2605 raft_consensus.cc:515] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.936905 2605 leader_election.cc:290] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:44.937137 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72023f5408f4ef4b628568da0c008d6" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:44.937814 1176 raft_consensus.cc:2272] T ce82c595e30a4878be25be8eb3d30790 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.938679 1176 ts_tablet_manager.cc:1916] T ce82c595e30a4878be25be8eb3d30790 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.942255 1175 log.cc:1199] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/b383fd49049c4c1daba3f1ed60899f3e
I20260318 02:51:44.942698 1175 ts_tablet_manager.cc:1950] T b383fd49049c4c1daba3f1ed60899f3e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:44.943109 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1198) took 1318 ms. Trace:
I20260318 02:51:44.943789 1175 rpcz_store.cc:276] 0318 02:51:43.625114 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.625597 (+ 483us) service_pool.cc:225] Handling call
0318 02:51:44.807217 (+1181620us) ts_tablet_manager.cc:1151] Deleting tablet b383fd49049c4c1daba3f1ed60899f3e
0318 02:51:44.807227 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.849238 (+ 42011us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.908399 (+ 59161us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:44.943075 (+ 34676us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1181424}
I20260318 02:51:44.944150 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f37ab96f13444fcbb5cfc3ad92d53c35" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:44.944998 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1199) took 1269 ms. Trace:
I20260318 02:51:44.945345 1176 ts_tablet_manager.cc:1929] T ce82c595e30a4878be25be8eb3d30790 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:44.945508 1176 log.cc:1199] T ce82c595e30a4878be25be8eb3d30790 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/ce82c595e30a4878be25be8eb3d30790
I20260318 02:51:44.945511 1175 rpcz_store.cc:276] 0318 02:51:43.675978 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.676033 (+ 55us) service_pool.cc:225] Handling call
0318 02:51:44.944851 (+1268818us) ts_tablet_manager.cc:1151] Deleting tablet 7f2c321032c34a1596c37981f8c95cd5
0318 02:51:44.944862 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.944955 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1212534}
I20260318 02:51:44.945889 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1200) took 1185 ms. Trace:
I20260318 02:51:44.945930 1176 ts_tablet_manager.cc:1950] T ce82c595e30a4878be25be8eb3d30790 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:44.945987 1175 rpcz_store.cc:276] 0318 02:51:43.760393 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.760447 (+ 54us) service_pool.cc:225] Handling call
0318 02:51:44.945764 (+1185317us) ts_tablet_manager.cc:1151] Deleting tablet f5f53ee0015740a5a32a858e798c592e
0318 02:51:44.945772 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.945857 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1185107}
I20260318 02:51:44.946300 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1201) took 1182 ms. Trace:
I20260318 02:51:44.946359 2605 raft_consensus.cc:493] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:44.946381 1175 rpcz_store.cc:276] 0318 02:51:43.763836 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.763885 (+ 49us) service_pool.cc:225] Handling call
0318 02:51:44.946183 (+1182298us) ts_tablet_manager.cc:1151] Deleting tablet e96b662de89a48018920544e9abb66c7
0318 02:51:44.946191 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.946272 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1182027}
I20260318 02:51:44.946494 2605 raft_consensus.cc:515] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:44.946616 1175 tablet_replica.cc:333] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:44.946807 1175 raft_consensus.cc:2243] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:44.947062 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4051c8e4d3d49829f9eac8e36baab2f" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:44.947124 2605 leader_election.cc:290] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:44.947239 997 leader_election.cc:343] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:44.947410 997 leader_election.cc:343] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:44.947960 997 leader_election.cc:343] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.947952 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9777963ff20c4a799de2870555f6b335" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:44.948357 997 leader_election.cc:343] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:44.952198 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet b383fd49049c4c1daba3f1ed60899f3e (table default.Table_5ed9c43cfcf94d058b59ec604059817b [id=fc9e568fb3884c3ca8575e591393560e]) successfully deleted
W20260318 02:51:44.952526 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 7f2c321032c34a1596c37981f8c95cd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f2c321032c34a1596c37981f8c95cd5 already in progress: creating tablet
W20260318 02:51:44.952913 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f5f53ee0015740a5a32a858e798c592e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5f53ee0015740a5a32a858e798c592e already in progress: creating tablet
W20260318 02:51:44.953245 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet e96b662de89a48018920544e9abb66c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e96b662de89a48018920544e9abb66c7 already in progress: creating tablet
I20260318 02:51:44.959920 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 369e952736e44a92a242b2b5cfa29074 (DEFAULT_TABLE table=default.Table_0d2858909c654b5c9566dab7b33da1c3 [id=22c01966e3224406b3e3c039991da3c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.960460 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369e952736e44a92a242b2b5cfa29074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.960645 905 tablet_service.cc:1511] Processing CreateTablet for tablet 52a1ec507b8543b0b346a24aa2c0f476 (DEFAULT_TABLE table=default.Table_a875cf0d4d504b64b3a2a6dc15fc6416 [id=51e082f0a0574ec8a6c816f26c9b5f18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.961419 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a1ec507b8543b0b346a24aa2c0f476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.961884 1175 raft_consensus.cc:2272] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:44.962496 1175 ts_tablet_manager.cc:1916] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:44.963781 896 tablet_service.cc:1511] Processing CreateTablet for tablet a15228cf9661443188ba598f53d2dbdf (DEFAULT_TABLE table=default.Table_0877f95d5a2c42d199d4563969d06c2e [id=87916f24740d43d190991a8e9953e4b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.965044 1041 tablet_service.cc:1511] Processing CreateTablet for tablet a15228cf9661443188ba598f53d2dbdf (DEFAULT_TABLE table=default.Table_0877f95d5a2c42d199d4563969d06c2e [id=87916f24740d43d190991a8e9953e4b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.965382 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a15228cf9661443188ba598f53d2dbdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.971020 897 tablet_service.cc:1511] Processing CreateTablet for tablet 295ac73a106e4a7e87d001a79f80cb99 (DEFAULT_TABLE table=default.Table_3728303752c24f76b34471c6dea7725c [id=6ace0239e3b74faa8e8a4ec2601ea7ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.971200 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 295ac73a106e4a7e87d001a79f80cb99 (DEFAULT_TABLE table=default.Table_3728303752c24f76b34471c6dea7725c [id=6ace0239e3b74faa8e8a4ec2601ea7ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.971635 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295ac73a106e4a7e87d001a79f80cb99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.972359 893 tablet_service.cc:1511] Processing CreateTablet for tablet 31ab4c332a824a29b0b6c0fbd449e1c9 (DEFAULT_TABLE table=default.Table_5e53f15adf3f483f892dd81b106bbe56 [id=5fd90558747546eca3bf439dbcdc40aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.972664 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 31ab4c332a824a29b0b6c0fbd449e1c9 (DEFAULT_TABLE table=default.Table_5e53f15adf3f483f892dd81b106bbe56 [id=5fd90558747546eca3bf439dbcdc40aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.973049 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ab4c332a824a29b0b6c0fbd449e1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.980197 890 tablet_service.cc:1511] Processing CreateTablet for tablet 6c6570ad948c4c049bc3931a0440941e (DEFAULT_TABLE table=default.Table_e31a9cb72cdc4e19801984222e014d7e [id=cabcfba8a21a423485f20671266feb59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.980772 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 6c6570ad948c4c049bc3931a0440941e (DEFAULT_TABLE table=default.Table_e31a9cb72cdc4e19801984222e014d7e [id=cabcfba8a21a423485f20671266feb59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.981240 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c6570ad948c4c049bc3931a0440941e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.985949 903 tablet_service.cc:1511] Processing CreateTablet for tablet 152e06b85e044909a7bf7fcad9f215b9 (DEFAULT_TABLE table=default.Table_b5b721ed331a4c519ab844bceff17911 [id=793c4cca22c54b17b982bc4ca3b1f78d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.990720 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91898e36c5624185aca9249c2b2ce0d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.992909 1040 tablet_service.cc:1511] Processing CreateTablet for tablet df624ec8df244dee85edc443dba4cd05 (DEFAULT_TABLE table=default.Table_350a0da6de9147aeb8ec20a8d661d892 [id=0ed2d0832bb64404a48bc0889bd3d776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.993340 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df624ec8df244dee85edc443dba4cd05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.998524 749 tablet_service.cc:1511] Processing CreateTablet for tablet 6fda88f28e4447029cfeab1b197d27ff (DEFAULT_TABLE table=default.Table_dde65a0e8449460f970a61ce1e8d80df [id=5e6e3859b4f64874b3dc1657cdbe0d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:44.999006 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fda88f28e4447029cfeab1b197d27ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:44.999240 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet fca751e8fa5e4098b33093766e80d933 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:45.001304 2620 raft_consensus.cc:493] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260318 02:51:45.001398 999 leader_election.cc:343] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: f72023f5408f4ef4b628568da0c008d6
I20260318 02:51:45.001425 2620 raft_consensus.cc:515] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.001508 999 leader_election.cc:304] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:45.001910 999 leader_election.cc:343] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: f37ab96f13444fcbb5cfc3ad92d53c35
I20260318 02:51:45.001978 2620 leader_election.cc:290] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:45.001996 999 leader_election.cc:304] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:45.002297 999 leader_election.cc:343] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: c4051c8e4d3d49829f9eac8e36baab2f
I20260318 02:51:45.002369 999 leader_election.cc:304] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:45.002923 2494 raft_consensus.cc:2749] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.003082 2494 raft_consensus.cc:2749] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.003181 2494 raft_consensus.cc:2749] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.004046 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 1516525b471540288c6cb5d61120d430 (table default.Table_4e770bc308894d9094b88315d9093ba5 [id=433e7aa77412424ebb38784bb073d1fb]) successfully deleted
I20260318 02:51:45.004266 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 2dab268da5e843cab5c28a521217df97 (table default.Table_c6d53ff287654d37b638cd812b89127f [id=b8168c5ff40940f4ad3d544513810e9b]) successfully deleted
W20260318 02:51:45.004443 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 75c4ba372960496880405e5dffe11d60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75c4ba372960496880405e5dffe11d60 already in progress: creating tablet
W20260318 02:51:45.004638 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 5b1527c9ce014e819d03330486e8ef3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b1527c9ce014e819d03330486e8ef3b already in progress: creating tablet
W20260318 02:51:45.004830 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 407b6b2f451e43aaaba4f6cebb80fac7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 407b6b2f451e43aaaba4f6cebb80fac7 already in progress: creating tablet
I20260318 02:51:45.004966 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet ce82c595e30a4878be25be8eb3d30790 (table default.Table_cf5f0ff49fa24bf18b21a4ebbe45d2e4 [id=c532f0623efe4c3f8d9c90ae9c3d02c3]) successfully deleted
W20260318 02:51:45.005126 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f8e428b700044eaf9e360f74c751a206 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8e428b700044eaf9e360f74c751a206 already in progress: creating tablet
W20260318 02:51:45.005271 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 0f499c464eb14164a2df3abc2d4a47c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f499c464eb14164a2df3abc2d4a47c7 already in progress: creating tablet
W20260318 02:51:45.005424 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet fca751e8fa5e4098b33093766e80d933 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fca751e8fa5e4098b33093766e80d933 already in progress: creating tablet
W20260318 02:51:45.005697 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 443e6018aed94077a38aa80bafee7264 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 443e6018aed94077a38aa80bafee7264 already in progress: creating tablet
I20260318 02:51:45.010224 2646 tablet.cc:1723] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260318 02:51:45.018139 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 52a1ec507b8543b0b346a24aa2c0f476 (DEFAULT_TABLE table=default.Table_a875cf0d4d504b64b3a2a6dc15fc6416 [id=51e082f0a0574ec8a6c816f26c9b5f18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.018882 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a1ec507b8543b0b346a24aa2c0f476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.019227 2614 raft_consensus.cc:493] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.019413 2614 raft_consensus.cc:515] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.020476 2614 leader_election.cc:290] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:44.992107 906 tablet_service.cc:1511] Processing CreateTablet for tablet df624ec8df244dee85edc443dba4cd05 (DEFAULT_TABLE table=default.Table_350a0da6de9147aeb8ec20a8d661d892 [id=0ed2d0832bb64404a48bc0889bd3d776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.017434 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "498f592fa2fb46748f7752004780fe46" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:45.023801 1174 tablet_bootstrap.cc:492] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
W20260318 02:51:45.024060 418 external_mini_cluster.cc:1715] Unable to check leaks on /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu pid 1280: Timed out: CheckLeaks RPC to 127.0.104.188:41593 timed out after 1.000s (SENT)
I20260318 02:51:45.024200 418 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu with pid 1280
I20260318 02:51:45.025866 1174 ts_tablet_manager.cc:1403] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.208s user 0.012s sys 0.007s
W20260318 02:51:45.026713 719 leader_election.cc:343] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.027534 2593 raft_consensus.cc:493] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.027697 2593 raft_consensus.cc:515] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.028347 2593 leader_election.cc:290] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:45.029589 860 leader_election.cc:343] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: c7c4257a54d3487aa520531a64fc721c
W20260318 02:51:45.033951 862 leader_election.cc:343] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: c7c4257a54d3487aa520531a64fc721c
I20260318 02:51:45.034102 862 leader_election.cc:304] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:45.034619 2593 raft_consensus.cc:2749] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.035822 892 tablet_service.cc:1511] Processing CreateTablet for tablet 558073d59dcf4fc5b4bfd1d9685415a1 (DEFAULT_TABLE table=default.Table_4822eac87bd94e139cf4b94ab7edede3 [id=1ce74e7050e2445c857e4737077342e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.035845 900 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1281a1ef494b159f302098ca0bb59c (DEFAULT_TABLE table=default.Table_7bcf13e9740d4c79a280135b653670e1 [id=103b78ad09324b379fe1c05cd79f0fc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.041138 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_85adec1c70d14a57bfcf04d35aaeb2ee" } new_table_name: "default.Table_bfec8e8db9bb48238ec29bccd4a19f26" modify_external_catalogs: true
I20260318 02:51:45.042317 455 catalog_manager.cc:5671] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a903d876086423b8016d705b98895ad (127.0.104.129). New cstate: current_term: 1 leader_uuid: "6a903d876086423b8016d705b98895ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:45.042546 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c8c62b5fb5124c57bde7d7daa0fc61cf" } new_table_name: "default.Table_cc875a4d2a5e4e44a20992083e030f24" modify_external_catalogs: true
I20260318 02:51:45.042697 455 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet d7f21df58fac437da5747becfa3f28b4 (table default.Table_357b13fa64234ab49f2349df67f8a0e2 [id=48b004d4295f40f0ac9ff77d7bb31720]). Expected version 3 got 0
I20260318 02:51:45.045816 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169f97b2320e4a5baae1dec29a1c7c36" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:45.045367 1173 tablet_bootstrap.cc:492] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:45.000279 1172 raft_consensus.cc:359] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.046941 1172 raft_consensus.cc:385] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.048921 1173 ts_tablet_manager.cc:1403] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.160s user 0.009s sys 0.005s
I20260318 02:51:45.046416 1174 raft_consensus.cc:359] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.051327 2659 tablet.cc:1723] T 6f8b5120633e4e0d8964f17d6d5f316d P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:45.049679 1172 raft_consensus.cc:740] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.051738 1174 raft_consensus.cc:385] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.054490 2663 tablet.cc:1723] T 3868406102b748a5b13420b24bf16485 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260318 02:51:45.054643 1174 raft_consensus.cc:740] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.055280 2593 raft_consensus.cc:493] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.055420 2593 raft_consensus.cc:515] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.056037 2593 leader_election.cc:290] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:45.055541 1174 consensus_queue.cc:260] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:45.057022 860 leader_election.cc:343] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 41646d513e834600a209761392ac7fb1
I20260318 02:51:45.057511 1174 ts_tablet_manager.cc:1434] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.031s user 0.003s sys 0.002s
I20260318 02:51:45.061317 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 152e06b85e044909a7bf7fcad9f215b9 (DEFAULT_TABLE table=default.Table_b5b721ed331a4c519ab844bceff17911 [id=793c4cca22c54b17b982bc4ca3b1f78d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.062147 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 152e06b85e044909a7bf7fcad9f215b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.065428 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 558073d59dcf4fc5b4bfd1d9685415a1 (DEFAULT_TABLE table=default.Table_4822eac87bd94e139cf4b94ab7edede3 [id=1ce74e7050e2445c857e4737077342e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.071245 1172 consensus_queue.cc:260] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.072538 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1281a1ef494b159f302098ca0bb59c (DEFAULT_TABLE table=default.Table_7bcf13e9740d4c79a280135b653670e1 [id=103b78ad09324b379fe1c05cd79f0fc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.075881 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8960a5cf6bf54d6d8dd7cd71fd131e04" } modify_external_catalogs: true
I20260318 02:51:45.076099 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8960a5cf6bf54d6d8dd7cd71fd131e04" } modify_external_catalogs: true
I20260318 02:51:45.076165 1173 raft_consensus.cc:359] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.076879 1173 raft_consensus.cc:385] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.077100 1173 raft_consensus.cc:740] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.077672 1173 consensus_queue.cc:260] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.079136 1173 ts_tablet_manager.cc:1434] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.029s user 0.000s sys 0.003s
I20260318 02:51:45.080056 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 558073d59dcf4fc5b4bfd1d9685415a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.081564 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c6570ad948c4c049bc3931a0440941e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.083194 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1281a1ef494b159f302098ca0bb59c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.083357 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a15228cf9661443188ba598f53d2dbdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.084173 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df624ec8df244dee85edc443dba4cd05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.088594 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 152e06b85e044909a7bf7fcad9f215b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.090251 1175 ts_tablet_manager.cc:1929] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.090354 1175 log.cc:1199] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/2882569524e74a308e9fabf533a8a87c
I20260318 02:51:45.090629 1175 ts_tablet_manager.cc:1950] T 2882569524e74a308e9fabf533a8a87c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:45.090837 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295ac73a106e4a7e87d001a79f80cb99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.095057 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ab4c332a824a29b0b6c0fbd449e1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.096410 759 tablet_service.cc:1511] Processing CreateTablet for tablet 44dbf7e728f54b49b884d32d9e12aa72 (DEFAULT_TABLE table=default.Table_8de5959d46654370a20f284e22d05049 [id=bae69a46bcd54bb784c2e53cb33cb9a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.096975 749 tablet_service.cc:1511] Processing CreateTablet for tablet ee1e0887692e412a89834e5c146fe72b (DEFAULT_TABLE table=default.Table_cfd0d4de76d7477491c09d9212370fc2 [id=3d6dc1d849014edcb278242033bb7faf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.097352 754 tablet_service.cc:1511] Processing CreateTablet for tablet a15228cf9661443188ba598f53d2dbdf (DEFAULT_TABLE table=default.Table_0877f95d5a2c42d199d4563969d06c2e [id=87916f24740d43d190991a8e9953e4b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.097569 765 tablet_service.cc:1511] Processing CreateTablet for tablet 295ac73a106e4a7e87d001a79f80cb99 (DEFAULT_TABLE table=default.Table_3728303752c24f76b34471c6dea7725c [id=6ace0239e3b74faa8e8a4ec2601ea7ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.097633 758 tablet_service.cc:1511] Processing CreateTablet for tablet 52a1ec507b8543b0b346a24aa2c0f476 (DEFAULT_TABLE table=default.Table_a875cf0d4d504b64b3a2a6dc15fc6416 [id=51e082f0a0574ec8a6c816f26c9b5f18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.096975 748 tablet_service.cc:1511] Processing CreateTablet for tablet 369e952736e44a92a242b2b5cfa29074 (DEFAULT_TABLE table=default.Table_0d2858909c654b5c9566dab7b33da1c3 [id=22c01966e3224406b3e3c039991da3c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.098024 761 tablet_service.cc:1511] Processing CreateTablet for tablet 31ab4c332a824a29b0b6c0fbd449e1c9 (DEFAULT_TABLE table=default.Table_5e53f15adf3f483f892dd81b106bbe56 [id=5fd90558747546eca3bf439dbcdc40aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.098464 762 tablet_service.cc:1511] Processing CreateTablet for tablet 6c6570ad948c4c049bc3931a0440941e (DEFAULT_TABLE table=default.Table_e31a9cb72cdc4e19801984222e014d7e [id=cabcfba8a21a423485f20671266feb59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.098917 756 tablet_service.cc:1511] Processing CreateTablet for tablet 152e06b85e044909a7bf7fcad9f215b9 (DEFAULT_TABLE table=default.Table_b5b721ed331a4c519ab844bceff17911 [id=793c4cca22c54b17b982bc4ca3b1f78d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.099484 750 tablet_service.cc:1511] Processing CreateTablet for tablet 558073d59dcf4fc5b4bfd1d9685415a1 (DEFAULT_TABLE table=default.Table_4822eac87bd94e139cf4b94ab7edede3 [id=1ce74e7050e2445c857e4737077342e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.099558 766 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1281a1ef494b159f302098ca0bb59c (DEFAULT_TABLE table=default.Table_7bcf13e9740d4c79a280135b653670e1 [id=103b78ad09324b379fe1c05cd79f0fc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.099797 753 tablet_service.cc:1511] Processing CreateTablet for tablet df624ec8df244dee85edc443dba4cd05 (DEFAULT_TABLE table=default.Table_350a0da6de9147aeb8ec20a8d661d892 [id=0ed2d0832bb64404a48bc0889bd3d776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.106397 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 558073d59dcf4fc5b4bfd1d9685415a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.113523 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a340f8a14a61411eb0cac18278e5715d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:45.114148 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a340f8a14a61411eb0cac18278e5715d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:45.115563 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8845dbc4ad3a499bb77aa9b6e24b554d consensus state has no leader
I20260318 02:51:45.116000 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ef3fc2e773ac4783a799b73a979a0bcb" } modify_external_catalogs: true
I20260318 02:51:45.116176 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ef3fc2e773ac4783a799b73a979a0bcb" } modify_external_catalogs: true
I20260318 02:51:45.117720 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_cee83ff8473e40bfad11b5345c1d1e02"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:45.118273 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cee83ff8473e40bfad11b5345c1d1e02 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:45.119309 1174 tablet_bootstrap.cc:492] T d8b956e389134a4485434a819a5df2e7 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:45.119614 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet a2b8723a0d354f248ffe4cd2ef5a21dc
W20260318 02:51:45.120111 862 leader_election.cc:343] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 41646d513e834600a209761392ac7fb1
I20260318 02:51:45.120247 862 leader_election.cc:304] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:45.120262 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4aebf277fe2649d19839dab3d49e8862" } modify_external_catalogs: true
I20260318 02:51:45.120370 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4aebf277fe2649d19839dab3d49e8862" } modify_external_catalogs: true
I20260318 02:51:45.120877 2664 raft_consensus.cc:2749] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:45.072919 997 leader_election.cc:343] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.121320 763 tablet_service.cc:1558] Processing DeleteTablet for tablet a2b8723a0d354f248ffe4cd2ef5a21dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:45.121587 997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 48718.6us
I20260318 02:51:45.121445 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 3f1a75b4559440c1bf38d4ae0c52d4e5
I20260318 02:51:45.122262 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bfe33a0aadc84b8e83a5de13322a445a" } new_table_name: "default.Table_0504d91e59e546d7b74a5d14f9323f90" modify_external_catalogs: true
I20260318 02:51:45.122565 2605 raft_consensus.cc:493] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.122689 2605 raft_consensus.cc:515] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.121452 1172 ts_tablet_manager.cc:1434] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.257s user 0.004s sys 0.000s
I20260318 02:51:45.124105 763 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f1a75b4559440c1bf38d4ae0c52d4e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:45.126784 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee1e0887692e412a89834e5c146fe72b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:45.129673 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet a2b8723a0d354f248ffe4cd2ef5a21dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2b8723a0d354f248ffe4cd2ef5a21dc already in progress: creating tablet
I20260318 02:51:45.129809 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a15228cf9661443188ba598f53d2dbdf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:45.130151 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 3f1a75b4559440c1bf38d4ae0c52d4e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f1a75b4559440c1bf38d4ae0c52d4e5 already in progress: creating tablet
I20260318 02:51:45.132927 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a1ec507b8543b0b346a24aa2c0f476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.136270 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 369e952736e44a92a242b2b5cfa29074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.139248 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1281a1ef494b159f302098ca0bb59c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.139359 2605 leader_election.cc:290] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:45.139698 1172 tablet_bootstrap.cc:492] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:45.140956 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 558073d59dcf4fc5b4bfd1d9685415a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.141381 1184 ts_tablet_manager.cc:1929] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.141476 1184 log.cc:1199] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/b8973d8930ef4b65be7b4ff990bf9d72
I20260318 02:51:45.142455 1184 ts_tablet_manager.cc:1950] T b8973d8930ef4b65be7b4ff990bf9d72 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:45.145157 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df624ec8df244dee85edc443dba4cd05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.145310 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1131) took 4450 ms. Trace:
I20260318 02:51:45.145395 1184 rpcz_store.cc:276] 0318 02:51:40.695169 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.695220 (+ 51us) service_pool.cc:225] Handling call
0318 02:51:44.803330 (+4108110us) ts_tablet_manager.cc:1151] Deleting tablet b8973d8930ef4b65be7b4ff990bf9d72
0318 02:51:44.803340 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:44.807271 (+ 3931us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:45.141278 (+334007us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:45.145284 (+ 4006us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4107958}
I20260318 02:51:45.145689 1184 tablet_replica.cc:333] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:45.145756 1172 tablet_bootstrap.cc:654] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.145849 1184 raft_consensus.cc:2243] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.146009 1184 raft_consensus.cc:2272] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.146457 1184 ts_tablet_manager.cc:1916] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.148934 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44dbf7e728f54b49b884d32d9e12aa72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.152968 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295ac73a106e4a7e87d001a79f80cb99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.153167 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 152e06b85e044909a7bf7fcad9f215b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.156927 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1281a1ef494b159f302098ca0bb59c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.160935 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c6570ad948c4c049bc3931a0440941e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.164672 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ab4c332a824a29b0b6c0fbd449e1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.166668 1184 ts_tablet_manager.cc:1929] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.166787 1184 log.cc:1199] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/de2bc2f79e8b49248de3e7eca1a600cf
I20260318 02:51:45.175992 1184 ts_tablet_manager.cc:1950] T de2bc2f79e8b49248de3e7eca1a600cf P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:45.177392 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1132) took 4481 ms. Trace:
I20260318 02:51:45.177505 1184 rpcz_store.cc:276] 0318 02:51:40.695475 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.695509 (+ 34us) service_pool.cc:225] Handling call
0318 02:51:45.145645 (+4450136us) ts_tablet_manager.cc:1151] Deleting tablet de2bc2f79e8b49248de3e7eca1a600cf
0318 02:51:45.145656 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.156231 (+ 10575us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:45.166558 (+ 10327us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:45.177363 (+ 10805us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4450028}
I20260318 02:51:45.177850 1184 tablet_replica.cc:333] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:45.178606 1184 raft_consensus.cc:2243] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.178800 1184 raft_consensus.cc:2272] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.178891 1172 tablet_bootstrap.cc:492] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:45.179019 1172 ts_tablet_manager.cc:1403] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.007s
I20260318 02:51:45.181085 1184 ts_tablet_manager.cc:1916] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.188287 902 tablet_service.cc:1558] Processing DeleteTablet for tablet a2b8723a0d354f248ffe4cd2ef5a21dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:45.189055 902 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f1a75b4559440c1bf38d4ae0c52d4e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:45.191781 1172 raft_consensus.cc:359] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.191995 1172 raft_consensus.cc:385] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.192046 1172 raft_consensus.cc:740] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.192235 1172 consensus_queue.cc:260] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.192786 1172 ts_tablet_manager.cc:1434] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260318 02:51:45.193120 1172 tablet_bootstrap.cc:492] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:45.196100 1172 tablet_bootstrap.cc:654] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:45.197197 999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.129:46711, user_credentials={real_user=slave}} blocked reactor thread for 194468us
W20260318 02:51:45.209115 999 leader_election.cc:343] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 9777963ff20c4a799de2870555f6b335
I20260318 02:51:45.209336 999 leader_election.cc:304] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:45.208832 2662 consensus_queue.cc:1048] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260318 02:51:45.216511 2662 raft_consensus.cc:2749] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.224121 1184 ts_tablet_manager.cc:1929] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.228680 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169f97b2320e4a5baae1dec29a1c7c36" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:45.228946 777 raft_consensus.cc:2468] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:45.230682 449 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_a08fb7078dfc4ab9b85ef5701d3a9e33 [id=a7ad61d6d9264ec4ac482798b1ea992e] alter complete (version 4)
I20260318 02:51:45.231211 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d3e615cf324a48f79eda58efbfeff3cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:45.231851 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3e615cf324a48f79eda58efbfeff3cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:45.237617 1174 tablet_bootstrap.cc:654] T d8b956e389134a4485434a819a5df2e7 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.238622 926 raft_consensus.cc:3060] T a9c60ef260d049bea4ce729316a0d09f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:45.247877 2648 tablet.cc:1723] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260318 02:51:45.248627 1173 tablet_bootstrap.cc:492] T 8a0af3aecf4f485ebc54e1955eca8c92 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:45.249538 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a1f37d4a907249fe82f19779b0ae59a9 consensus state has no leader
I20260318 02:51:45.250059 1173 tablet_bootstrap.cc:654] T 8a0af3aecf4f485ebc54e1955eca8c92 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.253234 455 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 6f8b5120633e4e0d8964f17d6d5f316d (table default.Table_ba6394a91baa4e3889ba7a14f2287aab [id=779018c836a14c518c02a844331ce251]). Expected version 1 got 0
I20260318 02:51:45.254304 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9455e17b8cb64e84b9157279c6fa159d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:45.254899 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9455e17b8cb64e84b9157279c6fa159d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:45.255656 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 64df878a137b470e9383be7f458999b3 consensus state has no leader
I20260318 02:51:45.256028 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_50dae330cd4440048412c7f6dfd40332"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:45.256609 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50dae330cd4440048412c7f6dfd40332 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:45.256647 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet b8973d8930ef4b65be7b4ff990bf9d72 (table default.Table_9f269c4844cc473580c4743dd9be3dea [id=997461446ec8473382964afdb61aafb3]) successfully deleted
I20260318 02:51:45.257251 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8d21c7fe2d1845128785f018e728aa03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:45.257692 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d21c7fe2d1845128785f018e728aa03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:45.258291 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f96013c844414fd28c35724a6160ee81
I20260318 02:51:45.259119 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8cbba3ff6714425fa1c800098813892d" } new_table_name: "default.Table_e46ead2403a84f55a7454fe532d2502f" modify_external_catalogs: true
I20260318 02:51:45.260814 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ab2009980b7a4c2b8101098211fba4a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:45.261281 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab2009980b7a4c2b8101098211fba4a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:45.261775 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9ca21ac13205419783d815c62d54e5d3 consensus state has no leader
I20260318 02:51:45.261966 448 master_service.cc:954] ReplaceTablet: received request to replace tablet ebfb14850afa4043848814f01eabf394 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:45.267665 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet de2bc2f79e8b49248de3e7eca1a600cf (table default.Table_28ea1894a58c438785ae9e4b8b414447 [id=b71fc31bca0a449296c3e0a0b8ceb6e6]) successfully deleted
I20260318 02:51:45.269224 1174 tablet_bootstrap.cc:492] T d8b956e389134a4485434a819a5df2e7 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:45.269349 1174 ts_tablet_manager.cc:1403] T d8b956e389134a4485434a819a5df2e7 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.150s user 0.003s sys 0.000s
I20260318 02:51:45.269846 892 tablet_service.cc:1558] Processing DeleteTablet for tablet f96013c844414fd28c35724a6160ee81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:45 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:45.250991 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "498f592fa2fb46748f7752004780fe46" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:45.270059 1174 raft_consensus.cc:359] T d8b956e389134a4485434a819a5df2e7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.270221 1174 raft_consensus.cc:385] T d8b956e389134a4485434a819a5df2e7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.270262 1174 raft_consensus.cc:740] T d8b956e389134a4485434a819a5df2e7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.254109 999 leader_election.cc:304] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:45.266865 2665 raft_consensus.cc:493] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.270435 1174 consensus_queue.cc:260] T d8b956e389134a4485434a819a5df2e7 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.270514 2665 raft_consensus.cc:515] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.270888 1174 ts_tablet_manager.cc:1434] T d8b956e389134a4485434a819a5df2e7 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260318 02:51:45.270989 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aeb492564a94a569f70506712dad4ed" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:45.271077 2665 leader_election.cc:290] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:45.271461 2665 raft_consensus.cc:2804] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:45.271531 2665 raft_consensus.cc:493] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:45.271589 2665 raft_consensus.cc:3060] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:45.274199 2665 raft_consensus.cc:515] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.274740 2665 leader_election.cc:290] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:45.275480 1174 tablet_bootstrap.cc:492] T fd1284c6e90d4beb8223fd807d7888ec P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:45.276230 999 consensus_peers.cc:597] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d -> Peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Couldn't send request to peer 6a903d876086423b8016d705b98895ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 184ce58aa96d4e70ad7b2783f19ccdeb. This is attempt 1: this message will repeat every 5th retry.
W20260318 02:51:45.277597 999 leader_election.cc:343] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 9aeb492564a94a569f70506712dad4ed
I20260318 02:51:45.280325 1184 log.cc:1199] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/9aeb492564a94a569f70506712dad4ed
W20260318 02:51:45.281118 719 leader_election.cc:343] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.281240 719 leader_election.cc:304] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:45.280642 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet a2b8723a0d354f248ffe4cd2ef5a21dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:45.282451 449 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet a9c60ef260d049bea4ce729316a0d09f (table default.Table_d5ddb641ef9245ca92ab35d8ac25b157 [id=fb45f238426142faa79cbe89242c7418]). Expected version 1 got 0
I20260318 02:51:45.282933 1184 ts_tablet_manager.cc:1950] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:45.283411 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1134) took 4587 ms. Trace:
I20260318 02:51:45.283485 1184 rpcz_store.cc:276] 0318 02:51:40.696191 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.696228 (+ 37us) service_pool.cc:225] Handling call
0318 02:51:45.177797 (+4481569us) ts_tablet_manager.cc:1151] Deleting tablet 9aeb492564a94a569f70506712dad4ed
0318 02:51:45.177808 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.221075 (+ 43267us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:45.224002 (+ 2927us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:45.283393 (+ 59391us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4481430}
I20260318 02:51:45.283968 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f1a75b4559440c1bf38d4ae0c52d4e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:44 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:45.283969 2467 raft_consensus.cc:2749] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.285081 1174 tablet_bootstrap.cc:654] T fd1284c6e90d4beb8223fd807d7888ec P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.285573 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169f97b2320e4a5baae1dec29a1c7c36" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:45.285737 782 raft_consensus.cc:3060] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:45.285822 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet f96013c844414fd28c35724a6160ee81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:45 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:45.286695 999 leader_election.cc:343] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 4df7d75e696a4aec981de3963c282b0d
I20260318 02:51:45.287283 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "169f97b2320e4a5baae1dec29a1c7c36" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:45.288403 782 raft_consensus.cc:2468] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:45.292050 999 leader_election.cc:304] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:45.299495 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1127) took 4605 ms. Trace:
I20260318 02:51:45.300088 449 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet a9c60ef260d049bea4ce729316a0d09f (table default.Table_d5ddb641ef9245ca92ab35d8ac25b157 [id=fb45f238426142faa79cbe89242c7418]). Expected version 1 got 0
I20260318 02:51:45.300374 758 tablet_service.cc:1558] Processing DeleteTablet for tablet f96013c844414fd28c35724a6160ee81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:45 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:45.300828 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4df7d75e696a4aec981de3963c282b0d" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:45.299794 2494 raft_consensus.cc:2804] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:45.302022 2494 raft_consensus.cc:697] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:45.302276 2494 consensus_queue.cc:237] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.303516 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1202) took 1396 ms. Trace:
I20260318 02:51:45.303736 1175 rpcz_store.cc:276] 0318 02:51:43.907105 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.907532 (+ 427us) service_pool.cc:225] Handling call
0318 02:51:44.946554 (+1039022us) ts_tablet_manager.cc:1151] Deleting tablet 2882569524e74a308e9fabf533a8a87c
0318 02:51:44.946561 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.087590 (+141029us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:45.090178 (+ 2588us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:45.303473 (+213295us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":991909}
I20260318 02:51:45.304685 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1206) took 1298 ms. Trace:
I20260318 02:51:45.304915 1175 rpcz_store.cc:276] 0318 02:51:44.005732 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.006177 (+ 445us) service_pool.cc:225] Handling call
0318 02:51:45.304459 (+1298282us) ts_tablet_manager.cc:1151] Deleting tablet 1be09e67b9d94e669f28a7cd236b48a4
0318 02:51:45.304493 (+ 34us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.304642 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1298029}
I20260318 02:51:45.305830 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1214) took 1196 ms. Trace:
I20260318 02:51:45.306030 1175 rpcz_store.cc:276] 0318 02:51:44.109012 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.109081 (+ 69us) service_pool.cc:225] Handling call
0318 02:51:45.305620 (+1196539us) ts_tablet_manager.cc:1151] Deleting tablet aa12fe852965419ab1803049e416c780
0318 02:51:45.305632 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.305786 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1196262}
I20260318 02:51:45.307108 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1215) took 1197 ms. Trace:
I20260318 02:51:45.307351 1175 rpcz_store.cc:276] 0318 02:51:44.109125 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.109177 (+ 52us) service_pool.cc:225] Handling call
0318 02:51:45.306888 (+1197711us) ts_tablet_manager.cc:1151] Deleting tablet 33d90a619ae54227aaf95acd180af119
0318 02:51:45.306900 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.307083 (+ 183us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1197405}
I20260318 02:51:45.308408 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1213) took 1199 ms. Trace:
I20260318 02:51:45.308652 1175 rpcz_store.cc:276] 0318 02:51:44.108927 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.110234 (+ 1307us) service_pool.cc:225] Handling call
0318 02:51:45.308191 (+1197957us) ts_tablet_manager.cc:1151] Deleting tablet 7253dcb3d73c4297bf444defd3ef6e74
0318 02:51:45.308204 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.308384 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1197767}
I20260318 02:51:45.309351 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1212) took 1200 ms. Trace:
I20260318 02:51:45.309490 1175 rpcz_store.cc:276] 0318 02:51:44.108813 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.139407 (+ 30594us) service_pool.cc:225] Handling call
0318 02:51:45.309237 (+1169830us) ts_tablet_manager.cc:1151] Deleting tablet 4052eede3f404b84ac27e21a204bf5a9
0318 02:51:45.309247 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.309335 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1168884}
I20260318 02:51:45.310009 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1217) took 1141 ms. Trace:
I20260318 02:51:45.310151 1175 rpcz_store.cc:276] 0318 02:51:44.168509 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.168560 (+ 51us) service_pool.cc:225] Handling call
0318 02:51:45.309904 (+1141344us) ts_tablet_manager.cc:1151] Deleting tablet ffa9d9dcc70e402099b414029f062d6e
0318 02:51:45.309915 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.309995 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1141143}
I20260318 02:51:45.310614 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1216) took 1143 ms. Trace:
I20260318 02:51:45.310734 1175 rpcz_store.cc:276] 0318 02:51:44.167644 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.170421 (+ 2777us) service_pool.cc:225] Handling call
0318 02:51:45.310516 (+1140095us) ts_tablet_manager.cc:1151] Deleting tablet 036c17d033b145a681843d14f67ab575
0318 02:51:45.310526 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.310600 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1139832}
I20260318 02:51:45.311759 1175 tablet_replica.cc:333] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:45.312038 1175 raft_consensus.cc:2243] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.312268 1175 raft_consensus.cc:2272] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.312907 1175 ts_tablet_manager.cc:1916] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:45.300328 997 consensus_peers.cc:597] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:45.316301 1184 rpcz_store.cc:276] 0318 02:51:40.694529 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.696762 (+ 2233us) service_pool.cc:225] Handling call
0318 02:51:45.299340 (+4602578us) ts_tablet_manager.cc:1151] Deleting tablet 9ca9bad2b9aa4a41bb7801da61cd0d16
0318 02:51:45.299352 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.299468 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4602445}
I20260318 02:51:45.335002 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1128) took 4640 ms. Trace:
W20260318 02:51:45.334386 997 leader_election.cc:343] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.336755 997 leader_election.cc:304] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:45.337036 997 raft_consensus.cc:2686] T 9aeb492564a94a569f70506712dad4ed P 9422bb7011f342b08be0b073a88c4c4d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260318 02:51:45.336069 1184 rpcz_store.cc:276] 0318 02:51:40.694647 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.696914 (+ 2267us) service_pool.cc:225] Handling call
0318 02:51:45.334847 (+4637933us) ts_tablet_manager.cc:1151] Deleting tablet e993481bf55747b0a6a1c996c6917408
0318 02:51:45.334859 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.334979 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4637807}
I20260318 02:51:45.338330 1184 tablet_replica.cc:333] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:45.341732 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 2882569524e74a308e9fabf533a8a87c (table default.Table_28a12ac7769744d1ba2c07c2b335e41e [id=a2aa1e87cbae4de99a4d6ba96b5ec04d]) successfully deleted
W20260318 02:51:45.342010 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 1be09e67b9d94e669f28a7cd236b48a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1be09e67b9d94e669f28a7cd236b48a4 already in progress: creating tablet
W20260318 02:51:45.342211 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet aa12fe852965419ab1803049e416c780 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aa12fe852965419ab1803049e416c780 already in progress: creating tablet
W20260318 02:51:45.342378 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 33d90a619ae54227aaf95acd180af119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33d90a619ae54227aaf95acd180af119 already in progress: creating tablet
W20260318 02:51:45.342548 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 7253dcb3d73c4297bf444defd3ef6e74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7253dcb3d73c4297bf444defd3ef6e74 already in progress: creating tablet
W20260318 02:51:45.342681 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 4052eede3f404b84ac27e21a204bf5a9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4052eede3f404b84ac27e21a204bf5a9 already in progress: creating tablet
W20260318 02:51:45.342823 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet ffa9d9dcc70e402099b414029f062d6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffa9d9dcc70e402099b414029f062d6e already in progress: creating tablet
W20260318 02:51:45.342959 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 036c17d033b145a681843d14f67ab575 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 036c17d033b145a681843d14f67ab575 already in progress: creating tablet
W20260318 02:51:45.343111 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 495c8ace1cdb4741aa2ffa1f85dfb25e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 495c8ace1cdb4741aa2ffa1f85dfb25e already in progress: creating tablet
W20260318 02:51:45.343263 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2b818b2d7f194db2bbd0cc4ad837fb00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b818b2d7f194db2bbd0cc4ad837fb00 already in progress: creating tablet
W20260318 02:51:45.343400 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 0abb9045d6394fd4a9e294269387dfc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0abb9045d6394fd4a9e294269387dfc9 already in progress: creating tablet
I20260318 02:51:45.343621 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 9aeb492564a94a569f70506712dad4ed (table default.Table_f664e51423be4580b3ebf91d14e66886 [id=f0a505a78b8e4ea695e1c3da2f9a0e80]) successfully deleted
I20260318 02:51:45.344300 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ab6108d8e1194517983dd8a515a08eb7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:45.347467 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3788aa65127c4272ab53ae531d8db638" } new_table_name: "default.Table_c63455064fda45b6a964b45792b04c48" modify_external_catalogs: true
I20260318 02:51:45.350536 1184 raft_consensus.cc:2243] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.352026 1184 raft_consensus.cc:2272] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.324772 897 tablet_service.cc:1558] Processing DeleteTablet for tablet a6f42462ed9c49c797f5115b3ca6c423 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:45.355329 997 leader_election.cc:343] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.324981 905 tablet_service.cc:1558] Processing DeleteTablet for tablet c7c4257a54d3487aa520531a64fc721c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:24 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:45.345425 1173 tablet_bootstrap.cc:492] T 8a0af3aecf4f485ebc54e1955eca8c92 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:45.356648 1173 ts_tablet_manager.cc:1403] T 8a0af3aecf4f485ebc54e1955eca8c92 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.108s user 0.003s sys 0.000s
I20260318 02:51:45.357499 1173 raft_consensus.cc:359] T 8a0af3aecf4f485ebc54e1955eca8c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.357951 1173 raft_consensus.cc:385] T 8a0af3aecf4f485ebc54e1955eca8c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.358067 1173 raft_consensus.cc:740] T 8a0af3aecf4f485ebc54e1955eca8c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.357700 1184 ts_tablet_manager.cc:1916] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.358371 1173 consensus_queue.cc:260] T 8a0af3aecf4f485ebc54e1955eca8c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:45.358749 997 leader_election.cc:343] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.359587 997 leader_election.cc:304] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:45.360394 1173 ts_tablet_manager.cc:1434] T 8a0af3aecf4f485ebc54e1955eca8c92 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260318 02:51:45.360842 1173 tablet_bootstrap.cc:492] T c0c33cfa1c194a65bfc64d0e1e9434ff P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:45.361306 2605 raft_consensus.cc:2749] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.362370 1173 tablet_bootstrap.cc:654] T c0c33cfa1c194a65bfc64d0e1e9434ff P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:45.367226 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab6108d8e1194517983dd8a515a08eb7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:45.301134 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f96013c844414fd28c35724a6160ee81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f96013c844414fd28c35724a6160ee81 already in progress: creating tablet
W20260318 02:51:45.370560 443 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.104.129:46711, user_credentials={real_user=slave}} blocked reactor thread for 69435.6us
I20260318 02:51:45.373857 1174 tablet_bootstrap.cc:492] T fd1284c6e90d4beb8223fd807d7888ec P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:45.374030 1174 ts_tablet_manager.cc:1403] T fd1284c6e90d4beb8223fd807d7888ec P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.103s user 0.018s sys 0.012s
I20260318 02:51:45.374861 1174 raft_consensus.cc:359] T fd1284c6e90d4beb8223fd807d7888ec P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.375039 1174 raft_consensus.cc:385] T fd1284c6e90d4beb8223fd807d7888ec P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.375100 1174 raft_consensus.cc:740] T fd1284c6e90d4beb8223fd807d7888ec P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.375306 1174 consensus_queue.cc:260] T fd1284c6e90d4beb8223fd807d7888ec P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.375834 1174 ts_tablet_manager.cc:1434] T fd1284c6e90d4beb8223fd807d7888ec P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:45.378748 1174 tablet_bootstrap.cc:492] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:45.380494 1174 tablet_bootstrap.cc:654] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:45.390456 444 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 64df878a137b470e9383be7f458999b3 (table default.Table_cc875a4d2a5e4e44a20992083e030f24 [id=1616784ba04e44a2817e92fe4f8d5810], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 64df878a137b470e9383be7f458999b3 consensus state has no leader
I20260318 02:51:45.391681 1174 tablet_bootstrap.cc:492] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
W20260318 02:51:45.398447 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 9ca9bad2b9aa4a41bb7801da61cd0d16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9ca9bad2b9aa4a41bb7801da61cd0d16 already in progress: creating tablet
I20260318 02:51:45.400902 781 raft_consensus.cc:1275] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Refusing update from remote peer 9422bb7011f342b08be0b073a88c4c4d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:45.401888 2662 consensus_queue.cc:1048] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:45.411854 1175 ts_tablet_manager.cc:1929] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.411998 1175 log.cc:1199] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/254b8722e7ff4ccabc6d16f04daf85aa
I20260318 02:51:45.412281 1175 ts_tablet_manager.cc:1950] T 254b8722e7ff4ccabc6d16f04daf85aa P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:45.426293 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_17f53305fd994cdea1582a7b180c3a23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:45.427522 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c62cd6e64e5246adb82d1804cd0a02a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:45.428100 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c62cd6e64e5246adb82d1804cd0a02a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:45.429177 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2cfd06c2ef384e81a1cbde18678a8737" } modify_external_catalogs: true
I20260318 02:51:45.429348 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2cfd06c2ef384e81a1cbde18678a8737" } modify_external_catalogs: true
I20260318 02:51:45.430245 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3c8778ad1e5149aeafe6d2c059b95881" } modify_external_catalogs: true
I20260318 02:51:45.430408 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3c8778ad1e5149aeafe6d2c059b95881" } modify_external_catalogs: true
W20260318 02:51:45.431222 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17f53305fd994cdea1582a7b180c3a23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:45.434695 1173 tablet_bootstrap.cc:492] T c0c33cfa1c194a65bfc64d0e1e9434ff P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:45.434887 1173 ts_tablet_manager.cc:1403] T c0c33cfa1c194a65bfc64d0e1e9434ff P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.074s user 0.002s sys 0.000s
I20260318 02:51:45.440565 905 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a0af3aecf4f485ebc54e1955eca8c92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:45.442580 997 consensus_peers.cc:597] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:45.443456 1174 ts_tablet_manager.cc:1403] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.065s user 0.017s sys 0.009s
I20260318 02:51:45.444237 1174 raft_consensus.cc:359] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.444432 1174 raft_consensus.cc:385] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.444479 1174 raft_consensus.cc:740] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.444653 1174 consensus_queue.cc:260] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.445164 1174 ts_tablet_manager.cc:1434] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20260318 02:51:45.445458 1174 tablet_bootstrap.cc:492] T fb5d1d828899472e8f48723b35e94d62 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:45.446872 1174 tablet_bootstrap.cc:654] T fb5d1d828899472e8f48723b35e94d62 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.449388 1175 tablet_replica.cc:333] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:45.449640 1175 raft_consensus.cc:2243] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.449833 1175 raft_consensus.cc:2272] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.449664 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 254b8722e7ff4ccabc6d16f04daf85aa (table default.Table_c8066725c1a94b1f9e3a030be08a461d [id=d9f99876511c4cf294e3edbbfae441c0]) successfully deleted
I20260318 02:51:45.450418 2664 raft_consensus.cc:493] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.450454 1175 ts_tablet_manager.cc:1916] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.450548 2664 raft_consensus.cc:515] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.451175 2664 leader_election.cc:290] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:45.451192 1173 raft_consensus.cc:359] T c0c33cfa1c194a65bfc64d0e1e9434ff P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.451360 1173 raft_consensus.cc:385] T c0c33cfa1c194a65bfc64d0e1e9434ff P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.451403 1173 raft_consensus.cc:740] T c0c33cfa1c194a65bfc64d0e1e9434ff P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.451565 1173 consensus_queue.cc:260] T c0c33cfa1c194a65bfc64d0e1e9434ff P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.452028 1173 ts_tablet_manager.cc:1434] T c0c33cfa1c194a65bfc64d0e1e9434ff P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260318 02:51:45.452311 1173 tablet_bootstrap.cc:492] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:45.453670 1173 tablet_bootstrap.cc:654] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.454032 2593 raft_consensus.cc:493] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.454147 2593 raft_consensus.cc:515] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.454730 2593 leader_election.cc:290] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:45.457731 860 leader_election.cc:343] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: a0a6f4b34ff14714892ed9e9b3604dc9
W20260318 02:51:45.458591 860 leader_election.cc:343] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: a6f42462ed9c49c797f5115b3ca6c423
I20260318 02:51:45.459080 1184 ts_tablet_manager.cc:1929] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.459278 1184 log.cc:1199] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/5ff188f25ff146fab121ebfab1af8467
I20260318 02:51:45.459637 2494 raft_consensus.cc:493] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.459821 2494 raft_consensus.cc:515] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.460988 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aeffffd34f047eeaa9a8a5100c7aad2" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:45.461181 777 raft_consensus.cc:2468] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:45.462319 2646 tablet.cc:1723] T 7e6f40a5d3f14a779c26d73bf58f302b P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:45.463145 999 leader_election.cc:304] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:45.463471 2665 raft_consensus.cc:2804] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:45.463533 2665 raft_consensus.cc:493] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:45.463593 2665 raft_consensus.cc:3060] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:45.466351 2665 raft_consensus.cc:515] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.466981 2665 leader_election.cc:290] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:45.469933 1174 tablet_bootstrap.cc:492] T fb5d1d828899472e8f48723b35e94d62 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:45.470083 1174 ts_tablet_manager.cc:1403] T fb5d1d828899472e8f48723b35e94d62 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.001s
I20260318 02:51:45.471725 1175 ts_tablet_manager.cc:1929] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.471827 1175 log.cc:1199] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/41646d513e834600a209761392ac7fb1
I20260318 02:51:45.472070 1175 ts_tablet_manager.cc:1950] T 41646d513e834600a209761392ac7fb1 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:45.470825 1174 raft_consensus.cc:359] T fb5d1d828899472e8f48723b35e94d62 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.472496 1174 raft_consensus.cc:385] T fb5d1d828899472e8f48723b35e94d62 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.472566 1174 raft_consensus.cc:740] T fb5d1d828899472e8f48723b35e94d62 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.472862 1174 consensus_queue.cc:260] T fb5d1d828899472e8f48723b35e94d62 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.473402 1174 ts_tablet_manager.cc:1434] T fb5d1d828899472e8f48723b35e94d62 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260318 02:51:45.473693 1174 tablet_bootstrap.cc:492] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:45.474181 862 leader_election.cc:343] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: a6f42462ed9c49c797f5115b3ca6c423
I20260318 02:51:45.474298 862 leader_election.cc:304] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
W20260318 02:51:45.474678 862 leader_election.cc:343] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: a0a6f4b34ff14714892ed9e9b3604dc9
I20260318 02:51:45.474650 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aeffffd34f047eeaa9a8a5100c7aad2" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:45.474782 862 leader_election.cc:304] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:45.474821 782 raft_consensus.cc:3060] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:45.475149 1174 tablet_bootstrap.cc:654] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.475148 2664 raft_consensus.cc:2749] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.475298 2664 raft_consensus.cc:2749] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.476516 2648 tablet.cc:1723] T 7e6f40a5d3f14a779c26d73bf58f302b P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:45.477231 2494 leader_election.cc:290] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:45.477380 782 raft_consensus.cc:2468] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:45.478313 999 leader_election.cc:304] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:45.478710 2662 raft_consensus.cc:2804] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:45.478838 2662 raft_consensus.cc:697] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:45.479138 2662 consensus_queue.cc:237] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.487123 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aeffffd34f047eeaa9a8a5100c7aad2" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:45.488143 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aeffffd34f047eeaa9a8a5100c7aad2" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:45.497471 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ea1caf000264d6fa2a7b0bd0aa18062 consensus state has no leader
I20260318 02:51:45.498950 1173 tablet_bootstrap.cc:492] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:45.499096 1173 ts_tablet_manager.cc:1403] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.047s user 0.005s sys 0.001s
I20260318 02:51:45.499778 1173 raft_consensus.cc:359] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.499945 1173 raft_consensus.cc:385] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.499992 1173 raft_consensus.cc:740] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.500023 456 master_service.cc:954] ReplaceTablet: received request to replace tablet 59ce7583e7f545f18145b4e55e1fbb81 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:45.500218 1173 consensus_queue.cc:260] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.500674 1173 ts_tablet_manager.cc:1434] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:45.500651 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c31b6e1619f5437cadef729724fc2468" } new_table_name: "default.Table_1a7ca8bebd1e4c699fe6cb5563131736" modify_external_catalogs: true
I20260318 02:51:45.510198 1173 tablet_bootstrap.cc:492] T 2a3a36a7fd4742c9827b334ce31d4a7c P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:45.512452 1175 tablet_replica.cc:333] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:45.512825 1175 raft_consensus.cc:2243] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.513092 1175 raft_consensus.cc:2272] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.513757 1175 ts_tablet_manager.cc:1916] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.520843 449 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 9c05f7a75527410e9c5cde0dbc6bc10e (table default.Table_fed9534e8e3d410ab1775c885744cc2a [id=113b6b3abc1a4dcc91c49be4704a159c]). Expected version 2 got 0
I20260318 02:51:45.520987 1174 tablet_bootstrap.cc:492] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:45.521107 449 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 3aa05403966349ae9056777d913a0db6 (table default.Table_802a2d53f1c14a879d8737dad75f6252 [id=5b2e7b122a394e058dc5b2fd84a0f558]). Expected version 3 got 0
I20260318 02:51:45.521132 1174 ts_tablet_manager.cc:1403] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.020s
I20260318 02:51:45.521818 1174 raft_consensus.cc:359] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.522007 1174 raft_consensus.cc:385] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.522064 1174 raft_consensus.cc:740] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.522269 1174 consensus_queue.cc:260] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.522792 1174 ts_tablet_manager.cc:1434] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:45.523083 1174 tablet_bootstrap.cc:492] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:45.524399 1174 tablet_bootstrap.cc:654] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.529947 1174 tablet_bootstrap.cc:492] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:45.530095 1174 ts_tablet_manager.cc:1403] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20260318 02:51:45.530779 1174 raft_consensus.cc:359] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.530964 1174 raft_consensus.cc:385] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.531014 1174 raft_consensus.cc:740] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.531186 1174 consensus_queue.cc:260] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.531656 1174 ts_tablet_manager.cc:1434] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260318 02:51:45.531942 1174 tablet_bootstrap.cc:492] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:45.533567 1174 tablet_bootstrap.cc:654] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.535655 1062 raft_consensus.cc:1275] T d7f21df58fac437da5747becfa3f28b4 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Refusing update from remote peer 6a903d876086423b8016d705b98895ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260318 02:51:45.535924 719 consensus_peers.cc:597] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:45.536541 2467 consensus_queue.cc:1048] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:45.539436 1173 tablet_bootstrap.cc:654] T 2a3a36a7fd4742c9827b334ce31d4a7c P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.545118 449 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 3aa05403966349ae9056777d913a0db6 (table default.Table_802a2d53f1c14a879d8737dad75f6252 [id=5b2e7b122a394e058dc5b2fd84a0f558]). Expected version 3 got 0
I20260318 02:51:45.547354 1175 ts_tablet_manager.cc:1929] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.553020 749 tablet_service.cc:1511] Processing CreateTablet for tablet 11bef12729dc47e1b034a872648c998d (DEFAULT_TABLE table=default.Table_484f25ecd6914954923ed82621c50371 [id=8374bb60c8bd4c5287e497092b7406e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.553473 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bef12729dc47e1b034a872648c998d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.553872 1175 log.cc:1199] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/a0a6f4b34ff14714892ed9e9b3604dc9
I20260318 02:51:45.554106 758 tablet_service.cc:1511] Processing CreateTablet for tablet e09d153d1cbe4b4eb821d0b978310b2e (DEFAULT_TABLE table=default.Table_da8501c40a7c4e079c81ee43aecca824 [id=9d9afcb7a4ec4c6d9d8f931f200eafbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.554239 748 tablet_service.cc:1511] Processing CreateTablet for tablet 4156bc560f6e4fb18b0ce0f4f1042180 (DEFAULT_TABLE table=default.Table_c31b6e1619f5437cadef729724fc2468 [id=83932b3f9d8f4e9a96c3ad765487cb80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.554476 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e09d153d1cbe4b4eb821d0b978310b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.554713 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4156bc560f6e4fb18b0ce0f4f1042180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.558580 1175 ts_tablet_manager.cc:1950] T a0a6f4b34ff14714892ed9e9b3604dc9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:45.560866 2467 raft_consensus.cc:493] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.561022 2467 raft_consensus.cc:515] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:45.563105 997 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.104.189:45933, user_credentials={real_user=slave}} blocked reactor thread for 70254.6us
W20260318 02:51:45.563993 441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.189:45933, user_credentials={real_user=slave}} blocked reactor thread for 73710.7us
I20260318 02:51:45.564639 1175 tablet_replica.cc:333] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:45.564920 1175 raft_consensus.cc:2243] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.565148 1175 raft_consensus.cc:2272] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.565732 1175 ts_tablet_manager.cc:1916] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.567407 2467 leader_election.cc:290] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:45.568397 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b894f0772a754196a3e651b38c46f001" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:45.568986 719 leader_election.cc:343] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.569469 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b894f0772a754196a3e651b38c46f001" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:45.570006 719 leader_election.cc:343] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.570127 719 leader_election.cc:304] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:45.571030 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_eb225edbcae24cc8b21780a90930083a" } new_table_name: "default.Table_5048646e181b43af9e8798938115b3eb" modify_external_catalogs: true
W20260318 02:51:45.564989 997 leader_election.cc:343] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.579207 758 tablet_service.cc:1511] Processing CreateTablet for tablet 01019493d58b4cd3bc20b48a3192f239 (DEFAULT_TABLE table=default.Table_06e84fa324c3410197903c4ea0c6056b [id=e4c17a9261144122a3beedeb7744a247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.579326 2648 tablet.cc:1723] T d7f21df58fac437da5747becfa3f28b4 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:45.579634 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01019493d58b4cd3bc20b48a3192f239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.585422 748 tablet_service.cc:1511] Processing CreateTablet for tablet 48c7495118a743848640ac754f2ca009 (DEFAULT_TABLE table=default.Table_824f5a8c5da1479297ff211029e64fe6 [id=dcc520cb08824a8a829a4e19ecd19f99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.585961 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c7495118a743848640ac754f2ca009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.596349 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3b585ecfc5b445f58bd17b27c4ffcd8c" } modify_external_catalogs: true
I20260318 02:51:45.596576 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3b585ecfc5b445f58bd17b27c4ffcd8c" } modify_external_catalogs: true
W20260318 02:51:45.574674 997 leader_election.cc:343] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.601178 2689 raft_consensus.cc:2749] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.601450 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_56040d9c52e348588edf25ce8dd51855"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:45.602340 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56040d9c52e348588edf25ce8dd51855 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:45.605288 1175 ts_tablet_manager.cc:1929] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:45.608836 1175 log.cc:1199] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/1516525b471540288c6cb5d61120d430
I20260318 02:51:45.609396 1175 ts_tablet_manager.cc:1950] T 1516525b471540288c6cb5d61120d430 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:45.609385 749 tablet_service.cc:1511] Processing CreateTablet for tablet 51c23289b2d2488ca73ca5e4ef53a5a4 (DEFAULT_TABLE table=default.Table_d7d8654621644ac7a6b0fa1a093c0f8b [id=344d089dc4ec477c8062ee0edb0c40c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.609946 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c23289b2d2488ca73ca5e4ef53a5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.625121 2665 raft_consensus.cc:493] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.625247 1175 tablet_replica.cc:333] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:45.625370 2665 raft_consensus.cc:515] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.625999 2665 leader_election.cc:290] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:45.626187 1175 raft_consensus.cc:2243] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.626535 2688 tablet.cc:1723] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260318 02:51:45.626797 999 leader_election.cc:343] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 6bb381f10d87414f9c1a99942216adc7
I20260318 02:51:45.627117 2646 tablet.cc:1723] T 608df0ce4e1d4ed6b7655802a6f7f6bc P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:45.635658 2665 raft_consensus.cc:493] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.635874 2665 raft_consensus.cc:515] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.627547 905 tablet_service.cc:1558] Processing DeleteTablet for tablet c0c33cfa1c194a65bfc64d0e1e9434ff with delete_type TABLET_DATA_DELETED (replaced by tablet e918bb008e0743a9bf7ada170812146e) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:45.626434 1175 raft_consensus.cc:2272] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.637048 2665 leader_election.cc:290] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:45.630009 1173 tablet_bootstrap.cc:492] T 2a3a36a7fd4742c9827b334ce31d4a7c P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:45.637583 1173 ts_tablet_manager.cc:1403] T 2a3a36a7fd4742c9827b334ce31d4a7c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.127s user 0.003s sys 0.006s
I20260318 02:51:45.638428 1173 raft_consensus.cc:359] T 2a3a36a7fd4742c9827b334ce31d4a7c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.638600 1173 raft_consensus.cc:385] T 2a3a36a7fd4742c9827b334ce31d4a7c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.638648 1173 raft_consensus.cc:740] T 2a3a36a7fd4742c9827b334ce31d4a7c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
W20260318 02:51:45.638641 999 leader_election.cc:343] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2f04e5699531479d8b76edb0e2d2873c
I20260318 02:51:45.638855 1173 consensus_queue.cc:260] T 2a3a36a7fd4742c9827b334ce31d4a7c P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.639319 1173 ts_tablet_manager.cc:1434] T 2a3a36a7fd4742c9827b334ce31d4a7c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:45.639552 1175 ts_tablet_manager.cc:1916] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.630411 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb381f10d87414f9c1a99942216adc7" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:45.639596 1173 tablet_bootstrap.cc:492] T 5ff188f25ff146fab121ebfab1af8467 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:45.641669 1173 tablet_bootstrap.cc:654] T 5ff188f25ff146fab121ebfab1af8467 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:45.643383 443 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.0.104.188:41593 (error 108) [suppressed 8 similar messages]
W20260318 02:51:45.650985 999 connection.cc:537] client connection to 127.0.104.188:41593 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260318 02:51:45.651482 721 connection.cc:537] client connection to 127.0.104.188:41593 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260318 02:51:45.655213 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f04e5699531479d8b76edb0e2d2873c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:45.658529 905 tablet_service.cc:1558] Processing DeleteTablet for tablet f72023f5408f4ef4b628568da0c008d6 with delete_type TABLET_DATA_DELETED (replaced by tablet bf54f8603e514f1cad3f53ff1427cabe) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:45.660790 2660 raft_consensus.cc:493] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.660982 2660 raft_consensus.cc:515] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.661666 2660 leader_election.cc:290] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:45.664942 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b01131720748688ca6c28985a3b3ff" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:45.666666 719 leader_election.cc:343] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:45.667564 997 leader_election.cc:343] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.667748 997 leader_election.cc:304] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:45.668004 2665 raft_consensus.cc:2749] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:45.668434 997 leader_election.cc:343] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.668565 997 leader_election.cc:304] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:45.668819 2665 raft_consensus.cc:2749] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.670260 905 tablet_service.cc:1511] Processing CreateTablet for tablet e09d153d1cbe4b4eb821d0b978310b2e (DEFAULT_TABLE table=default.Table_da8501c40a7c4e079c81ee43aecca824 [id=9d9afcb7a4ec4c6d9d8f931f200eafbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.670666 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e09d153d1cbe4b4eb821d0b978310b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.670914 890 tablet_service.cc:1511] Processing CreateTablet for tablet 4156bc560f6e4fb18b0ce0f4f1042180 (DEFAULT_TABLE table=default.Table_c31b6e1619f5437cadef729724fc2468 [id=83932b3f9d8f4e9a96c3ad765487cb80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.671286 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4156bc560f6e4fb18b0ce0f4f1042180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.671314 893 tablet_service.cc:1511] Processing CreateTablet for tablet 01019493d58b4cd3bc20b48a3192f239 (DEFAULT_TABLE table=default.Table_06e84fa324c3410197903c4ea0c6056b [id=e4c17a9261144122a3beedeb7744a247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.671579 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01019493d58b4cd3bc20b48a3192f239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.672986 897 tablet_service.cc:1511] Processing CreateTablet for tablet 11bef12729dc47e1b034a872648c998d (DEFAULT_TABLE table=default.Table_484f25ecd6914954923ed82621c50371 [id=8374bb60c8bd4c5287e497092b7406e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.673292 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bef12729dc47e1b034a872648c998d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:45.679890 862 connection.cc:537] client connection to 127.0.104.188:41593 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260318 02:51:45.684485 1175 ts_tablet_manager.cc:1929] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.688310 1184 ts_tablet_manager.cc:1950] T 5ff188f25ff146fab121ebfab1af8467 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:45.689239 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1139) took 4857 ms. Trace:
I20260318 02:51:45.692827 1175 log.cc:1199] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/a6f42462ed9c49c797f5115b3ca6c423
I20260318 02:51:45.693231 1175 ts_tablet_manager.cc:1950] T a6f42462ed9c49c797f5115b3ca6c423 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:45.693727 1175 tablet_replica.cc:333] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:45.696426 1175 raft_consensus.cc:2243] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.697659 905 tablet_service.cc:1511] Processing CreateTablet for tablet 48c7495118a743848640ac754f2ca009 (DEFAULT_TABLE table=default.Table_824f5a8c5da1479297ff211029e64fe6 [id=dcc520cb08824a8a829a4e19ecd19f99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.697891 1175 raft_consensus.cc:2272] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.698160 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c7495118a743848640ac754f2ca009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.698745 1175 ts_tablet_manager.cc:1916] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.699199 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 41646d513e834600a209761392ac7fb1 (table default.Table_8a612850d1784dda9f09b14b7e12b28c [id=717896f5560d483e94054f017eaa9a6f]) successfully deleted
I20260318 02:51:45.699430 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet a0a6f4b34ff14714892ed9e9b3604dc9 (table default.Table_7692f02c62f94771bc39331507161bb2 [id=60f0afdd0f9f4c5196ea491b90991241]) successfully deleted
I20260318 02:51:45.699599 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 1516525b471540288c6cb5d61120d430 (table default.Table_4e770bc308894d9094b88315d9093ba5 [id=433e7aa77412424ebb38784bb073d1fb]) successfully deleted
W20260318 02:51:45.699784 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 5b1527c9ce014e819d03330486e8ef3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b1527c9ce014e819d03330486e8ef3b already in progress: creating tablet
W20260318 02:51:45.699978 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 407b6b2f451e43aaaba4f6cebb80fac7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 407b6b2f451e43aaaba4f6cebb80fac7 already in progress: creating tablet
W20260318 02:51:45.700145 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 75c4ba372960496880405e5dffe11d60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75c4ba372960496880405e5dffe11d60 already in progress: creating tablet
W20260318 02:51:45.700297 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f8e428b700044eaf9e360f74c751a206 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8e428b700044eaf9e360f74c751a206 already in progress: creating tablet
W20260318 02:51:45.700451 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 0f499c464eb14164a2df3abc2d4a47c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f499c464eb14164a2df3abc2d4a47c7 already in progress: creating tablet
W20260318 02:51:45.700593 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet fca751e8fa5e4098b33093766e80d933 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fca751e8fa5e4098b33093766e80d933 already in progress: creating tablet
W20260318 02:51:45.700774 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 443e6018aed94077a38aa80bafee7264 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 443e6018aed94077a38aa80bafee7264 already in progress: creating tablet
W20260318 02:51:45.700943 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet a2b8723a0d354f248ffe4cd2ef5a21dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2b8723a0d354f248ffe4cd2ef5a21dc already in progress: creating tablet
I20260318 02:51:45.703095 1184 rpcz_store.cc:276] 0318 02:51:40.831614 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.831676 (+ 62us) service_pool.cc:225] Handling call
0318 02:51:45.338275 (+4506599us) ts_tablet_manager.cc:1151] Deleting tablet 5ff188f25ff146fab121ebfab1af8467
0318 02:51:45.338287 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.438945 (+100658us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:45.458956 (+ 20011us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:45.689211 (+230255us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4498605}
I20260318 02:51:45.705070 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1140) took 4854 ms. Trace:
I20260318 02:51:45.705945 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b01131720748688ca6c28985a3b3ff" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:45.706224 2630 mvcc.cc:204] Tried to move back new op lower bound from 7265494243466924032 to 7265494240807075840. Current Snapshot: MvccSnapshot[applied={T|T < 7265494243466924032}]
I20260318 02:51:45.706616 2646 tablet.cc:1723] T d7f21df58fac437da5747becfa3f28b4 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260318 02:51:45.708936 2695 negotiation.cc:337] Failed RPC negotiation. Trace:
0318 02:51:45.652780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.104.188:41593 (local address 127.0.104.129:60893)
0318 02:51:45.708630 (+ 55850us) negotiation.cc:107] Waiting for socket to connect
0318 02:51:45.708770 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":55729,"threads_started":1}
W20260318 02:51:45.710203 719 leader_election.cc:343] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.710410 719 leader_election.cc:304] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:45.710844 2690 raft_consensus.cc:2749] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.702335 1172 tablet_bootstrap.cc:492] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:45.711117 1172 ts_tablet_manager.cc:1403] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.518s user 0.021s sys 0.000s
I20260318 02:51:45.711825 1172 raft_consensus.cc:359] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.711992 1172 raft_consensus.cc:385] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.712044 1172 raft_consensus.cc:740] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.712220 1172 consensus_queue.cc:260] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:45.698940 2696 negotiation.cc:337] Failed RPC negotiation. Trace:
0318 02:51:45.653916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.104.188:41593 (local address 127.0.104.131:40547)
0318 02:51:45.698656 (+ 44740us) negotiation.cc:107] Waiting for socket to connect
0318 02:51:45.698772 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":44612,"thread_start_us":43107,"threads_started":1}
I20260318 02:51:45.712895 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 82858fd64d534d1abcad12bc4a93cda7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:45.705159 1184 rpcz_store.cc:276] 0318 02:51:40.850263 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.850330 (+ 67us) service_pool.cc:225] Handling call
0318 02:51:45.704951 (+4854621us) ts_tablet_manager.cc:1151] Deleting tablet f5ce7b986536414099b53f61033a960d
0318 02:51:45.704961 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.705053 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4854418}
I20260318 02:51:45.714880 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1141) took 4808 ms. Trace:
I20260318 02:51:45.714967 1184 rpcz_store.cc:276] 0318 02:51:40.906462 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.906524 (+ 62us) service_pool.cc:225] Handling call
0318 02:51:45.714760 (+4808236us) ts_tablet_manager.cc:1151] Deleting tablet 4a60e189801440bca43f35fe787d3aa7
0318 02:51:45.714771 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.714863 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4797285}
I20260318 02:51:45.715690 1041 tablet_service.cc:1511] Processing CreateTablet for tablet e09d153d1cbe4b4eb821d0b978310b2e (DEFAULT_TABLE table=default.Table_da8501c40a7c4e079c81ee43aecca824 [id=9d9afcb7a4ec4c6d9d8f931f200eafbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.716549 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 11bef12729dc47e1b034a872648c998d (DEFAULT_TABLE table=default.Table_484f25ecd6914954923ed82621c50371 [id=8374bb60c8bd4c5287e497092b7406e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.717036 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 4156bc560f6e4fb18b0ce0f4f1042180 (DEFAULT_TABLE table=default.Table_c31b6e1619f5437cadef729724fc2468 [id=83932b3f9d8f4e9a96c3ad765487cb80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.717545 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 01019493d58b4cd3bc20b48a3192f239 (DEFAULT_TABLE table=default.Table_06e84fa324c3410197903c4ea0c6056b [id=e4c17a9261144122a3beedeb7744a247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.718453 1173 tablet_bootstrap.cc:492] T 5ff188f25ff146fab121ebfab1af8467 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:45.718659 1173 ts_tablet_manager.cc:1403] T 5ff188f25ff146fab121ebfab1af8467 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.079s user 0.002s sys 0.006s
I20260318 02:51:45.719477 1173 raft_consensus.cc:359] T 5ff188f25ff146fab121ebfab1af8467 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.719720 1173 raft_consensus.cc:385] T 5ff188f25ff146fab121ebfab1af8467 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.719825 1173 raft_consensus.cc:740] T 5ff188f25ff146fab121ebfab1af8467 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.720095 1173 consensus_queue.cc:260] T 5ff188f25ff146fab121ebfab1af8467 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.720662 1173 ts_tablet_manager.cc:1434] T 5ff188f25ff146fab121ebfab1af8467 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:45.720997 1173 tablet_bootstrap.cc:492] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:45.722649 1173 tablet_bootstrap.cc:654] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.723814 1174 tablet_bootstrap.cc:492] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:45.723942 1174 ts_tablet_manager.cc:1403] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.192s user 0.043s sys 0.053s
I20260318 02:51:45.724532 1174 raft_consensus.cc:359] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.724684 1174 raft_consensus.cc:385] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.724763 1174 raft_consensus.cc:740] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.724979 1174 consensus_queue.cc:260] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.725417 1174 ts_tablet_manager.cc:1434] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260318 02:51:45.725666 1174 tablet_bootstrap.cc:492] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:45.727252 1174 tablet_bootstrap.cc:654] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.731344 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11bef12729dc47e1b034a872648c998d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.733873 1184 tablet_replica.cc:333] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:45.734086 1184 raft_consensus.cc:2243] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.736584 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e09d153d1cbe4b4eb821d0b978310b2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.736971 1172 ts_tablet_manager.cc:1434] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.026s user 0.001s sys 0.000s
I20260318 02:51:45.737241 1172 tablet_bootstrap.cc:492] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:45.738591 1172 tablet_bootstrap.cc:654] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.738971 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4156bc560f6e4fb18b0ce0f4f1042180. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:45.701093 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 3f1a75b4559440c1bf38d4ae0c52d4e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f1a75b4559440c1bf38d4ae0c52d4e5 already in progress: creating tablet
W20260318 02:51:45.739473 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f96013c844414fd28c35724a6160ee81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f96013c844414fd28c35724a6160ee81 already in progress: creating tablet
W20260318 02:51:45.711717 443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.188:41593, user_credentials={real_user=slave}} blocked reactor thread for 68346us
I20260318 02:51:45.739981 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet a6f42462ed9c49c797f5115b3ca6c423 (table default.Table_9573754c7e3b4c0b8200f0cc47b2182d [id=01cdfd48166b4ea79e00c77b1deb5eca]) successfully deleted
I20260318 02:51:45.740994 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01019493d58b4cd3bc20b48a3192f239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.741178 748 tablet_service.cc:1511] Processing CreateTablet for tablet f87b929bea754436b07ec7265d9b0514 (DEFAULT_TABLE table=default.Table_1c16727d959149009c4d63b308305db7 [id=edb569b3d9a14e91bd0c6b9f62c57902]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.741242 897 tablet_service.cc:1511] Processing CreateTablet for tablet d76951897efa4f528c101888e0607e93 (DEFAULT_TABLE table=default.Table_3c5185412638410fb9c5356e8cb5d84d [id=8b9d84b919e6475b8aaca4cf1eaf338d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.741546 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87b929bea754436b07ec7265d9b0514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.741545 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76951897efa4f528c101888e0607e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.742477 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 48c7495118a743848640ac754f2ca009 (DEFAULT_TABLE table=default.Table_824f5a8c5da1479297ff211029e64fe6 [id=dcc520cb08824a8a829a4e19ecd19f99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.742790 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c7495118a743848640ac754f2ca009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.744975 758 tablet_service.cc:1511] Processing CreateTablet for tablet 763549b232c248188d063cccde126772 (DEFAULT_TABLE table=default.Table_9ea103c1629a45baa8d4804f11679100 [id=f806550e50374908b7d2c41244a661b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.744975 905 tablet_service.cc:1511] Processing CreateTablet for tablet 51c23289b2d2488ca73ca5e4ef53a5a4 (DEFAULT_TABLE table=default.Table_d7d8654621644ac7a6b0fa1a093c0f8b [id=344d089dc4ec477c8062ee0edb0c40c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.745307 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763549b232c248188d063cccde126772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.745307 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c23289b2d2488ca73ca5e4ef53a5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.748557 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 51c23289b2d2488ca73ca5e4ef53a5a4 (DEFAULT_TABLE table=default.Table_d7d8654621644ac7a6b0fa1a093c0f8b [id=344d089dc4ec477c8062ee0edb0c40c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.748919 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c23289b2d2488ca73ca5e4ef53a5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.750193 2690 raft_consensus.cc:493] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.750321 2690 raft_consensus.cc:515] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.750893 2690 leader_election.cc:290] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:45.751564 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b698d732a905469caaf564d9512ba02c" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:45.752097 719 leader_election.cc:343] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.752463 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b698d732a905469caaf564d9512ba02c" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:45.753257 719 leader_election.cc:343] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.753368 719 leader_election.cc:304] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:45.753953 2690 raft_consensus.cc:2749] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.754544 2688 tablet.cc:1723] T 3aa05403966349ae9056777d913a0db6 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:45.758211 758 tablet_service.cc:1511] Processing CreateTablet for tablet bb7d45558bcb4c658a69741730b2f98c (DEFAULT_TABLE table=default.Table_9497c2ca1edd40ec8ab79a75552b87d9 [id=e56e572832fe49fe841b07d79a2537e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.758373 750 tablet_service.cc:1511] Processing CreateTablet for tablet 4196352b47614d67b1db9c45b693f7df (DEFAULT_TABLE table=default.Table_7f2b4c79603342a2b19f5b755a16fafc [id=8d86cabd25f9421c8b3c314dbac248a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.758599 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7d45558bcb4c658a69741730b2f98c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.758806 759 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab9bdc476f64d758637a12148f2b092 (DEFAULT_TABLE table=default.Table_0c0ba4c3df1348149d99921eddf79c1c [id=35f4bf8b3884486c9635dad552f9af26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.759087 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab9bdc476f64d758637a12148f2b092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.761310 748 tablet_service.cc:1511] Processing CreateTablet for tablet bf6517e55af54c3dae05ed6bceaa7638 (DEFAULT_TABLE table=default.Table_2f58164571244099848c2984bd08ef81 [id=8d282a0ea34f484f9b8f29cc45bb7dea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.761435 1175 ts_tablet_manager.cc:1929] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.761544 1175 log.cc:1199] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/c7c4257a54d3487aa520531a64fc721c
I20260318 02:51:45.761647 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf6517e55af54c3dae05ed6bceaa7638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.761839 1175 ts_tablet_manager.cc:1950] T c7c4257a54d3487aa520531a64fc721c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:45.762356 1175 tablet_replica.cc:333] T 8a0af3aecf4f485ebc54e1955eca8c92 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:45.762528 1175 raft_consensus.cc:2243] T 8a0af3aecf4f485ebc54e1955eca8c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.762676 1175 raft_consensus.cc:2272] T 8a0af3aecf4f485ebc54e1955eca8c92 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.762892 893 tablet_service.cc:1511] Processing CreateTablet for tablet f87b929bea754436b07ec7265d9b0514 (DEFAULT_TABLE table=default.Table_1c16727d959149009c4d63b308305db7 [id=edb569b3d9a14e91bd0c6b9f62c57902]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.763164 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4196352b47614d67b1db9c45b693f7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.763223 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87b929bea754436b07ec7265d9b0514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.767268 1174 tablet_bootstrap.cc:492] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:45.767484 1174 ts_tablet_manager.cc:1403] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.001s
I20260318 02:51:45.769579 1174 raft_consensus.cc:359] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.771024 1174 raft_consensus.cc:385] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.771152 1174 raft_consensus.cc:740] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.771378 1174 consensus_queue.cc:260] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.771795 1175 ts_tablet_manager.cc:1916] T 8a0af3aecf4f485ebc54e1955eca8c92 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.772280 2646 tablet.cc:1723] T 3aa05403966349ae9056777d913a0db6 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:45.773012 1174 ts_tablet_manager.cc:1434] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260318 02:51:45.773277 1174 tablet_bootstrap.cc:492] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:45.773674 897 tablet_service.cc:1511] Processing CreateTablet for tablet 763549b232c248188d063cccde126772 (DEFAULT_TABLE table=default.Table_9ea103c1629a45baa8d4804f11679100 [id=f806550e50374908b7d2c41244a661b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.774322 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763549b232c248188d063cccde126772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.774916 1174 tablet_bootstrap.cc:654] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:45.776767 443 consensus_peers.cc:597] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a -> Peer 971baf5b9e4644c990dbf4d4fc7ba900 (127.0.104.188:41593): Couldn't send request to peer 971baf5b9e4644c990dbf4d4fc7ba900. Status: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:45.777346 749 tablet_service.cc:1511] Processing CreateTablet for tablet d76951897efa4f528c101888e0607e93 (DEFAULT_TABLE table=default.Table_3c5185412638410fb9c5356e8cb5d84d [id=8b9d84b919e6475b8aaca4cf1eaf338d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.777524 1175 ts_tablet_manager.cc:1929] T 8a0af3aecf4f485ebc54e1955eca8c92 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.777999 1175 log.cc:1199] T 8a0af3aecf4f485ebc54e1955eca8c92 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/8a0af3aecf4f485ebc54e1955eca8c92
I20260318 02:51:45.778401 1175 ts_tablet_manager.cc:1950] T 8a0af3aecf4f485ebc54e1955eca8c92 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:45.778884 1175 tablet_replica.cc:333] T c0c33cfa1c194a65bfc64d0e1e9434ff P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:45.779143 1175 raft_consensus.cc:2243] T c0c33cfa1c194a65bfc64d0e1e9434ff P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.779364 1175 raft_consensus.cc:2272] T c0c33cfa1c194a65bfc64d0e1e9434ff P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.788448 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76951897efa4f528c101888e0607e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.739086 1184 raft_consensus.cc:2272] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.797127 1184 ts_tablet_manager.cc:1916] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.801088 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 5ff188f25ff146fab121ebfab1af8467 (table default.Table_33930f6668f341159c318db9160c142a [id=a5613244ee434bc88b23181c7bf23e0c]) successfully deleted
W20260318 02:51:45.801323 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f5ce7b986536414099b53f61033a960d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5ce7b986536414099b53f61033a960d already in progress: creating tablet
W20260318 02:51:45.801507 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 4a60e189801440bca43f35fe787d3aa7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a60e189801440bca43f35fe787d3aa7 already in progress: creating tablet
W20260318 02:51:45.806387 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4156bc560f6e4fb18b0ce0f4f1042180 consensus state has no leader
I20260318 02:51:45.808954 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2a90be200678468eaa8c57b843521440
I20260318 02:51:45.809635 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_86fd2b4ab3b54217a92aca9959fc9238" } new_table_name: "default.Table_9f47ebe5641a40adb125b4d2a49aec14" modify_external_catalogs: true
I20260318 02:51:45.810086 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a90be200678468eaa8c57b843521440 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:45 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:45.811041 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 1fa6e24943d54a3ea40fd34980ba2b27
I20260318 02:51:45.811692 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_c38f8ee4055b4cc7b6af7251832e4105"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:45.812023 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 1fa6e24943d54a3ea40fd34980ba2b27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:45 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:45.812242 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c38f8ee4055b4cc7b6af7251832e4105 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:45.812858 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 66f2eb49809945b3ae9d083a4fe56245
I20260318 02:51:45.813491 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7b016317a2984ce7bb11ca474a735aba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:45.813764 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 66f2eb49809945b3ae9d083a4fe56245 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:45 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:45.813982 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b016317a2984ce7bb11ca474a735aba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:45.814502 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b3a12a4854914f9892e614697fe3a7b4
I20260318 02:51:45.814983 453 master_service.cc:954] ReplaceTablet: received request to replace tablet 6e72f04c08fe44fdabce1c5b102ca61a from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:45.816172 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 59ce7583e7f545f18145b4e55e1fbb81
I20260318 02:51:45.816493 456 catalog_manager.cc:6741] ReplaceTablet: tablet 59ce7583e7f545f18145b4e55e1fbb81 deleted and replaced by tablet 6934cf71f9034febb5e0ebfa410fb94b
I20260318 02:51:45.816812 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a08fb7078dfc4ab9b85ef5701d3a9e33" } new_table_name: "default.Table_27fe2cc2b50646fa9d8d97f04f87e86d" modify_external_catalogs: true
I20260318 02:51:45.817915 449 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_91e64c048d4048168906fcd3d1a5b3d0 [id=05445eb067cb46a5803415774772c91e] alter complete (version 2)
I20260318 02:51:45.819492 2690 raft_consensus.cc:493] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.819645 2690 raft_consensus.cc:515] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.820279 2690 leader_election.cc:290] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:45.821302 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c05f7a75527410e9c5cde0dbc6bc10e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:45.821844 719 leader_election.cc:343] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.829523 449 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet b698d732a905469caaf564d9512ba02c (table default.Table_6238662cdd5443a694ee4feec8bc0413 [id=eb11e3d1c3ef4295ac9b6ee657ac233a]). Expected version 1 got 0
I20260318 02:51:45.830699 2690 raft_consensus.cc:493] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.830871 2690 raft_consensus.cc:515] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.831485 2690 leader_election.cc:290] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:45.832237 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c89f413a26a43ef95c850d7c44f85b2" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:45.832746 719 leader_election.cc:343] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.836959 758 tablet_service.cc:1558] Processing DeleteTablet for tablet b3a12a4854914f9892e614697fe3a7b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:45 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:45.837595 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 59ce7583e7f545f18145b4e55e1fbb81 with delete_type TABLET_DATA_DELETED (replaced by tablet 6934cf71f9034febb5e0ebfa410fb94b) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:45.838129 758 tablet_service.cc:1558] Processing DeleteTablet for tablet fb5d1d828899472e8f48723b35e94d62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:45.838351 2704 tablet_replica.cc:333] T fb5d1d828899472e8f48723b35e94d62 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:45.838551 2704 raft_consensus.cc:2243] T fb5d1d828899472e8f48723b35e94d62 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.838595 758 tablet_service.cc:1558] Processing DeleteTablet for tablet d8b956e389134a4485434a819a5df2e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:45.838660 1172 tablet_bootstrap.cc:492] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:45.838696 2704 raft_consensus.cc:2272] T fb5d1d828899472e8f48723b35e94d62 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.838794 1172 ts_tablet_manager.cc:1403] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.102s user 0.002s sys 0.000s
W20260318 02:51:45.839320 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2a90be200678468eaa8c57b843521440 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a90be200678468eaa8c57b843521440 already in progress: creating tablet
I20260318 02:51:45.839367 2704 ts_tablet_manager.cc:1916] T fb5d1d828899472e8f48723b35e94d62 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:45.839556 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 1fa6e24943d54a3ea40fd34980ba2b27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fa6e24943d54a3ea40fd34980ba2b27 already in progress: creating tablet
W20260318 02:51:45.839730 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 66f2eb49809945b3ae9d083a4fe56245 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66f2eb49809945b3ae9d083a4fe56245 already in progress: creating tablet
I20260318 02:51:45.839782 1172 raft_consensus.cc:359] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.839936 1172 raft_consensus.cc:385] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.839994 1172 raft_consensus.cc:740] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
W20260318 02:51:45.840005 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet b3a12a4854914f9892e614697fe3a7b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3a12a4854914f9892e614697fe3a7b4 already in progress: creating tablet
W20260318 02:51:45.840170 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 59ce7583e7f545f18145b4e55e1fbb81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59ce7583e7f545f18145b4e55e1fbb81 already in progress: creating tablet
I20260318 02:51:45.840193 1172 consensus_queue.cc:260] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.840863 748 tablet_service.cc:1558] Processing DeleteTablet for tablet d0b01131720748688ca6c28985a3b3ff with delete_type TABLET_DATA_DELETED (replaced by tablet fa68d30736044b71b38938fded1b314b) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:45.841179 750 tablet_service.cc:1511] Processing CreateTablet for tablet 4aab5486caa24d09a9e43c3db0df5d79 (DEFAULT_TABLE table=default.Table_50962224abd7467492507d0af7c6a030 [id=b2cffc121a364e96b33062c69737ef9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.841425 766 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce4f2d7d92f4d1ba4ce666e48cf8d8b (DEFAULT_TABLE table=default.Table_57cf0fee93474e9ebf2fb7c515c7aaf5 [id=935681f43fc743eb8eed9b63c787c8e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.841564 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aab5486caa24d09a9e43c3db0df5d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.841641 1172 ts_tablet_manager.cc:1434] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:45.841715 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce4f2d7d92f4d1ba4ce666e48cf8d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.841917 1172 tablet_bootstrap.cc:492] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:45.843288 1172 tablet_bootstrap.cc:654] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.844686 756 tablet_service.cc:1511] Processing CreateTablet for tablet bbe81848885f4ea89b1a7307e5a9f3b3 (DEFAULT_TABLE table=default.Table_e4f76e7e6a3f45a9a367b7c2874f85e0 [id=a3688e1d2f884393bfb56ff84890d5b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.844945 753 tablet_service.cc:1511] Processing CreateTablet for tablet ba9554206a4a431cbe35a4efb2615eab (DEFAULT_TABLE table=default.Table_c16e719f5ec444dfbf8cc9fd019945e6 [id=ed4e6b506f964405877f8d6cbfff5c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.845048 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe81848885f4ea89b1a7307e5a9f3b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.845204 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba9554206a4a431cbe35a4efb2615eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.845542 759 tablet_service.cc:1558] Processing DeleteTablet for tablet fd1284c6e90d4beb8223fd807d7888ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:45.845588 762 tablet_service.cc:1511] Processing CreateTablet for tablet 2fcfbac8dcfe4a23b7be892a4d758b22 (DEFAULT_TABLE table=default.Table_c89f8c40260f47be9787ac38ce5dcd46 [id=1dbb8f277403450086790ee9034c98da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.846210 748 tablet_service.cc:1511] Processing CreateTablet for tablet 1a1f0601a7a249c78a05f23084ff535e (DEFAULT_TABLE table=default.Table_b6bc70833af0498d8ec1b7e98aff1c64 [id=36cd7596eb47491689505e77dcffa567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.841430 758 tablet_service.cc:1558] Processing DeleteTablet for tablet b894f0772a754196a3e651b38c46f001 with delete_type TABLET_DATA_DELETED (replaced by tablet 977a25a368734b11a8b2cefef88be651) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:45.841179 761 tablet_service.cc:1511] Processing CreateTablet for tablet a5a4c494c20044d280cf43c89d9e3ce2 (DEFAULT_TABLE table=default.Table_79bea80cab3d40f5bead32f2fdcf09fa [id=873432f002e14a4fa7065dcfe5caebd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.795742 1173 tablet_bootstrap.cc:492] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:45.799541 893 tablet_service.cc:1511] Processing CreateTablet for tablet bf6517e55af54c3dae05ed6bceaa7638 (DEFAULT_TABLE table=default.Table_2f58164571244099848c2984bd08ef81 [id=8d282a0ea34f484f9b8f29cc45bb7dea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.847045 1036 tablet_service.cc:1511] Processing CreateTablet for tablet d76951897efa4f528c101888e0607e93 (DEFAULT_TABLE table=default.Table_3c5185412638410fb9c5356e8cb5d84d [id=8b9d84b919e6475b8aaca4cf1eaf338d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.847386 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76951897efa4f528c101888e0607e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.848971 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab9bdc476f64d758637a12148f2b092 (DEFAULT_TABLE table=default.Table_0c0ba4c3df1348149d99921eddf79c1c [id=35f4bf8b3884486c9635dad552f9af26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.849301 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab9bdc476f64d758637a12148f2b092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.849998 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 763549b232c248188d063cccde126772 (DEFAULT_TABLE table=default.Table_9ea103c1629a45baa8d4804f11679100 [id=f806550e50374908b7d2c41244a661b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.851157 2704 ts_tablet_manager.cc:1929] T fb5d1d828899472e8f48723b35e94d62 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.851250 2704 log.cc:1199] T fb5d1d828899472e8f48723b35e94d62 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/fb5d1d828899472e8f48723b35e94d62
I20260318 02:51:45.851419 1035 tablet_service.cc:1511] Processing CreateTablet for tablet f87b929bea754436b07ec7265d9b0514 (DEFAULT_TABLE table=default.Table_1c16727d959149009c4d63b308305db7 [id=edb569b3d9a14e91bd0c6b9f62c57902]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.851501 2704 ts_tablet_manager.cc:1950] T fb5d1d828899472e8f48723b35e94d62 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:45.851747 1030 tablet_service.cc:1511] Processing CreateTablet for tablet bb7d45558bcb4c658a69741730b2f98c (DEFAULT_TABLE table=default.Table_9497c2ca1edd40ec8ab79a75552b87d9 [id=e56e572832fe49fe841b07d79a2537e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.852061 1041 tablet_service.cc:1511] Processing CreateTablet for tablet bf6517e55af54c3dae05ed6bceaa7638 (DEFAULT_TABLE table=default.Table_2f58164571244099848c2984bd08ef81 [id=8d282a0ea34f484f9b8f29cc45bb7dea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.800230 890 tablet_service.cc:1511] Processing CreateTablet for tablet 4196352b47614d67b1db9c45b693f7df (DEFAULT_TABLE table=default.Table_7f2b4c79603342a2b19f5b755a16fafc [id=8d86cabd25f9421c8b3c314dbac248a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.800489 903 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab9bdc476f64d758637a12148f2b092 (DEFAULT_TABLE table=default.Table_0c0ba4c3df1348149d99921eddf79c1c [id=35f4bf8b3884486c9635dad552f9af26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.847045 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 4196352b47614d67b1db9c45b693f7df (DEFAULT_TABLE table=default.Table_7f2b4c79603342a2b19f5b755a16fafc [id=8d86cabd25f9421c8b3c314dbac248a1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:45.855571 999 consensus_peers.cc:597] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d -> Peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Couldn't send request to peer 6a903d876086423b8016d705b98895ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1516525b471540288c6cb5d61120d430. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:45.855703 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fcfbac8dcfe4a23b7be892a4d758b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.856663 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a4c494c20044d280cf43c89d9e3ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.857415 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a1f0601a7a249c78a05f23084ff535e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.861316 448 catalog_manager.cc:5671] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:45.861934 448 catalog_manager.cc:5671] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:45.862408 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 3aa05403966349ae9056777d913a0db6 (table default.Table_802a2d53f1c14a879d8737dad75f6252 [id=5b2e7b122a394e058dc5b2fd84a0f558]). Expected version 3 got 0
I20260318 02:51:45.805987 905 tablet_service.cc:1511] Processing CreateTablet for tablet bb7d45558bcb4c658a69741730b2f98c (DEFAULT_TABLE table=default.Table_9497c2ca1edd40ec8ab79a75552b87d9 [id=e56e572832fe49fe841b07d79a2537e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.823340 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c05f7a75527410e9c5cde0dbc6bc10e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:45.832265 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c89f413a26a43ef95c850d7c44f85b2" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:45.863449 719 leader_election.cc:343] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.863574 719 leader_election.cc:304] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:45.863977 719 leader_election.cc:343] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.864074 719 leader_election.cc:304] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:45.864391 2690 raft_consensus.cc:2749] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.864539 2690 raft_consensus.cc:2749] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.870025 2662 raft_consensus.cc:493] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.870182 2662 raft_consensus.cc:515] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.870796 2662 leader_election.cc:290] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:45.872932 1172 tablet_bootstrap.cc:492] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:45.873250 1172 ts_tablet_manager.cc:1403] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.000s
W20260318 02:51:45.873535 999 leader_election.cc:343] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 82858fd64d534d1abcad12bc4a93cda7
I20260318 02:51:45.874612 1172 raft_consensus.cc:359] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.874940 1172 raft_consensus.cc:385] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.875072 1172 raft_consensus.cc:740] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
W20260318 02:51:45.875627 441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.189:45933, user_credentials={real_user=slave}} blocked reactor thread for 73453.6us
I20260318 02:51:45.875520 1172 consensus_queue.cc:260] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.876451 2704 tablet_replica.cc:333] T d8b956e389134a4485434a819a5df2e7 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:45.876648 2704 raft_consensus.cc:2243] T d8b956e389134a4485434a819a5df2e7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.876806 2704 raft_consensus.cc:2272] T d8b956e389134a4485434a819a5df2e7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.876579 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet fb5d1d828899472e8f48723b35e94d62 (table default.Table_7692f02c62f94771bc39331507161bb2 [id=60f0afdd0f9f4c5196ea491b90991241]) successfully deleted
I20260318 02:51:45.877300 2704 ts_tablet_manager.cc:1916] T d8b956e389134a4485434a819a5df2e7 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.880003 1172 ts_tablet_manager.cc:1434] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260318 02:51:45.847249 1173 ts_tablet_manager.cc:1403] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.126s user 0.004s sys 0.000s
I20260318 02:51:45.874689 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82858fd64d534d1abcad12bc4a93cda7" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:45.847438 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf6517e55af54c3dae05ed6bceaa7638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.885550 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab9bdc476f64d758637a12148f2b092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.887370 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7d45558bcb4c658a69741730b2f98c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.888841 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4196352b47614d67b1db9c45b693f7df. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:45.889062 997 leader_election.cc:343] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.850265 1175 ts_tablet_manager.cc:1916] T c0c33cfa1c194a65bfc64d0e1e9434ff P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.890708 2704 ts_tablet_manager.cc:1929] T d8b956e389134a4485434a819a5df2e7 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.890888 2704 log.cc:1199] T d8b956e389134a4485434a819a5df2e7 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/d8b956e389134a4485434a819a5df2e7
I20260318 02:51:45.891289 2704 ts_tablet_manager.cc:1950] T d8b956e389134a4485434a819a5df2e7 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:45.892287 2704 tablet_replica.cc:333] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:45.892514 2704 raft_consensus.cc:2243] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.892736 2704 raft_consensus.cc:2272] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.892740 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet d8b956e389134a4485434a819a5df2e7 (table default.Table_5ceb6bf88c4743ee88d4fe26441e46ec [id=711aeebd6e7b4620b53d44b7692de91a]) successfully deleted
I20260318 02:51:45.892814 997 leader_election.cc:304] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:45.893463 2662 raft_consensus.cc:2749] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.893966 1173 raft_consensus.cc:359] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.894157 1173 raft_consensus.cc:385] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.894235 1173 raft_consensus.cc:740] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.894452 1173 consensus_queue.cc:260] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.896983 1173 ts_tablet_manager.cc:1434] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260318 02:51:45.898013 1174 tablet_bootstrap.cc:492] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:45.898149 1174 ts_tablet_manager.cc:1403] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.125s user 0.030s sys 0.037s
I20260318 02:51:45.899744 1173 tablet_bootstrap.cc:492] T 68b0f0cd89234e72a052f3f9f964aa35 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:45.900813 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 763549b232c248188d063cccde126772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.901078 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb7d45558bcb4c658a69741730b2f98c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.901480 1174 raft_consensus.cc:359] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.901666 1174 raft_consensus.cc:385] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.901721 1174 raft_consensus.cc:740] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.902078 2593 raft_consensus.cc:493] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.902228 2593 raft_consensus.cc:515] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.902805 2593 leader_election.cc:290] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:45.903257 1175 ts_tablet_manager.cc:1929] T c0c33cfa1c194a65bfc64d0e1e9434ff P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.903362 1175 log.cc:1199] T c0c33cfa1c194a65bfc64d0e1e9434ff P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/c0c33cfa1c194a65bfc64d0e1e9434ff
I20260318 02:51:45.903643 1175 ts_tablet_manager.cc:1950] T c0c33cfa1c194a65bfc64d0e1e9434ff P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
W20260318 02:51:45.903725 862 leader_election.cc:343] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: f72023f5408f4ef4b628568da0c008d6
I20260318 02:51:45.903987 1174 consensus_queue.cc:260] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.904309 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72023f5408f4ef4b628568da0c008d6" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:45.904633 1174 ts_tablet_manager.cc:1434] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
W20260318 02:51:45.904841 860 leader_election.cc:343] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: Tablet not RUNNING: STOPPED
I20260318 02:51:45.904925 1174 tablet_bootstrap.cc:492] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:45.904940 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf6517e55af54c3dae05ed6bceaa7638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.904976 860 leader_election.cc:304] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:45.905588 2593 raft_consensus.cc:2749] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.906410 1174 tablet_bootstrap.cc:654] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.908972 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4196352b47614d67b1db9c45b693f7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.911721 2704 ts_tablet_manager.cc:1916] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.912757 2593 raft_consensus.cc:493] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.912914 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f87b929bea754436b07ec7265d9b0514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.912914 2593 raft_consensus.cc:515] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.913533 2593 leader_election.cc:290] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:45.914397 862 leader_election.cc:343] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: de2bc2f79e8b49248de3e7eca1a600cf
W20260318 02:51:45.915361 860 leader_election.cc:343] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: de2bc2f79e8b49248de3e7eca1a600cf
I20260318 02:51:45.915473 860 leader_election.cc:304] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:45.916169 2593 raft_consensus.cc:2749] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.922770 1175 tablet_replica.cc:333] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:45.922995 1175 raft_consensus.cc:2243] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.923157 1175 raft_consensus.cc:2272] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.923166 1173 tablet_bootstrap.cc:654] T 68b0f0cd89234e72a052f3f9f964aa35 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.925493 1184 ts_tablet_manager.cc:1929] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.926774 1175 ts_tablet_manager.cc:1916] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.928417 1184 log.cc:1199] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/f72023f5408f4ef4b628568da0c008d6
I20260318 02:51:45.928834 1184 ts_tablet_manager.cc:1950] T f72023f5408f4ef4b628568da0c008d6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:45.932539 1173 tablet_bootstrap.cc:492] T 68b0f0cd89234e72a052f3f9f964aa35 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:45.932753 1173 ts_tablet_manager.cc:1403] T 68b0f0cd89234e72a052f3f9f964aa35 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.001s
I20260318 02:51:45.933550 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1142) took 5025 ms. Trace:
I20260318 02:51:45.933569 1173 raft_consensus.cc:359] T 68b0f0cd89234e72a052f3f9f964aa35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.933772 1173 raft_consensus.cc:385] T 68b0f0cd89234e72a052f3f9f964aa35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.933848 1173 raft_consensus.cc:740] T 68b0f0cd89234e72a052f3f9f964aa35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.933992 1175 ts_tablet_manager.cc:1929] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.934120 1175 log.cc:1199] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/f72023f5408f4ef4b628568da0c008d6
I20260318 02:51:45.934126 1173 consensus_queue.cc:260] T 68b0f0cd89234e72a052f3f9f964aa35 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.934458 1175 ts_tablet_manager.cc:1950] T f72023f5408f4ef4b628568da0c008d6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:45.934670 1173 ts_tablet_manager.cc:1434] T 68b0f0cd89234e72a052f3f9f964aa35 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260318 02:51:45.934954 1173 tablet_bootstrap.cc:492] T b8973d8930ef4b65be7b4ff990bf9d72 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:45.936453 1174 tablet_bootstrap.cc:492] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:45.937820 1174 ts_tablet_manager.cc:1403] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.033s user 0.007s sys 0.012s
I20260318 02:51:45.938488 1174 raft_consensus.cc:359] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.938653 1174 raft_consensus.cc:385] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.938699 1174 raft_consensus.cc:740] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.938890 1174 consensus_queue.cc:260] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.942283 2704 ts_tablet_manager.cc:1929] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.942533 1184 rpcz_store.cc:276] 0318 02:51:40.908068 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.908127 (+ 59us) service_pool.cc:225] Handling call
0318 02:51:45.715177 (+4807050us) ts_tablet_manager.cc:1151] Deleting tablet f72023f5408f4ef4b628568da0c008d6
0318 02:51:45.715186 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.817280 (+102094us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:45.925375 (+108095us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:45.933527 (+ 8152us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4832,"tablet-delete.queue_time_us":4797640}
I20260318 02:51:45.937059 1172 tablet_bootstrap.cc:492] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:45.944837 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1143) took 5036 ms. Trace:
I20260318 02:51:45.944948 1184 rpcz_store.cc:276] 0318 02:51:40.908663 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:40.908739 (+ 76us) service_pool.cc:225] Handling call
0318 02:51:45.944572 (+5035833us) ts_tablet_manager.cc:1151] Deleting tablet 78aba0a60d494da9ac3b8b4fd3d5dc68
0318 02:51:45.944585 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.944814 (+ 229us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5026991}
I20260318 02:51:45.945300 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1144) took 4816 ms. Trace:
I20260318 02:51:45.945379 1184 rpcz_store.cc:276] 0318 02:51:41.128904 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.130122 (+ 1218us) service_pool.cc:225] Handling call
0318 02:51:45.945195 (+4815073us) ts_tablet_manager.cc:1151] Deleting tablet 373a94164167431c87025ce82c9b88d9
0318 02:51:45.945205 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.945284 (+ 79us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4814476}
I20260318 02:51:45.945688 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1145) took 4815 ms. Trace:
I20260318 02:51:45.945736 1173 tablet_bootstrap.cc:654] T b8973d8930ef4b65be7b4ff990bf9d72 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.945771 1184 rpcz_store.cc:276] 0318 02:51:41.130440 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.130495 (+ 55us) service_pool.cc:225] Handling call
0318 02:51:45.945593 (+4815098us) ts_tablet_manager.cc:1151] Deleting tablet 916f7a2a31f843e39f8703ba72b78287
0318 02:51:45.945600 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.945671 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4814791}
I20260318 02:51:45.946081 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1147) took 4814 ms. Trace:
I20260318 02:51:45.946156 1184 rpcz_store.cc:276] 0318 02:51:41.131131 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.131176 (+ 45us) service_pool.cc:225] Handling call
0318 02:51:45.945975 (+4814799us) ts_tablet_manager.cc:1151] Deleting tablet 6a65ccfd73234e8fb2bea5b6911cb3f1
0318 02:51:45.945983 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.946066 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4814620}
I20260318 02:51:45.946379 1172 tablet_bootstrap.cc:654] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.946451 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1163) took 4722 ms. Trace:
I20260318 02:51:45.946524 1184 rpcz_store.cc:276] 0318 02:51:41.223504 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.223587 (+ 83us) service_pool.cc:225] Handling call
0318 02:51:45.946358 (+4722771us) ts_tablet_manager.cc:1151] Deleting tablet c1b33758e7e546abba5b02c79db6c1d2
0318 02:51:45.946366 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.946437 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4722561}
I20260318 02:51:45.946831 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1177) took 4661 ms. Trace:
I20260318 02:51:45.946914 1184 rpcz_store.cc:276] 0318 02:51:41.285014 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.345871 (+ 60857us) service_pool.cc:225] Handling call
0318 02:51:45.946730 (+4600859us) ts_tablet_manager.cc:1151] Deleting tablet 793a87e8bcb442c1b6fb0ecfcbc71480
0318 02:51:45.946738 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.946814 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4600654}
I20260318 02:51:45.948081 1173 tablet_bootstrap.cc:492] T b8973d8930ef4b65be7b4ff990bf9d72 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:45.948243 905 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a3a36a7fd4742c9827b334ce31d4a7c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:45.948312 1173 ts_tablet_manager.cc:1403] T b8973d8930ef4b65be7b4ff990bf9d72 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.001s
I20260318 02:51:45.948514 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a90be200678468eaa8c57b843521440 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:45 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:45.949110 1175 tablet_replica.cc:333] T 2a3a36a7fd4742c9827b334ce31d4a7c P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:45.949091 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a90be200678468eaa8c57b843521440 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:45 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:45.949365 1175 raft_consensus.cc:2243] T 2a3a36a7fd4742c9827b334ce31d4a7c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.949653 1175 raft_consensus.cc:2272] T 2a3a36a7fd4742c9827b334ce31d4a7c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.950497 1175 ts_tablet_manager.cc:1916] T 2a3a36a7fd4742c9827b334ce31d4a7c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.950959 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 1fa6e24943d54a3ea40fd34980ba2b27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:45 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:45.951423 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 1fa6e24943d54a3ea40fd34980ba2b27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:45 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:45.952229 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 66f2eb49809945b3ae9d083a4fe56245 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:45 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:45.952644 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 66f2eb49809945b3ae9d083a4fe56245 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:45 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:45.953506 893 tablet_service.cc:1558] Processing DeleteTablet for tablet b3a12a4854914f9892e614697fe3a7b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:45 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:45.953917 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet b3a12a4854914f9892e614697fe3a7b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:45 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:45.954622 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 59ce7583e7f545f18145b4e55e1fbb81 with delete_type TABLET_DATA_DELETED (replaced by tablet 6934cf71f9034febb5e0ebfa410fb94b) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:45.954963 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1178) took 4667 ms. Trace:
I20260318 02:51:45.944813 1174 ts_tablet_manager.cc:1434] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260318 02:51:45.958431 1174 tablet_bootstrap.cc:492] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:45.955142 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 59ce7583e7f545f18145b4e55e1fbb81 with delete_type TABLET_DATA_DELETED (replaced by tablet 6934cf71f9034febb5e0ebfa410fb94b) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:45.958148 2704 log.cc:1199] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/d0b01131720748688ca6c28985a3b3ff
I20260318 02:51:45.959408 1184 rpcz_store.cc:276] 0318 02:51:41.287976 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.346090 (+ 58114us) service_pool.cc:225] Handling call
0318 02:51:45.954816 (+4608726us) ts_tablet_manager.cc:1151] Deleting tablet cce09767819441e599e7a62526d2cb75
0318 02:51:45.954827 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.954943 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4608615}
I20260318 02:51:45.959759 2704 ts_tablet_manager.cc:1950] T d0b01131720748688ca6c28985a3b3ff P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:45.960098 1174 tablet_bootstrap.cc:654] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.960275 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1179) took 4672 ms. Trace:
I20260318 02:51:45.960853 2704 tablet_replica.cc:333] T fd1284c6e90d4beb8223fd807d7888ec P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:45.960870 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet d0b01131720748688ca6c28985a3b3ff (table default.Table_85c16d674e834595911be295a8222653 [id=c21facd3dbe74a239960adf801256801]) successfully deleted
I20260318 02:51:45.961150 2704 raft_consensus.cc:2243] T fd1284c6e90d4beb8223fd807d7888ec P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.961122 1184 rpcz_store.cc:276] 0318 02:51:41.288079 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.346199 (+ 58120us) service_pool.cc:225] Handling call
0318 02:51:45.960079 (+4613880us) ts_tablet_manager.cc:1151] Deleting tablet 5f63108c062348b1ba995ea16f40a695
0318 02:51:45.960089 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.960256 (+ 167us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4613701}
I20260318 02:51:45.961428 2704 raft_consensus.cc:2272] T fd1284c6e90d4beb8223fd807d7888ec P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.961659 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1185) took 4393 ms. Trace:
I20260318 02:51:45.961740 1184 rpcz_store.cc:276] 0318 02:51:41.568199 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.568256 (+ 57us) service_pool.cc:225] Handling call
0318 02:51:45.961538 (+4393282us) ts_tablet_manager.cc:1151] Deleting tablet fae818515c7744899b80b87bd6dcd198
0318 02:51:45.961550 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.961643 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4393024}
I20260318 02:51:45.962132 2704 ts_tablet_manager.cc:1916] T fd1284c6e90d4beb8223fd807d7888ec P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.963299 1184 tablet_replica.cc:333] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:45.963485 1184 raft_consensus.cc:2243] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:45.963819 1184 raft_consensus.cc:2272] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.964337 1184 ts_tablet_manager.cc:1916] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.965452 2660 raft_consensus.cc:493] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.965572 2660 raft_consensus.cc:515] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.966131 2660 leader_election.cc:290] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:45.966049 893 tablet_service.cc:1511] Processing CreateTablet for tablet 4aab5486caa24d09a9e43c3db0df5d79 (DEFAULT_TABLE table=default.Table_50962224abd7467492507d0af7c6a030 [id=b2cffc121a364e96b33062c69737ef9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.966501 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aab5486caa24d09a9e43c3db0df5d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.967039 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c35d41da7146faa89d8af3bb5f5140" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:45.967038 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c35d41da7146faa89d8af3bb5f5140" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:45.967602 1175 ts_tablet_manager.cc:1929] T 2a3a36a7fd4742c9827b334ce31d4a7c P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.967698 1175 log.cc:1199] T 2a3a36a7fd4742c9827b334ce31d4a7c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/2a3a36a7fd4742c9827b334ce31d4a7c
I20260318 02:51:45.967974 1175 ts_tablet_manager.cc:1950] T 2a3a36a7fd4742c9827b334ce31d4a7c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
W20260318 02:51:45.967949 719 leader_election.cc:343] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:45.968117 719 leader_election.cc:343] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:45.968187 719 leader_election.cc:304] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:45.968509 2660 raft_consensus.cc:2749] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:45.972648 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 4aab5486caa24d09a9e43c3db0df5d79 (DEFAULT_TABLE table=default.Table_50962224abd7467492507d0af7c6a030 [id=b2cffc121a364e96b33062c69737ef9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.973261 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4aab5486caa24d09a9e43c3db0df5d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.973766 2704 ts_tablet_manager.cc:1929] T fd1284c6e90d4beb8223fd807d7888ec P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:45.973942 2704 log.cc:1199] T fd1284c6e90d4beb8223fd807d7888ec P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/fd1284c6e90d4beb8223fd807d7888ec
I20260318 02:51:45.974346 2704 ts_tablet_manager.cc:1950] T fd1284c6e90d4beb8223fd807d7888ec P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:45.975468 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet fd1284c6e90d4beb8223fd807d7888ec (table default.Table_86b70df7bd76402aaa4c0b1faa730a62 [id=d1dd0940c55b4a4a97cf0f8543ebcaf8]) successfully deleted
I20260318 02:51:45.976042 2704 tablet_replica.cc:333] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:45.976285 2704 raft_consensus.cc:2243] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.976519 2704 raft_consensus.cc:2272] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.977344 2704 ts_tablet_manager.cc:1916] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.980633 1031 tablet_service.cc:1511] Processing CreateTablet for tablet a5a4c494c20044d280cf43c89d9e3ce2 (DEFAULT_TABLE table=default.Table_79bea80cab3d40f5bead32f2fdcf09fa [id=873432f002e14a4fa7065dcfe5caebd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.981053 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a4c494c20044d280cf43c89d9e3ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.983144 1173 raft_consensus.cc:359] T b8973d8930ef4b65be7b4ff990bf9d72 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.983317 1173 raft_consensus.cc:385] T b8973d8930ef4b65be7b4ff990bf9d72 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.983359 1173 raft_consensus.cc:740] T b8973d8930ef4b65be7b4ff990bf9d72 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.983544 1173 consensus_queue.cc:260] T b8973d8930ef4b65be7b4ff990bf9d72 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.984019 1173 ts_tablet_manager.cc:1434] T b8973d8930ef4b65be7b4ff990bf9d72 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:45.984283 1173 tablet_bootstrap.cc:492] T 608df0ce4e1d4ed6b7655802a6f7f6bc P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:45.985699 1173 tablet_bootstrap.cc:654] T 608df0ce4e1d4ed6b7655802a6f7f6bc P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:45.986686 1184 ts_tablet_manager.cc:1929] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:45.986800 1184 log.cc:1199] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/cf73a9f8f67b42d9baf1396d70a1a3a9
I20260318 02:51:45.987118 1184 ts_tablet_manager.cc:1950] T cf73a9f8f67b42d9baf1396d70a1a3a9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:45.987890 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1183) took 4419 ms. Trace:
I20260318 02:51:45.987990 1184 rpcz_store.cc:276] 0318 02:51:41.567996 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.569705 (+ 1709us) service_pool.cc:225] Handling call
0318 02:51:45.963254 (+4393549us) ts_tablet_manager.cc:1151] Deleting tablet cf73a9f8f67b42d9baf1396d70a1a3a9
0318 02:51:45.963263 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.983931 (+ 20668us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:45.986583 (+ 2652us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:45.987868 (+ 1285us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4393250}
I20260318 02:51:45.988314 1184 tablet_replica.cc:333] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:45.988512 1184 raft_consensus.cc:2243] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:45.988461 893 tablet_service.cc:1511] Processing CreateTablet for tablet a5a4c494c20044d280cf43c89d9e3ce2 (DEFAULT_TABLE table=default.Table_79bea80cab3d40f5bead32f2fdcf09fa [id=873432f002e14a4fa7065dcfe5caebd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.988701 1184 raft_consensus.cc:2272] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:45.989068 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a4c494c20044d280cf43c89d9e3ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.989243 1184 ts_tablet_manager.cc:1916] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:45.994724 1173 tablet_bootstrap.cc:492] T 608df0ce4e1d4ed6b7655802a6f7f6bc P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:45.994907 1173 ts_tablet_manager.cc:1403] T 608df0ce4e1d4ed6b7655802a6f7f6bc P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260318 02:51:45.995735 905 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce4f2d7d92f4d1ba4ce666e48cf8d8b (DEFAULT_TABLE table=default.Table_57cf0fee93474e9ebf2fb7c515c7aaf5 [id=935681f43fc743eb8eed9b63c787c8e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.995808 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce4f2d7d92f4d1ba4ce666e48cf8d8b (DEFAULT_TABLE table=default.Table_57cf0fee93474e9ebf2fb7c515c7aaf5 [id=935681f43fc743eb8eed9b63c787c8e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:45.996162 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce4f2d7d92f4d1ba4ce666e48cf8d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.996425 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce4f2d7d92f4d1ba4ce666e48cf8d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:45.996876 1173 raft_consensus.cc:359] T 608df0ce4e1d4ed6b7655802a6f7f6bc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.997044 1173 raft_consensus.cc:385] T 608df0ce4e1d4ed6b7655802a6f7f6bc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:45.997095 1173 raft_consensus.cc:740] T 608df0ce4e1d4ed6b7655802a6f7f6bc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:45.997282 1173 consensus_queue.cc:260] T 608df0ce4e1d4ed6b7655802a6f7f6bc P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:45.997692 2662 raft_consensus.cc:493] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:45.997820 2662 raft_consensus.cc:515] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:45.998423 2662 leader_election.cc:290] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:45.983357 2704 ts_tablet_manager.cc:1929] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.002157 2704 log.cc:1199] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/b894f0772a754196a3e651b38c46f001
I20260318 02:51:46.002477 2704 ts_tablet_manager.cc:1950] T b894f0772a754196a3e651b38c46f001 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:46.000620 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461adcc8bbd94d30b9b84d1010430829" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:46.003454 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet b894f0772a754196a3e651b38c46f001 (table default.Table_b3839730b36c41868e3760527839bafb [id=c5fda294c63f4731b2890404b92def44]) successfully deleted
I20260318 02:51:46.003592 2649 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee6aa91804a2401fa0ceb31b196ec40a" member_type: VOTER last_known_addr { host: "127.0.104.190" port: 39451 } } peers { permanent_uuid: "8b701993861d4c11b3394a2d6588b3b7" member_type: VOTER last_known_addr { host: "127.0.104.189" port: 45933 } } peers { permanent_uuid: "971baf5b9e4644c990dbf4d4fc7ba900" member_type: VOTER last_known_addr { host: "127.0.104.188" port: 41593 } } }
I20260318 02:51:46.003764 2649 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a [sys.catalog]: This master's current role is: LEADER
W20260318 02:51:46.004741 999 leader_election.cc:343] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 461adcc8bbd94d30b9b84d1010430829
I20260318 02:51:46.006306 890 tablet_service.cc:1511] Processing CreateTablet for tablet bbe81848885f4ea89b1a7307e5a9f3b3 (DEFAULT_TABLE table=default.Table_e4f76e7e6a3f45a9a367b7c2874f85e0 [id=a3688e1d2f884393bfb56ff84890d5b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.006389 903 tablet_service.cc:1511] Processing CreateTablet for tablet ba9554206a4a431cbe35a4efb2615eab (DEFAULT_TABLE table=default.Table_c16e719f5ec444dfbf8cc9fd019945e6 [id=ed4e6b506f964405877f8d6cbfff5c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.006721 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe81848885f4ea89b1a7307e5a9f3b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.009025 897 tablet_service.cc:1511] Processing CreateTablet for tablet 2fcfbac8dcfe4a23b7be892a4d758b22 (DEFAULT_TABLE table=default.Table_c89f8c40260f47be9787ac38ce5dcd46 [id=1dbb8f277403450086790ee9034c98da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.009420 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fcfbac8dcfe4a23b7be892a4d758b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.009383 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet c7c4257a54d3487aa520531a64fc721c (table default.Table_ebd103e5fbf4484597076b02ffd82044 [id=4067c18ce85f44d7993786a3e9bda883]) successfully deleted
I20260318 02:51:46.009732 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 8a0af3aecf4f485ebc54e1955eca8c92 (table default.Table_7671b3be1e0c4259a325679c394aae2c [id=688586df74e84dc0a4fc5dc50ef48f32]) successfully deleted
I20260318 02:51:46.010921 1041 tablet_service.cc:1511] Processing CreateTablet for tablet bbe81848885f4ea89b1a7307e5a9f3b3 (DEFAULT_TABLE table=default.Table_e4f76e7e6a3f45a9a367b7c2874f85e0 [id=a3688e1d2f884393bfb56ff84890d5b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.011307 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbe81848885f4ea89b1a7307e5a9f3b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.011293 905 tablet_service.cc:1511] Processing CreateTablet for tablet 1a1f0601a7a249c78a05f23084ff535e (DEFAULT_TABLE table=default.Table_b6bc70833af0498d8ec1b7e98aff1c64 [id=36cd7596eb47491689505e77dcffa567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.011602 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a1f0601a7a249c78a05f23084ff535e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.012912 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba9554206a4a431cbe35a4efb2615eab. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:46.010967 997 leader_election.cc:343] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.014149 997 leader_election.cc:304] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.014598 2605 raft_consensus.cc:2749] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:46.018978 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 2fcfbac8dcfe4a23b7be892a4d758b22 (DEFAULT_TABLE table=default.Table_c89f8c40260f47be9787ac38ce5dcd46 [id=1dbb8f277403450086790ee9034c98da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.019381 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fcfbac8dcfe4a23b7be892a4d758b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.019455 1184 ts_tablet_manager.cc:1929] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260318 02:51:46.019569 1184 log.cc:1199] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/6b82751cbcbb4c39a6942b6856412fc8
I20260318 02:51:46.019897 1184 ts_tablet_manager.cc:1950] T 6b82751cbcbb4c39a6942b6856412fc8 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.020632 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1184) took 4452 ms. Trace:
I20260318 02:51:46.020758 1184 rpcz_store.cc:276] 0318 02:51:41.568118 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.568864 (+ 746us) service_pool.cc:225] Handling call
0318 02:51:45.988269 (+4419405us) ts_tablet_manager.cc:1151] Deleting tablet 6b82751cbcbb4c39a6942b6856412fc8
0318 02:51:45.988278 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:45.992040 (+ 3762us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.019358 (+ 27318us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.020612 (+ 1254us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4388564}
I20260318 02:51:46.021378 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1188) took 4419 ms. Trace:
I20260318 02:51:46.021449 1184 rpcz_store.cc:276] 0318 02:51:41.601473 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.601522 (+ 49us) service_pool.cc:225] Handling call
0318 02:51:46.021151 (+4419629us) ts_tablet_manager.cc:1151] Deleting tablet 9a0fe429edde49fe8702ffb13b034a6c
0318 02:51:46.021160 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.021363 (+ 203us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4419344}
I20260318 02:51:46.021759 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1187) took 4420 ms. Trace:
I20260318 02:51:46.021826 1184 rpcz_store.cc:276] 0318 02:51:41.601352 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.601845 (+ 493us) service_pool.cc:225] Handling call
0318 02:51:46.021649 (+4419804us) ts_tablet_manager.cc:1151] Deleting tablet 416d5d20d0f649ca872de02471fa9cf8
0318 02:51:46.021657 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.021744 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4419583}
I20260318 02:51:46.022083 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1176) took 4737 ms. Trace:
I20260318 02:51:46.022141 1184 rpcz_store.cc:276] 0318 02:51:41.284949 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.321266 (+ 36317us) service_pool.cc:225] Handling call
0318 02:51:46.021998 (+4700732us) ts_tablet_manager.cc:1151] Deleting tablet c93e05eb5c9e4d5da1b688a03312ad8e
0318 02:51:46.022006 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.022070 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4347163}
I20260318 02:51:46.022394 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1197) took 4064 ms. Trace:
I20260318 02:51:46.022461 1184 rpcz_store.cc:276] 0318 02:51:41.958283 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.958323 (+ 40us) service_pool.cc:225] Handling call
0318 02:51:46.022309 (+4063986us) ts_tablet_manager.cc:1151] Deleting tablet fa077243d5634d888f3a191b7f9d2d19
0318 02:51:46.022317 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.022381 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3969544}
I20260318 02:51:46.022753 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1192) took 4066 ms. Trace:
I20260318 02:51:46.022825 1184 rpcz_store.cc:276] 0318 02:51:41.955964 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:41.956024 (+ 60us) service_pool.cc:225] Handling call
0318 02:51:46.022657 (+4066633us) ts_tablet_manager.cc:1151] Deleting tablet df499767dfee4fbd939d775db9d2577e
0318 02:51:46.022665 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.022739 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3936401}
I20260318 02:51:46.023105 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1203) took 3576 ms. Trace:
I20260318 02:51:46.023176 1184 rpcz_store.cc:276] 0318 02:51:42.446843 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.446910 (+ 67us) service_pool.cc:225] Handling call
0318 02:51:46.023018 (+3576108us) ts_tablet_manager.cc:1151] Deleting tablet 2332d8dabb79471e8c8ea545228c1d18
0318 02:51:46.023026 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.023091 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3575889}
I20260318 02:51:46.023448 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1204) took 3569 ms. Trace:
I20260318 02:51:46.023521 1184 rpcz_store.cc:276] 0318 02:51:42.453700 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.453767 (+ 67us) service_pool.cc:225] Handling call
0318 02:51:46.023363 (+3569596us) ts_tablet_manager.cc:1151] Deleting tablet d3b37df330984378b81b367446d34748
0318 02:51:46.023371 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.023435 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3569325}
I20260318 02:51:46.023792 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1205) took 3568 ms. Trace:
I20260318 02:51:46.023865 1184 rpcz_store.cc:276] 0318 02:51:42.455280 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.455339 (+ 59us) service_pool.cc:225] Handling call
0318 02:51:46.023707 (+3568368us) ts_tablet_manager.cc:1151] Deleting tablet a7c35c13521b43789a1f0b6092b4d855
0318 02:51:46.023714 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.023777 (+ 63us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3568144}
I20260318 02:51:46.024165 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1202) took 3577 ms. Trace:
I20260318 02:51:46.024240 1184 rpcz_store.cc:276] 0318 02:51:42.446713 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.457973 (+ 11260us) service_pool.cc:225] Handling call
0318 02:51:46.024052 (+3566079us) ts_tablet_manager.cc:1151] Deleting tablet 15f79ab1c38141adaed4bd381df26d9b
0318 02:51:46.024060 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.024152 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3565886}
I20260318 02:51:46.024523 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1208) took 3420 ms. Trace:
I20260318 02:51:46.024590 1184 rpcz_store.cc:276] 0318 02:51:42.604159 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.604213 (+ 54us) service_pool.cc:225] Handling call
0318 02:51:46.024438 (+3420225us) ts_tablet_manager.cc:1151] Deleting tablet 77a17ef7cfee4d65808b11e9cb51e7df
0318 02:51:46.024446 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.024510 (+ 64us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3419909}
I20260318 02:51:46.024945 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1210) took 3414 ms. Trace:
I20260318 02:51:46.025015 1184 rpcz_store.cc:276] 0318 02:51:42.610715 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.610772 (+ 57us) service_pool.cc:225] Handling call
0318 02:51:46.024858 (+3414086us) ts_tablet_manager.cc:1151] Deleting tablet b8477c484db84187a3a576de6195a228
0318 02:51:46.024866 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.024931 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3413841}
I20260318 02:51:46.025235 1184 tablet_replica.cc:333] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.025411 1184 raft_consensus.cc:2243] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.025565 1184 raft_consensus.cc:2272] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.026080 1184 ts_tablet_manager.cc:1916] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.026916 1027 tablet_service.cc:1511] Processing CreateTablet for tablet ba9554206a4a431cbe35a4efb2615eab (DEFAULT_TABLE table=default.Table_c16e719f5ec444dfbf8cc9fd019945e6 [id=ed4e6b506f964405877f8d6cbfff5c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.035290 1173 ts_tablet_manager.cc:1434] T 608df0ce4e1d4ed6b7655802a6f7f6bc P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.040s user 0.003s sys 0.001s
I20260318 02:51:46.035689 1173 tablet_bootstrap.cc:492] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:46.037128 1173 tablet_bootstrap.cc:654] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.037395 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba9554206a4a431cbe35a4efb2615eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.041962 1184 ts_tablet_manager.cc:1929] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.042095 1184 log.cc:1199] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/461adcc8bbd94d30b9b84d1010430829
I20260318 02:51:46.042356 1184 ts_tablet_manager.cc:1950] T 461adcc8bbd94d30b9b84d1010430829 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.045158 1173 tablet_bootstrap.cc:492] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:46.045308 1173 ts_tablet_manager.cc:1403] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260318 02:51:46.045991 1173 raft_consensus.cc:359] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:46.046166 1173 raft_consensus.cc:385] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.046218 1173 raft_consensus.cc:740] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.047123 1172 tablet_bootstrap.cc:492] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:46.047341 1172 ts_tablet_manager.cc:1403] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.110s user 0.003s sys 0.000s
I20260318 02:51:46.047928 1173 consensus_queue.cc:260] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:46.048305 1172 raft_consensus.cc:359] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.048516 1172 raft_consensus.cc:385] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.048604 1172 raft_consensus.cc:740] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.048940 1173 ts_tablet_manager.cc:1434] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:46.048867 1172 consensus_queue.cc:260] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.049214 1173 tablet_bootstrap.cc:492] T cf73a9f8f67b42d9baf1396d70a1a3a9 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:46.049491 1172 ts_tablet_manager.cc:1434] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260318 02:51:46.050699 1173 tablet_bootstrap.cc:654] T cf73a9f8f67b42d9baf1396d70a1a3a9 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.051944 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1229) took 3376 ms. Trace:
I20260318 02:51:46.052021 1184 rpcz_store.cc:276] 0318 02:51:42.675645 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.675907 (+ 262us) service_pool.cc:225] Handling call
0318 02:51:46.025197 (+3349290us) ts_tablet_manager.cc:1151] Deleting tablet 461adcc8bbd94d30b9b84d1010430829
0318 02:51:46.025205 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.039063 (+ 13858us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.041871 (+ 2808us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.051922 (+ 10051us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3347924}
I20260318 02:51:46.052476 1184 tablet_replica.cc:333] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.052646 1184 raft_consensus.cc:2243] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.052820 1184 raft_consensus.cc:2272] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.053121 1172 tablet_bootstrap.cc:492] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:46.053328 1184 ts_tablet_manager.cc:1916] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.055642 1172 tablet_bootstrap.cc:654] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.056118 1173 tablet_bootstrap.cc:492] T cf73a9f8f67b42d9baf1396d70a1a3a9 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:46.056269 1173 ts_tablet_manager.cc:1403] T cf73a9f8f67b42d9baf1396d70a1a3a9 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260318 02:51:46.057019 1173 raft_consensus.cc:359] T cf73a9f8f67b42d9baf1396d70a1a3a9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:46.057180 2605 raft_consensus.cc:493] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:46.057221 1173 raft_consensus.cc:385] T cf73a9f8f67b42d9baf1396d70a1a3a9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.057266 1173 raft_consensus.cc:740] T cf73a9f8f67b42d9baf1396d70a1a3a9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.057309 2605 raft_consensus.cc:515] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.057832 2605 leader_election.cc:290] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:46.058642 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e998e290291c443394f478c4ac1cfbd2" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:46.059070 441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 48875.2us
I20260318 02:51:46.059170 1173 consensus_queue.cc:260] T cf73a9f8f67b42d9baf1396d70a1a3a9 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:46.059341 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet c0c33cfa1c194a65bfc64d0e1e9434ff (table default.Table_c8ea19bed9e54eaf91af95c365e46851 [id=551f7031c6b84904836a915c07704492]) successfully deleted
I20260318 02:51:46.059553 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet f72023f5408f4ef4b628568da0c008d6 (table default.Table_f4faa0e71fbe408f9bc811fe2a9c62e4 [id=50010510ab9a432a9861d13efaaa9e6d]) successfully deleted
I20260318 02:51:46.059804 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 2a3a36a7fd4742c9827b334ce31d4a7c (table default.Table_607fac50cf4a4239bff8616d7176493d [id=f84167772dc74b15a01306e41817f3d1]) successfully deleted
I20260318 02:51:46.059825 1184 ts_tablet_manager.cc:1929] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.059947 1184 log.cc:1199] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/46ce65cca47f48db94e70226494cfbae
W20260318 02:51:46.060012 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2a90be200678468eaa8c57b843521440 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a90be200678468eaa8c57b843521440 already in progress: creating tablet
I20260318 02:51:46.060102 1173 ts_tablet_manager.cc:1434] T cf73a9f8f67b42d9baf1396d70a1a3a9 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260318 02:51:46.060102 997 leader_election.cc:343] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:46.060190 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 1fa6e24943d54a3ea40fd34980ba2b27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fa6e24943d54a3ea40fd34980ba2b27 already in progress: creating tablet
I20260318 02:51:46.060225 1184 ts_tablet_manager.cc:1950] T 46ce65cca47f48db94e70226494cfbae P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
W20260318 02:51:46.060346 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 66f2eb49809945b3ae9d083a4fe56245 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66f2eb49809945b3ae9d083a4fe56245 already in progress: creating tablet
I20260318 02:51:46.060420 1173 tablet_bootstrap.cc:492] T 19f0750985d947a3a9323944540abbac P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:46.060645 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet b3a12a4854914f9892e614697fe3a7b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3a12a4854914f9892e614697fe3a7b4 already in progress: creating tablet
I20260318 02:51:46.060961 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e998e290291c443394f478c4ac1cfbd2" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:46.061152 782 raft_consensus.cc:2468] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:46.062080 1173 tablet_bootstrap.cc:654] T 19f0750985d947a3a9323944540abbac P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.062644 999 leader_election.cc:304] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.063225 2662 raft_consensus.cc:2804] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:46.063313 2662 raft_consensus.cc:493] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:46.063371 2662 raft_consensus.cc:3060] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:46.064352 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1238) took 3383 ms. Trace:
I20260318 02:51:46.064430 1184 rpcz_store.cc:276] 0318 02:51:42.680837 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.681428 (+ 591us) service_pool.cc:225] Handling call
0318 02:51:46.052425 (+3370997us) ts_tablet_manager.cc:1151] Deleting tablet 46ce65cca47f48db94e70226494cfbae
0318 02:51:46.052436 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.056388 (+ 3952us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.059711 (+ 3323us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.064330 (+ 4619us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3370637}
I20260318 02:51:46.064956 1184 tablet_replica.cc:333] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.065146 1184 raft_consensus.cc:2243] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.065291 1184 raft_consensus.cc:2272] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.065795 1184 ts_tablet_manager.cc:1916] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.065930 2662 raft_consensus.cc:515] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.066533 2662 leader_election.cc:290] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:46.066545 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 59ce7583e7f545f18145b4e55e1fbb81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59ce7583e7f545f18145b4e55e1fbb81 already in progress: creating tablet
I20260318 02:51:46.066876 1174 tablet_bootstrap.cc:492] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:46.067023 1174 ts_tablet_manager.cc:1403] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.109s user 0.011s sys 0.028s
I20260318 02:51:46.067595 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e998e290291c443394f478c4ac1cfbd2" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:46.067760 1174 raft_consensus.cc:359] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.067843 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet f72023f5408f4ef4b628568da0c008d6 (table default.Table_f4faa0e71fbe408f9bc811fe2a9c62e4 [id=50010510ab9a432a9861d13efaaa9e6d]) successfully deleted
I20260318 02:51:46.067931 1174 raft_consensus.cc:385] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.067981 1174 raft_consensus.cc:740] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
W20260318 02:51:46.068064 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 78aba0a60d494da9ac3b8b4fd3d5dc68 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78aba0a60d494da9ac3b8b4fd3d5dc68 already in progress: creating tablet
I20260318 02:51:46.065150 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 1a1f0601a7a249c78a05f23084ff535e (DEFAULT_TABLE table=default.Table_b6bc70833af0498d8ec1b7e98aff1c64 [id=36cd7596eb47491689505e77dcffa567]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:46.068220 997 leader_election.cc:343] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:46.068240 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 373a94164167431c87025ce82c9b88d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 373a94164167431c87025ce82c9b88d9 already in progress: creating tablet
I20260318 02:51:46.068184 1174 consensus_queue.cc:260] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:46.068392 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 916f7a2a31f843e39f8703ba72b78287 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 916f7a2a31f843e39f8703ba72b78287 already in progress: creating tablet
W20260318 02:51:46.068548 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 already in progress: creating tablet
I20260318 02:51:46.068744 1174 ts_tablet_manager.cc:1434] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260318 02:51:46.069031 1174 tablet_bootstrap.cc:492] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:46.070621 1174 tablet_bootstrap.cc:654] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.072029 1173 tablet_bootstrap.cc:492] T 19f0750985d947a3a9323944540abbac P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:46.072072 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e998e290291c443394f478c4ac1cfbd2" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:46.072237 782 raft_consensus.cc:3060] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:46.074548 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a1f0601a7a249c78a05f23084ff535e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.074962 782 raft_consensus.cc:2468] T e998e290291c443394f478c4ac1cfbd2 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:46.076110 999 leader_election.cc:304] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.076822 2605 raft_consensus.cc:2804] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:46.076959 2605 raft_consensus.cc:697] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:46.077178 2605 consensus_queue.cc:237] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.072175 1173 ts_tablet_manager.cc:1403] T 19f0750985d947a3a9323944540abbac P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260318 02:51:46.080636 1173 raft_consensus.cc:359] T 19f0750985d947a3a9323944540abbac P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.080842 1173 raft_consensus.cc:385] T 19f0750985d947a3a9323944540abbac P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.080892 1173 raft_consensus.cc:740] T 19f0750985d947a3a9323944540abbac P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.081458 1173 consensus_queue.cc:260] T 19f0750985d947a3a9323944540abbac P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:46.081667 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet c1b33758e7e546abba5b02c79db6c1d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1b33758e7e546abba5b02c79db6c1d2 already in progress: creating tablet
W20260318 02:51:46.081961 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 793a87e8bcb442c1b6fb0ecfcbc71480 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 793a87e8bcb442c1b6fb0ecfcbc71480 already in progress: creating tablet
I20260318 02:51:46.082067 1173 ts_tablet_manager.cc:1434] T 19f0750985d947a3a9323944540abbac P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260318 02:51:46.082157 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet cce09767819441e599e7a62526d2cb75 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cce09767819441e599e7a62526d2cb75 already in progress: creating tablet
W20260318 02:51:46.082316 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 5f63108c062348b1ba995ea16f40a695 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f63108c062348b1ba995ea16f40a695 already in progress: creating tablet
I20260318 02:51:46.082340 1173 tablet_bootstrap.cc:492] T 46ce65cca47f48db94e70226494cfbae P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:46.082471 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet fae818515c7744899b80b87bd6dcd198 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fae818515c7744899b80b87bd6dcd198 already in progress: creating tablet
I20260318 02:51:46.082791 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet cf73a9f8f67b42d9baf1396d70a1a3a9 (table default.Table_c0889091422144f8af318ab6f38afd05 [id=75621b04db1d4c67bd2d2f5fe76c8a25]) successfully deleted
I20260318 02:51:46.083108 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 6b82751cbcbb4c39a6942b6856412fc8 (table default.Table_4a0d32e1914846ec81bdfcb8a0fd758e [id=84a657155372475db438c6eb3119b595]) successfully deleted
W20260318 02:51:46.083271 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 9a0fe429edde49fe8702ffb13b034a6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a0fe429edde49fe8702ffb13b034a6c already in progress: creating tablet
W20260318 02:51:46.083420 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 416d5d20d0f649ca872de02471fa9cf8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 416d5d20d0f649ca872de02471fa9cf8 already in progress: creating tablet
W20260318 02:51:46.083563 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet c93e05eb5c9e4d5da1b688a03312ad8e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c93e05eb5c9e4d5da1b688a03312ad8e already in progress: creating tablet
W20260318 02:51:46.083695 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet fa077243d5634d888f3a191b7f9d2d19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa077243d5634d888f3a191b7f9d2d19 already in progress: creating tablet
W20260318 02:51:46.083847 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet df499767dfee4fbd939d775db9d2577e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df499767dfee4fbd939d775db9d2577e already in progress: creating tablet
W20260318 02:51:46.084000 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2332d8dabb79471e8c8ea545228c1d18 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2332d8dabb79471e8c8ea545228c1d18 already in progress: creating tablet
I20260318 02:51:46.084102 1173 tablet_bootstrap.cc:654] T 46ce65cca47f48db94e70226494cfbae P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:46.084147 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet d3b37df330984378b81b367446d34748 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3b37df330984378b81b367446d34748 already in progress: creating tablet
W20260318 02:51:46.084302 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet a7c35c13521b43789a1f0b6092b4d855 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7c35c13521b43789a1f0b6092b4d855 already in progress: creating tablet
W20260318 02:51:46.084453 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 15f79ab1c38141adaed4bd381df26d9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15f79ab1c38141adaed4bd381df26d9b already in progress: creating tablet
W20260318 02:51:46.084601 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 77a17ef7cfee4d65808b11e9cb51e7df because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77a17ef7cfee4d65808b11e9cb51e7df already in progress: creating tablet
I20260318 02:51:46.089563 1172 tablet_bootstrap.cc:492] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:46.089721 1172 ts_tablet_manager.cc:1403] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.037s user 0.001s sys 0.002s
I20260318 02:51:46.090469 1172 raft_consensus.cc:359] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.090656 1172 raft_consensus.cc:385] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.090709 1172 raft_consensus.cc:740] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.092204 1173 tablet_bootstrap.cc:492] T 46ce65cca47f48db94e70226494cfbae P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:46.092345 1173 ts_tablet_manager.cc:1403] T 46ce65cca47f48db94e70226494cfbae P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260318 02:51:46.092403 1184 ts_tablet_manager.cc:1929] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.092525 1184 log.cc:1199] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/64c2a579264e43b9a1e25ded000d4d9f
I20260318 02:51:46.092882 1172 consensus_queue.cc:260] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.093034 1184 ts_tablet_manager.cc:1950] T 64c2a579264e43b9a1e25ded000d4d9f P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.093128 1173 raft_consensus.cc:359] T 46ce65cca47f48db94e70226494cfbae P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.093286 1173 raft_consensus.cc:385] T 46ce65cca47f48db94e70226494cfbae P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.093334 1173 raft_consensus.cc:740] T 46ce65cca47f48db94e70226494cfbae P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.093514 1173 consensus_queue.cc:260] T 46ce65cca47f48db94e70226494cfbae P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.093873 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1240) took 3317 ms. Trace:
I20260318 02:51:46.093940 1172 ts_tablet_manager.cc:1434] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260318 02:51:46.094252 1172 tablet_bootstrap.cc:492] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:46.096005 1172 tablet_bootstrap.cc:654] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.096127 1173 ts_tablet_manager.cc:1434] T 46ce65cca47f48db94e70226494cfbae P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:46.093952 1184 rpcz_store.cc:276] 0318 02:51:42.776230 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.796480 (+ 20250us) service_pool.cc:225] Handling call
0318 02:51:46.064894 (+3268414us) ts_tablet_manager.cc:1151] Deleting tablet 64c2a579264e43b9a1e25ded000d4d9f
0318 02:51:46.064905 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.089473 (+ 24568us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.092296 (+ 2823us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.093852 (+ 1556us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":47,"tablet-delete.queue_time_us":3268141}
I20260318 02:51:46.096400 1173 tablet_bootstrap.cc:492] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:46.096432 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1241) took 3289 ms. Trace:
I20260318 02:51:46.096508 1184 rpcz_store.cc:276] 0318 02:51:42.807387 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:42.807892 (+ 505us) service_pool.cc:225] Handling call
0318 02:51:46.096297 (+3288405us) ts_tablet_manager.cc:1151] Deleting tablet 1294e1ae2115471a8b605d38f1c26e60
0318 02:51:46.096307 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.096416 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3288169}
I20260318 02:51:46.096654 2715 raft_consensus.cc:493] T 68b0f0cd89234e72a052f3f9f964aa35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:46.096805 2715 raft_consensus.cc:515] T 68b0f0cd89234e72a052f3f9f964aa35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:46.096864 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1243) took 2965 ms. Trace:
I20260318 02:51:46.096943 1184 rpcz_store.cc:276] 0318 02:51:43.131753 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.131825 (+ 72us) service_pool.cc:225] Handling call
0318 02:51:46.096757 (+2964932us) ts_tablet_manager.cc:1151] Deleting tablet 89a225cb00d04582b2bf0f569ddab07f
0318 02:51:46.096766 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.096848 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2964691}
I20260318 02:51:46.097337 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1244) took 2936 ms. Trace:
I20260318 02:51:46.097357 2715 leader_election.cc:290] T 68b0f0cd89234e72a052f3f9f964aa35 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:46.097399 1184 rpcz_store.cc:276] 0318 02:51:43.160446 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.161415 (+ 969us) service_pool.cc:225] Handling call
0318 02:51:46.097233 (+2935818us) ts_tablet_manager.cc:1151] Deleting tablet c3f37e3d16f943e0aeeddafe1a955599
0318 02:51:46.097242 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.097322 (+ 80us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2935600}
I20260318 02:51:46.097782 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1245) took 2931 ms. Trace:
I20260318 02:51:46.098037 1184 rpcz_store.cc:276] 0318 02:51:43.166559 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.166620 (+ 61us) service_pool.cc:225] Handling call
0318 02:51:46.097670 (+2931050us) ts_tablet_manager.cc:1151] Deleting tablet ca765bc27f564ab9ab419bcf2aeda59f
0318 02:51:46.097678 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.097768 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2930847}
I20260318 02:51:46.097891 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0f0cd89234e72a052f3f9f964aa35" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:46.098434 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1246) took 2926 ms. Trace:
I20260318 02:51:46.098497 1184 rpcz_store.cc:276] 0318 02:51:43.171629 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.171702 (+ 73us) service_pool.cc:225] Handling call
0318 02:51:46.098328 (+2926626us) ts_tablet_manager.cc:1151] Deleting tablet 82d2922edaae4dc0bd8bcf859d248a11
0318 02:51:46.098337 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.098420 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2926384}
I20260318 02:51:46.098883 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1247) took 2919 ms. Trace:
I20260318 02:51:46.098946 1184 rpcz_store.cc:276] 0318 02:51:43.179079 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.179153 (+ 74us) service_pool.cc:225] Handling call
0318 02:51:46.098777 (+2919624us) ts_tablet_manager.cc:1151] Deleting tablet bdb950b9207d4528a86fac1da0ae6538
0318 02:51:46.098785 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.098868 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2919439}
I20260318 02:51:46.099259 1184 tablet_replica.cc:333] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.099421 1184 raft_consensus.cc:2243] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.099543 1173 tablet_bootstrap.cc:654] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.099555 1184 raft_consensus.cc:2272] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.099792 782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68b0f0cd89234e72a052f3f9f964aa35" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:46.100054 1184 ts_tablet_manager.cc:1916] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.100337 862 leader_election.cc:304] T 68b0f0cd89234e72a052f3f9f964aa35 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:46.100560 2715 raft_consensus.cc:2749] T 68b0f0cd89234e72a052f3f9f964aa35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:46.101660 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet b8477c484db84187a3a576de6195a228 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b8477c484db84187a3a576de6195a228 already in progress: creating tablet
I20260318 02:51:46.102206 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 461adcc8bbd94d30b9b84d1010430829 (table default.Table_600a629a518c46678144af62a75ea690 [id=9de656e677a540ad90ccd30ab1d092e5]) successfully deleted
I20260318 02:51:46.102443 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 46ce65cca47f48db94e70226494cfbae (table default.Table_a1b9dc84de4a42288ee7754f4a110daa [id=a858f67286ca4fe09d8e64e68b31337a]) successfully deleted
I20260318 02:51:46.102639 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 64c2a579264e43b9a1e25ded000d4d9f (table default.Table_c662869530134cb08ab6cc52957d07d9 [id=fda071b90fe64716b46fd1ab46f4b934]) successfully deleted
W20260318 02:51:46.102782 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 1294e1ae2115471a8b605d38f1c26e60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1294e1ae2115471a8b605d38f1c26e60 already in progress: creating tablet
W20260318 02:51:46.102927 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 89a225cb00d04582b2bf0f569ddab07f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89a225cb00d04582b2bf0f569ddab07f already in progress: creating tablet
W20260318 02:51:46.103072 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet c3f37e3d16f943e0aeeddafe1a955599 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3f37e3d16f943e0aeeddafe1a955599 already in progress: creating tablet
W20260318 02:51:46.103204 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet ca765bc27f564ab9ab419bcf2aeda59f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca765bc27f564ab9ab419bcf2aeda59f already in progress: creating tablet
W20260318 02:51:46.103331 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 82d2922edaae4dc0bd8bcf859d248a11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82d2922edaae4dc0bd8bcf859d248a11 already in progress: creating tablet
W20260318 02:51:46.103515 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet bdb950b9207d4528a86fac1da0ae6538 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bdb950b9207d4528a86fac1da0ae6538 already in progress: creating tablet
I20260318 02:51:46.111907 451 master_service.cc:954] ReplaceTablet: received request to replace tablet 306367152e834668bbf5fcadd008b3ea from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:46.112919 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet e566cc653bd341feaadea09394b4ef94
I20260318 02:51:46.113538 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_61a1261da65d47c4802ca3a883412e41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:46.114075 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61a1261da65d47c4802ca3a883412e41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.115487 1184 ts_tablet_manager.cc:1929] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.115620 1184 log.cc:1199] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/49afed40c7aa4f2d913daed8055a098e
I20260318 02:51:46.115888 1184 ts_tablet_manager.cc:1950] T 49afed40c7aa4f2d913daed8055a098e P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.116000 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_39f3697e6d8047fa8af7d8312c902c41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:46.116508 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39f3697e6d8047fa8af7d8312c902c41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.116562 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1250) took 2712 ms. Trace:
I20260318 02:51:46.116636 1184 rpcz_store.cc:276] 0318 02:51:43.404127 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.404189 (+ 62us) service_pool.cc:225] Handling call
0318 02:51:46.099222 (+2695033us) ts_tablet_manager.cc:1151] Deleting tablet 49afed40c7aa4f2d913daed8055a098e
0318 02:51:46.099230 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.104803 (+ 5573us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.115377 (+ 10574us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.116544 (+ 1167us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2694838}
I20260318 02:51:46.117115 1184 tablet_replica.cc:333] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.117290 1184 raft_consensus.cc:2243] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:46.117537 1184 pending_rounds.cc:70] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d: Trying to abort 1 pending ops.
I20260318 02:51:46.117568 1184 pending_rounds.cc:77] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494237728530432 op_type: NO_OP noop_request { }
W20260318 02:51:46.117635 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e1d897fa1eb9435e8a4b59f4a984336a consensus state has no leader
I20260318 02:51:46.117645 1184 raft_consensus.cc:2889] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:46.117709 1184 raft_consensus.cc:2272] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.117995 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0fdddc22ae614ebbbcbf68377f43fbdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:46.118201 1184 ts_tablet_manager.cc:1916] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:46.118468 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0fdddc22ae614ebbbcbf68377f43fbdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.119493 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 6e72f04c08fe44fdabce1c5b102ca61a
I20260318 02:51:46.119863 453 catalog_manager.cc:6741] ReplaceTablet: tablet 6e72f04c08fe44fdabce1c5b102ca61a deleted and replaced by tablet 4c61959a36be44d38c57f95c9bcc860e
I20260318 02:51:46.120108 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6e665984937f42d4ae5415a59bff0f2f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:46.120530 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e665984937f42d4ae5415a59bff0f2f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.121981 456 master_service.cc:954] ReplaceTablet: received request to replace tablet 7110ce4a03724c16b32d3ba1a128aa5b from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:46.122912 449 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_802a2d53f1c14a879d8737dad75f6252 [id=5b2e7b122a394e058dc5b2fd84a0f558] alter complete (version 3)
I20260318 02:51:46.123939 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b1678df9cd524c9982cfff7ad3197cfe" } new_table_name: "default.Table_86586eba46774b4fbfd3e932484d31be" modify_external_catalogs: true
I20260318 02:51:46.124348 1184 ts_tablet_manager.cc:1929] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:46.124447 1184 log.cc:1199] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/184ce58aa96d4e70ad7b2783f19ccdeb
I20260318 02:51:46.124812 1184 ts_tablet_manager.cc:1950] T 184ce58aa96d4e70ad7b2783f19ccdeb P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.125598 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1254) took 2688 ms. Trace:
I20260318 02:51:46.125682 1184 rpcz_store.cc:276] 0318 02:51:43.437046 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.437153 (+ 107us) service_pool.cc:225] Handling call
0318 02:51:46.117067 (+2679914us) ts_tablet_manager.cc:1151] Deleting tablet 184ce58aa96d4e70ad7b2783f19ccdeb
0318 02:51:46.117077 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.121096 (+ 4019us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.124251 (+ 3155us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.125577 (+ 1326us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2679705}
I20260318 02:51:46.125800 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_848a7926eb504f5198ad05b9a7479597"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:46.126255 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_848a7926eb504f5198ad05b9a7479597 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.126343 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1257) took 2615 ms. Trace:
I20260318 02:51:46.126417 1184 rpcz_store.cc:276] 0318 02:51:43.511161 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.511289 (+ 128us) service_pool.cc:225] Handling call
0318 02:51:46.126123 (+2614834us) ts_tablet_manager.cc:1151] Deleting tablet a1ea3329a317495792d26bd31fcd3b43
0318 02:51:46.126134 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.126326 (+ 192us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2614566}
I20260318 02:51:46.126874 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1258) took 2539 ms. Trace:
I20260318 02:51:46.126940 1184 rpcz_store.cc:276] 0318 02:51:43.587304 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.587360 (+ 56us) service_pool.cc:225] Handling call
0318 02:51:46.126766 (+2539406us) ts_tablet_manager.cc:1151] Deleting tablet c5afbb4fd4b146ed9e0e8ff46aecc465
0318 02:51:46.126775 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.126861 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2539142}
I20260318 02:51:46.127591 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1259) took 2538 ms. Trace:
I20260318 02:51:46.127655 1184 rpcz_store.cc:276] 0318 02:51:43.589537 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.589594 (+ 57us) service_pool.cc:225] Handling call
0318 02:51:46.127496 (+2537902us) ts_tablet_manager.cc:1151] Deleting tablet 2fe517a0498e4ac3b0bb52a0eea7448d
0318 02:51:46.127504 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.127578 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2537730}
I20260318 02:51:46.128072 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1260) took 2452 ms. Trace:
I20260318 02:51:46.128137 1184 rpcz_store.cc:276] 0318 02:51:43.675660 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.675727 (+ 67us) service_pool.cc:225] Handling call
0318 02:51:46.127964 (+2452237us) ts_tablet_manager.cc:1151] Deleting tablet 7f2c321032c34a1596c37981f8c95cd5
0318 02:51:46.127972 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.128058 (+ 86us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2452075}
I20260318 02:51:46.128508 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1261) took 2367 ms. Trace:
I20260318 02:51:46.128574 1184 rpcz_store.cc:276] 0318 02:51:43.761116 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.761181 (+ 65us) service_pool.cc:225] Handling call
0318 02:51:46.128408 (+2367227us) ts_tablet_manager.cc:1151] Deleting tablet f5f53ee0015740a5a32a858e798c592e
0318 02:51:46.128416 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.128493 (+ 77us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2367038}
I20260318 02:51:46.129238 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1262) took 2366 ms. Trace:
I20260318 02:51:46.129305 1184 rpcz_store.cc:276] 0318 02:51:43.763172 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.763233 (+ 61us) service_pool.cc:225] Handling call
0318 02:51:46.129141 (+2365908us) ts_tablet_manager.cc:1151] Deleting tablet e96b662de89a48018920544e9abb66c7
0318 02:51:46.129150 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.129224 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2365735}
I20260318 02:51:46.129614 1184 tablet_replica.cc:333] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.129809 1184 raft_consensus.cc:2243] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.129971 1184 raft_consensus.cc:2272] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.130576 1184 ts_tablet_manager.cc:1916] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.131706 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e72f04c08fe44fdabce1c5b102ca61a with delete_type TABLET_DATA_DELETED (replaced by tablet 4c61959a36be44d38c57f95c9bcc860e) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:46.132337 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 6e72f04c08fe44fdabce1c5b102ca61a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e72f04c08fe44fdabce1c5b102ca61a already in progress: creating tablet
I20260318 02:51:46.132843 749 tablet_service.cc:1558] Processing DeleteTablet for tablet e566cc653bd341feaadea09394b4ef94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:45 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:46.135272 2660 raft_consensus.cc:493] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:46.135404 2660 raft_consensus.cc:515] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.135962 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ff188f25ff146fab121ebfab1af8467 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:46.136030 2660 leader_election.cc:290] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:46.137328 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e578c7498b6404cb87f493127005500" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:46.137292 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6ae4413312c2415c91b672165cd440c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:46.137811 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ae4413312c2415c91b672165cd440c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:46.138140 719 leader_election.cc:343] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:46.138907 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet e566cc653bd341feaadea09394b4ef94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e566cc653bd341feaadea09394b4ef94 already in progress: creating tablet
I20260318 02:51:46.138880 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e578c7498b6404cb87f493127005500" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:46.139495 719 leader_election.cc:343] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.139598 719 leader_election.cc:304] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.139966 2660 raft_consensus.cc:2749] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:46.140388 1175 tablet_replica.cc:333] T 5ff188f25ff146fab121ebfab1af8467 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:46.140579 1175 raft_consensus.cc:2243] T 5ff188f25ff146fab121ebfab1af8467 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.140753 1175 raft_consensus.cc:2272] T 5ff188f25ff146fab121ebfab1af8467 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.141234 893 tablet_service.cc:1558] Processing DeleteTablet for tablet e566cc653bd341feaadea09394b4ef94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:45 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:46.141332 1175 ts_tablet_manager.cc:1916] T 5ff188f25ff146fab121ebfab1af8467 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.141774 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet e566cc653bd341feaadea09394b4ef94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:45 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:46.145886 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e72f04c08fe44fdabce1c5b102ca61a with delete_type TABLET_DATA_DELETED (replaced by tablet 4c61959a36be44d38c57f95c9bcc860e) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:46.146435 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 6e72f04c08fe44fdabce1c5b102ca61a with delete_type TABLET_DATA_DELETED (replaced by tablet 4c61959a36be44d38c57f95c9bcc860e) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:46.147440 1172 tablet_bootstrap.cc:492] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:46.147574 1172 ts_tablet_manager.cc:1403] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.053s user 0.001s sys 0.002s
I20260318 02:51:46.148802 1172 raft_consensus.cc:359] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.148963 1172 raft_consensus.cc:385] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.149027 1172 raft_consensus.cc:740] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.149206 1172 consensus_queue.cc:260] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.149658 1172 ts_tablet_manager.cc:1434] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:46.149902 1172 tablet_bootstrap.cc:492] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:46.151459 1172 tablet_bootstrap.cc:654] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.154405 1175 ts_tablet_manager.cc:1929] T 5ff188f25ff146fab121ebfab1af8467 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.154518 1175 log.cc:1199] T 5ff188f25ff146fab121ebfab1af8467 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/5ff188f25ff146fab121ebfab1af8467
I20260318 02:51:46.154812 1175 ts_tablet_manager.cc:1950] T 5ff188f25ff146fab121ebfab1af8467 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:46.160800 2715 raft_consensus.cc:493] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:46.160964 2715 raft_consensus.cc:515] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:46.161368 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 49afed40c7aa4f2d913daed8055a098e (table default.Table_8e1825ed6ac14c60b72e23cbbce1b677 [id=df327d7be3fc46d0b969529acb5684c5]) successfully deleted
I20260318 02:51:46.161597 2715 leader_election.cc:290] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:46.161969 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 184ce58aa96d4e70ad7b2783f19ccdeb (table default.Table_f7c512acb00946069cb735b743f8b2af [id=3e7b4f46e6c04379b32c2d39de6aa759]) successfully deleted
W20260318 02:51:46.162215 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet a1ea3329a317495792d26bd31fcd3b43 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1ea3329a317495792d26bd31fcd3b43 already in progress: creating tablet
W20260318 02:51:46.162395 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet c5afbb4fd4b146ed9e0e8ff46aecc465 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5afbb4fd4b146ed9e0e8ff46aecc465 already in progress: creating tablet
W20260318 02:51:46.162550 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2fe517a0498e4ac3b0bb52a0eea7448d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2fe517a0498e4ac3b0bb52a0eea7448d already in progress: creating tablet
W20260318 02:51:46.162703 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 7f2c321032c34a1596c37981f8c95cd5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f2c321032c34a1596c37981f8c95cd5 already in progress: creating tablet
W20260318 02:51:46.162784 860 leader_election.cc:343] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 9aeb492564a94a569f70506712dad4ed
W20260318 02:51:46.162849 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f5f53ee0015740a5a32a858e798c592e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5f53ee0015740a5a32a858e798c592e already in progress: creating tablet
W20260318 02:51:46.162997 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet e96b662de89a48018920544e9abb66c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e96b662de89a48018920544e9abb66c7 already in progress: creating tablet
W20260318 02:51:46.163019 862 leader_election.cc:343] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 9aeb492564a94a569f70506712dad4ed
I20260318 02:51:46.163089 862 leader_election.cc:304] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:46.163318 2715 raft_consensus.cc:2749] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:46.171142 1184 ts_tablet_manager.cc:1929] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.171286 1184 log.cc:1199] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/60dedba077d34435b30061bfba737412
I20260318 02:51:46.171567 1184 ts_tablet_manager.cc:1950] T 60dedba077d34435b30061bfba737412 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.172818 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1264) took 2255 ms. Trace:
I20260318 02:51:46.173058 1173 tablet_bootstrap.cc:492] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:46.173194 1173 ts_tablet_manager.cc:1403] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.077s user 0.003s sys 0.000s
I20260318 02:51:46.172906 1184 rpcz_store.cc:276] 0318 02:51:43.917051 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.917103 (+ 52us) service_pool.cc:225] Handling call
0318 02:51:46.129573 (+2212470us) ts_tablet_manager.cc:1151] Deleting tablet 60dedba077d34435b30061bfba737412
0318 02:51:46.129581 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.152985 (+ 23404us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.171024 (+ 18039us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.172798 (+ 1774us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2175425}
I20260318 02:51:46.177441 1184 tablet_replica.cc:333] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.177671 1184 raft_consensus.cc:2243] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.177847 1184 raft_consensus.cc:2272] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.178115 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 5ff188f25ff146fab121ebfab1af8467 (table default.Table_33930f6668f341159c318db9160c142a [id=a5613244ee434bc88b23181c7bf23e0c]) successfully deleted
W20260318 02:51:46.178386 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet e566cc653bd341feaadea09394b4ef94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e566cc653bd341feaadea09394b4ef94 already in progress: creating tablet
I20260318 02:51:46.178408 1184 ts_tablet_manager.cc:1916] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:46.178603 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 6e72f04c08fe44fdabce1c5b102ca61a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e72f04c08fe44fdabce1c5b102ca61a already in progress: creating tablet
I20260318 02:51:46.179493 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 60dedba077d34435b30061bfba737412 (table default.Table_374dfe5a11944231bc786a2cb0c66a84 [id=6449f780fd6a4361960f0a62d81dd60d]) successfully deleted
I20260318 02:51:46.180392 1174 tablet_bootstrap.cc:492] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:46.180549 1174 ts_tablet_manager.cc:1403] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.112s user 0.003s sys 0.008s
I20260318 02:51:46.187476 1173 raft_consensus.cc:359] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.187669 1173 raft_consensus.cc:385] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.187719 1173 raft_consensus.cc:740] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.187981 1173 consensus_queue.cc:260] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.188572 1173 ts_tablet_manager.cc:1434] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260318 02:51:46.189467 1173 tablet_bootstrap.cc:492] T 6d938a2eefe4471cb94a9544647f8e3e P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:46.192406 2646 tablet.cc:1723] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:46.205250 1174 raft_consensus.cc:359] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.205173 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e1807b04c33a458593ceefbe21323b39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:46.205433 1174 raft_consensus.cc:385] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.205499 1174 raft_consensus.cc:740] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
W20260318 02:51:46.205792 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1807b04c33a458593ceefbe21323b39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.205739 1174 consensus_queue.cc:260] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.207036 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 7110ce4a03724c16b32d3ba1a128aa5b
I20260318 02:51:46.207432 456 catalog_manager.cc:6741] ReplaceTablet: tablet 7110ce4a03724c16b32d3ba1a128aa5b deleted and replaced by tablet c68a1cfcd9e043a6b9e9cbcf3c8d0c63
I20260318 02:51:46.207621 456 master_service.cc:954] ReplaceTablet: received request to replace tablet c2453557439844a19cc7b4c8a0696b1e from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:46.208994 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_677331592d5441dfb4aea1f996121ddb" } new_table_name: "default.Table_40883b0d08e944cc9538820ff8ed8ebb" modify_external_catalogs: true
I20260318 02:51:46.210470 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6e299f3484ca428cbccc8ea294a0ea69" } modify_external_catalogs: true
I20260318 02:51:46.210608 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6e299f3484ca428cbccc8ea294a0ea69" } modify_external_catalogs: true
W20260318 02:51:46.211838 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5148fd282f894ab19d9ce77841f4fdc1 consensus state has no leader
I20260318 02:51:46.212281 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_20b2dbf580454a4a993130bde0ae0265" } modify_external_catalogs: true
I20260318 02:51:46.212423 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_20b2dbf580454a4a993130bde0ae0265" } modify_external_catalogs: true
I20260318 02:51:46.215755 451 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 306367152e834668bbf5fcadd008b3ea
I20260318 02:51:46.216301 451 catalog_manager.cc:6741] ReplaceTablet: tablet 306367152e834668bbf5fcadd008b3ea deleted and replaced by tablet 1b307f817e144bb9943fd8e30bb50227
I20260318 02:51:46.216593 451 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a340f8a14a61411eb0cac18278e5715d" } modify_external_catalogs: true
I20260318 02:51:46.216764 451 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a340f8a14a61411eb0cac18278e5715d" } modify_external_catalogs: true
I20260318 02:51:46.218387 1184 ts_tablet_manager.cc:1929] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.218494 1184 log.cc:1199] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/783c886a99994d6c8d9add724277819a
I20260318 02:51:46.218766 1184 ts_tablet_manager.cc:1950] T 783c886a99994d6c8d9add724277819a P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.219502 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1265) took 2302 ms. Trace:
I20260318 02:51:46.219589 1184 rpcz_store.cc:276] 0318 02:51:43.917283 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.917325 (+ 42us) service_pool.cc:225] Handling call
0318 02:51:46.177376 (+2260051us) ts_tablet_manager.cc:1151] Deleting tablet 783c886a99994d6c8d9add724277819a
0318 02:51:46.177390 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.215249 (+ 37859us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.218281 (+ 3032us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.219480 (+ 1199us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2223136}
I20260318 02:51:46.219911 1184 tablet_replica.cc:333] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.220109 1184 raft_consensus.cc:2243] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.220238 1184 raft_consensus.cc:2272] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.220700 1184 ts_tablet_manager.cc:1916] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.220752 2646 tablet.cc:1723] T 3868406102b748a5b13420b24bf16485 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260318 02:51:46.221199 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b8f5883380bc49fa8b363bfb86b8d526" } modify_external_catalogs: true
I20260318 02:51:46.221344 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b8f5883380bc49fa8b363bfb86b8d526" } modify_external_catalogs: true
I20260318 02:51:46.223914 1172 tablet_bootstrap.cc:492] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:46.224062 1172 ts_tablet_manager.cc:1403] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.074s user 0.003s sys 0.002s
I20260318 02:51:46.224823 1172 raft_consensus.cc:359] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.225001 1172 raft_consensus.cc:385] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.225057 1172 raft_consensus.cc:740] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.225253 1172 consensus_queue.cc:260] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.225757 1172 ts_tablet_manager.cc:1434] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:46.226042 1172 tablet_bootstrap.cc:492] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:46.226744 1184 ts_tablet_manager.cc:1929] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.226846 1184 log.cc:1199] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/85e6ad2a9817444caecb78eabde5d222
I20260318 02:51:46.227114 1184 ts_tablet_manager.cc:1950] T 85e6ad2a9817444caecb78eabde5d222 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.227422 1172 tablet_bootstrap.cc:654] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.227720 457 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet c58290c2d1c742d3b45dfb5caf52c75b (table default.Table_944521fea0294e3381643693804fd723 [id=18d79b10f75b43efa4946ca8979a4235]). Expected version 1 got 0
I20260318 02:51:46.227788 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1266) took 2310 ms. Trace:
I20260318 02:51:46.227866 1184 rpcz_store.cc:276] 0318 02:51:43.917494 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.917540 (+ 46us) service_pool.cc:225] Handling call
0318 02:51:46.219860 (+2302320us) ts_tablet_manager.cc:1151] Deleting tablet 85e6ad2a9817444caecb78eabde5d222
0318 02:51:46.219871 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.223709 (+ 3838us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.226649 (+ 2940us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.227766 (+ 1117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2265600}
I20260318 02:51:46.228175 1184 tablet_replica.cc:333] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.228340 1184 raft_consensus.cc:2243] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.228473 1184 raft_consensus.cc:2272] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.228046 457 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet fe82e581368c4d8a894f0283c1a710fe (table default.Table_676a667361dd4f23afbda31df87958fb [id=831b3293b7eb44c6acb5de02d0769c1d]). Expected version 2 got 0
I20260318 02:51:46.229001 1184 ts_tablet_manager.cc:1916] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.229024 457 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet a9c60ef260d049bea4ce729316a0d09f (table default.Table_d5ddb641ef9245ca92ab35d8ac25b157 [id=fb45f238426142faa79cbe89242c7418]). Expected version 1 got 0
I20260318 02:51:46.229329 457 catalog_manager.cc:5671] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:46.229784 457 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet e998e290291c443394f478c4ac1cfbd2 (table default.Table_5d59b3f280d345a3937fff6df372fcff [id=00651cbebdb046c9975ecfa30f08fce5]). Expected version 2 got 0
I20260318 02:51:46.206262 1174 ts_tablet_manager.cc:1434] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.026s user 0.000s sys 0.001s
I20260318 02:51:46.208685 2688 tablet.cc:1723] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:46.218338 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 306367152e834668bbf5fcadd008b3ea with delete_type TABLET_DATA_DELETED (replaced by tablet 1b307f817e144bb9943fd8e30bb50227) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:46.208590 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 7110ce4a03724c16b32d3ba1a128aa5b with delete_type TABLET_DATA_DELETED (replaced by tablet c68a1cfcd9e043a6b9e9cbcf3c8d0c63) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:46.234958 1174 tablet_bootstrap.cc:492] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:46.234993 1184 ts_tablet_manager.cc:1929] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.235088 1184 log.cc:1199] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/21e6e89e5a0a4d1bb952e74be1b7e551
I20260318 02:51:46.235334 1184 ts_tablet_manager.cc:1950] T 21e6e89e5a0a4d1bb952e74be1b7e551 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
W20260318 02:51:46.235759 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 306367152e834668bbf5fcadd008b3ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 306367152e834668bbf5fcadd008b3ea already in progress: creating tablet
I20260318 02:51:46.236241 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1267) took 2318 ms. Trace:
I20260318 02:51:46.236325 1184 rpcz_store.cc:276] 0318 02:51:43.917774 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.917821 (+ 47us) service_pool.cc:225] Handling call
0318 02:51:46.228129 (+2310308us) ts_tablet_manager.cc:1151] Deleting tablet 21e6e89e5a0a4d1bb952e74be1b7e551
0318 02:51:46.228138 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.231856 (+ 3718us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.234890 (+ 3034us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.236220 (+ 1330us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2273822}
I20260318 02:51:46.236747 2662 raft_consensus.cc:493] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:46.236865 2662 raft_consensus.cc:515] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.237421 2662 leader_election.cc:290] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:46.237780 2688 tablet.cc:1723] T 3868406102b748a5b13420b24bf16485 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260318 02:51:46.238343 1184 tablet_replica.cc:333] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.238425 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe82e581368c4d8a894f0283c1a710fe" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:46.238530 1184 raft_consensus.cc:2243] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.238739 1184 raft_consensus.cc:2272] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.239234 1184 ts_tablet_manager.cc:1916] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:46.239284 997 leader_election.cc:343] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:46.240546 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 7110ce4a03724c16b32d3ba1a128aa5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7110ce4a03724c16b32d3ba1a128aa5b already in progress: creating tablet
I20260318 02:51:46.242234 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 7110ce4a03724c16b32d3ba1a128aa5b with delete_type TABLET_DATA_DELETED (replaced by tablet c68a1cfcd9e043a6b9e9cbcf3c8d0c63) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:46.242250 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 7110ce4a03724c16b32d3ba1a128aa5b with delete_type TABLET_DATA_DELETED (replaced by tablet c68a1cfcd9e043a6b9e9cbcf3c8d0c63) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:46.243443 1173 tablet_bootstrap.cc:654] T 6d938a2eefe4471cb94a9544647f8e3e P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.245201 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 306367152e834668bbf5fcadd008b3ea with delete_type TABLET_DATA_DELETED (replaced by tablet 1b307f817e144bb9943fd8e30bb50227) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:46.246773 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 306367152e834668bbf5fcadd008b3ea with delete_type TABLET_DATA_DELETED (replaced by tablet 1b307f817e144bb9943fd8e30bb50227) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:46.248690 1184 ts_tablet_manager.cc:1929] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.248848 1184 log.cc:1199] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/59c6741a6d154d8f99d487c6590d2d26
I20260318 02:51:46.249128 1184 ts_tablet_manager.cc:1950] T 59c6741a6d154d8f99d487c6590d2d26 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.249895 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1268) took 2332 ms. Trace:
I20260318 02:51:46.249998 1184 rpcz_store.cc:276] 0318 02:51:43.917920 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:43.917966 (+ 46us) service_pool.cc:225] Handling call
0318 02:51:46.238287 (+2320321us) ts_tablet_manager.cc:1151] Deleting tablet 59c6741a6d154d8f99d487c6590d2d26
0318 02:51:46.238298 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.245528 (+ 7230us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.248597 (+ 3069us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.249876 (+ 1279us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2283931}
I20260318 02:51:46.250524 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1272) took 2245 ms. Trace:
I20260318 02:51:46.250612 1184 rpcz_store.cc:276] 0318 02:51:44.005283 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.006124 (+ 841us) service_pool.cc:225] Handling call
0318 02:51:46.250398 (+2244274us) ts_tablet_manager.cc:1151] Deleting tablet 1be09e67b9d94e669f28a7cd236b48a4
0318 02:51:46.250407 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.250506 (+ 99us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2164782}
I20260318 02:51:46.250876 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 783c886a99994d6c8d9add724277819a (table default.Table_cfd83086efd94aeeac453573d0c9350b [id=f1416944463a4ad98086e63fe84cf76f]) successfully deleted
I20260318 02:51:46.251040 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1279) took 2141 ms. Trace:
I20260318 02:51:46.251006 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe82e581368c4d8a894f0283c1a710fe" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:46.251147 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 85e6ad2a9817444caecb78eabde5d222 (table default.Table_c23e7504b2474f1686592467b684da52 [id=96801ef3b02b4ab6b22d34157d05bb49]) successfully deleted
I20260318 02:51:46.251108 1184 rpcz_store.cc:276] 0318 02:51:44.109790 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.109855 (+ 65us) service_pool.cc:225] Handling call
0318 02:51:46.250931 (+2141076us) ts_tablet_manager.cc:1151] Deleting tablet 7253dcb3d73c4297bf444defd3ef6e74
0318 02:51:46.250940 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.251027 (+ 87us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2140868}
I20260318 02:51:46.251222 781 raft_consensus.cc:2468] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:46.251291 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 21e6e89e5a0a4d1bb952e74be1b7e551 (table default.Table_997fb2399fa943e9b940ce4e2b1f31ca [id=e3ae42e4eb124dcebd6692574f6d0a9b]) successfully deleted
I20260318 02:51:46.251473 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 59c6741a6d154d8f99d487c6590d2d26 (table default.Table_f4978db62ff94982b1fbb4afc8e96b29 [id=9c9b005136654a8e874925b6bbef33a4]) successfully deleted
W20260318 02:51:46.251639 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 1be09e67b9d94e669f28a7cd236b48a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1be09e67b9d94e669f28a7cd236b48a4 already in progress: creating tablet
I20260318 02:51:46.251649 999 leader_election.cc:304] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:46.251829 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 7253dcb3d73c4297bf444defd3ef6e74 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7253dcb3d73c4297bf444defd3ef6e74 already in progress: creating tablet
I20260318 02:51:46.252084 2605 raft_consensus.cc:2804] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:46.252161 2605 raft_consensus.cc:493] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:46.252226 2605 raft_consensus.cc:3060] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:46.254693 2614 raft_consensus.cc:493] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:46.254889 2614 raft_consensus.cc:515] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.256506 2614 leader_election.cc:290] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:46.257328 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 708127379215482ca4146309c2ac23c1 consensus state has no leader
I20260318 02:51:46.257834 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet c2453557439844a19cc7b4c8a0696b1e
I20260318 02:51:46.258291 456 catalog_manager.cc:6741] ReplaceTablet: tablet c2453557439844a19cc7b4c8a0696b1e deleted and replaced by tablet 56ef9cbc718d4a849cbca020866f9440
I20260318 02:51:46.258773 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 6f15a63d18f14061b8e5ec8f6306f79b
I20260318 02:51:46.260524 451 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 9215899a49214bcb8868c44133f070fa
I20260318 02:51:46.260046 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f15a63d18f14061b8e5ec8f6306f79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:46.259979 749 tablet_service.cc:1558] Processing DeleteTablet for tablet c2453557439844a19cc7b4c8a0696b1e with delete_type TABLET_DATA_DELETED (replaced by tablet 56ef9cbc718d4a849cbca020866f9440) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:46.261658 2605 raft_consensus.cc:515] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:46.261716 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet c2453557439844a19cc7b4c8a0696b1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2453557439844a19cc7b4c8a0696b1e already in progress: creating tablet
W20260318 02:51:46.261998 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 6f15a63d18f14061b8e5ec8f6306f79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f15a63d18f14061b8e5ec8f6306f79b already in progress: creating tablet
I20260318 02:51:46.262203 2605 leader_election.cc:290] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:46.263280 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe82e581368c4d8a894f0283c1a710fe" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:46.263573 777 raft_consensus.cc:3060] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:46.263643 455 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 608df0ce4e1d4ed6b7655802a6f7f6bc (table default.Table_e46ead2403a84f55a7454fe532d2502f [id=ae4df4d179134efc82a2504d8ec91814]). Expected version 1 got 0
I20260318 02:51:46.263855 455 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 68b0f0cd89234e72a052f3f9f964aa35 (table default.Table_1068ed12c0774560af59c6eb9d2f292c [id=9a52b01ffd5b4f7e8a7a20a817aa842f]). Expected version 2 got 0
I20260318 02:51:46.264135 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac04b3e4ad448b09a1a25a754b44aad" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:46.264431 449 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_e46ead2403a84f55a7454fe532d2502f [id=ae4df4d179134efc82a2504d8ec91814] alter complete (version 1)
W20260318 02:51:46.265210 997 leader_election.cc:343] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:46.265450 997 consensus_peers.cc:597] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1516525b471540288c6cb5d61120d430. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:46.266319 777 raft_consensus.cc:2468] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
W20260318 02:51:46.266682 997 consensus_peers.cc:597] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:46.266633 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe82e581368c4d8a894f0283c1a710fe" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:46.267078 997 leader_election.cc:343] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.267277 999 leader_election.cc:304] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.267341 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1281) took 2157 ms. Trace:
I20260318 02:51:46.267494 1184 rpcz_store.cc:276] 0318 02:51:44.110091 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.110149 (+ 58us) service_pool.cc:225] Handling call
0318 02:51:46.251393 (+2141244us) ts_tablet_manager.cc:1151] Deleting tablet 33d90a619ae54227aaf95acd180af119
0318 02:51:46.251401 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.267326 (+ 15925us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2141100}
I20260318 02:51:46.267649 2605 raft_consensus.cc:2804] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:46.268071 2605 raft_consensus.cc:697] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:46.268319 2605 consensus_queue.cc:237] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.271099 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1277) took 2161 ms. Trace:
W20260318 02:51:46.271528 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 7110ce4a03724c16b32d3ba1a128aa5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7110ce4a03724c16b32d3ba1a128aa5b already in progress: creating tablet
W20260318 02:51:46.271771 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 306367152e834668bbf5fcadd008b3ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 306367152e834668bbf5fcadd008b3ea already in progress: creating tablet
I20260318 02:51:46.258064 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac04b3e4ad448b09a1a25a754b44aad" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:46.271514 1184 rpcz_store.cc:276] 0318 02:51:44.109582 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.110341 (+ 759us) service_pool.cc:225] Handling call
0318 02:51:46.270969 (+2160628us) ts_tablet_manager.cc:1151] Deleting tablet 4052eede3f404b84ac27e21a204bf5a9
0318 02:51:46.270990 (+ 21us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.271081 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2160462}
I20260318 02:51:46.272145 781 raft_consensus.cc:2468] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:46.272424 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1280) took 2162 ms. Trace:
I20260318 02:51:46.272500 1184 rpcz_store.cc:276] 0318 02:51:44.109973 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.110145 (+ 172us) service_pool.cc:225] Handling call
0318 02:51:46.272317 (+2162172us) ts_tablet_manager.cc:1151] Deleting tablet aa12fe852965419ab1803049e416c780
0318 02:51:46.272326 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.272409 (+ 83us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2161790}
I20260318 02:51:46.273370 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1282) took 2105 ms. Trace:
I20260318 02:51:46.273432 1184 rpcz_store.cc:276] 0318 02:51:44.168003 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.168073 (+ 70us) service_pool.cc:225] Handling call
0318 02:51:46.273273 (+2105200us) ts_tablet_manager.cc:1151] Deleting tablet 036c17d033b145a681843d14f67ab575
0318 02:51:46.273281 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.273355 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2104997}
I20260318 02:51:46.274159 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1283) took 2105 ms. Trace:
I20260318 02:51:46.274227 1184 rpcz_store.cc:276] 0318 02:51:44.169135 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.169190 (+ 55us) service_pool.cc:225] Handling call
0318 02:51:46.274065 (+2104875us) ts_tablet_manager.cc:1151] Deleting tablet ffa9d9dcc70e402099b414029f062d6e
0318 02:51:46.274074 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.274145 (+ 71us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2104710}
I20260318 02:51:46.274952 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1297) took 1664 ms. Trace:
I20260318 02:51:46.275023 1184 rpcz_store.cc:276] 0318 02:51:44.610934 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.611009 (+ 75us) service_pool.cc:225] Handling call
0318 02:51:46.274865 (+1663856us) ts_tablet_manager.cc:1151] Deleting tablet 2b818b2d7f194db2bbd0cc4ad837fb00
0318 02:51:46.274874 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.274939 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1663617}
I20260318 02:51:46.275702 1184 tablet_replica.cc:333] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.275879 1184 raft_consensus.cc:2243] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.276026 1184 raft_consensus.cc:2272] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.276443 999 leader_election.cc:304] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.276546 1184 ts_tablet_manager.cc:1916] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.276686 2662 raft_consensus.cc:2804] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:46.276768 2662 raft_consensus.cc:493] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:46.276827 2662 raft_consensus.cc:3060] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:46.279536 2662 raft_consensus.cc:515] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.280206 2662 leader_election.cc:290] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:46.281296 893 tablet_service.cc:1558] Processing DeleteTablet for tablet c2453557439844a19cc7b4c8a0696b1e with delete_type TABLET_DATA_DELETED (replaced by tablet 56ef9cbc718d4a849cbca020866f9440) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:46.281323 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac04b3e4ad448b09a1a25a754b44aad" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:46.281504 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac04b3e4ad448b09a1a25a754b44aad" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:46.281695 780 raft_consensus.cc:3060] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:46.282085 997 leader_election.cc:343] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.282296 1174 tablet_bootstrap.cc:654] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.282706 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet c2453557439844a19cc7b4c8a0696b1e with delete_type TABLET_DATA_DELETED (replaced by tablet 56ef9cbc718d4a849cbca020866f9440) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:46.283416 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f15a63d18f14061b8e5ec8f6306f79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:46.284106 997 consensus_peers.cc:597] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:46.284480 2735 tablet.cc:1723] T 9a5afc5611d3481e9a6d48381dc67e86 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:46.285290 2740 tablet.cc:1723] T 3868406102b748a5b13420b24bf16485 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20260318 02:51:46.285336 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f15a63d18f14061b8e5ec8f6306f79b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:46.287644 780 raft_consensus.cc:2468] T bac04b3e4ad448b09a1a25a754b44aad P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:46.286509 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 9aeb492564a94a569f70506712dad4ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:46.287217 905 tablet_service.cc:1558] Processing DeleteTablet for tablet b8973d8930ef4b65be7b4ff990bf9d72 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c89f413a26a43ef95c850d7c44f85b2) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:46.287653 890 tablet_service.cc:1558] Processing DeleteTablet for tablet de2bc2f79e8b49248de3e7eca1a600cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:46.288467 1175 tablet_replica.cc:333] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:46.288667 1175 raft_consensus.cc:2243] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.288877 1175 raft_consensus.cc:2272] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.289477 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 46ce65cca47f48db94e70226494cfbae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:46.289693 1175 ts_tablet_manager.cc:1916] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.290796 890 tablet_service.cc:1558] Processing DeleteTablet for tablet cf73a9f8f67b42d9baf1396d70a1a3a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:46.291399 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 33d90a619ae54227aaf95acd180af119 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33d90a619ae54227aaf95acd180af119 already in progress: creating tablet
W20260318 02:51:46.294938 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 4052eede3f404b84ac27e21a204bf5a9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4052eede3f404b84ac27e21a204bf5a9 already in progress: creating tablet
I20260318 02:51:46.296934 1173 tablet_bootstrap.cc:492] T 6d938a2eefe4471cb94a9544647f8e3e P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:46.297394 1173 ts_tablet_manager.cc:1403] T 6d938a2eefe4471cb94a9544647f8e3e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.108s user 0.004s sys 0.000s
I20260318 02:51:46.298308 1173 raft_consensus.cc:359] T 6d938a2eefe4471cb94a9544647f8e3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.298640 1173 raft_consensus.cc:385] T 6d938a2eefe4471cb94a9544647f8e3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.298743 1173 raft_consensus.cc:740] T 6d938a2eefe4471cb94a9544647f8e3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.299015 1173 consensus_queue.cc:260] T 6d938a2eefe4471cb94a9544647f8e3e P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.300486 1173 ts_tablet_manager.cc:1434] T 6d938a2eefe4471cb94a9544647f8e3e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
W20260318 02:51:46.300875 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet aa12fe852965419ab1803049e416c780 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aa12fe852965419ab1803049e416c780 already in progress: creating tablet
I20260318 02:51:46.306553 1172 tablet_bootstrap.cc:492] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:46.306718 1172 ts_tablet_manager.cc:1403] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.081s user 0.002s sys 0.001s
I20260318 02:51:46.307438 1172 raft_consensus.cc:359] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.307616 1172 raft_consensus.cc:385] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.307665 1172 raft_consensus.cc:740] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.307857 1172 consensus_queue.cc:260] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.309312 1175 ts_tablet_manager.cc:1929] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.309455 1175 log.cc:1199] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/9aeb492564a94a569f70506712dad4ed
I20260318 02:51:46.309762 1175 ts_tablet_manager.cc:1950] T 9aeb492564a94a569f70506712dad4ed P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:46.310853 1172 ts_tablet_manager.cc:1434] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
W20260318 02:51:46.301317 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 036c17d033b145a681843d14f67ab575 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 036c17d033b145a681843d14f67ab575 already in progress: creating tablet
W20260318 02:51:46.312270 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet ffa9d9dcc70e402099b414029f062d6e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffa9d9dcc70e402099b414029f062d6e already in progress: creating tablet
W20260318 02:51:46.312788 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2b818b2d7f194db2bbd0cc4ad837fb00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b818b2d7f194db2bbd0cc4ad837fb00 already in progress: creating tablet
I20260318 02:51:46.313524 455 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 6d938a2eefe4471cb94a9544647f8e3e (table default.Table_c0956e46e13c47bc95482c534f632c04 [id=d0c05683decb4a5bbf2e3eab386a1116]). Expected version 1 got 0
I20260318 02:51:46.314327 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 461adcc8bbd94d30b9b84d1010430829 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:46.316095 449 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_357b13fa64234ab49f2349df67f8a0e2 [id=48b004d4295f40f0ac9ff77d7bb31720] alter complete (version 3)
I20260318 02:51:46.317680 1174 tablet_bootstrap.cc:492] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:46.317840 1174 ts_tablet_manager.cc:1403] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.083s user 0.002s sys 0.002s
I20260318 02:51:46.318625 1174 raft_consensus.cc:359] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.318812 1174 raft_consensus.cc:385] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.318882 1174 raft_consensus.cc:740] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.319149 1174 consensus_queue.cc:260] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.319715 1174 ts_tablet_manager.cc:1434] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:46.320086 1174 tablet_bootstrap.cc:492] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:46.321871 1172 tablet_bootstrap.cc:492] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:46.323267 2614 consensus_queue.cc:1048] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:46.326877 1174 tablet_bootstrap.cc:654] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.328519 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e578c7498b6404cb87f493127005500 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:46.328702 756 tablet_service.cc:1558] Processing DeleteTablet for tablet b894f0772a754196a3e651b38c46f001 with delete_type TABLET_DATA_DELETED (replaced by tablet 977a25a368734b11a8b2cefef88be651) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:46.328771 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c89f413a26a43ef95c850d7c44f85b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:46.328960 2704 tablet_replica.cc:333] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:46.329149 2704 raft_consensus.cc:2243] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.329290 2704 raft_consensus.cc:2272] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.329312 999 leader_election.cc:304] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.329741 2614 raft_consensus.cc:2804] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:46.329797 2704 ts_tablet_manager.cc:1916] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.329861 2614 raft_consensus.cc:697] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:46.330104 2614 consensus_queue.cc:237] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.332823 2660 raft_consensus.cc:493] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:46.332983 2660 raft_consensus.cc:515] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.333627 2660 leader_election.cc:290] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:46.334760 1172 tablet_bootstrap.cc:654] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.340636 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e418df45882c435a8276e46a8abf6bdd" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:46.344094 719 leader_election.cc:343] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.346827 2704 ts_tablet_manager.cc:1929] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.347301 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e418df45882c435a8276e46a8abf6bdd" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:46.347585 1173 tablet_bootstrap.cc:492] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:46.349490 1173 tablet_bootstrap.cc:654] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.350564 2704 log.cc:1199] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/8e578c7498b6404cb87f493127005500
I20260318 02:51:46.351097 2704 ts_tablet_manager.cc:1950] T 8e578c7498b6404cb87f493127005500 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:46.352965 1175 tablet_replica.cc:333] T b8973d8930ef4b65be7b4ff990bf9d72 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:46.353256 1175 raft_consensus.cc:2243] T b8973d8930ef4b65be7b4ff990bf9d72 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.353904 1175 raft_consensus.cc:2272] T b8973d8930ef4b65be7b4ff990bf9d72 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.354944 1175 ts_tablet_manager.cc:1916] T b8973d8930ef4b65be7b4ff990bf9d72 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:46.355367 719 leader_election.cc:343] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.355546 719 leader_election.cc:304] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.356395 2660 raft_consensus.cc:2749] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:46.356616 1172 tablet_bootstrap.cc:492] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:46.356817 1172 ts_tablet_manager.cc:1403] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.003s
I20260318 02:51:46.357515 1172 raft_consensus.cc:359] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.357677 1172 raft_consensus.cc:385] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.357739 1172 raft_consensus.cc:740] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.357939 1172 consensus_queue.cc:260] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:46.358229 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet c2453557439844a19cc7b4c8a0696b1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2453557439844a19cc7b4c8a0696b1e already in progress: creating tablet
W20260318 02:51:46.358449 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 6f15a63d18f14061b8e5ec8f6306f79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f15a63d18f14061b8e5ec8f6306f79b already in progress: creating tablet
I20260318 02:51:46.358734 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 9aeb492564a94a569f70506712dad4ed (table default.Table_f664e51423be4580b3ebf91d14e66886 [id=f0a505a78b8e4ea695e1c3da2f9a0e80]) successfully deleted
I20260318 02:51:46.359788 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet a384923c86ee42d6a47ed3f68e6811df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:46.360136 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f80f29dfd814acd8b7e143a72231dfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:46.360800 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_75e9c86b388f4ece810c6d095af5da19" } new_table_name: "default.Table_d3fb73e01eb74778836f895ab67ceb7c" modify_external_catalogs: true
I20260318 02:51:46.364992 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 8e578c7498b6404cb87f493127005500 (table default.Table_f41e180b423949a7a0f65976f1b993ed [id=c0c36670f3a04ac8a2a792bc64a8249f]) successfully deleted
I20260318 02:51:46.365067 2704 tablet_replica.cc:333] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
W20260318 02:51:46.365541 443 catalog_manager.cc:4969] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet b894f0772a754196a3e651b38c46f001 because the tablet was not found. No further retry: Not found: Tablet not found: b894f0772a754196a3e651b38c46f001
I20260318 02:51:46.365572 1172 ts_tablet_manager.cc:1434] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20260318 02:51:46.365864 1172 tablet_bootstrap.cc:492] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:46.366122 2704 raft_consensus.cc:2243] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.366940 2704 raft_consensus.cc:2272] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.367542 2704 ts_tablet_manager.cc:1916] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.370086 1172 tablet_bootstrap.cc:654] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.373761 1184 ts_tablet_manager.cc:1929] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.373900 1184 log.cc:1199] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/b317cc133346412fb981b1c8e5b99c4d
I20260318 02:51:46.374328 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a614370b71c542db819ec98834a87cec" } modify_external_catalogs: true
I20260318 02:51:46.374415 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_37aae142c970437f856dc0368bc7f382" } new_table_name: "default.Table_0d25ade46bcc47ca841de57b0f5a7da6" modify_external_catalogs: true
I20260318 02:51:46.374518 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a614370b71c542db819ec98834a87cec" } modify_external_catalogs: true
I20260318 02:51:46.377751 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a434e4d757524b6ab3f091ed992952d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:46.378275 2660 raft_consensus.cc:493] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260318 02:51:46.378310 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a434e4d757524b6ab3f091ed992952d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.378437 2660 raft_consensus.cc:515] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.379118 2660 leader_election.cc:290] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:46.379897 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831a7cb00e7040a7ade210c755dbff4a" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:46.380326 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831a7cb00e7040a7ade210c755dbff4a" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:46.380514 719 leader_election.cc:343] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:46.380774 719 leader_election.cc:343] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.380901 719 leader_election.cc:304] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.381270 2660 raft_consensus.cc:2749] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:46.381304 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f386fceff4eb4f528da50b63a3703bec" } new_table_name: "default.Table_96df2a15d5d84421a6c5b217a43b3f75" modify_external_catalogs: true
I20260318 02:51:46.385895 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_629d59d49c864d1f9170c6ac4526c27e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:46.386373 1172 tablet_bootstrap.cc:492] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
W20260318 02:51:46.386487 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_629d59d49c864d1f9170c6ac4526c27e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.386507 1172 ts_tablet_manager.cc:1403] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20260318 02:51:46.387192 1172 raft_consensus.cc:359] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.387367 1172 raft_consensus.cc:385] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.387415 1172 raft_consensus.cc:740] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.387187 1184 ts_tablet_manager.cc:1950] T b317cc133346412fb981b1c8e5b99c4d P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.388384 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1298) took 1777 ms. Trace:
I20260318 02:51:46.388475 1184 rpcz_store.cc:276] 0318 02:51:44.611028 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.611224 (+ 196us) service_pool.cc:225] Handling call
0318 02:51:46.275659 (+1664435us) ts_tablet_manager.cc:1151] Deleting tablet b317cc133346412fb981b1c8e5b99c4d
0318 02:51:46.275668 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.342937 (+ 67269us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.373652 (+ 30715us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.388363 (+ 14711us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1664288}
I20260318 02:51:46.390239 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1296) took 1779 ms. Trace:
I20260318 02:51:46.390336 1184 rpcz_store.cc:276] 0318 02:51:44.610841 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.612120 (+ 1279us) service_pool.cc:225] Handling call
0318 02:51:46.390104 (+1777984us) ts_tablet_manager.cc:1151] Deleting tablet 495c8ace1cdb4741aa2ffa1f85dfb25e
0318 02:51:46.390115 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.390220 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1777811}
I20260318 02:51:46.387596 1172 consensus_queue.cc:260] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:46.391281 442 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet e418df45882c435a8276e46a8abf6bdd (table default.Table_b87c8d210af448238e2ed324e0fa82b3 [id=3b169945a7bc477bb1a48b662948f322], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet e418df45882c435a8276e46a8abf6bdd consensus state has no leader
I20260318 02:51:46.392573 1172 ts_tablet_manager.cc:1434] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260318 02:51:46.393136 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1299) took 1766 ms. Trace:
I20260318 02:51:46.393213 1184 rpcz_store.cc:276] 0318 02:51:44.626822 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.626925 (+ 103us) service_pool.cc:225] Handling call
0318 02:51:46.393019 (+1766094us) ts_tablet_manager.cc:1151] Deleting tablet 0abb9045d6394fd4a9e294269387dfc9
0318 02:51:46.393028 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.393119 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1765946}
I20260318 02:51:46.394879 1184 tablet_replica.cc:333] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.395255 1172 tablet_bootstrap.cc:492] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:46.398079 457 catalog_manager.cc:5671] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:46.398622 457 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet fe82e581368c4d8a894f0283c1a710fe (table default.Table_676a667361dd4f23afbda31df87958fb [id=831b3293b7eb44c6acb5de02d0769c1d]). Expected version 2 got 0
I20260318 02:51:46.398898 457 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet bac04b3e4ad448b09a1a25a754b44aad (table default.Table_c0a9aae588ef49148c04338c906dab4a [id=1532d6dc2cc641998f9c120075fa04b4]). Expected version 1 got 0
I20260318 02:51:46.398880 749 tablet_service.cc:1511] Processing CreateTablet for tablet 6468eaebf8d74dfcbbc6c2994946e0ee (DEFAULT_TABLE table=default.Table_17f53305fd994cdea1582a7b180c3a23 [id=750774185cb74071b6fd7c4635c064dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.399291 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6468eaebf8d74dfcbbc6c2994946e0ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.399766 451 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_5048646e181b43af9e8798938115b3eb [id=e03eb5ce646645e393ddc268a1aabf1f] alter complete (version 1)
I20260318 02:51:46.400200 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9e4aa1be0f02404cba048010fcf9c011"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:46.400645 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e4aa1be0f02404cba048010fcf9c011 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.400900 1184 raft_consensus.cc:2243] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:46.401269 1184 raft_consensus.cc:2272] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.401841 1184 ts_tablet_manager.cc:1916] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.403270 1172 tablet_bootstrap.cc:654] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.407120 749 tablet_service.cc:1511] Processing CreateTablet for tablet 62241078411c41a989200a897c44e520 (DEFAULT_TABLE table=default.Table_8d21c7fe2d1845128785f018e728aa03 [id=f9bcf8024ca94893a4e3e9dc1c5acfa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.407639 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62241078411c41a989200a897c44e520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.409261 756 tablet_service.cc:1511] Processing CreateTablet for tablet 211e70a0130b4d88ae6ce9e0d3aa215f (DEFAULT_TABLE table=default.Table_9455e17b8cb64e84b9157279c6fa159d [id=90269bb3484540348dda574c782c7964]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.409689 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211e70a0130b4d88ae6ce9e0d3aa215f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.413398 2662 raft_consensus.cc:493] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:46.413543 2662 raft_consensus.cc:515] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.414176 2662 leader_election.cc:290] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:46.415107 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c58290c2d1c742d3b45dfb5caf52c75b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:46.415634 997 leader_election.cc:343] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.415863 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet b317cc133346412fb981b1c8e5b99c4d (table default.Table_39aee165029f47559776d7610e509b6a [id=dbaa2341227b48d19ec73a413513358a]) successfully deleted
W20260318 02:51:46.416080 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 495c8ace1cdb4741aa2ffa1f85dfb25e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 495c8ace1cdb4741aa2ffa1f85dfb25e already in progress: creating tablet
W20260318 02:51:46.416276 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 0abb9045d6394fd4a9e294269387dfc9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0abb9045d6394fd4a9e294269387dfc9 already in progress: creating tablet
I20260318 02:51:46.416827 753 tablet_service.cc:1511] Processing CreateTablet for tablet 5b7e3d783edf420a933925c90bdda19c (DEFAULT_TABLE table=default.Table_d3e615cf324a48f79eda58efbfeff3cf [id=a88657dadeee4987b713e2aadbec3a85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.416896 890 tablet_service.cc:1511] Processing CreateTablet for tablet 6468eaebf8d74dfcbbc6c2994946e0ee (DEFAULT_TABLE table=default.Table_17f53305fd994cdea1582a7b180c3a23 [id=750774185cb74071b6fd7c4635c064dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.417254 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b7e3d783edf420a933925c90bdda19c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.417284 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6468eaebf8d74dfcbbc6c2994946e0ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.418723 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c58290c2d1c742d3b45dfb5caf52c75b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:46.418948 780 raft_consensus.cc:2468] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:46.419415 999 leader_election.cc:304] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.419983 2662 raft_consensus.cc:2804] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:46.420066 2662 raft_consensus.cc:493] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:46.420128 2662 raft_consensus.cc:3060] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:46.422845 2662 raft_consensus.cc:515] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.424011 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c58290c2d1c742d3b45dfb5caf52c75b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:46.424521 997 leader_election.cc:343] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.425251 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 6468eaebf8d74dfcbbc6c2994946e0ee (DEFAULT_TABLE table=default.Table_17f53305fd994cdea1582a7b180c3a23 [id=750774185cb74071b6fd7c4635c064dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.425395 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c58290c2d1c742d3b45dfb5caf52c75b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:46.425597 780 raft_consensus.cc:3060] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:46.425635 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6468eaebf8d74dfcbbc6c2994946e0ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.426608 890 tablet_service.cc:1511] Processing CreateTablet for tablet 62241078411c41a989200a897c44e520 (DEFAULT_TABLE table=default.Table_8d21c7fe2d1845128785f018e728aa03 [id=f9bcf8024ca94893a4e3e9dc1c5acfa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.427042 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62241078411c41a989200a897c44e520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.428182 780 raft_consensus.cc:2468] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:46.428655 999 leader_election.cc:304] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.428928 2605 raft_consensus.cc:2804] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:46.429056 2605 raft_consensus.cc:697] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:46.429350 2662 leader_election.cc:290] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:46.429275 2605 consensus_queue.cc:237] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.430866 1173 tablet_bootstrap.cc:492] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:46.431069 1173 ts_tablet_manager.cc:1403] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.084s user 0.003s sys 0.000s
I20260318 02:51:46.431936 1173 raft_consensus.cc:359] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.434873 1173 raft_consensus.cc:385] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.435019 1173 raft_consensus.cc:740] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.435294 1173 consensus_queue.cc:260] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.437443 1173 ts_tablet_manager.cc:1434] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260318 02:51:46.437791 1173 tablet_bootstrap.cc:492] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:46.439801 890 tablet_service.cc:1511] Processing CreateTablet for tablet 211e70a0130b4d88ae6ce9e0d3aa215f (DEFAULT_TABLE table=default.Table_9455e17b8cb64e84b9157279c6fa159d [id=90269bb3484540348dda574c782c7964]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.440099 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 62241078411c41a989200a897c44e520 (DEFAULT_TABLE table=default.Table_8d21c7fe2d1845128785f018e728aa03 [id=f9bcf8024ca94893a4e3e9dc1c5acfa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.440547 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62241078411c41a989200a897c44e520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.442299 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 211e70a0130b4d88ae6ce9e0d3aa215f (DEFAULT_TABLE table=default.Table_9455e17b8cb64e84b9157279c6fa159d [id=90269bb3484540348dda574c782c7964]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.442751 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211e70a0130b4d88ae6ce9e0d3aa215f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.454509 753 tablet_service.cc:1511] Processing CreateTablet for tablet b5ccf00334f54100aaf5406dd23acac5 (DEFAULT_TABLE table=default.Table_cee83ff8473e40bfad11b5345c1d1e02 [id=040e62c44feb486eb65da42b232ad6a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.454970 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ccf00334f54100aaf5406dd23acac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.456921 2605 raft_consensus.cc:493] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:46.457110 2605 raft_consensus.cc:515] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.457880 418 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu
/tmp/dist-test-taskvjTIu6/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.104.188:41593
--webserver_interface=127.0.104.188
--webserver_port=37041
--builtin_ntp_servers=127.0.104.148:43937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.104.190:39451,127.0.104.189:45933,127.0.104.188:41593
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260318 02:51:46.459933 761 tablet_service.cc:1511] Processing CreateTablet for tablet 4cb348be3d234a83ad8b053ca3610092 (DEFAULT_TABLE table=default.Table_ab2009980b7a4c2b8101098211fba4a7 [id=7ae0985cd2524671bf2ea232b4f25767]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.460371 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cb348be3d234a83ad8b053ca3610092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.461170 1173 tablet_bootstrap.cc:654] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.462096 905 tablet_service.cc:1511] Processing CreateTablet for tablet 5b7e3d783edf420a933925c90bdda19c (DEFAULT_TABLE table=default.Table_d3e615cf324a48f79eda58efbfeff3cf [id=a88657dadeee4987b713e2aadbec3a85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.462786 1174 tablet_bootstrap.cc:492] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:46.462939 1174 ts_tablet_manager.cc:1403] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.143s user 0.000s sys 0.010s
I20260318 02:51:46.463876 1174 raft_consensus.cc:359] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.464474 1174 raft_consensus.cc:385] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.464563 1174 raft_consensus.cc:740] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.464843 1174 consensus_queue.cc:260] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.464951 893 tablet_service.cc:1511] Processing CreateTablet for tablet b5ccf00334f54100aaf5406dd23acac5 (DEFAULT_TABLE table=default.Table_cee83ff8473e40bfad11b5345c1d1e02 [id=040e62c44feb486eb65da42b232ad6a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.465365 1174 ts_tablet_manager.cc:1434] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:46.466025 756 tablet_service.cc:1511] Processing CreateTablet for tablet 6c88de297ccc4ca18d0f2102195d19b8 (DEFAULT_TABLE table=default.Table_8b18f758538e4645aa8c5ad6341c4f93 [id=ebb54eadcb6c4f16b120cc6240afd16a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.466588 1027 tablet_service.cc:1511] Processing CreateTablet for tablet b5ccf00334f54100aaf5406dd23acac5 (DEFAULT_TABLE table=default.Table_cee83ff8473e40bfad11b5345c1d1e02 [id=040e62c44feb486eb65da42b232ad6a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.466979 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ccf00334f54100aaf5406dd23acac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.467062 903 tablet_service.cc:1511] Processing CreateTablet for tablet 6c88de297ccc4ca18d0f2102195d19b8 (DEFAULT_TABLE table=default.Table_8b18f758538e4645aa8c5ad6341c4f93 [id=ebb54eadcb6c4f16b120cc6240afd16a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.467550 2605 leader_election.cc:290] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:46.468150 999 leader_election.cc:343] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: a384923c86ee42d6a47ed3f68e6811df
I20260318 02:51:46.468928 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a384923c86ee42d6a47ed3f68e6811df" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:46.469444 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 6c88de297ccc4ca18d0f2102195d19b8 (DEFAULT_TABLE table=default.Table_8b18f758538e4645aa8c5ad6341c4f93 [id=ebb54eadcb6c4f16b120cc6240afd16a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.464299 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 5b7e3d783edf420a933925c90bdda19c (DEFAULT_TABLE table=default.Table_d3e615cf324a48f79eda58efbfeff3cf [id=a88657dadeee4987b713e2aadbec3a85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.469797 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c88de297ccc4ca18d0f2102195d19b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.469846 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c88de297ccc4ca18d0f2102195d19b8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:46.469990 997 leader_election.cc:343] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.470089 997 leader_election.cc:304] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.470417 2605 raft_consensus.cc:2749] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:46.470618 897 tablet_service.cc:1511] Processing CreateTablet for tablet 4cb348be3d234a83ad8b053ca3610092 (DEFAULT_TABLE table=default.Table_ab2009980b7a4c2b8101098211fba4a7 [id=7ae0985cd2524671bf2ea232b4f25767]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.473047 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b7e3d783edf420a933925c90bdda19c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.474840 1174 tablet_bootstrap.cc:492] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:46.476560 1174 tablet_bootstrap.cc:654] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:46.479586 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet be210e062db54f52883b4298f63d1821 consensus state has no leader
W20260318 02:51:46.481159 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 69b5315fe198465388d826101f00b844 consensus state has no leader
W20260318 02:51:46.483740 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ef03f9716ae04df4826fb9f54a0ef765 consensus state has no leader
I20260318 02:51:46.484385 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2ecbbe70dfd74243982cf1b03b0f167b
I20260318 02:51:46.485184 450 catalog_manager.cc:5953] Not sending DeleteTablet requests; no consensus state for tablet 1b307f817e144bb9943fd8e30bb50227
I20260318 02:51:46.485702 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet c3d6574f9a4747b9ac417790fd978823
I20260318 02:51:46.496001 1172 tablet_bootstrap.cc:492] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:46.496183 1172 ts_tablet_manager.cc:1403] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.101s user 0.002s sys 0.002s
I20260318 02:51:46.500162 766 tablet_service.cc:1511] Processing CreateTablet for tablet 073375d3f7c24c9c9f6806a11783acba (DEFAULT_TABLE table=default.Table_448e0cc41ff047c4ab15e7fe7fd1305e [id=a73e35b4277f41968c6d1d09c9455bea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.500252 750 tablet_service.cc:1511] Processing CreateTablet for tablet 6659a0d0ee3c435187cdcf3920f1d5e7 (DEFAULT_TABLE table=default.Table_3f853afbb0104fe0a6e0652ccc682718 [id=1b5a902027c643b988dde764d07ee218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.499521 749 tablet_service.cc:1511] Processing CreateTablet for tablet 351fd674a3bb4a139ad66f013e274e90 (DEFAULT_TABLE table=default.Table_c62cd6e64e5246adb82d1804cd0a02a3 [id=3ab79896f26648ed869694e30dcd1f20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.499858 762 tablet_service.cc:1558] Processing DeleteTablet for tablet c3d6574f9a4747b9ac417790fd978823 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:46.499927 761 tablet_service.cc:1511] Processing CreateTablet for tablet ff34bb37ffb046629a98232c1fa752d1 (DEFAULT_TABLE table=default.Table_50dae330cd4440048412c7f6dfd40332 [id=8f4d8028ab5f4a179afade311adf6454]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.500567 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 073375d3f7c24c9c9f6806a11783acba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.500758 748 tablet_service.cc:1511] Processing CreateTablet for tablet 4615699c76a5465f9d70e86469f0888b (DEFAULT_TABLE table=default.Table_ab6108d8e1194517983dd8a515a08eb7 [id=c657086801444f1e8f2277b3462dea90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.500875 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff34bb37ffb046629a98232c1fa752d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.501065 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4615699c76a5465f9d70e86469f0888b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.501127 1172 raft_consensus.cc:359] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.501302 1172 raft_consensus.cc:385] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.501349 1172 raft_consensus.cc:740] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.503206 1172 consensus_queue.cc:260] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.505576 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6659a0d0ee3c435187cdcf3920f1d5e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.505632 756 tablet_service.cc:1511] Processing CreateTablet for tablet 6934cf71f9034febb5e0ebfa410fb94b (DEFAULT_TABLE table=default.Table_ecc8c866d2154ffbbb606dba2a14c2c9 [id=38d754fc7768404493abfcd27874f157]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.509151 1184 ts_tablet_manager.cc:1929] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:46.509297 1184 log.cc:1199] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/1516525b471540288c6cb5d61120d430
I20260318 02:51:46.509615 1184 ts_tablet_manager.cc:1950] T 1516525b471540288c6cb5d61120d430 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.511842 1172 ts_tablet_manager.cc:1434] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20260318 02:51:46.499922 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ecbbe70dfd74243982cf1b03b0f167b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:46.513823 1172 tablet_bootstrap.cc:492] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:46.514683 1173 tablet_bootstrap.cc:492] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:46.514938 1173 ts_tablet_manager.cc:1403] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.077s user 0.004s sys 0.000s
I20260318 02:51:46.515615 449 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 6d938a2eefe4471cb94a9544647f8e3e (table default.Table_c0956e46e13c47bc95482c534f632c04 [id=d0c05683decb4a5bbf2e3eab386a1116]). Expected version 1 got 0
I20260318 02:51:46.516287 1172 tablet_bootstrap.cc:654] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.516193 1173 raft_consensus.cc:359] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.516463 1173 raft_consensus.cc:385] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.516558 1173 raft_consensus.cc:740] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.516875 1173 consensus_queue.cc:260] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.518836 1173 ts_tablet_manager.cc:1434] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260318 02:51:46.519441 1173 tablet_bootstrap.cc:492] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:46.521373 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 351fd674a3bb4a139ad66f013e274e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.522300 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6934cf71f9034febb5e0ebfa410fb94b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.523910 927 raft_consensus.cc:3060] T 68b0f0cd89234e72a052f3f9f964aa35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:46.528895 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1300) took 1873 ms. Trace:
I20260318 02:51:46.529018 1184 rpcz_store.cc:276] 0318 02:51:44.655575 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.655661 (+ 86us) service_pool.cc:225] Handling call
0318 02:51:46.394833 (+1739172us) ts_tablet_manager.cc:1151] Deleting tablet 1516525b471540288c6cb5d61120d430
0318 02:51:46.394843 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.407882 (+ 13039us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.509022 (+101140us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.528863 (+ 19841us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1738953}
I20260318 02:51:46.529587 1184 tablet_replica.cc:333] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.529788 1184 raft_consensus.cc:2243] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.529932 1184 raft_consensus.cc:2272] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.530467 1184 ts_tablet_manager.cc:1916] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.537190 2740 tablet.cc:1723] T 68b0f0cd89234e72a052f3f9f964aa35 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260318 02:51:46.558085 441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.189:45933, user_credentials={real_user=slave}} blocked reactor thread for 84805.3us
I20260318 02:51:46.561740 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 1516525b471540288c6cb5d61120d430 (table default.Table_4e770bc308894d9094b88315d9093ba5 [id=433e7aa77412424ebb38784bb073d1fb]) successfully deleted
I20260318 02:51:46.563791 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_274158734fea47acba9c6794bed6975c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:46.564435 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_274158734fea47acba9c6794bed6975c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.571847 1175 ts_tablet_manager.cc:1929] T b8973d8930ef4b65be7b4ff990bf9d72 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.574604 1175 log.cc:1199] T b8973d8930ef4b65be7b4ff990bf9d72 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/b8973d8930ef4b65be7b4ff990bf9d72
I20260318 02:51:46.575129 1184 ts_tablet_manager.cc:1929] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.576169 1175 ts_tablet_manager.cc:1950] T b8973d8930ef4b65be7b4ff990bf9d72 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:46.577345 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b7e3d783edf420a933925c90bdda19c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.576210 1172 tablet_bootstrap.cc:492] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:46.577970 1172 ts_tablet_manager.cc:1403] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.064s user 0.005s sys 0.003s
I20260318 02:51:46.578893 1172 raft_consensus.cc:359] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.579282 1173 tablet_bootstrap.cc:654] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.582623 2660 raft_consensus.cc:493] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:46.582893 2660 raft_consensus.cc:515] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.583608 2660 leader_election.cc:290] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:46.584264 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cb348be3d234a83ad8b053ca3610092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.584781 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c88de297ccc4ca18d0f2102195d19b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.585475 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6deb99f7937144f39409929f99b135c5" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:46.586445 1172 raft_consensus.cc:385] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.586529 1172 raft_consensus.cc:740] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
W20260318 02:51:46.586958 719 leader_election.cc:343] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.587496 1172 consensus_queue.cc:260] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.589082 1172 ts_tablet_manager.cc:1434] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260318 02:51:46.589262 1184 log.cc:1199] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/2f04e5699531479d8b76edb0e2d2873c
I20260318 02:51:46.589608 1184 ts_tablet_manager.cc:1950] T 2f04e5699531479d8b76edb0e2d2873c P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.591168 1172 tablet_bootstrap.cc:492] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:46.592204 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1310) took 1835 ms. Trace:
I20260318 02:51:46.592360 1184 rpcz_store.cc:276] 0318 02:51:44.757154 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.757582 (+ 428us) service_pool.cc:225] Handling call
0318 02:51:46.529533 (+1771951us) ts_tablet_manager.cc:1151] Deleting tablet 2f04e5699531479d8b76edb0e2d2873c
0318 02:51:46.529545 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.568818 (+ 39273us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.575010 (+ 6192us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.592182 (+ 17172us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1771733}
I20260318 02:51:46.593071 1184 tablet_replica.cc:333] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.593302 1184 raft_consensus.cc:2243] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.596191 1172 tablet_bootstrap.cc:654] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.596237 1184 raft_consensus.cc:2272] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.597084 1184 ts_tablet_manager.cc:1916] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.604218 2605 consensus_queue.cc:1048] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:46.611670 1184 ts_tablet_manager.cc:1929] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.612639 2715 raft_consensus.cc:493] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:46.612818 2715 raft_consensus.cc:515] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.612677 1184 log.cc:1199] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/c4051c8e4d3d49829f9eac8e36baab2f
I20260318 02:51:46.613487 2715 leader_election.cc:290] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:46.614544 860 leader_election.cc:343] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 461adcc8bbd94d30b9b84d1010430829
W20260318 02:51:46.614759 862 leader_election.cc:343] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 461adcc8bbd94d30b9b84d1010430829
I20260318 02:51:46.614879 862 leader_election.cc:304] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:46.615115 2715 raft_consensus.cc:2749] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:46.613449 1184 ts_tablet_manager.cc:1950] T c4051c8e4d3d49829f9eac8e36baab2f P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.619949 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1312) took 1862 ms. Trace:
I20260318 02:51:46.620114 1184 rpcz_store.cc:276] 0318 02:51:44.757351 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.757848 (+ 497us) service_pool.cc:225] Handling call
0318 02:51:46.592893 (+1835045us) ts_tablet_manager.cc:1151] Deleting tablet c4051c8e4d3d49829f9eac8e36baab2f
0318 02:51:46.592904 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.603959 (+ 11055us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.611526 (+ 7567us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.619927 (+ 8401us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1834871}
I20260318 02:51:46.620644 1184 tablet_replica.cc:333] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.620939 1184 raft_consensus.cc:2243] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.621140 1184 raft_consensus.cc:2272] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.621718 1184 ts_tablet_manager.cc:1916] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.623343 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ccf00334f54100aaf5406dd23acac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.626742 2660 raft_consensus.cc:493] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:46.626892 2660 raft_consensus.cc:515] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.627504 2660 leader_election.cc:290] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:46.628590 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a92761edfe74a9798da4d93964383ea" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:46.629138 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211e70a0130b4d88ae6ce9e0d3aa215f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:46.629199 719 leader_election.cc:343] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.629796 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a92761edfe74a9798da4d93964383ea" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:46.629887 926 raft_consensus.cc:3060] T 19f0750985d947a3a9323944540abbac P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:46.631630 719 leader_election.cc:343] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.631752 719 leader_election.cc:304] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.632294 2660 raft_consensus.cc:2749] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:46.633802 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6deb99f7937144f39409929f99b135c5" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:46.636003 719 leader_election.cc:343] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.636122 719 leader_election.cc:304] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.638870 2660 raft_consensus.cc:2749] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:46.641924 1175 tablet_replica.cc:333] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:46.642133 1175 raft_consensus.cc:2243] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.642290 1175 raft_consensus.cc:2272] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.642803 1175 ts_tablet_manager.cc:1916] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.644565 1184 ts_tablet_manager.cc:1929] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.645529 1174 tablet_bootstrap.cc:492] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:46.645684 1174 ts_tablet_manager.cc:1403] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.171s user 0.006s sys 0.006s
I20260318 02:51:46.646397 1174 raft_consensus.cc:359] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.646577 1174 raft_consensus.cc:385] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.646629 1174 raft_consensus.cc:740] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.646831 1174 consensus_queue.cc:260] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.647568 1174 ts_tablet_manager.cc:1434] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:46.647759 1184 log.cc:1199] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/f37ab96f13444fcbb5cfc3ad92d53c35
I20260318 02:51:46.647856 1174 tablet_bootstrap.cc:492] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:46.648183 1184 ts_tablet_manager.cc:1950] T f37ab96f13444fcbb5cfc3ad92d53c35 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.653761 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1313) took 1896 ms. Trace:
I20260318 02:51:46.653990 1184 rpcz_store.cc:276] 0318 02:51:44.757443 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.758054 (+ 611us) service_pool.cc:225] Handling call
0318 02:51:46.620595 (+1862541us) ts_tablet_manager.cc:1151] Deleting tablet f37ab96f13444fcbb5cfc3ad92d53c35
0318 02:51:46.620605 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.633931 (+ 13326us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.644436 (+ 10505us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.653731 (+ 9295us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1862405}
I20260318 02:51:46.654770 1184 tablet_replica.cc:333] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.655030 1184 raft_consensus.cc:2243] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.655274 1184 raft_consensus.cc:2272] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.656167 1184 ts_tablet_manager.cc:1916] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.670238 2704 ts_tablet_manager.cc:1929] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.670372 2704 log.cc:1199] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/5c89f413a26a43ef95c850d7c44f85b2
I20260318 02:51:46.670635 2704 ts_tablet_manager.cc:1950] T 5c89f413a26a43ef95c850d7c44f85b2 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:46.671397 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_10db426df0be4af699aa590ebfe24dd4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:46.671990 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10db426df0be4af699aa590ebfe24dd4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.672020 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet b8973d8930ef4b65be7b4ff990bf9d72 (table default.Table_9f269c4844cc473580c4743dd9be3dea [id=997461446ec8473382964afdb61aafb3]) successfully deleted
I20260318 02:51:46.672942 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_443be3a1959546e3a1a362232f473064"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:46.673452 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_443be3a1959546e3a1a362232f473064 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.673712 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 4cb348be3d234a83ad8b053ca3610092 (DEFAULT_TABLE table=default.Table_ab2009980b7a4c2b8101098211fba4a7 [id=7ae0985cd2524671bf2ea232b4f25767]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.674177 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cb348be3d234a83ad8b053ca3610092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.669977 1184 ts_tablet_manager.cc:1929] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.674508 1184 log.cc:1199] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/9777963ff20c4a799de2870555f6b335
I20260318 02:51:46.674649 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3bbaffd805554520b32b15b19b072c13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:46.675110 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3bbaffd805554520b32b15b19b072c13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.676203 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7f25bb7b147945ff9cfc45d68c843e42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:46.676652 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f25bb7b147945ff9cfc45d68c843e42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.677738 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1f92e5cb67504f599ef161548211b85a" } new_table_name: "default.Table_fd94e00511a84ba29e390163dd874c31" modify_external_catalogs: true
I20260318 02:51:46.678260 1184 ts_tablet_manager.cc:1950] T 9777963ff20c4a799de2870555f6b335 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.678848 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ffb878be775b445d9cb1a9b6e6a3c1f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:46.679190 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1311) took 1921 ms. Trace:
W20260318 02:51:46.679288 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ffb878be775b445d9cb1a9b6e6a3c1f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.679298 1184 rpcz_store.cc:276] 0318 02:51:44.757280 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.760319 (+ 3039us) service_pool.cc:225] Handling call
0318 02:51:46.654711 (+1894392us) ts_tablet_manager.cc:1151] Deleting tablet 9777963ff20c4a799de2870555f6b335
0318 02:51:46.654723 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.663071 (+ 8348us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.669839 (+ 6768us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.679134 (+ 9295us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1894226}
I20260318 02:51:46.680171 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1302) took 1953 ms. Trace:
I20260318 02:51:46.680291 1184 rpcz_store.cc:276] 0318 02:51:44.726665 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.728277 (+ 1612us) service_pool.cc:225] Handling call
0318 02:51:46.679960 (+1951683us) ts_tablet_manager.cc:1151] Deleting tablet 75c4ba372960496880405e5dffe11d60
0318 02:51:46.679987 (+ 27us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.680115 (+ 128us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1919148}
I20260318 02:51:46.681229 1173 tablet_bootstrap.cc:492] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:46.681366 1173 ts_tablet_manager.cc:1403] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.162s user 0.006s sys 0.006s
I20260318 02:51:46.681509 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1303) took 1954 ms. Trace:
I20260318 02:51:46.681607 1184 rpcz_store.cc:276] 0318 02:51:44.726857 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.728445 (+ 1588us) service_pool.cc:225] Handling call
0318 02:51:46.681358 (+1952913us) ts_tablet_manager.cc:1151] Deleting tablet 5b1527c9ce014e819d03330486e8ef3b
0318 02:51:46.681369 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.681473 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1920487}
I20260318 02:51:46.682155 1173 raft_consensus.cc:359] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.682322 1173 raft_consensus.cc:385] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.682374 1173 raft_consensus.cc:740] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.682574 1173 consensus_queue.cc:260] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.682879 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1306) took 1955 ms. Trace:
I20260318 02:51:46.682981 1184 rpcz_store.cc:276] 0318 02:51:44.727194 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.728542 (+ 1348us) service_pool.cc:225] Handling call
0318 02:51:46.682730 (+1954188us) ts_tablet_manager.cc:1151] Deleting tablet 407b6b2f451e43aaaba4f6cebb80fac7
0318 02:51:46.682740 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.682842 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1921815}
I20260318 02:51:46.684865 1184 tablet_replica.cc:333] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.685187 1184 raft_consensus.cc:2243] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.685371 1184 raft_consensus.cc:2272] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.685802 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 351fd674a3bb4a139ad66f013e274e90 (DEFAULT_TABLE table=default.Table_c62cd6e64e5246adb82d1804cd0a02a3 [id=3ab79896f26648ed869694e30dcd1f20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.686268 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 351fd674a3bb4a139ad66f013e274e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.689117 2152 raft_consensus.cc:493] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:46.689320 2152 raft_consensus.cc:515] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.689980 2152 leader_election.cc:290] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:46.690258 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f80f29dfd814acd8b7e143a72231dfd" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:46.690805 999 leader_election.cc:343] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2f80f29dfd814acd8b7e143a72231dfd
I20260318 02:51:46.691104 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ecbbe70dfd74243982cf1b03b0f167b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:46.691848 997 leader_election.cc:343] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.692200 997 leader_election.cc:304] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.692432 2152 raft_consensus.cc:2749] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:46.692821 1184 ts_tablet_manager.cc:1916] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.694082 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 6934cf71f9034febb5e0ebfa410fb94b (DEFAULT_TABLE table=default.Table_ecc8c866d2154ffbbb606dba2a14c2c9 [id=38d754fc7768404493abfcd27874f157]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.694501 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6934cf71f9034febb5e0ebfa410fb94b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.694545 897 tablet_service.cc:1511] Processing CreateTablet for tablet 6934cf71f9034febb5e0ebfa410fb94b (DEFAULT_TABLE table=default.Table_ecc8c866d2154ffbbb606dba2a14c2c9 [id=38d754fc7768404493abfcd27874f157]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.695123 893 tablet_service.cc:1511] Processing CreateTablet for tablet 351fd674a3bb4a139ad66f013e274e90 (DEFAULT_TABLE table=default.Table_c62cd6e64e5246adb82d1804cd0a02a3 [id=3ab79896f26648ed869694e30dcd1f20]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.704396 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6934cf71f9034febb5e0ebfa410fb94b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.707046 903 tablet_service.cc:1511] Processing CreateTablet for tablet ff34bb37ffb046629a98232c1fa752d1 (DEFAULT_TABLE table=default.Table_50dae330cd4440048412c7f6dfd40332 [id=8f4d8028ab5f4a179afade311adf6454]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.707423 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet c3d6574f9a4747b9ac417790fd978823 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:46.707641 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff34bb37ffb046629a98232c1fa752d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.708158 1041 tablet_service.cc:1511] Processing CreateTablet for tablet ff34bb37ffb046629a98232c1fa752d1 (DEFAULT_TABLE table=default.Table_50dae330cd4440048412c7f6dfd40332 [id=8f4d8028ab5f4a179afade311adf6454]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.708534 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff34bb37ffb046629a98232c1fa752d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.710379 2660 raft_consensus.cc:493] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:46.710518 2660 raft_consensus.cc:515] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.711074 2660 leader_election.cc:290] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:46.711201 905 tablet_service.cc:1558] Processing DeleteTablet for tablet c3d6574f9a4747b9ac417790fd978823 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:46.711439 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 351fd674a3bb4a139ad66f013e274e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.711863 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10fd13bf3ea48b0896b34fce478e25a" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:46.711680 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10fd13bf3ea48b0896b34fce478e25a" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:46.712353 719 leader_election.cc:343] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:46.712671 719 leader_election.cc:343] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.712822 719 leader_election.cc:304] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.713032 1184 ts_tablet_manager.cc:1929] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.713048 2660 raft_consensus.cc:2749] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:46.713160 1184 log.cc:1199] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/20a492fdea6c44ba8439614b0dcc2ba6
I20260318 02:51:46.713460 1184 ts_tablet_manager.cc:1950] T 20a492fdea6c44ba8439614b0dcc2ba6 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.713955 905 tablet_service.cc:1511] Processing CreateTablet for tablet 6659a0d0ee3c435187cdcf3920f1d5e7 (DEFAULT_TABLE table=default.Table_3f853afbb0104fe0a6e0652ccc682718 [id=1b5a902027c643b988dde764d07ee218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.714069 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 5c89f413a26a43ef95c850d7c44f85b2 (table default.Table_9f269c4844cc473580c4743dd9be3dea [id=997461446ec8473382964afdb61aafb3]) successfully deleted
I20260318 02:51:46.714247 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1309) took 1974 ms. Trace:
W20260318 02:51:46.714376 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet c3d6574f9a4747b9ac417790fd978823 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3d6574f9a4747b9ac417790fd978823 already in progress: creating tablet
I20260318 02:51:46.714349 1184 rpcz_store.cc:276] 0318 02:51:44.739336 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.739398 (+ 62us) service_pool.cc:225] Handling call
0318 02:51:46.684796 (+1945398us) ts_tablet_manager.cc:1151] Deleting tablet 20a492fdea6c44ba8439614b0dcc2ba6
0318 02:51:46.684808 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.699874 (+ 15066us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.709231 (+ 9357us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.714210 (+ 4979us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1919976}
I20260318 02:51:46.714581 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6659a0d0ee3c435187cdcf3920f1d5e7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:46.714576 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2ecbbe70dfd74243982cf1b03b0f167b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ecbbe70dfd74243982cf1b03b0f167b already in progress: creating tablet
I20260318 02:51:46.714864 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ecbbe70dfd74243982cf1b03b0f167b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:46.714993 1184 tablet_replica.cc:333] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.715214 1184 raft_consensus.cc:2243] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.715387 1184 raft_consensus.cc:2272] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.715847 1174 tablet_bootstrap.cc:654] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.715939 1184 ts_tablet_manager.cc:1916] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.716851 1173 ts_tablet_manager.cc:1434] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.035s user 0.000s sys 0.002s
I20260318 02:51:46.717190 1173 tablet_bootstrap.cc:492] T 49afed40c7aa4f2d913daed8055a098e P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:46.718796 1173 tablet_bootstrap.cc:654] T 49afed40c7aa4f2d913daed8055a098e P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.722406 2764 raft_consensus.cc:493] T 608df0ce4e1d4ed6b7655802a6f7f6bc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:46.722563 2764 raft_consensus.cc:515] T 608df0ce4e1d4ed6b7655802a6f7f6bc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:46.723240 2764 leader_election.cc:290] T 608df0ce4e1d4ed6b7655802a6f7f6bc P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:46.723702 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608df0ce4e1d4ed6b7655802a6f7f6bc" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:46.725087 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608df0ce4e1d4ed6b7655802a6f7f6bc" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:46.725610 860 leader_election.cc:304] T 608df0ce4e1d4ed6b7655802a6f7f6bc P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:46.725869 2764 raft_consensus.cc:2749] T 608df0ce4e1d4ed6b7655802a6f7f6bc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:46.728397 926 raft_consensus.cc:3060] T 608df0ce4e1d4ed6b7655802a6f7f6bc P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:46.734004 1172 tablet_bootstrap.cc:492] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:46.734185 1172 ts_tablet_manager.cc:1403] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.143s user 0.014s sys 0.013s
I20260318 02:51:46.734980 1172 raft_consensus.cc:359] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.735172 1172 raft_consensus.cc:385] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.735244 1172 raft_consensus.cc:740] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.735543 1172 consensus_queue.cc:260] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.735687 1184 ts_tablet_manager.cc:1929] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.736878 1172 ts_tablet_manager.cc:1434] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:46.737768 1172 tablet_bootstrap.cc:492] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:46.742900 1175 ts_tablet_manager.cc:1929] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.746640 1184 log.cc:1199] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/6bb381f10d87414f9c1a99942216adc7
I20260318 02:51:46.746981 1184 ts_tablet_manager.cc:1950] T 6bb381f10d87414f9c1a99942216adc7 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.747772 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1316) took 1953 ms. Trace:
I20260318 02:51:46.747880 1184 rpcz_store.cc:276] 0318 02:51:44.794650 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.800817 (+ 6167us) service_pool.cc:225] Handling call
0318 02:51:46.714922 (+1914105us) ts_tablet_manager.cc:1151] Deleting tablet 6bb381f10d87414f9c1a99942216adc7
0318 02:51:46.714932 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.724307 (+ 9375us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.735556 (+ 11249us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.747732 (+ 12176us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1913873}
I20260318 02:51:46.748235 1184 tablet_replica.cc:333] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.748780 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 6659a0d0ee3c435187cdcf3920f1d5e7 (DEFAULT_TABLE table=default.Table_3f853afbb0104fe0a6e0652ccc682718 [id=1b5a902027c643b988dde764d07ee218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.749260 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6659a0d0ee3c435187cdcf3920f1d5e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.751696 1174 tablet_bootstrap.cc:492] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:46.751904 1174 ts_tablet_manager.cc:1403] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.104s user 0.002s sys 0.001s
I20260318 02:51:46.752331 1184 raft_consensus.cc:2243] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.752532 1184 raft_consensus.cc:2272] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.752846 1174 raft_consensus.cc:359] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.753091 1184 ts_tablet_manager.cc:1916] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.753101 1174 raft_consensus.cc:385] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.753297 1174 raft_consensus.cc:740] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.753562 1174 consensus_queue.cc:260] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.754891 1174 ts_tablet_manager.cc:1434] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:46.746009 2740 tablet.cc:1723] T 608df0ce4e1d4ed6b7655802a6f7f6bc P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:46.755602 1175 log.cc:1199] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/de2bc2f79e8b49248de3e7eca1a600cf
I20260318 02:51:46.755967 1175 ts_tablet_manager.cc:1950] T de2bc2f79e8b49248de3e7eca1a600cf P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:46.756829 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 4615699c76a5465f9d70e86469f0888b (DEFAULT_TABLE table=default.Table_ab6108d8e1194517983dd8a515a08eb7 [id=c657086801444f1e8f2277b3462dea90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.757285 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4615699c76a5465f9d70e86469f0888b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.757229 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 073375d3f7c24c9c9f6806a11783acba (DEFAULT_TABLE table=default.Table_448e0cc41ff047c4ab15e7fe7fd1305e [id=a73e35b4277f41968c6d1d09c9455bea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.757604 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 073375d3f7c24c9c9f6806a11783acba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.759912 2764 raft_consensus.cc:493] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:46.760304 2764 raft_consensus.cc:515] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.760987 2764 leader_election.cc:290] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:46.761782 860 leader_election.cc:343] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 60dedba077d34435b30061bfba737412
I20260318 02:51:46.762080 1175 tablet_replica.cc:333] T 46ce65cca47f48db94e70226494cfbae P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:46.762259 1175 raft_consensus.cc:2243] T 46ce65cca47f48db94e70226494cfbae P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.762392 1175 raft_consensus.cc:2272] T 46ce65cca47f48db94e70226494cfbae P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.763687 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 2f04e5699531479d8b76edb0e2d2873c (table default.Table_9e6e77bf748f460894d85c701ccfad5b [id=ddd8b0b49c334776b49a59c18e75453c]) successfully deleted
I20260318 02:51:46.763919 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet c4051c8e4d3d49829f9eac8e36baab2f (table default.Table_fe03be40cbc54d21927bda17030ed005 [id=3665ac075f964d4c8e2cdda80cbef8a4]) successfully deleted
I20260318 02:51:46.764130 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet f37ab96f13444fcbb5cfc3ad92d53c35 (table default.Table_a9ca2b8e5b9042279576e9b9c6701069 [id=3066ad66b0914b759c32fe9296ca90bc]) successfully deleted
I20260318 02:51:46.764283 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 9777963ff20c4a799de2870555f6b335 (table default.Table_6de905c387094641af62b74f3e0cee37 [id=f8c2021fcd4c4fb2b807bf8fa92088dd]) successfully deleted
W20260318 02:51:46.764585 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 75c4ba372960496880405e5dffe11d60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75c4ba372960496880405e5dffe11d60 already in progress: creating tablet
W20260318 02:51:46.764808 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 5b1527c9ce014e819d03330486e8ef3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b1527c9ce014e819d03330486e8ef3b already in progress: creating tablet
W20260318 02:51:46.764984 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 407b6b2f451e43aaaba4f6cebb80fac7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 407b6b2f451e43aaaba4f6cebb80fac7 already in progress: creating tablet
I20260318 02:51:46.765308 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 20a492fdea6c44ba8439614b0dcc2ba6 (table default.Table_d2f73355578d4f4391b25e72718cfa1e [id=0bd115a0960941ff9d49b4566fe1c666]) successfully deleted
I20260318 02:51:46.765451 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 6bb381f10d87414f9c1a99942216adc7 (table default.Table_944b58673e2348228ec36d8ba31e25b4 [id=b175f925e78640e586132f07ed6e44c0]) successfully deleted
I20260318 02:51:46.766216 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet de2bc2f79e8b49248de3e7eca1a600cf (table default.Table_28ea1894a58c438785ae9e4b8b414447 [id=b71fc31bca0a449296c3e0a0b8ceb6e6]) successfully deleted
I20260318 02:51:46.748245 890 tablet_service.cc:1511] Processing CreateTablet for tablet 073375d3f7c24c9c9f6806a11783acba (DEFAULT_TABLE table=default.Table_448e0cc41ff047c4ab15e7fe7fd1305e [id=a73e35b4277f41968c6d1d09c9455bea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.767874 1174 tablet_bootstrap.cc:492] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:46.768615 862 leader_election.cc:343] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 60dedba077d34435b30061bfba737412
I20260318 02:51:46.768779 862 leader_election.cc:304] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:46.769270 2764 raft_consensus.cc:2749] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:46.769399 1174 tablet_bootstrap.cc:654] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.769456 1184 ts_tablet_manager.cc:1929] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.769625 1184 log.cc:1199] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/4df7d75e696a4aec981de3963c282b0d
I20260318 02:51:46.769992 1184 ts_tablet_manager.cc:1950] T 4df7d75e696a4aec981de3963c282b0d P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.772073 1175 ts_tablet_manager.cc:1916] T 46ce65cca47f48db94e70226494cfbae P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.772855 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 073375d3f7c24c9c9f6806a11783acba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.773396 897 tablet_service.cc:1511] Processing CreateTablet for tablet 4615699c76a5465f9d70e86469f0888b (DEFAULT_TABLE table=default.Table_ab6108d8e1194517983dd8a515a08eb7 [id=c657086801444f1e8f2277b3462dea90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:46.750758 1173 tablet_bootstrap.cc:492] T 49afed40c7aa4f2d913daed8055a098e P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:46.773948 1173 ts_tablet_manager.cc:1403] T 49afed40c7aa4f2d913daed8055a098e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.057s user 0.002s sys 0.001s
I20260318 02:51:46.774710 1173 raft_consensus.cc:359] T 49afed40c7aa4f2d913daed8055a098e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.774883 1173 raft_consensus.cc:385] T 49afed40c7aa4f2d913daed8055a098e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.774936 1173 raft_consensus.cc:740] T 49afed40c7aa4f2d913daed8055a098e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.775166 1173 consensus_queue.cc:260] T 49afed40c7aa4f2d913daed8055a098e P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.783721 1175 ts_tablet_manager.cc:1929] T 46ce65cca47f48db94e70226494cfbae P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.790331 1175 log.cc:1199] T 46ce65cca47f48db94e70226494cfbae P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/46ce65cca47f48db94e70226494cfbae
I20260318 02:51:46.790925 1175 ts_tablet_manager.cc:1950] T 46ce65cca47f48db94e70226494cfbae P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:46.791522 1175 tablet_replica.cc:333] T cf73a9f8f67b42d9baf1396d70a1a3a9 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:46.791877 1175 raft_consensus.cc:2243] T cf73a9f8f67b42d9baf1396d70a1a3a9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.792121 1175 raft_consensus.cc:2272] T cf73a9f8f67b42d9baf1396d70a1a3a9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.792815 1175 ts_tablet_manager.cc:1916] T cf73a9f8f67b42d9baf1396d70a1a3a9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.794127 2152 raft_consensus.cc:493] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:46.794312 2152 raft_consensus.cc:515] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.795255 2152 leader_election.cc:290] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:46.795748 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2a586892a24c71a956dbbe382484c9" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:46.796085 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2a586892a24c71a956dbbe382484c9" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:46.796290 781 raft_consensus.cc:2468] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
W20260318 02:51:46.796407 997 leader_election.cc:343] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.796799 999 leader_election.cc:304] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.797120 2152 raft_consensus.cc:2804] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:46.797212 2152 raft_consensus.cc:493] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:46.797308 2152 raft_consensus.cc:3060] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:46.803575 1172 tablet_bootstrap.cc:654] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.804929 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4615699c76a5465f9d70e86469f0888b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:46.810551 1173 ts_tablet_manager.cc:1434] T 49afed40c7aa4f2d913daed8055a098e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.037s user 0.001s sys 0.001s
I20260318 02:51:46.810993 1173 tablet_bootstrap.cc:492] T 3aa05403966349ae9056777d913a0db6 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:46.818114 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1317) took 2016 ms. Trace:
I20260318 02:51:46.818259 1184 rpcz_store.cc:276] 0318 02:51:44.801987 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.803058 (+ 1071us) service_pool.cc:225] Handling call
0318 02:51:46.748162 (+1945104us) ts_tablet_manager.cc:1151] Deleting tablet 4df7d75e696a4aec981de3963c282b0d
0318 02:51:46.748172 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.765925 (+ 17753us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.769315 (+ 3390us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.818049 (+ 48734us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1944909}
I20260318 02:51:46.818691 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1322) took 1979 ms. Trace:
I20260318 02:51:46.818779 1184 rpcz_store.cc:276] 0318 02:51:44.839468 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.839641 (+ 173us) service_pool.cc:225] Handling call
0318 02:51:46.818524 (+1978883us) ts_tablet_manager.cc:1151] Deleting tablet 0f499c464eb14164a2df3abc2d4a47c7
0318 02:51:46.818535 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.818650 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1978680}
I20260318 02:51:46.819098 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1321) took 1979 ms. Trace:
I20260318 02:51:46.819177 1184 rpcz_store.cc:276] 0318 02:51:44.839344 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.839927 (+ 583us) service_pool.cc:225] Handling call
0318 02:51:46.818976 (+1979049us) ts_tablet_manager.cc:1151] Deleting tablet f8e428b700044eaf9e360f74c751a206
0318 02:51:46.818985 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.819058 (+ 73us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1978899}
I20260318 02:51:46.819444 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1323) took 1976 ms. Trace:
I20260318 02:51:46.819511 1184 rpcz_store.cc:276] 0318 02:51:44.843173 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.843239 (+ 66us) service_pool.cc:225] Handling call
0318 02:51:46.819350 (+1976111us) ts_tablet_manager.cc:1151] Deleting tablet 443e6018aed94077a38aa80bafee7264
0318 02:51:46.819358 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.819417 (+ 59us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1975938}
I20260318 02:51:46.819790 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1320) took 1980 ms. Trace:
I20260318 02:51:46.819870 1184 rpcz_store.cc:276] 0318 02:51:44.839231 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:44.999024 (+159793us) service_pool.cc:225] Handling call
0318 02:51:46.819685 (+1820661us) ts_tablet_manager.cc:1151] Deleting tablet fca751e8fa5e4098b33093766e80d933
0318 02:51:46.819692 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.819754 (+ 62us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1820058}
I20260318 02:51:46.820127 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1343) took 1550 ms. Trace:
I20260318 02:51:46.820195 1184 rpcz_store.cc:276] 0318 02:51:45.269936 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:45.280512 (+ 10576us) service_pool.cc:225] Handling call
0318 02:51:46.820034 (+1539522us) ts_tablet_manager.cc:1151] Deleting tablet a2b8723a0d354f248ffe4cd2ef5a21dc
0318 02:51:46.820041 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.820099 (+ 58us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1537459}
I20260318 02:51:46.820459 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1344) took 1539 ms. Trace:
I20260318 02:51:46.820529 1184 rpcz_store.cc:276] 0318 02:51:45.280882 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:45.283904 (+ 3022us) service_pool.cc:225] Handling call
0318 02:51:46.820363 (+1536459us) ts_tablet_manager.cc:1151] Deleting tablet 3f1a75b4559440c1bf38d4ae0c52d4e5
0318 02:51:46.820370 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.820431 (+ 61us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1536284}
I20260318 02:51:46.820986 1174 tablet_bootstrap.cc:492] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:46.821161 1174 ts_tablet_manager.cc:1403] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.054s user 0.003s sys 0.000s
I20260318 02:51:46.822029 1174 raft_consensus.cc:359] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.822252 1174 raft_consensus.cc:385] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.822309 1174 raft_consensus.cc:740] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.822556 1174 consensus_queue.cc:260] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.825227 1173 tablet_bootstrap.cc:654] T 3aa05403966349ae9056777d913a0db6 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.826864 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 4df7d75e696a4aec981de3963c282b0d (table default.Table_5ed5970032fe44119b015cb6bbcd91d0 [id=5b9c6b78b2a94e55af6944b71dd51850]) successfully deleted
W20260318 02:51:46.827725 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 0f499c464eb14164a2df3abc2d4a47c7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f499c464eb14164a2df3abc2d4a47c7 already in progress: creating tablet
W20260318 02:51:46.828487 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f8e428b700044eaf9e360f74c751a206 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8e428b700044eaf9e360f74c751a206 already in progress: creating tablet
I20260318 02:51:46.828805 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1346) took 1544 ms. Trace:
I20260318 02:51:46.829068 1184 rpcz_store.cc:276] 0318 02:51:45.284331 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:45.285780 (+ 1449us) service_pool.cc:225] Handling call
0318 02:51:46.828561 (+1542781us) ts_tablet_manager.cc:1151] Deleting tablet f96013c844414fd28c35724a6160ee81
0318 02:51:46.828580 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.828747 (+ 167us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1534789}
W20260318 02:51:46.829850 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 443e6018aed94077a38aa80bafee7264 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 443e6018aed94077a38aa80bafee7264 already in progress: creating tablet
W20260318 02:51:46.830042 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet fca751e8fa5e4098b33093766e80d933 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fca751e8fa5e4098b33093766e80d933 already in progress: creating tablet
W20260318 02:51:46.830176 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet a2b8723a0d354f248ffe4cd2ef5a21dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2b8723a0d354f248ffe4cd2ef5a21dc already in progress: creating tablet
I20260318 02:51:46.829931 1184 tablet_replica.cc:333] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
W20260318 02:51:46.830298 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 3f1a75b4559440c1bf38d4ae0c52d4e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f1a75b4559440c1bf38d4ae0c52d4e5 already in progress: creating tablet
W20260318 02:51:46.830453 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f96013c844414fd28c35724a6160ee81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f96013c844414fd28c35724a6160ee81 already in progress: creating tablet
I20260318 02:51:46.830708 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 46ce65cca47f48db94e70226494cfbae (table default.Table_a1b9dc84de4a42288ee7754f4a110daa [id=a858f67286ca4fe09d8e64e68b31337a]) successfully deleted
I20260318 02:51:46.830735 1184 raft_consensus.cc:2243] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.831135 1184 raft_consensus.cc:2272] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.831449 1174 ts_tablet_manager.cc:1434] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260318 02:51:46.831909 1184 ts_tablet_manager.cc:1916] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.832827 457 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_27fe2cc2b50646fa9d8d97f04f87e86d [id=a7ad61d6d9264ec4ac482798b1ea992e] alter complete (version 5)
I20260318 02:51:46.833652 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0da8901cfbff4305a6b9dd4ead654bcc" } new_table_name: "default.Table_e0cec55991854ab09bb7b0a8d5cef441" modify_external_catalogs: true
I20260318 02:51:46.833901 1173 tablet_bootstrap.cc:492] T 3aa05403966349ae9056777d913a0db6 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:46.834041 1173 ts_tablet_manager.cc:1403] T 3aa05403966349ae9056777d913a0db6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260318 02:51:46.834830 1173 raft_consensus.cc:359] T 3aa05403966349ae9056777d913a0db6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.835011 1173 raft_consensus.cc:385] T 3aa05403966349ae9056777d913a0db6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.835062 1173 raft_consensus.cc:740] T 3aa05403966349ae9056777d913a0db6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.835281 1173 consensus_queue.cc:260] T 3aa05403966349ae9056777d913a0db6 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.835719 1174 tablet_bootstrap.cc:492] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:46.835877 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9d108b010bbd4cc69eed488a5356a87e" } modify_external_catalogs: true
I20260318 02:51:46.836050 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9d108b010bbd4cc69eed488a5356a87e" } modify_external_catalogs: true
I20260318 02:51:46.837540 1174 tablet_bootstrap.cc:654] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.838435 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_986b4af488014b0fbbe01adae41c7475"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:46.839051 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_986b4af488014b0fbbe01adae41c7475 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.838977 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dd894706cc2466a8cd4e4df67856862 with delete_type TABLET_DATA_DELETED (replaced by tablet fc96b13affd442eca3b671a3741b6000) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:46.839097 2152 raft_consensus.cc:515] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.839794 2152 leader_election.cc:290] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:46.843274 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2a586892a24c71a956dbbe382484c9" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:46.848083 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_eea6a27dda544c4288859e25ca97caef" } modify_external_catalogs: true
I20260318 02:51:46.848295 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_eea6a27dda544c4288859e25ca97caef" } modify_external_catalogs: true
W20260318 02:51:46.849820 456 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 69992d861bdd447db2b363b298245c58 consensus state has no leader
I20260318 02:51:46.850370 1173 ts_tablet_manager.cc:1434] T 3aa05403966349ae9056777d913a0db6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260318 02:51:46.852385 1174 tablet_bootstrap.cc:492] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:46.852521 1174 ts_tablet_manager.cc:1403] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20260318 02:51:46.853262 1174 raft_consensus.cc:359] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.853430 1174 raft_consensus.cc:385] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.853477 1174 raft_consensus.cc:740] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.853652 1174 consensus_queue.cc:260] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.854099 1174 ts_tablet_manager.cc:1434] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:46.854555 1173 tablet_bootstrap.cc:492] T bcb731f97a764183aba7408bae969331 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:46.857503 1173 tablet_bootstrap.cc:654] T bcb731f97a764183aba7408bae969331 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.859649 1174 tablet_bootstrap.cc:492] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:46.861721 1174 tablet_bootstrap.cc:654] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:46.864509 997 leader_election.cc:343] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.864754 1173 tablet_bootstrap.cc:492] T bcb731f97a764183aba7408bae969331 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:46.864908 1173 ts_tablet_manager.cc:1403] T bcb731f97a764183aba7408bae969331 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.001s
I20260318 02:51:46.865602 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e2a586892a24c71a956dbbe382484c9" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:46.865679 1173 raft_consensus.cc:359] T bcb731f97a764183aba7408bae969331 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.865826 781 raft_consensus.cc:3060] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:46.865857 1173 raft_consensus.cc:385] T bcb731f97a764183aba7408bae969331 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.865916 1173 raft_consensus.cc:740] T bcb731f97a764183aba7408bae969331 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.866107 1173 consensus_queue.cc:260] T bcb731f97a764183aba7408bae969331 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.871258 1173 ts_tablet_manager.cc:1434] T bcb731f97a764183aba7408bae969331 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260318 02:51:46.872090 1173 tablet_bootstrap.cc:492] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:46.876209 448 master_service.cc:954] ReplaceTablet: received request to replace tablet 13e5d1aeebcf4b9a9eff3dcd85a8772a from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:46.877461 1174 tablet_bootstrap.cc:492] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
W20260318 02:51:46.878319 423 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 65054.5us
I20260318 02:51:46.878978 1174 ts_tablet_manager.cc:1403] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260318 02:51:46.879169 456 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 3aa05403966349ae9056777d913a0db6 (table default.Table_802a2d53f1c14a879d8737dad75f6252 [id=5b2e7b122a394e058dc5b2fd84a0f558]). Expected version 3 got 0
I20260318 02:51:46.880216 1174 raft_consensus.cc:359] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.880869 1173 tablet_bootstrap.cc:654] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.882694 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_77afda1bd8aa46e0b03b1dc203059f1e" } new_table_name: "default.Table_cf2bac4f514644ae8497b6843effcec2" modify_external_catalogs: true
I20260318 02:51:46.884147 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7f97dbe723b3423ba4f059ec5f67a900"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:46.884794 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f97dbe723b3423ba4f059ec5f67a900 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.888906 1174 raft_consensus.cc:385] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.889395 1174 raft_consensus.cc:740] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.889917 1174 consensus_queue.cc:260] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.891324 749 tablet_service.cc:1558] Processing DeleteTablet for tablet b10fd13bf3ea48b0896b34fce478e25a with delete_type TABLET_DATA_DELETED (replaced by tablet 053efeef673f4535993b29d102884408) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:46.891505 750 tablet_service.cc:1558] Processing DeleteTablet for tablet e418df45882c435a8276e46a8abf6bdd with delete_type TABLET_DATA_DELETED (replaced by tablet b510f3c213104798971cf84c95e357d7) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:46.891593 2704 tablet_replica.cc:333] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:46.891721 748 tablet_service.cc:1558] Processing DeleteTablet for tablet 6deb99f7937144f39409929f99b135c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:46.891768 2704 raft_consensus.cc:2243] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.891922 2704 raft_consensus.cc:2272] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.892514 2704 ts_tablet_manager.cc:1916] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.892488 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3747269973ec485caeed2bb52bde1307" } new_table_name: "default.Table_4d5e18ca2f9b4e6bbf9144bd39ad38a3" modify_external_catalogs: true
I20260318 02:51:46.892844 1174 ts_tablet_manager.cc:1434] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260318 02:51:46.893487 1174 tablet_bootstrap.cc:492] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:46.868640 781 raft_consensus.cc:2468] T 6e2a586892a24c71a956dbbe382484c9 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:46.896901 999 leader_election.cc:304] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.897229 1174 tablet_bootstrap.cc:654] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.897243 2152 raft_consensus.cc:2804] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:46.897382 2152 raft_consensus.cc:697] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:46.897651 2152 consensus_queue.cc:237] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.898484 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 60dedba077d34435b30061bfba737412 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:46.898717 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 49afed40c7aa4f2d913daed8055a098e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:46.899245 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 64c2a579264e43b9a1e25ded000d4d9f with delete_type TABLET_DATA_DELETED (replaced by tablet 5ce282f91c2f44b59c0b6ea836ad5d0e) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:46.899531 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 783c886a99994d6c8d9add724277819a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:46.900267 2704 ts_tablet_manager.cc:1929] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.901242 2704 log.cc:1199] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/b10fd13bf3ea48b0896b34fce478e25a
I20260318 02:51:46.901713 2704 ts_tablet_manager.cc:1950] T b10fd13bf3ea48b0896b34fce478e25a P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:46.902868 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet b10fd13bf3ea48b0896b34fce478e25a (table default.Table_3c703c59a09d493d8c132dd9a026135f [id=a06743180c9e418590b66e4476eba4d5]) successfully deleted
I20260318 02:51:46.903275 2704 tablet_replica.cc:333] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:46.903512 2704 raft_consensus.cc:2243] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.903712 2704 raft_consensus.cc:2272] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.904277 2704 ts_tablet_manager.cc:1916] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:46.906524 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0d2c9a52052140ae884cbdce0889da0a consensus state has no leader
I20260318 02:51:46.907035 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_69553ca89bbd4df08e60a4ba2ea6840c" } new_table_name: "default.Table_b11d9e2237894ee182579c007c13d475" modify_external_catalogs: true
I20260318 02:51:46.915201 926 raft_consensus.cc:3060] T 6d938a2eefe4471cb94a9544647f8e3e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:46.917932 1184 ts_tablet_manager.cc:1929] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.918085 1184 log.cc:1199] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/82858fd64d534d1abcad12bc4a93cda7
I20260318 02:51:46.918129 1172 tablet_bootstrap.cc:492] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:46.918370 1172 ts_tablet_manager.cc:1403] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.181s user 0.011s sys 0.020s
W20260318 02:51:46.918725 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d8205812fef14c7b832d30624911c2aa consensus state has no leader
I20260318 02:51:46.919165 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1568e115138b4d858570bc80c7f2b7ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:46.918391 1184 ts_tablet_manager.cc:1950] T 82858fd64d534d1abcad12bc4a93cda7 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:46.921092 1172 raft_consensus.cc:359] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.921283 1172 raft_consensus.cc:385] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.921357 1172 raft_consensus.cc:740] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.921581 1172 consensus_queue.cc:260] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.922096 1184 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38664 (request call id 1349) took 1217 ms. Trace:
I20260318 02:51:46.922253 1184 rpcz_store.cc:276] 0318 02:51:45.704206 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:45.712825 (+ 8619us) service_pool.cc:225] Handling call
0318 02:51:46.829846 (+1117021us) ts_tablet_manager.cc:1151] Deleting tablet 82858fd64d534d1abcad12bc4a93cda7
0318 02:51:46.829858 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:46.851987 (+ 22129us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.917769 (+ 65782us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:46.922044 (+ 4275us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1116807}
W20260318 02:51:46.923578 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7c4b6f64c20e4e2e86a1e2f4ff628319 consensus state has no leader
I20260318 02:51:46.923957 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8a26eebc10854c6a84b60130cb3e5841" } modify_external_catalogs: true
I20260318 02:51:46.924109 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8a26eebc10854c6a84b60130cb3e5841" } modify_external_catalogs: true
I20260318 02:51:46.925413 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3890c095727844ee94916b9b8d38781a" } modify_external_catalogs: true
I20260318 02:51:46.925573 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3890c095727844ee94916b9b8d38781a" } modify_external_catalogs: true
I20260318 02:51:46.922107 1172 ts_tablet_manager.cc:1434] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260318 02:51:46.926149 1172 tablet_bootstrap.cc:492] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:46.926419 2665 raft_consensus.cc:493] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:46.927150 2665 raft_consensus.cc:515] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.927731 2665 leader_election.cc:290] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:46.928491 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f527a0ba0914924bc7f604ae8a48393" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:46.929154 997 leader_election.cc:343] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:46.930687 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8290ddf883774684b025ecb0a89e7e3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:46.932219 999 leader_election.cc:343] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 6f527a0ba0914924bc7f604ae8a48393
I20260318 02:51:46.932379 999 leader_election.cc:304] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:46.932662 2665 raft_consensus.cc:2749] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:46.934998 1172 tablet_bootstrap.cc:654] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.939337 2704 ts_tablet_manager.cc:1929] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.943995 1175 ts_tablet_manager.cc:1929] T cf73a9f8f67b42d9baf1396d70a1a3a9 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.944819 2704 log.cc:1199] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/e418df45882c435a8276e46a8abf6bdd
I20260318 02:51:46.945266 2704 ts_tablet_manager.cc:1950] T e418df45882c435a8276e46a8abf6bdd P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:46.945034 1175 log.cc:1199] T cf73a9f8f67b42d9baf1396d70a1a3a9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/cf73a9f8f67b42d9baf1396d70a1a3a9
I20260318 02:51:46.947861 2740 tablet.cc:1723] T 6d938a2eefe4471cb94a9544647f8e3e P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:46.949034 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet e418df45882c435a8276e46a8abf6bdd (table default.Table_b87c8d210af448238e2ed324e0fa82b3 [id=3b169945a7bc477bb1a48b662948f322]) successfully deleted
I20260318 02:51:46.952090 1184 tablet_replica.cc:333] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:46.952440 1184 raft_consensus.cc:2243] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.952729 1184 raft_consensus.cc:2272] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.952883 1173 tablet_bootstrap.cc:492] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:46.952945 2704 tablet_replica.cc:333] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:46.953169 2704 raft_consensus.cc:2243] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.953326 2704 raft_consensus.cc:2272] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.953361 1184 ts_tablet_manager.cc:1916] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.953866 2704 ts_tablet_manager.cc:1916] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.953806 456 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 6d938a2eefe4471cb94a9544647f8e3e (table default.Table_c0956e46e13c47bc95482c534f632c04 [id=d0c05683decb4a5bbf2e3eab386a1116]). Expected version 1 got 0
I20260318 02:51:46.954142 1173 ts_tablet_manager.cc:1403] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.082s user 0.002s sys 0.017s
I20260318 02:51:46.953862 1172 tablet_bootstrap.cc:492] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:46.954422 1172 ts_tablet_manager.cc:1403] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.005s
I20260318 02:51:46.955526 1175 ts_tablet_manager.cc:1950] T cf73a9f8f67b42d9baf1396d70a1a3a9 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:46.957203 1172 raft_consensus.cc:359] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.957520 1173 raft_consensus.cc:359] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.957917 1173 raft_consensus.cc:385] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.958022 1173 raft_consensus.cc:740] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.958159 1172 raft_consensus.cc:385] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.958387 1172 raft_consensus.cc:740] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.958392 1175 tablet_replica.cc:333] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:46.958650 1173 consensus_queue.cc:260] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.959040 1172 consensus_queue.cc:260] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.959625 1173 ts_tablet_manager.cc:1434] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260318 02:51:46.960865 1173 tablet_bootstrap.cc:492] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:46.961627 1175 raft_consensus.cc:2243] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:46.961993 1175 raft_consensus.cc:2272] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:46.963250 1175 ts_tablet_manager.cc:1916] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:46.964658 1173 tablet_bootstrap.cc:654] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.969746 1174 tablet_bootstrap.cc:492] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:46.970013 1174 ts_tablet_manager.cc:1403] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.077s user 0.015s sys 0.001s
I20260318 02:51:46.970849 1174 raft_consensus.cc:359] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.971107 1174 raft_consensus.cc:385] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.971206 1174 raft_consensus.cc:740] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.971453 1174 consensus_queue.cc:260] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.922963 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 82858fd64d534d1abcad12bc4a93cda7 (table default.Table_e81f3622048c415e977ce897e4edcacf [id=74f992023abb491eb564bdfd68b19b98]) successfully deleted
W20260318 02:51:46.972231 441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.104.131:37025, user_credentials={real_user=slave}} blocked reactor thread for 49281us
I20260318 02:51:46.972319 1174 ts_tablet_manager.cc:1434] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260318 02:51:46.972784 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8290ddf883774684b025ecb0a89e7e3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.973382 1174 tablet_bootstrap.cc:492] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:46.975265 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1568e115138b4d858570bc80c7f2b7ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:46.976418 1174 tablet_bootstrap.cc:654] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:46.977226 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet cf73a9f8f67b42d9baf1396d70a1a3a9 (table default.Table_c0889091422144f8af318ab6f38afd05 [id=75621b04db1d4c67bd2d2f5fe76c8a25]) successfully deleted
W20260318 02:51:46.977679 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2a90be200678468eaa8c57b843521440 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a90be200678468eaa8c57b843521440 already in progress: creating tablet
W20260318 02:51:46.977871 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 1fa6e24943d54a3ea40fd34980ba2b27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fa6e24943d54a3ea40fd34980ba2b27 already in progress: creating tablet
W20260318 02:51:46.978040 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 66f2eb49809945b3ae9d083a4fe56245 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66f2eb49809945b3ae9d083a4fe56245 already in progress: creating tablet
W20260318 02:51:46.978191 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet b3a12a4854914f9892e614697fe3a7b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3a12a4854914f9892e614697fe3a7b4 already in progress: creating tablet
I20260318 02:51:46.978243 1173 tablet_bootstrap.cc:492] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
W20260318 02:51:46.978341 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 59ce7583e7f545f18145b4e55e1fbb81 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 59ce7583e7f545f18145b4e55e1fbb81 already in progress: creating tablet
I20260318 02:51:46.978379 1173 ts_tablet_manager.cc:1403] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
W20260318 02:51:46.978484 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet e566cc653bd341feaadea09394b4ef94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e566cc653bd341feaadea09394b4ef94 already in progress: creating tablet
W20260318 02:51:46.978646 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 6e72f04c08fe44fdabce1c5b102ca61a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6e72f04c08fe44fdabce1c5b102ca61a already in progress: creating tablet
W20260318 02:51:46.978813 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 7110ce4a03724c16b32d3ba1a128aa5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7110ce4a03724c16b32d3ba1a128aa5b already in progress: creating tablet
W20260318 02:51:46.979024 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet c2453557439844a19cc7b4c8a0696b1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2453557439844a19cc7b4c8a0696b1e already in progress: creating tablet
W20260318 02:51:46.979157 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 6f15a63d18f14061b8e5ec8f6306f79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f15a63d18f14061b8e5ec8f6306f79b already in progress: creating tablet
I20260318 02:51:46.979207 1173 raft_consensus.cc:359] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.979372 1173 raft_consensus.cc:385] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.979418 1173 raft_consensus.cc:740] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.979645 1173 consensus_queue.cc:260] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.980365 1173 ts_tablet_manager.cc:1434] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:46.980669 1173 tablet_bootstrap.cc:492] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:46.982035 1173 tablet_bootstrap.cc:654] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:46.982874 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7b388b964c5f402ea4485d266563d07a consensus state has no leader
I20260318 02:51:46.989485 1184 ts_tablet_manager.cc:1929] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.992422 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4822eac87bd94e139cf4b94ab7edede3" } modify_external_catalogs: true
I20260318 02:51:46.992630 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4822eac87bd94e139cf4b94ab7edede3" } modify_external_catalogs: true
I20260318 02:51:46.993463 1173 tablet_bootstrap.cc:492] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:46.993598 1173 ts_tablet_manager.cc:1403] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260318 02:51:46.994230 1173 raft_consensus.cc:359] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.994381 1173 raft_consensus.cc:385] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:46.994421 1173 raft_consensus.cc:740] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:46.996148 1173 consensus_queue.cc:260] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:46.996626 2704 ts_tablet_manager.cc:1929] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:46.996766 2704 log.cc:1199] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/6deb99f7937144f39409929f99b135c5
I20260318 02:51:46.997059 2704 ts_tablet_manager.cc:1950] T 6deb99f7937144f39409929f99b135c5 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:46.997139 1173 ts_tablet_manager.cc:1434] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:46.997421 1173 tablet_bootstrap.cc:492] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:46.998759 456 master_service.cc:954] ReplaceTablet: received request to replace tablet 60a4e38c14f84e6ba9d0402b62f7432c from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:46.999142 1173 tablet_bootstrap.cc:654] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.000408 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 184ce58aa96d4e70ad7b2783f19ccdeb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:47.000696 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ebcf120100349319d27615b6e0c7550 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:47.002627 2660 raft_consensus.cc:493] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.002782 2660 raft_consensus.cc:515] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.003410 2660 leader_election.cc:290] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:47.004657 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b37df330984378b81b367446d34748" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:47.005404 719 leader_election.cc:343] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.010064 1173 tablet_bootstrap.cc:492] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:47.013895 1173 ts_tablet_manager.cc:1403] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.002s
I20260318 02:51:47.014968 1173 raft_consensus.cc:359] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.015725 2660 raft_consensus.cc:493] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.015866 2660 raft_consensus.cc:515] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.016435 2660 leader_election.cc:290] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:47.015353 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 85e6ad2a9817444caecb78eabde5d222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:47.017164 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4052eede3f404b84ac27e21a204bf5a9" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:47.018370 719 leader_election.cc:343] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.018599 1173 raft_consensus.cc:385] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.018785 1173 raft_consensus.cc:740] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.019198 1173 consensus_queue.cc:260] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.020162 1173 ts_tablet_manager.cc:1434] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260318 02:51:47.021039 1173 tablet_bootstrap.cc:492] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:47.022926 1173 tablet_bootstrap.cc:654] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.025719 897 tablet_service.cc:1558] Processing DeleteTablet for tablet 59c6741a6d154d8f99d487c6590d2d26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:47.037585 781 raft_consensus.cc:1275] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Refusing update from remote peer 9422bb7011f342b08be0b073a88c4c4d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260318 02:51:47.004503 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b37df330984378b81b367446d34748" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:47.040844 1184 log.cc:1199] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/a384923c86ee42d6a47ed3f68e6811df
I20260318 02:51:47.041191 1184 ts_tablet_manager.cc:1950] T a384923c86ee42d6a47ed3f68e6811df P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:47.025481 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4052eede3f404b84ac27e21a204bf5a9" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:47.026854 1172 ts_tablet_manager.cc:1434] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.072s user 0.019s sys 0.001s
W20260318 02:51:47.041404 719 leader_election.cc:343] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.034689 2152 raft_consensus.cc:493] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.041536 719 leader_election.cc:304] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:47.041600 2152 raft_consensus.cc:515] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.042258 2152 leader_election.cc:290] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:47.038300 997 consensus_peers.cc:597] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:47.042732 2660 raft_consensus.cc:2749] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:47.042773 997 consensus_peers.cc:597] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:47.043110 1172 tablet_bootstrap.cc:492] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:47.043118 719 leader_election.cc:343] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.043221 719 leader_election.cc:304] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:47.043558 2660 raft_consensus.cc:2749] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:47.044445 999 leader_election.cc:343] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 5dd894706cc2466a8cd4e4df67856862
I20260318 02:51:47.044838 1172 tablet_bootstrap.cc:654] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.045717 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 6deb99f7937144f39409929f99b135c5 (table default.Table_039d1d42521f4f9f8be161d0b97004f7 [id=19ba004fc5d143ffae445b129ce28b05]) successfully deleted
I20260318 02:51:47.046701 451 catalog_manager.cc:5671] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:47.047070 451 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet bac04b3e4ad448b09a1a25a754b44aad (table default.Table_c0a9aae588ef49148c04338c906dab4a [id=1532d6dc2cc641998f9c120075fa04b4]). Expected version 1 got 0
I20260318 02:51:47.047326 451 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 895aa252b9f243d89e972d1b717ee910 (table default.Table_2afe66e6b2374e3c9b8e4692abb54d07 [id=6f9eb9fbda9846d495f3e70e229a5590]). Expected version 1 got 0
I20260318 02:51:47.047595 451 catalog_manager.cc:5671] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:47.047926 451 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet c58290c2d1c742d3b45dfb5caf52c75b (table default.Table_944521fea0294e3381643693804fd723 [id=18d79b10f75b43efa4946ca8979a4235]). Expected version 1 got 0
I20260318 02:51:47.038501 2614 consensus_queue.cc:1048] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:47.061250 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dd894706cc2466a8cd4e4df67856862" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:47.060700 1172 tablet_bootstrap.cc:492] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:47.061692 1172 ts_tablet_manager.cc:1403] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.004s
W20260318 02:51:47.062130 997 leader_election.cc:343] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.062310 997 leader_election.cc:304] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:47.062629 748 tablet_service.cc:1511] Processing CreateTablet for tablet eb28550a612d4ac59d088e716e58a759 (DEFAULT_TABLE table=default.Table_a434e4d757524b6ab3f091ed992952d2 [id=b5bd9b851abe47f9867b110c4e6ee114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.062836 2152 raft_consensus.cc:2749] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:47.063058 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb28550a612d4ac59d088e716e58a759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.060760 1184 tablet_replica.cc:333] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:47.063406 1184 raft_consensus.cc:2243] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:47.063542 1184 raft_consensus.cc:2272] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:47.064083 1184 ts_tablet_manager.cc:1916] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:47.065802 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d4e06073c326433daaa437bbe54e3f55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:47.065855 1172 raft_consensus.cc:359] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.066040 1172 raft_consensus.cc:385] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.066090 1172 raft_consensus.cc:740] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
W20260318 02:51:47.066395 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4e06073c326433daaa437bbe54e3f55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:47.067893 1172 consensus_queue.cc:260] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.068033 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet a384923c86ee42d6a47ed3f68e6811df (table default.Table_594a288e26f245c8a9c365f583bced74 [id=a653573522fe43da9c796fc1c7c638f9]) successfully deleted
I20260318 02:51:47.069301 1041 tablet_service.cc:1511] Processing CreateTablet for tablet eb28550a612d4ac59d088e716e58a759 (DEFAULT_TABLE table=default.Table_a434e4d757524b6ab3f091ed992952d2 [id=b5bd9b851abe47f9867b110c4e6ee114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.069732 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb28550a612d4ac59d088e716e58a759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.069952 1172 ts_tablet_manager.cc:1434] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260318 02:51:47.070251 1172 tablet_bootstrap.cc:492] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:47.073058 750 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd800a4b7b04bc2ad3be537ee2561c4 (DEFAULT_TABLE table=default.Table_e1807b04c33a458593ceefbe21323b39 [id=f2a6109e4a4f4cde981c8956cb801380]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.073495 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd800a4b7b04bc2ad3be537ee2561c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.075981 1172 tablet_bootstrap.cc:654] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.077425 893 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd800a4b7b04bc2ad3be537ee2561c4 (DEFAULT_TABLE table=default.Table_e1807b04c33a458593ceefbe21323b39 [id=f2a6109e4a4f4cde981c8956cb801380]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.077828 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd800a4b7b04bc2ad3be537ee2561c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.081023 890 tablet_service.cc:1511] Processing CreateTablet for tablet b0383f41c94040b2b6d2a957120742e1 (DEFAULT_TABLE table=default.Table_0fdddc22ae614ebbbcbf68377f43fbdf [id=186bd4a727734423b4dd98ada3b6b277]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.081399 890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0383f41c94040b2b6d2a957120742e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.082814 1173 tablet_bootstrap.cc:492] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:47.082939 1173 ts_tablet_manager.cc:1403] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.062s user 0.010s sys 0.006s
I20260318 02:51:47.083559 1173 raft_consensus.cc:359] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.083719 1173 raft_consensus.cc:385] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.083765 1173 raft_consensus.cc:740] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.084348 2152 raft_consensus.cc:493] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.084472 2152 raft_consensus.cc:515] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.085072 2152 leader_election.cc:290] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:47.085448 897 tablet_service.cc:1511] Processing CreateTablet for tablet eb28550a612d4ac59d088e716e58a759 (DEFAULT_TABLE table=default.Table_a434e4d757524b6ab3f091ed992952d2 [id=b5bd9b851abe47f9867b110c4e6ee114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.085856 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb28550a612d4ac59d088e716e58a759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.088732 1173 consensus_queue.cc:260] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:47.089498 999 leader_election.cc:343] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2dab268da5e843cab5c28a521217df97
I20260318 02:51:47.090468 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 7dd800a4b7b04bc2ad3be537ee2561c4 (DEFAULT_TABLE table=default.Table_e1807b04c33a458593ceefbe21323b39 [id=f2a6109e4a4f4cde981c8956cb801380]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.090507 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dab268da5e843cab5c28a521217df97" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:47.090910 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd800a4b7b04bc2ad3be537ee2561c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.090991 1173 ts_tablet_manager.cc:1434] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
W20260318 02:51:47.091591 997 leader_election.cc:343] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.091699 997 leader_election.cc:304] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:47.091856 1173 tablet_bootstrap.cc:492] T 169f97b2320e4a5baae1dec29a1c7c36 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:47.092151 2152 raft_consensus.cc:2749] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:47.101542 2628 mvcc.cc:204] Tried to move back new op lower bound from 7265494249619087360 to 7265494246478475264. Current Snapshot: MvccSnapshot[applied={T|T < 7265494249619087360}]
I20260318 02:51:47.107059 748 tablet_service.cc:1511] Processing CreateTablet for tablet b0383f41c94040b2b6d2a957120742e1 (DEFAULT_TABLE table=default.Table_0fdddc22ae614ebbbcbf68377f43fbdf [id=186bd4a727734423b4dd98ada3b6b277]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.107604 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0383f41c94040b2b6d2a957120742e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.113070 749 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbae97083a24ce683a411b058b0d4f6 (DEFAULT_TABLE table=default.Table_c38f8ee4055b4cc7b6af7251832e4105 [id=ff324d07e4104bbcbca3e0336a45dd6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.113497 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbae97083a24ce683a411b058b0d4f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.115880 1184 ts_tablet_manager.cc:1929] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:47.115996 1184 log.cc:1199] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/2f80f29dfd814acd8b7e143a72231dfd
I20260318 02:51:47.116261 1184 ts_tablet_manager.cc:1950] T 2f80f29dfd814acd8b7e143a72231dfd P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:47.116463 2665 consensus_queue.cc:1048] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:47.118638 756 tablet_service.cc:1511] Processing CreateTablet for tablet 6a84ce97426641ce9817381061eb46d1 (DEFAULT_TABLE table=default.Table_7b016317a2984ce7bb11ca474a735aba [id=bb2266fe5bd64417af3c2e92230224a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.119088 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a84ce97426641ce9817381061eb46d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.124918 766 tablet_service.cc:1511] Processing CreateTablet for tablet c68a1cfcd9e043a6b9e9cbcf3c8d0c63 (DEFAULT_TABLE table=default.Table_1073a99862de49db9d6523e2ab3c6b51 [id=38614342ec9845ceab6688383104c326]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.125330 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68a1cfcd9e043a6b9e9cbcf3c8d0c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.130424 748 tablet_service.cc:1511] Processing CreateTablet for tablet 4c61959a36be44d38c57f95c9bcc860e (DEFAULT_TABLE table=default.Table_d717ffddc62d4afaad80d7420e46be69 [id=082f59eac407447582cfc8ee5ec329a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.131415 756 tablet_service.cc:1511] Processing CreateTablet for tablet 9a8c924687e347c38bc16219429eea80 (DEFAULT_TABLE table=default.Table_39f3697e6d8047fa8af7d8312c902c41 [id=344a2f73d56040ebbc540b6e3c71eebf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.133554 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a8c924687e347c38bc16219429eea80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.132690 761 tablet_service.cc:1511] Processing CreateTablet for tablet 3e245a70fb214b78a1fae9b31f4e8a9d (DEFAULT_TABLE table=default.Table_6ae4413312c2415c91b672165cd440c2 [id=c8603bd8123240189b1a0ff257141f84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.133144 749 tablet_service.cc:1511] Processing CreateTablet for tablet ccf8437631764f3289d4e275e5407c5e (DEFAULT_TABLE table=default.Table_56040d9c52e348588edf25ce8dd51855 [id=3623ccc59c804922aa1b6717adabc420]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.131839 766 tablet_service.cc:1511] Processing CreateTablet for tablet 56ef9cbc718d4a849cbca020866f9440 (DEFAULT_TABLE table=default.Table_5e458201b5e746e1ab3e18cfc8d6734a [id=cdbb3c8fed724d5eba690b0ee8f4dc27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.134411 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf8437631764f3289d4e275e5407c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.134538 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 36c3a417e8c04108b22d28674e570b9b
I20260318 02:51:47.134650 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56ef9cbc718d4a849cbca020866f9440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.134862 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e245a70fb214b78a1fae9b31f4e8a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.135216 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f388a339b3c044c7a02d829be6a973f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:47.135370 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 36c3a417e8c04108b22d28674e570b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:47.135828 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f388a339b3c044c7a02d829be6a973f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:47.136472 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 36c3a417e8c04108b22d28674e570b9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36c3a417e8c04108b22d28674e570b9b already in progress: creating tablet
I20260318 02:51:47.136830 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c61959a36be44d38c57f95c9bcc860e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.136932 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 28f06d6037fa426296ee68adbb6f689a
I20260318 02:51:47.137565 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7e04ba863ea34e95854d94b4a8b7caaf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:47.138092 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e04ba863ea34e95854d94b4a8b7caaf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:47.139835 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 28f06d6037fa426296ee68adbb6f689a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:47.140576 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 28f06d6037fa426296ee68adbb6f689a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28f06d6037fa426296ee68adbb6f689a already in progress: creating tablet
I20260318 02:51:47.141821 905 tablet_service.cc:1511] Processing CreateTablet for tablet 4a843e9ca4ae4d4a957d4c57c06ef607 (DEFAULT_TABLE table=default.Table_629d59d49c864d1f9170c6ac4526c27e [id=2d1854c3867c4f1589d37998a8d65f3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.142220 905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a843e9ca4ae4d4a957d4c57c06ef607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.143689 1173 tablet_bootstrap.cc:654] T 169f97b2320e4a5baae1dec29a1c7c36 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.145537 892 tablet_service.cc:1511] Processing CreateTablet for tablet c68a1cfcd9e043a6b9e9cbcf3c8d0c63 (DEFAULT_TABLE table=default.Table_1073a99862de49db9d6523e2ab3c6b51 [id=38614342ec9845ceab6688383104c326]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.145915 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68a1cfcd9e043a6b9e9cbcf3c8d0c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.146884 903 tablet_service.cc:1511] Processing CreateTablet for tablet 6a84ce97426641ce9817381061eb46d1 (DEFAULT_TABLE table=default.Table_7b016317a2984ce7bb11ca474a735aba [id=bb2266fe5bd64417af3c2e92230224a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.147222 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a84ce97426641ce9817381061eb46d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.149382 900 tablet_service.cc:1511] Processing CreateTablet for tablet 4c61959a36be44d38c57f95c9bcc860e (DEFAULT_TABLE table=default.Table_d717ffddc62d4afaad80d7420e46be69 [id=082f59eac407447582cfc8ee5ec329a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.149492 902 tablet_service.cc:1511] Processing CreateTablet for tablet 56ef9cbc718d4a849cbca020866f9440 (DEFAULT_TABLE table=default.Table_5e458201b5e746e1ab3e18cfc8d6734a [id=cdbb3c8fed724d5eba690b0ee8f4dc27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.149745 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c61959a36be44d38c57f95c9bcc860e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.149885 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56ef9cbc718d4a849cbca020866f9440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.151322 2789 tablet.cc:1723] T fe82e581368c4d8a894f0283c1a710fe P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:47.128931 2788 tablet.cc:1723] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:47.152837 896 tablet_service.cc:1511] Processing CreateTablet for tablet 9a8c924687e347c38bc16219429eea80 (DEFAULT_TABLE table=default.Table_39f3697e6d8047fa8af7d8312c902c41 [id=344a2f73d56040ebbc540b6e3c71eebf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.153185 901 tablet_service.cc:1511] Processing CreateTablet for tablet d77381b5591b449a89328f0819e242a7 (DEFAULT_TABLE table=default.Table_61a1261da65d47c4802ca3a883412e41 [id=33bcf5e90b9541f5a08702f0e413fb0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.153420 906 tablet_service.cc:1511] Processing CreateTablet for tablet ccf8437631764f3289d4e275e5407c5e (DEFAULT_TABLE table=default.Table_56040d9c52e348588edf25ce8dd51855 [id=3623ccc59c804922aa1b6717adabc420]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.153183 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a8c924687e347c38bc16219429eea80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.156829 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf8437631764f3289d4e275e5407c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.157531 1172 tablet_bootstrap.cc:492] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:47.157756 1172 ts_tablet_manager.cc:1403] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.088s user 0.008s sys 0.011s
I20260318 02:51:47.158624 1172 raft_consensus.cc:359] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.159148 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77381b5591b449a89328f0819e242a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.159271 1172 raft_consensus.cc:385] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.161024 1172 raft_consensus.cc:740] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.161360 1172 consensus_queue.cc:260] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.162016 1172 ts_tablet_manager.cc:1434] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260318 02:51:47.162349 1172 tablet_bootstrap.cc:492] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:47.164615 1172 tablet_bootstrap.cc:654] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.165465 1173 tablet_bootstrap.cc:492] T 169f97b2320e4a5baae1dec29a1c7c36 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:47.165606 1173 ts_tablet_manager.cc:1403] T 169f97b2320e4a5baae1dec29a1c7c36 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.074s user 0.003s sys 0.001s
I20260318 02:51:47.166661 1184 tablet_replica.cc:333] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:47.166877 1184 raft_consensus.cc:2243] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:47.167023 1184 raft_consensus.cc:2272] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:47.167250 1173 raft_consensus.cc:359] T 169f97b2320e4a5baae1dec29a1c7c36 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.167439 1173 raft_consensus.cc:385] T 169f97b2320e4a5baae1dec29a1c7c36 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.167493 1173 raft_consensus.cc:740] T 169f97b2320e4a5baae1dec29a1c7c36 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.167534 1184 ts_tablet_manager.cc:1916] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:47.168016 1173 consensus_queue.cc:260] T 169f97b2320e4a5baae1dec29a1c7c36 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.170818 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbae97083a24ce683a411b058b0d4f6 (DEFAULT_TABLE table=default.Table_c38f8ee4055b4cc7b6af7251832e4105 [id=ff324d07e4104bbcbca3e0336a45dd6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.171262 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbae97083a24ce683a411b058b0d4f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.173205 1035 tablet_service.cc:1511] Processing CreateTablet for tablet b0383f41c94040b2b6d2a957120742e1 (DEFAULT_TABLE table=default.Table_0fdddc22ae614ebbbcbf68377f43fbdf [id=186bd4a727734423b4dd98ada3b6b277]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.173624 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0383f41c94040b2b6d2a957120742e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.173934 1173 ts_tablet_manager.cc:1434] T 169f97b2320e4a5baae1dec29a1c7c36 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260318 02:51:47.174459 1173 tablet_bootstrap.cc:492] T d7f21df58fac437da5747becfa3f28b4 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:47.180127 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 6a84ce97426641ce9817381061eb46d1 (DEFAULT_TABLE table=default.Table_7b016317a2984ce7bb11ca474a735aba [id=bb2266fe5bd64417af3c2e92230224a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.180549 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a84ce97426641ce9817381061eb46d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.176098 1173 tablet_bootstrap.cc:654] T d7f21df58fac437da5747becfa3f28b4 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.186736 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 9a8c924687e347c38bc16219429eea80 (DEFAULT_TABLE table=default.Table_39f3697e6d8047fa8af7d8312c902c41 [id=344a2f73d56040ebbc540b6e3c71eebf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.187145 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a8c924687e347c38bc16219429eea80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.187907 1173 tablet_bootstrap.cc:492] T d7f21df58fac437da5747becfa3f28b4 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:47.188040 1173 ts_tablet_manager.cc:1403] T d7f21df58fac437da5747becfa3f28b4 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.002s
I20260318 02:51:47.188781 1173 raft_consensus.cc:359] T d7f21df58fac437da5747becfa3f28b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.188956 1173 raft_consensus.cc:385] T d7f21df58fac437da5747becfa3f28b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.189013 1173 raft_consensus.cc:740] T d7f21df58fac437da5747becfa3f28b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.189042 1035 tablet_service.cc:1511] Processing CreateTablet for tablet c68a1cfcd9e043a6b9e9cbcf3c8d0c63 (DEFAULT_TABLE table=default.Table_1073a99862de49db9d6523e2ab3c6b51 [id=38614342ec9845ceab6688383104c326]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.189249 1173 consensus_queue.cc:260] T d7f21df58fac437da5747becfa3f28b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.189441 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 4c61959a36be44d38c57f95c9bcc860e (DEFAULT_TABLE table=default.Table_d717ffddc62d4afaad80d7420e46be69 [id=082f59eac407447582cfc8ee5ec329a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.189595 1036 tablet_service.cc:1511] Processing CreateTablet for tablet ccf8437631764f3289d4e275e5407c5e (DEFAULT_TABLE table=default.Table_56040d9c52e348588edf25ce8dd51855 [id=3623ccc59c804922aa1b6717adabc420]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.190104 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf8437631764f3289d4e275e5407c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.190258 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c61959a36be44d38c57f95c9bcc860e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.195066 1173 ts_tablet_manager.cc:1434] T d7f21df58fac437da5747becfa3f28b4 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260318 02:51:47.196990 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68a1cfcd9e043a6b9e9cbcf3c8d0c63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.197563 2715 raft_consensus.cc:493] T bcb731f97a764183aba7408bae969331 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.197706 2715 raft_consensus.cc:515] T bcb731f97a764183aba7408bae969331 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.198282 2715 leader_election.cc:290] T bcb731f97a764183aba7408bae969331 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:47.198985 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb731f97a764183aba7408bae969331" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:47.201344 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb731f97a764183aba7408bae969331" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:47.201674 1173 tablet_bootstrap.cc:492] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:47.201980 862 leader_election.cc:304] T bcb731f97a764183aba7408bae969331 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:47.202430 2715 raft_consensus.cc:2749] T bcb731f97a764183aba7408bae969331 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:47.204602 1173 tablet_bootstrap.cc:654] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.209642 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_183266f4fcdc4cf6a58bb6bc48fb33d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:47.210484 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_183266f4fcdc4cf6a58bb6bc48fb33d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:47.216681 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_29abedfba984406c939677f4ea6dd227" } new_table_name: "default.Table_26dffb94c5c84a55b8cd19e3a64b6d36" modify_external_catalogs: true
I20260318 02:51:47.222966 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 56ef9cbc718d4a849cbca020866f9440 (DEFAULT_TABLE table=default.Table_5e458201b5e746e1ab3e18cfc8d6734a [id=cdbb3c8fed724d5eba690b0ee8f4dc27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.223431 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56ef9cbc718d4a849cbca020866f9440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.226015 2152 raft_consensus.cc:493] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.226162 2152 raft_consensus.cc:515] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.226781 2152 leader_election.cc:290] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:47.227867 2715 raft_consensus.cc:493] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.228039 2715 raft_consensus.cc:515] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.228762 2715 leader_election.cc:290] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:47.229534 860 leader_election.cc:343] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 184ce58aa96d4e70ad7b2783f19ccdeb
W20260318 02:51:47.234015 862 leader_election.cc:343] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 184ce58aa96d4e70ad7b2783f19ccdeb
I20260318 02:51:47.234195 862 leader_election.cc:304] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:47.234853 2715 raft_consensus.cc:2749] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:47.235597 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453a1c6f16194cab91c0223e2eeda7ab" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:47.235836 781 raft_consensus.cc:2468] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:47.236443 999 leader_election.cc:304] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:47.236733 2152 raft_consensus.cc:2804] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:47.236905 2152 raft_consensus.cc:493] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:47.237026 2152 raft_consensus.cc:3060] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:47.237684 2665 raft_consensus.cc:493] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.237835 2665 raft_consensus.cc:515] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.238488 2665 leader_election.cc:290] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:47.238605 2665 raft_consensus.cc:493] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.238699 2665 raft_consensus.cc:515] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.239167 2665 leader_election.cc:290] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:47.239712 2152 raft_consensus.cc:515] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.240280 2152 leader_election.cc:290] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:47.245347 780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453a1c6f16194cab91c0223e2eeda7ab" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:47.245579 780 raft_consensus.cc:3060] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:47.248020 2660 raft_consensus.cc:493] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.248186 2660 raft_consensus.cc:515] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.248553 780 raft_consensus.cc:2468] T 453a1c6f16194cab91c0223e2eeda7ab P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:47.248798 2660 leader_election.cc:290] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:47.249317 999 leader_election.cc:343] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 33d90a619ae54227aaf95acd180af119
I20260318 02:51:47.249627 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb29fd9d6fc845b2aaffe34c290fd5ca" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:47.249939 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb29fd9d6fc845b2aaffe34c290fd5ca" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:47.250337 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453a1c6f16194cab91c0223e2eeda7ab" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:47.250834 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b956e389134a4485434a819a5df2e7" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:47.251063 719 leader_election.cc:343] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.251402 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33d90a619ae54227aaf95acd180af119" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:47.251809 926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "453a1c6f16194cab91c0223e2eeda7ab" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:47.252463 719 leader_election.cc:343] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.252562 719 leader_election.cc:304] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:47.253283 2660 raft_consensus.cc:2749] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:47.253381 999 leader_election.cc:304] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:47.253844 2614 raft_consensus.cc:2804] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:47.254323 2614 raft_consensus.cc:697] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:47.254725 2614 consensus_queue.cc:237] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.264130 903 tablet_service.cc:1511] Processing CreateTablet for tablet 3e245a70fb214b78a1fae9b31f4e8a9d (DEFAULT_TABLE table=default.Table_6ae4413312c2415c91b672165cd440c2 [id=c8603bd8123240189b1a0ff257141f84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.264849 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e245a70fb214b78a1fae9b31f4e8a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.269876 750 tablet_service.cc:1511] Processing CreateTablet for tablet 4a843e9ca4ae4d4a957d4c57c06ef607 (DEFAULT_TABLE table=default.Table_629d59d49c864d1f9170c6ac4526c27e [id=2d1854c3867c4f1589d37998a8d65f3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.270465 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a843e9ca4ae4d4a957d4c57c06ef607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.278107 1184 ts_tablet_manager.cc:1929] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:47.278386 1184 log.cc:1199] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/5dd894706cc2466a8cd4e4df67856862
I20260318 02:51:47.279618 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 2f80f29dfd814acd8b7e143a72231dfd (table default.Table_103c65f4b0d64732bb96cb99459082e6 [id=4dee1f40fb2b4b698dba47eb6c70cab2]) successfully deleted
W20260318 02:51:47.279865 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet c3d6574f9a4747b9ac417790fd978823 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3d6574f9a4747b9ac417790fd978823 already in progress: creating tablet
W20260318 02:51:47.280062 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2ecbbe70dfd74243982cf1b03b0f167b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ecbbe70dfd74243982cf1b03b0f167b already in progress: creating tablet
I20260318 02:51:47.281159 892 tablet_service.cc:1558] Processing DeleteTablet for tablet 28f06d6037fa426296ee68adbb6f689a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:47.281524 906 tablet_service.cc:1511] Processing CreateTablet for tablet 27e55b3449764e4f9e8ba3818ab5da7a (DEFAULT_TABLE table=default.Table_6e665984937f42d4ae5415a59bff0f2f [id=0959902c46974ea39c9ad107d3edca16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.281582 901 tablet_service.cc:1511] Processing CreateTablet for tablet e46af7b7ce6d422693dfddc81a1a3ebc (DEFAULT_TABLE table=default.Table_9e4aa1be0f02404cba048010fcf9c011 [id=0ce7767073d6443ba291c411f93e14f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.281865 905 tablet_service.cc:1558] Processing DeleteTablet for tablet 36c3a417e8c04108b22d28674e570b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:47.281946 902 tablet_service.cc:1511] Processing CreateTablet for tablet 7b8b500df03f4d5c90656d1fbbf8fb46 (DEFAULT_TABLE table=default.Table_848a7926eb504f5198ad05b9a7479597 [id=7eb09c0867b742398330ec29565e877e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.282162 893 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbae97083a24ce683a411b058b0d4f6 (DEFAULT_TABLE table=default.Table_c38f8ee4055b4cc7b6af7251832e4105 [id=ff324d07e4104bbcbca3e0336a45dd6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.282524 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e55b3449764e4f9e8ba3818ab5da7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.282670 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 4a843e9ca4ae4d4a957d4c57c06ef607 (DEFAULT_TABLE table=default.Table_629d59d49c864d1f9170c6ac4526c27e [id=2d1854c3867c4f1589d37998a8d65f3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.283030 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a843e9ca4ae4d4a957d4c57c06ef607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.284835 2715 raft_consensus.cc:493] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.284961 2715 raft_consensus.cc:515] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.285651 2715 leader_election.cc:290] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:47.286396 860 leader_election.cc:343] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 85e6ad2a9817444caecb78eabde5d222
W20260318 02:51:47.286502 862 leader_election.cc:343] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 85e6ad2a9817444caecb78eabde5d222
I20260318 02:51:47.286587 862 leader_election.cc:304] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:47.286989 2715 raft_consensus.cc:2749] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:47.288347 999 leader_election.cc:343] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: d8b956e389134a4485434a819a5df2e7
I20260318 02:51:47.290216 2715 raft_consensus.cc:493] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.290362 2715 raft_consensus.cc:515] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.291334 2715 leader_election.cc:290] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:47.291746 860 leader_election.cc:343] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 783c886a99994d6c8d9add724277819a
I20260318 02:51:47.292546 1035 tablet_service.cc:1558] Processing DeleteTablet for tablet 36c3a417e8c04108b22d28674e570b9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:47.292874 1173 tablet_bootstrap.cc:492] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:47.293017 1173 ts_tablet_manager.cc:1403] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.091s user 0.033s sys 0.035s
I20260318 02:51:47.293038 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 27e55b3449764e4f9e8ba3818ab5da7a (DEFAULT_TABLE table=default.Table_6e665984937f42d4ae5415a59bff0f2f [id=0959902c46974ea39c9ad107d3edca16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.293551 1031 tablet_service.cc:1511] Processing CreateTablet for tablet e46af7b7ce6d422693dfddc81a1a3ebc (DEFAULT_TABLE table=default.Table_9e4aa1be0f02404cba048010fcf9c011 [id=0ce7767073d6443ba291c411f93e14f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.293656 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e55b3449764e4f9e8ba3818ab5da7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.293769 1173 raft_consensus.cc:359] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.293889 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e46af7b7ce6d422693dfddc81a1a3ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.293978 1173 raft_consensus.cc:385] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.294037 1173 raft_consensus.cc:740] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.294214 1173 consensus_queue.cc:260] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.294929 1173 ts_tablet_manager.cc:1434] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:47.296851 1036 tablet_service.cc:1558] Processing DeleteTablet for tablet 28f06d6037fa426296ee68adbb6f689a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:47.300124 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbae97083a24ce683a411b058b0d4f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.300428 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b8b500df03f4d5c90656d1fbbf8fb46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.303485 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e46af7b7ce6d422693dfddc81a1a3ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.303675 2660 raft_consensus.cc:493] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.303829 2660 raft_consensus.cc:515] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.304395 2660 leader_election.cc:290] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:47.306324 1184 ts_tablet_manager.cc:1950] T 5dd894706cc2466a8cd4e4df67856862 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:47.306447 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75f367cde75433d86a4ee9384e57761" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:47.306945 719 leader_election.cc:343] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.307340 2764 raft_consensus.cc:493] T d7f21df58fac437da5747becfa3f28b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.307473 2764 raft_consensus.cc:515] T d7f21df58fac437da5747becfa3f28b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.307878 1027 tablet_service.cc:1511] Processing CreateTablet for tablet d77381b5591b449a89328f0819e242a7 (DEFAULT_TABLE table=default.Table_61a1261da65d47c4802ca3a883412e41 [id=33bcf5e90b9541f5a08702f0e413fb0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.308049 2764 leader_election.cc:290] T d7f21df58fac437da5747becfa3f28b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:47.308172 2764 raft_consensus.cc:493] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.308277 2764 raft_consensus.cc:515] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.308501 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77381b5591b449a89328f0819e242a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.308815 1173 tablet_bootstrap.cc:492] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:47.308842 2764 leader_election.cc:290] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:47.309609 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f21df58fac437da5747becfa3f28b4" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:47.310187 860 leader_election.cc:343] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 64c2a579264e43b9a1e25ded000d4d9f
I20260318 02:51:47.311126 1173 tablet_bootstrap.cc:654] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:47.311967 862 leader_election.cc:343] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 783c886a99994d6c8d9add724277819a
I20260318 02:51:47.312093 862 leader_election.cc:304] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:47.312511 2764 raft_consensus.cc:2749] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:47.313529 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f21df58fac437da5747becfa3f28b4" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:47.314764 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75f367cde75433d86a4ee9384e57761" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:47.314966 862 leader_election.cc:343] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 64c2a579264e43b9a1e25ded000d4d9f
I20260318 02:51:47.315071 862 leader_election.cc:304] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:47.315452 2764 raft_consensus.cc:2749] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:47.315900 862 leader_election.cc:304] T d7f21df58fac437da5747becfa3f28b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:47.316260 2764 raft_consensus.cc:2749] T d7f21df58fac437da5747becfa3f28b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:47.317121 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 3e245a70fb214b78a1fae9b31f4e8a9d (DEFAULT_TABLE table=default.Table_6ae4413312c2415c91b672165cd440c2 [id=c8603bd8123240189b1a0ff257141f84]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.317601 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e245a70fb214b78a1fae9b31f4e8a9d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:47.319520 719 leader_election.cc:343] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.319744 719 leader_election.cc:304] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:47.320189 2660 raft_consensus.cc:2749] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:47.320611 2665 raft_consensus.cc:493] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.320762 2665 raft_consensus.cc:515] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.321326 2665 leader_election.cc:290] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:47.293174 997 leader_election.cc:343] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.293054 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 7b8b500df03f4d5c90656d1fbbf8fb46 (DEFAULT_TABLE table=default.Table_848a7926eb504f5198ad05b9a7479597 [id=7eb09c0867b742398330ec29565e877e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:47.328949 997 leader_election.cc:343] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.329083 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b8b500df03f4d5c90656d1fbbf8fb46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.329116 997 leader_election.cc:304] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:47.329465 2665 raft_consensus.cc:2749] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:47.329620 997 leader_election.cc:343] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.329731 997 leader_election.cc:304] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:47.329953 2665 raft_consensus.cc:2749] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:47.330087 997 leader_election.cc:343] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:47.332967 999 leader_election.cc:343] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 824b9dc6982f425c9518c0ea3560bf84
I20260318 02:51:47.334147 2665 consensus_queue.cc:1048] T e998e290291c443394f478c4ac1cfbd2 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:47.334452 1175 ts_tablet_manager.cc:1929] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:47.334559 1175 log.cc:1199] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/461adcc8bbd94d30b9b84d1010430829
I20260318 02:51:47.334838 1175 ts_tablet_manager.cc:1950] T 461adcc8bbd94d30b9b84d1010430829 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:47.335183 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1310) took 1020 ms. Trace:
I20260318 02:51:47.335273 1175 rpcz_store.cc:276] 0318 02:51:46.314226 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:46.314273 (+ 47us) service_pool.cc:225] Handling call
0318 02:51:46.958114 (+643841us) ts_tablet_manager.cc:1151] Deleting tablet 461adcc8bbd94d30b9b84d1010430829
0318 02:51:46.958126 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:47.017499 (+ 59373us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:47.334335 (+316836us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:47.335164 (+ 829us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":643533}
W20260318 02:51:47.345328 997 consensus_peers.cc:597] T bac04b3e4ad448b09a1a25a754b44aad P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:47.346572 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824b9dc6982f425c9518c0ea3560bf84" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:47.363917 441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.104.131:37025, user_credentials={real_user=slave}} blocked reactor thread for 83220.5us
I20260318 02:51:47.366176 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 5dd894706cc2466a8cd4e4df67856862 (table default.Table_d1bc10f5a27b4fee93fafa3a93ee9d05 [id=f4308b8efe454170bce7eff85fab0959]) successfully deleted
I20260318 02:51:47.378508 1175 tablet_replica.cc:333] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
W20260318 02:51:47.379449 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 28f06d6037fa426296ee68adbb6f689a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28f06d6037fa426296ee68adbb6f689a already in progress: creating tablet
I20260318 02:51:47.383597 927 raft_consensus.cc:3060] T 169f97b2320e4a5baae1dec29a1c7c36 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:47.392427 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 36c3a417e8c04108b22d28674e570b9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36c3a417e8c04108b22d28674e570b9b already in progress: creating tablet
I20260318 02:51:47.393325 1175 raft_consensus.cc:2243] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:47.394294 1175 raft_consensus.cc:2272] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:47.394971 997 leader_election.cc:343] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:47.395942 441 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 4ea1caf000264d6fa2a7b0bd0aa18062 (table default.Table_c63455064fda45b6a964b45792b04c48 [id=69ad3cb2b6344cbd98664ff0cefc2b3a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4ea1caf000264d6fa2a7b0bd0aa18062 consensus state has no leader
I20260318 02:51:47.396087 766 tablet_service.cc:1511] Processing CreateTablet for tablet d77381b5591b449a89328f0819e242a7 (DEFAULT_TABLE table=default.Table_61a1261da65d47c4802ca3a883412e41 [id=33bcf5e90b9541f5a08702f0e413fb0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.396509 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d77381b5591b449a89328f0819e242a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.397271 1174 tablet_bootstrap.cc:492] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:47.397406 1174 ts_tablet_manager.cc:1403] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.424s user 0.007s sys 0.080s
I20260318 02:51:47.398259 1174 raft_consensus.cc:359] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.398435 1174 raft_consensus.cc:385] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.398483 1174 raft_consensus.cc:740] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.398690 1174 consensus_queue.cc:260] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.405431 1174 ts_tablet_manager.cc:1434] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260318 02:51:47.405668 766 tablet_service.cc:1511] Processing CreateTablet for tablet e46af7b7ce6d422693dfddc81a1a3ebc (DEFAULT_TABLE table=default.Table_9e4aa1be0f02404cba048010fcf9c011 [id=0ce7767073d6443ba291c411f93e14f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.407012 756 tablet_service.cc:1511] Processing CreateTablet for tablet 27e55b3449764e4f9e8ba3818ab5da7a (DEFAULT_TABLE table=default.Table_6e665984937f42d4ae5415a59bff0f2f [id=0959902c46974ea39c9ad107d3edca16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.407119 1174 tablet_bootstrap.cc:492] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:47.408533 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27e55b3449764e4f9e8ba3818ab5da7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.409051 1174 tablet_bootstrap.cc:654] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.411659 997 leader_election.cc:304] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:47.412279 2152 raft_consensus.cc:2749] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:47.412545 1175 ts_tablet_manager.cc:1916] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:47.419090 927 raft_consensus.cc:3060] T bcb731f97a764183aba7408bae969331 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:47.421533 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e46af7b7ce6d422693dfddc81a1a3ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.428309 756 tablet_service.cc:1511] Processing CreateTablet for tablet 7b8b500df03f4d5c90656d1fbbf8fb46 (DEFAULT_TABLE table=default.Table_848a7926eb504f5198ad05b9a7479597 [id=7eb09c0867b742398330ec29565e877e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.428869 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b8b500df03f4d5c90656d1fbbf8fb46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.431325 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 461adcc8bbd94d30b9b84d1010430829 (table default.Table_600a629a518c46678144af62a75ea690 [id=9de656e677a540ad90ccd30ab1d092e5]) successfully deleted
I20260318 02:51:47.433104 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 4ce1bf41b33842ab9ade884ae84daf96
I20260318 02:51:47.435046 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet c8d7aad0f2c545628a13b2ad3269dcd6
W20260318 02:51:47.438133 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2ecbbe70dfd74243982cf1b03b0f167b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ecbbe70dfd74243982cf1b03b0f167b already in progress: creating tablet
W20260318 02:51:47.438464 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet c3d6574f9a4747b9ac417790fd978823 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3d6574f9a4747b9ac417790fd978823 already in progress: creating tablet
I20260318 02:51:47.443694 2660 raft_consensus.cc:493] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.443905 2660 raft_consensus.cc:515] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.444546 2660 leader_election.cc:290] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:47.445668 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3073fbe00c5d45b6b3100e927e0cc5c3" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:47.446352 719 leader_election.cc:343] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.448863 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3073fbe00c5d45b6b3100e927e0cc5c3" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:47.449487 719 leader_election.cc:343] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.449615 719 leader_election.cc:304] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:47.450048 2660 raft_consensus.cc:2749] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:47.456386 453 master_service.cc:954] ReplaceTablet: received request to replace tablet dfb3e7fe7a834636a16ee8a772b73ee2 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:47.457182 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 558073d59dcf4fc5b4bfd1d9685415a1
I20260318 02:51:47.459007 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_69a57541ae934bd6947a6380a12a6b15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:47.459666 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69a57541ae934bd6947a6380a12a6b15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:47.463054 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0d2858909c654b5c9566dab7b33da1c3" } new_table_name: "default.Table_e2e6eee71f7e41f0b3b145877f187e29" modify_external_catalogs: true
I20260318 02:51:47.464529 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3d116ef2f5d54b9eb9f9bdb405ec8d50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:47.465096 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d116ef2f5d54b9eb9f9bdb405ec8d50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:47.465725 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ce1bf41b33842ab9ade884ae84daf96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:47.466753 2614 raft_consensus.cc:493] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.466892 2614 raft_consensus.cc:515] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.467501 2614 leader_election.cc:290] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:47.467947 903 tablet_service.cc:1558] Processing DeleteTablet for tablet c8d7aad0f2c545628a13b2ad3269dcd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:47.468073 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895aa252b9f243d89e972d1b717ee910" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:47.468251 781 raft_consensus.cc:2468] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:47.468470 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895aa252b9f243d89e972d1b717ee910" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:47.468534 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_9f47ebe5641a40adb125b4d2a49aec14" } new_table_name: "default.Table_5df4cb71ac9f42b9936d125977cd3a3d" modify_external_catalogs: true
I20260318 02:51:47.468667 999 leader_election.cc:304] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:47.468943 2614 raft_consensus.cc:2804] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:47.469008 2614 raft_consensus.cc:493] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:47.469064 2614 raft_consensus.cc:3060] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:47.469300 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 33d90a619ae54227aaf95acd180af119 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:47.469481 1027 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ce1bf41b33842ab9ade884ae84daf96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:47.469525 1184 tablet_replica.cc:333] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:47.469729 1184 raft_consensus.cc:2243] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:47.469874 1184 raft_consensus.cc:2272] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:47.470373 1184 ts_tablet_manager.cc:1916] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:47.470906 1174 tablet_bootstrap.cc:492] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:47.471026 1174 ts_tablet_manager.cc:1403] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.000s
I20260318 02:51:47.471534 2614 raft_consensus.cc:515] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.471717 1174 raft_consensus.cc:359] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.471871 1174 raft_consensus.cc:385] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.471918 1174 raft_consensus.cc:740] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.472107 1174 consensus_queue.cc:260] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.472517 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895aa252b9f243d89e972d1b717ee910" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:47.472671 781 raft_consensus.cc:3060] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:47.473093 1172 tablet_bootstrap.cc:492] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:47.473206 1172 ts_tablet_manager.cc:1403] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.311s user 0.023s sys 0.031s
I20260318 02:51:47.473860 1172 raft_consensus.cc:359] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.473997 1172 raft_consensus.cc:385] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.474037 1172 raft_consensus.cc:740] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.474210 1172 consensus_queue.cc:260] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.475142 781 raft_consensus.cc:2468] T 895aa252b9f243d89e972d1b717ee910 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:47.476128 999 leader_election.cc:304] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:47.476163 1184 ts_tablet_manager.cc:1929] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:47.476258 1184 log.cc:1199] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/33d90a619ae54227aaf95acd180af119
I20260318 02:51:47.476370 2152 raft_consensus.cc:2804] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:47.476469 2152 raft_consensus.cc:697] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:47.476516 1184 ts_tablet_manager.cc:1950] T 33d90a619ae54227aaf95acd180af119 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:47.476611 766 tablet_service.cc:1558] Processing DeleteTablet for tablet c8d7aad0f2c545628a13b2ad3269dcd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:47.476687 2152 consensus_queue.cc:237] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.476812 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ce1bf41b33842ab9ade884ae84daf96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:47.478209 1172 ts_tablet_manager.cc:1434] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
W20260318 02:51:47.478195 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 4ce1bf41b33842ab9ade884ae84daf96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ce1bf41b33842ab9ade884ae84daf96 already in progress: creating tablet
I20260318 02:51:47.478354 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 558073d59dcf4fc5b4bfd1d9685415a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:47.478710 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet c8d7aad0f2c545628a13b2ad3269dcd6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8d7aad0f2c545628a13b2ad3269dcd6 already in progress: creating tablet
W20260318 02:51:47.479099 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 558073d59dcf4fc5b4bfd1d9685415a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 558073d59dcf4fc5b4bfd1d9685415a1 already in progress: creating tablet
I20260318 02:51:47.481900 2614 leader_election.cc:290] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:47.486375 1172 tablet_bootstrap.cc:492] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:47.487950 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet d8b956e389134a4485434a819a5df2e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:35 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:47.488278 1184 tablet_replica.cc:333] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:47.488466 1184 raft_consensus.cc:2243] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:47.488605 1184 raft_consensus.cc:2272] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:47.489132 1184 ts_tablet_manager.cc:1916] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:47.491060 2764 raft_consensus.cc:493] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.491209 2764 raft_consensus.cc:515] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.491806 2764 leader_election.cc:290] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:47.492869 860 leader_election.cc:343] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 59c6741a6d154d8f99d487c6590d2d26
I20260318 02:51:47.488000 1172 tablet_bootstrap.cc:654] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.495788 1184 ts_tablet_manager.cc:1929] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:47.495926 1184 log.cc:1199] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/d8b956e389134a4485434a819a5df2e7
I20260318 02:51:47.496253 1184 ts_tablet_manager.cc:1950] T d8b956e389134a4485434a819a5df2e7 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:47.497387 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f527a0ba0914924bc7f604ae8a48393 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:47.498109 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895aa252b9f243d89e972d1b717ee910" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:47.500422 2152 raft_consensus.cc:493] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.500545 2152 raft_consensus.cc:515] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.501134 2152 leader_election.cc:290] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:47.505777 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 33d90a619ae54227aaf95acd180af119 (table default.Table_6188e1840e124ad0814b689b5887e654 [id=5d3de8b6b902412f900bbc2c35a4c2b9]) successfully deleted
W20260318 02:51:47.506031 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 4ce1bf41b33842ab9ade884ae84daf96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ce1bf41b33842ab9ade884ae84daf96 already in progress: creating tablet
I20260318 02:51:47.506187 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet d8b956e389134a4485434a819a5df2e7 (table default.Table_5ceb6bf88c4743ee88d4fe26441e46ec [id=711aeebd6e7b4620b53d44b7692de91a]) successfully deleted
I20260318 02:51:47.507459 903 tablet_service.cc:1558] Processing DeleteTablet for tablet 558073d59dcf4fc5b4bfd1d9685415a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:47.508044 997 leader_election.cc:343] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:47.508451 997 leader_election.cc:343] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.509135 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a65ccfd73234e8fb2bea5b6911cb3f1" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:47.516252 999 leader_election.cc:343] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 6a65ccfd73234e8fb2bea5b6911cb3f1
W20260318 02:51:47.516966 862 leader_election.cc:343] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 59c6741a6d154d8f99d487c6590d2d26
I20260318 02:51:47.517091 862 leader_election.cc:304] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:47.517606 2764 raft_consensus.cc:2749] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:47.519420 1174 ts_tablet_manager.cc:1434] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.048s user 0.001s sys 0.001s
I20260318 02:51:47.520043 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 558073d59dcf4fc5b4bfd1d9685415a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:47.520315 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet c8d7aad0f2c545628a13b2ad3269dcd6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:47.523262 1175 ts_tablet_manager.cc:1929] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260318 02:51:47.529047 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee5faed619d140fd99df5f104eb6adf9 consensus state has no leader
I20260318 02:51:47.533617 1172 tablet_bootstrap.cc:492] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:47.533797 1172 ts_tablet_manager.cc:1403] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.047s user 0.007s sys 0.001s
I20260318 02:51:47.534487 1172 raft_consensus.cc:359] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.534658 1172 raft_consensus.cc:385] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.534711 1172 raft_consensus.cc:740] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.534919 1172 consensus_queue.cc:260] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.535326 1172 ts_tablet_manager.cc:1434] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260318 02:51:47.535631 1172 tablet_bootstrap.cc:492] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:47.538300 1184 tablet_replica.cc:333] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:47.538584 1174 tablet_bootstrap.cc:492] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:47.538976 1184 raft_consensus.cc:2243] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:47.544229 1184 raft_consensus.cc:2272] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:47.545351 1184 ts_tablet_manager.cc:1916] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:47.550992 1174 tablet_bootstrap.cc:654] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:47.543962 997 leader_election.cc:343] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.547720 1172 tablet_bootstrap.cc:654] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.554797 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6349037f9ffc41d18ef322698885aea5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:47.555455 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6349037f9ffc41d18ef322698885aea5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:47.552639 997 leader_election.cc:304] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:47.556988 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_70703d3573974121b1631b1fd237b09c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:47.557121 2614 raft_consensus.cc:2749] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:47.557555 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70703d3573974121b1631b1fd237b09c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:47.561721 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_fef680b63ffe4b32a6a477d2f98ad498" } new_table_name: "default.Table_c3ca50129c944dd8a0bf402fe3ebc527" modify_external_catalogs: true
I20260318 02:51:47.564689 1172 tablet_bootstrap.cc:492] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:47.564873 1172 ts_tablet_manager.cc:1403] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.002s
I20260318 02:51:47.574219 2788 tablet.cc:1723] T a9c60ef260d049bea4ce729316a0d09f P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:47.538184 2715 raft_consensus.cc:493] T 3aa05403966349ae9056777d913a0db6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.575510 2715 raft_consensus.cc:515] T 3aa05403966349ae9056777d913a0db6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.575640 2789 tablet.cc:1723] T a9c60ef260d049bea4ce729316a0d09f P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:47.576210 2715 leader_election.cc:290] T 3aa05403966349ae9056777d913a0db6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:47.550351 1173 tablet_bootstrap.cc:492] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:47.576516 1173 ts_tablet_manager.cc:1403] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.268s user 0.044s sys 0.070s
I20260318 02:51:47.576776 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa05403966349ae9056777d913a0db6" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:47.577065 1172 raft_consensus.cc:359] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:47.577220 1172 raft_consensus.cc:385] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.577265 1172 raft_consensus.cc:740] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.577304 1173 raft_consensus.cc:359] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.577455 1173 raft_consensus.cc:385] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.577507 1173 raft_consensus.cc:740] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.577454 1172 consensus_queue.cc:260] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:47.577709 1173 consensus_queue.cc:260] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.578060 1172 ts_tablet_manager.cc:1434] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.013s user 0.000s sys 0.001s
I20260318 02:51:47.578179 1173 ts_tablet_manager.cc:1434] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260318 02:51:47.578464 1173 tablet_bootstrap.cc:492] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:47.578495 1172 tablet_bootstrap.cc:492] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:47.581061 921 raft_consensus.cc:3060] T 3aa05403966349ae9056777d913a0db6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:47.582468 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa05403966349ae9056777d913a0db6" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:47.583299 862 leader_election.cc:304] T 3aa05403966349ae9056777d913a0db6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:47.585181 1173 tablet_bootstrap.cc:654] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.587513 1172 tablet_bootstrap.cc:654] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.592692 1175 log.cc:1199] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/60dedba077d34435b30061bfba737412
I20260318 02:51:47.593075 1175 ts_tablet_manager.cc:1950] T 60dedba077d34435b30061bfba737412 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:47.599212 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 60dedba077d34435b30061bfba737412 (table default.Table_374dfe5a11944231bc786a2cb0c66a84 [id=6449f780fd6a4361960f0a62d81dd60d]) successfully deleted
I20260318 02:51:47.600000 1175 tablet_replica.cc:333] T 49afed40c7aa4f2d913daed8055a098e P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:47.600225 1175 raft_consensus.cc:2243] T 49afed40c7aa4f2d913daed8055a098e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:47.600387 1175 raft_consensus.cc:2272] T 49afed40c7aa4f2d913daed8055a098e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:47.601011 1175 ts_tablet_manager.cc:1916] T 49afed40c7aa4f2d913daed8055a098e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:47.608584 2820 tablet.cc:1723] T a9c60ef260d049bea4ce729316a0d09f P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:47.609197 2764 raft_consensus.cc:2749] T 3aa05403966349ae9056777d913a0db6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:47.609591 997 consensus_peers.cc:597] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:47.610606 1173 tablet_bootstrap.cc:492] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:47.610965 1173 ts_tablet_manager.cc:1403] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.003s
I20260318 02:51:47.611783 1173 raft_consensus.cc:359] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.612063 1173 raft_consensus.cc:385] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.612160 1173 raft_consensus.cc:740] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.612495 2819 tablet.cc:1723] T 3aa05403966349ae9056777d913a0db6 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:47.612759 1173 consensus_queue.cc:260] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.613420 1173 ts_tablet_manager.cc:1434] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:47.613757 1173 tablet_bootstrap.cc:492] T 7e6f40a5d3f14a779c26d73bf58f302b P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:47.614943 1172 tablet_bootstrap.cc:492] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:47.615135 1172 ts_tablet_manager.cc:1403] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.037s user 0.001s sys 0.003s
I20260318 02:51:47.615638 1173 tablet_bootstrap.cc:654] T 7e6f40a5d3f14a779c26d73bf58f302b P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.616075 1172 raft_consensus.cc:359] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.616289 1172 raft_consensus.cc:385] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.616370 1172 raft_consensus.cc:740] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.616783 1172 consensus_queue.cc:260] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.617400 1172 ts_tablet_manager.cc:1434] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:47.617704 1172 tablet_bootstrap.cc:492] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:47.626487 1184 ts_tablet_manager.cc:1929] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:47.626598 1174 tablet_bootstrap.cc:492] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:47.627130 1174 ts_tablet_manager.cc:1403] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.089s user 0.003s sys 0.003s
I20260318 02:51:47.628046 1174 raft_consensus.cc:359] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:47.628218 1174 raft_consensus.cc:385] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.628270 1174 raft_consensus.cc:740] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.628755 1174 consensus_queue.cc:260] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:47.633569 1173 tablet_bootstrap.cc:492] T 7e6f40a5d3f14a779c26d73bf58f302b P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:47.633728 1173 ts_tablet_manager.cc:1403] T 7e6f40a5d3f14a779c26d73bf58f302b P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20260318 02:51:47.634469 1173 raft_consensus.cc:359] T 7e6f40a5d3f14a779c26d73bf58f302b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.634639 1173 raft_consensus.cc:385] T 7e6f40a5d3f14a779c26d73bf58f302b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.634702 1173 raft_consensus.cc:740] T 7e6f40a5d3f14a779c26d73bf58f302b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.634943 1173 consensus_queue.cc:260] T 7e6f40a5d3f14a779c26d73bf58f302b P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:47.639281 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 369e952736e44a92a242b2b5cfa29074 consensus state has no leader
I20260318 02:51:47.639657 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6e99ecda3f32420f9aafb0a129769e76" } new_table_name: "default.Table_4283f2ee23bb48ff89ba6caa206041a4" modify_external_catalogs: true
I20260318 02:51:47.641175 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6c961a722c82458eb3d186f364834b85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:47.641686 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c961a722c82458eb3d186f364834b85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:47.642915 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e1d897fa1eb9435e8a4b59f4a984336a consensus state has no leader
I20260318 02:51:47.643221 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6c5efa5b460245ed8de1a2593c6655a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:47.643668 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c5efa5b460245ed8de1a2593c6655a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:47.644919 452 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 3073fbe00c5d45b6b3100e927e0cc5c3 (table default.Table_f368a8dc34ae4ea7815aea031af47ed3 [id=2c3964f728cc4231805fe553a37766ae]). Expected version 1 got 0
I20260318 02:51:47.645082 452 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet cb29fd9d6fc845b2aaffe34c290fd5ca (table default.Table_496f16dbb28a4f2d947c6f7d15d8ad9f [id=cc1e96ac2459417795a39cf88dd1edcf]). Expected version 2 got 0
I20260318 02:51:47.645262 452 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet a75f367cde75433d86a4ee9384e57761 (table default.Table_ed6ebe71dc614470a951f2e484f28d88 [id=837cbf1e256f46f484ceb9ffa208891c]). Expected version 1 got 0
W20260318 02:51:47.646790 452 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.104.129:41665 (request call id 259) took 772 ms (client timeout 1000 ms). Trace:
I20260318 02:51:47.647485 449 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet bac04b3e4ad448b09a1a25a754b44aad (table default.Table_c0a9aae588ef49148c04338c906dab4a [id=1532d6dc2cc641998f9c120075fa04b4]). Expected version 1 got 0
W20260318 02:51:47.646912 452 rpcz_store.cc:269] 0318 02:51:46.874039 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:46.874236 (+ 197us) service_pool.cc:225] Handling call
0318 02:51:47.646770 (+772534us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":7}
I20260318 02:51:47.647691 449 catalog_manager.cc:5671] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:47.648181 449 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 9c05f7a75527410e9c5cde0dbc6bc10e (table default.Table_fed9534e8e3d410ab1775c885744cc2a [id=113b6b3abc1a4dcc91c49be4704a159c]). Expected version 2 got 0
I20260318 02:51:47.648372 449 catalog_manager.cc:5671] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:47.648667 455 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet d7f21df58fac437da5747becfa3f28b4 (table default.Table_357b13fa64234ab49f2349df67f8a0e2 [id=48b004d4295f40f0ac9ff77d7bb31720]). Expected version 3 got 0
I20260318 02:51:47.649816 455 master_service.cc:954] ReplaceTablet: received request to replace tablet dd97103da8924a4583cf5fe300073446 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:47.652859 1184 log.cc:1199] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/6f527a0ba0914924bc7f604ae8a48393
I20260318 02:51:47.652839 753 tablet_service.cc:1511] Processing CreateTablet for tablet 63bc698ede864a0eb2c89a6f6acb2aae (DEFAULT_TABLE table=default.Table_10db426df0be4af699aa590ebfe24dd4 [id=b8b3cce950a9419d9ab9f22b0db310f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.653041 749 tablet_service.cc:1511] Processing CreateTablet for tablet bd268b6c207741689c01c52e39e96858 (DEFAULT_TABLE table=default.Table_7f97dbe723b3423ba4f059ec5f67a900 [id=f40e53cf9a3644f38b15a69a83c1fc94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.653177 1184 ts_tablet_manager.cc:1950] T 6f527a0ba0914924bc7f604ae8a48393 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:47.653237 762 tablet_service.cc:1511] Processing CreateTablet for tablet 2c52ffa70587433596e28256831fc021 (DEFAULT_TABLE table=default.Table_986b4af488014b0fbbe01adae41c7475 [id=81cc73c0a9a64a77beb06e11dcf91902]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.653342 748 tablet_service.cc:1511] Processing CreateTablet for tablet 3219c71c647148099bb0978a3f116108 (DEFAULT_TABLE table=default.Table_7f25bb7b147945ff9cfc45d68c843e42 [id=d34c8e5ecd7a4c0eaa4384387b7bd1f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.653680 766 tablet_service.cc:1558] Processing DeleteTablet for tablet d3b37df330984378b81b367446d34748 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:47.653889 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a92761edfe74a9798da4d93964383ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:47.654182 761 tablet_service.cc:1511] Processing CreateTablet for tablet f1efddb11f7f43a9b0d6ec23ebb0d73b (DEFAULT_TABLE table=default.Table_3bbaffd805554520b32b15b19b072c13 [id=3bdc93290de1414882538564e5e1d913]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.652839 750 tablet_service.cc:1511] Processing CreateTablet for tablet 7588d049320547f9a79bb8e1c3b0f28e (DEFAULT_TABLE table=default.Table_1568e115138b4d858570bc80c7f2b7ab [id=33f82b9bea7445308d4ca80861fb0379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.628512 1172 tablet_bootstrap.cc:654] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.652063 2614 consensus_queue.cc:1048] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:47.655102 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63bc698ede864a0eb2c89a6f6acb2aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.660228 449 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet e998e290291c443394f478c4ac1cfbd2 (table default.Table_5d59b3f280d345a3937fff6df372fcff [id=00651cbebdb046c9975ecfa30f08fce5]). Expected version 2 got 0
I20260318 02:51:47.661954 758 tablet_service.cc:1511] Processing CreateTablet for tablet a9c897f36569422aa0b1f2094b25587c (DEFAULT_TABLE table=default.Table_443be3a1959546e3a1a362232f473064 [id=41006675286f4e8a9707b108705389f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.662231 759 tablet_service.cc:1511] Processing CreateTablet for tablet 88f0c3233ac945b4ac8383ff7342e446 (DEFAULT_TABLE table=default.Table_274158734fea47acba9c6794bed6975c [id=58c74f1480524850b913044e32aab247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.662485 756 tablet_service.cc:1511] Processing CreateTablet for tablet d25ee8cba8024edc930149450ad2eeb6 (DEFAULT_TABLE table=default.Table_ffb878be775b445d9cb1a9b6e6a3c1f8 [id=2d731b833c1745d5a51011290a5866c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.662837 766 tablet_service.cc:1511] Processing CreateTablet for tablet a609383cc8c94e92bf384a575688abbd (DEFAULT_TABLE table=default.Table_8290ddf883774684b025ecb0a89e7e3c [id=e663ecb375294692a9d1941062bf6d10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.664736 2704 tablet_replica.cc:333] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:47.665130 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd268b6c207741689c01c52e39e96858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.668949 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3219c71c647148099bb0978a3f116108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.668998 452 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 7e6f40a5d3f14a779c26d73bf58f302b (table default.Table_91e64c048d4048168906fcd3d1a5b3d0 [id=05445eb067cb46a5803415774772c91e]). Expected version 2 got 0
I20260318 02:51:47.670531 452 master_service.cc:954] ReplaceTablet: received request to replace tablet 17699eee74be4698b84ee6f604aec41a from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:47.673146 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7588d049320547f9a79bb8e1c3b0f28e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.673362 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1efddb11f7f43a9b0d6ec23ebb0d73b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.676961 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9c897f36569422aa0b1f2094b25587c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.681422 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c52ffa70587433596e28256831fc021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.685492 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88f0c3233ac945b4ac8383ff7342e446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.688995 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25ee8cba8024edc930149450ad2eeb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.692914 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a609383cc8c94e92bf384a575688abbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.698442 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6390106122c8419595c87048c42ff574" } modify_external_catalogs: true
I20260318 02:51:47.698659 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_6390106122c8419595c87048c42ff574" } modify_external_catalogs: true
I20260318 02:51:47.700335 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f27228fc834e4dfa99011aca3fb3c5ea" } modify_external_catalogs: true
I20260318 02:51:47.700488 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f27228fc834e4dfa99011aca3fb3c5ea" } modify_external_catalogs: true
W20260318 02:51:47.701818 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3feb3a76a7b947f5a35baae379e8754d consensus state has no leader
I20260318 02:51:47.702056 450 master_service.cc:954] ReplaceTablet: received request to replace tablet 8b715c5a31ba4515996595de89f1d62c from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:47.718328 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 7588d049320547f9a79bb8e1c3b0f28e (DEFAULT_TABLE table=default.Table_1568e115138b4d858570bc80c7f2b7ab [id=33f82b9bea7445308d4ca80861fb0379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.718755 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7588d049320547f9a79bb8e1c3b0f28e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.734642 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 3219c71c647148099bb0978a3f116108 (DEFAULT_TABLE table=default.Table_7f25bb7b147945ff9cfc45d68c843e42 [id=d34c8e5ecd7a4c0eaa4384387b7bd1f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.735457 1027 tablet_service.cc:1511] Processing CreateTablet for tablet f1efddb11f7f43a9b0d6ec23ebb0d73b (DEFAULT_TABLE table=default.Table_3bbaffd805554520b32b15b19b072c13 [id=3bdc93290de1414882538564e5e1d913]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.736047 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 63bc698ede864a0eb2c89a6f6acb2aae (DEFAULT_TABLE table=default.Table_10db426df0be4af699aa590ebfe24dd4 [id=b8b3cce950a9419d9ab9f22b0db310f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.736642 1034 tablet_service.cc:1511] Processing CreateTablet for tablet 2c52ffa70587433596e28256831fc021 (DEFAULT_TABLE table=default.Table_986b4af488014b0fbbe01adae41c7475 [id=81cc73c0a9a64a77beb06e11dcf91902]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.736752 1041 tablet_service.cc:1511] Processing CreateTablet for tablet d25ee8cba8024edc930149450ad2eeb6 (DEFAULT_TABLE table=default.Table_ffb878be775b445d9cb1a9b6e6a3c1f8 [id=2d731b833c1745d5a51011290a5866c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.737272 1035 tablet_service.cc:1511] Processing CreateTablet for tablet a609383cc8c94e92bf384a575688abbd (DEFAULT_TABLE table=default.Table_8290ddf883774684b025ecb0a89e7e3c [id=e663ecb375294692a9d1941062bf6d10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.737450 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 88f0c3233ac945b4ac8383ff7342e446 (DEFAULT_TABLE table=default.Table_274158734fea47acba9c6794bed6975c [id=58c74f1480524850b913044e32aab247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.737577 1040 tablet_service.cc:1511] Processing CreateTablet for tablet a9c897f36569422aa0b1f2094b25587c (DEFAULT_TABLE table=default.Table_443be3a1959546e3a1a362232f473064 [id=41006675286f4e8a9707b108705389f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.737723 2614 raft_consensus.cc:493] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.737845 2614 raft_consensus.cc:515] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.738129 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25ee8cba8024edc930149450ad2eeb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.738281 1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c52ffa70587433596e28256831fc021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.738416 2614 leader_election.cc:290] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:47.740969 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88f0c3233ac945b4ac8383ff7342e446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.743986 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9c897f36569422aa0b1f2094b25587c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:47.747929 999 leader_election.cc:343] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: b894f0772a754196a3e651b38c46f001
I20260318 02:51:47.748329 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3219c71c647148099bb0978a3f116108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.748507 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a609383cc8c94e92bf384a575688abbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.753026 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63bc698ede864a0eb2c89a6f6acb2aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.753230 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1efddb11f7f43a9b0d6ec23ebb0d73b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.772835 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet dd97103da8924a4583cf5fe300073446
I20260318 02:51:47.773381 455 catalog_manager.cc:6741] ReplaceTablet: tablet dd97103da8924a4583cf5fe300073446 deleted and replaced by tablet b770b09798a6433daf9ec06128dee689
I20260318 02:51:47.773617 455 master_service.cc:954] ReplaceTablet: received request to replace tablet eaf1477c32ce45329a9a0ac19158d54e from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:47.774192 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a88efa1088f340949c151592c569491c" } modify_external_catalogs: true
I20260318 02:51:47.774376 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_a88efa1088f340949c151592c569491c" } modify_external_catalogs: true
I20260318 02:51:47.775799 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 17699eee74be4698b84ee6f604aec41a
I20260318 02:51:47.775919 2660 raft_consensus.cc:493] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.776052 2660 raft_consensus.cc:515] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.776229 452 catalog_manager.cc:6741] ReplaceTablet: tablet 17699eee74be4698b84ee6f604aec41a deleted and replaced by tablet 8dbaa63491ba4ad1b863f4417e3d2e40
I20260318 02:51:47.776463 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3ce17f77cb5e4ecdba2110059be25eaf" } modify_external_catalogs: true
I20260318 02:51:47.776585 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3ce17f77cb5e4ecdba2110059be25eaf" } modify_external_catalogs: true
I20260318 02:51:47.776674 2660 leader_election.cc:290] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:47.777566 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3332a507699349c2874b4ea205740a8e consensus state has no leader
I20260318 02:51:47.777592 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a17ef7cfee4d65808b11e9cb51e7df" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:47.777884 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_5a1ab6b7b3db4dfeb0dba6b1254a032c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:47.778512 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a1ab6b7b3db4dfeb0dba6b1254a032c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:47.779836 719 leader_election.cc:343] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.781205 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 17699eee74be4698b84ee6f604aec41a with delete_type TABLET_DATA_DELETED (replaced by tablet 8dbaa63491ba4ad1b863f4417e3d2e40) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:47.783454 451 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet bac04b3e4ad448b09a1a25a754b44aad (table default.Table_c0a9aae588ef49148c04338c906dab4a [id=1532d6dc2cc641998f9c120075fa04b4]). Expected version 1 got 0
I20260318 02:51:47.783872 451 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet e998e290291c443394f478c4ac1cfbd2 (table default.Table_5d59b3f280d345a3937fff6df372fcff [id=00651cbebdb046c9975ecfa30f08fce5]). Expected version 2 got 0
I20260318 02:51:47.785262 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 6f527a0ba0914924bc7f604ae8a48393 (table default.Table_3064939f4dfb44dba19bb6f8f9c6f250 [id=b56547120b2645cc9c7cbd6078f7a039]) successfully deleted
W20260318 02:51:47.785506 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 558073d59dcf4fc5b4bfd1d9685415a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 558073d59dcf4fc5b4bfd1d9685415a1 already in progress: creating tablet
W20260318 02:51:47.785671 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet c8d7aad0f2c545628a13b2ad3269dcd6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8d7aad0f2c545628a13b2ad3269dcd6 already in progress: creating tablet
I20260318 02:51:47.786116 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_33682c1fb3284897980e07d95f302cad" } modify_external_catalogs: true
I20260318 02:51:47.786316 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_33682c1fb3284897980e07d95f302cad" } modify_external_catalogs: true
I20260318 02:51:47.787710 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_72fe6064160f43009ee01778bf3b8724"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:47.788271 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72fe6064160f43009ee01778bf3b8724 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:47.794480 749 tablet_service.cc:1558] Processing DeleteTablet for tablet dd97103da8924a4583cf5fe300073446 with delete_type TABLET_DATA_DELETED (replaced by tablet b770b09798a6433daf9ec06128dee689) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:47.798291 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 17699eee74be4698b84ee6f604aec41a with delete_type TABLET_DATA_DELETED (replaced by tablet 8dbaa63491ba4ad1b863f4417e3d2e40) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:47.798540 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet dd97103da8924a4583cf5fe300073446 with delete_type TABLET_DATA_DELETED (replaced by tablet b770b09798a6433daf9ec06128dee689) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:47.798974 1039 tablet_service.cc:1511] Processing CreateTablet for tablet bd268b6c207741689c01c52e39e96858 (DEFAULT_TABLE table=default.Table_7f97dbe723b3423ba4f059ec5f67a900 [id=f40e53cf9a3644f38b15a69a83c1fc94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.799736 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd268b6c207741689c01c52e39e96858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.663080 903 tablet_service.cc:1511] Processing CreateTablet for tablet 7588d049320547f9a79bb8e1c3b0f28e (DEFAULT_TABLE table=default.Table_1568e115138b4d858570bc80c7f2b7ab [id=33f82b9bea7445308d4ca80861fb0379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.805312 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7588d049320547f9a79bb8e1c3b0f28e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.664088 901 tablet_service.cc:1511] Processing CreateTablet for tablet bd268b6c207741689c01c52e39e96858 (DEFAULT_TABLE table=default.Table_7f97dbe723b3423ba4f059ec5f67a900 [id=f40e53cf9a3644f38b15a69a83c1fc94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.809424 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd268b6c207741689c01c52e39e96858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.664615 893 tablet_service.cc:1511] Processing CreateTablet for tablet 3219c71c647148099bb0978a3f116108 (DEFAULT_TABLE table=default.Table_7f25bb7b147945ff9cfc45d68c843e42 [id=d34c8e5ecd7a4c0eaa4384387b7bd1f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.813357 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3219c71c647148099bb0978a3f116108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.677811 2815 raft_consensus.cc:493] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.816931 2815 raft_consensus.cc:515] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.817651 2815 leader_election.cc:290] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:47.678561 906 tablet_service.cc:1511] Processing CreateTablet for tablet f1efddb11f7f43a9b0d6ec23ebb0d73b (DEFAULT_TABLE table=default.Table_3bbaffd805554520b32b15b19b072c13 [id=3bdc93290de1414882538564e5e1d913]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.818171 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1efddb11f7f43a9b0d6ec23ebb0d73b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:47.819207 862 leader_election.cc:343] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: c4051c8e4d3d49829f9eac8e36baab2f
W20260318 02:51:47.819536 860 leader_election.cc:343] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: c4051c8e4d3d49829f9eac8e36baab2f
I20260318 02:51:47.819633 860 leader_election.cc:304] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:47.819977 2815 raft_consensus.cc:2749] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:47.678740 902 tablet_service.cc:1511] Processing CreateTablet for tablet 63bc698ede864a0eb2c89a6f6acb2aae (DEFAULT_TABLE table=default.Table_10db426df0be4af699aa590ebfe24dd4 [id=b8b3cce950a9419d9ab9f22b0db310f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.821162 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63bc698ede864a0eb2c89a6f6acb2aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.679081 897 tablet_service.cc:1511] Processing CreateTablet for tablet 2c52ffa70587433596e28256831fc021 (DEFAULT_TABLE table=default.Table_986b4af488014b0fbbe01adae41c7475 [id=81cc73c0a9a64a77beb06e11dcf91902]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.825466 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c52ffa70587433596e28256831fc021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.679451 890 tablet_service.cc:1558] Processing DeleteTablet for tablet 9777963ff20c4a799de2870555f6b335 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:47.679746 905 tablet_service.cc:1558] Processing DeleteTablet for tablet c4051c8e4d3d49829f9eac8e36baab2f with delete_type TABLET_DATA_DELETED (replaced by tablet 258dc29e4e4245289b7e450837edcd24) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:47.680564 896 tablet_service.cc:1511] Processing CreateTablet for tablet a609383cc8c94e92bf384a575688abbd (DEFAULT_TABLE table=default.Table_8290ddf883774684b025ecb0a89e7e3c [id=e663ecb375294692a9d1941062bf6d10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.704913 904 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bb381f10d87414f9c1a99942216adc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:47.705188 898 tablet_service.cc:1558] Processing DeleteTablet for tablet b317cc133346412fb981b1c8e5b99c4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:47.695396 907 tablet_service.cc:1511] Processing CreateTablet for tablet 88f0c3233ac945b4ac8383ff7342e446 (DEFAULT_TABLE table=default.Table_274158734fea47acba9c6794bed6975c [id=58c74f1480524850b913044e32aab247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.715324 2764 raft_consensus.cc:493] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.829691 2764 raft_consensus.cc:515] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.777436 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a17ef7cfee4d65808b11e9cb51e7df" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:47.789978 895 tablet_service.cc:1558] Processing DeleteTablet for tablet dd97103da8924a4583cf5fe300073446 with delete_type TABLET_DATA_DELETED (replaced by tablet b770b09798a6433daf9ec06128dee689) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:47.830313 2764 leader_election.cc:290] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:47.790505 899 tablet_service.cc:1558] Processing DeleteTablet for tablet 17699eee74be4698b84ee6f604aec41a with delete_type TABLET_DATA_DELETED (replaced by tablet 8dbaa63491ba4ad1b863f4417e3d2e40) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:47.831195 719 leader_election.cc:343] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:47.831276 860 leader_election.cc:343] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 2ebcf120100349319d27615b6e0c7550
I20260318 02:51:47.831312 719 leader_election.cc:304] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:47.831694 2660 raft_consensus.cc:2749] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:47.832047 862 leader_election.cc:343] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2ebcf120100349319d27615b6e0c7550
I20260318 02:51:47.832139 862 leader_election.cc:304] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:47.680315 892 tablet_service.cc:1511] Processing CreateTablet for tablet d25ee8cba8024edc930149450ad2eeb6 (DEFAULT_TABLE table=default.Table_ffb878be775b445d9cb1a9b6e6a3c1f8 [id=2d731b833c1745d5a51011290a5866c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.680866 900 tablet_service.cc:1511] Processing CreateTablet for tablet a9c897f36569422aa0b1f2094b25587c (DEFAULT_TABLE table=default.Table_443be3a1959546e3a1a362232f473064 [id=41006675286f4e8a9707b108705389f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:47.829560 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a609383cc8c94e92bf384a575688abbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.834827 2764 raft_consensus.cc:2749] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:47.836860 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9c897f36569422aa0b1f2094b25587c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.840828 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88f0c3233ac945b4ac8383ff7342e446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.846853 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25ee8cba8024edc930149450ad2eeb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:47.636772 1173 ts_tablet_manager.cc:1434] T 7e6f40a5d3f14a779c26d73bf58f302b P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:47.850612 1173 tablet_bootstrap.cc:492] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:47.864240 1174 ts_tablet_manager.cc:1434] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.237s user 0.002s sys 0.000s
I20260318 02:51:47.865517 1174 tablet_bootstrap.cc:492] T 565add8c21f343f2b11c12a9bb7ff111 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:47.866452 2704 raft_consensus.cc:2243] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:47.866639 2704 raft_consensus.cc:2272] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:47.867162 2704 ts_tablet_manager.cc:1916] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:47.797528 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b894f0772a754196a3e651b38c46f001" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:47.873275 2704 ts_tablet_manager.cc:1929] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:47.873397 2704 log.cc:1199] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/d3b37df330984378b81b367446d34748
I20260318 02:51:47.873669 2704 ts_tablet_manager.cc:1950] T d3b37df330984378b81b367446d34748 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:47.874895 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet d3b37df330984378b81b367446d34748 (table default.Table_fe927bc33c094a8bbec3557ad85c8e15 [id=ee1d866cd2674882bf473a546725ff76]) successfully deleted
I20260318 02:51:47.875290 2704 tablet_replica.cc:333] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:47.875526 2704 raft_consensus.cc:2243] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:47.879266 997 leader_election.cc:343] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.879431 997 leader_election.cc:304] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:47.880465 2614 raft_consensus.cc:2749] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:47.884407 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 8b715c5a31ba4515996595de89f1d62c
I20260318 02:51:47.884958 450 catalog_manager.cc:6741] ReplaceTablet: tablet 8b715c5a31ba4515996595de89f1d62c deleted and replaced by tablet 7cae709e0915495e96177beffb910b01
I20260318 02:51:47.886900 450 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 7e6f40a5d3f14a779c26d73bf58f302b (table default.Table_91e64c048d4048168906fcd3d1a5b3d0 [id=05445eb067cb46a5803415774772c91e]). Expected version 2 got 0
I20260318 02:51:47.887696 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a886da56344648d48d38d83f4d8c1986"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:47.888303 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a886da56344648d48d38d83f4d8c1986 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:47.888903 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f5784c1c633045eaba000b7f0ea137c0
I20260318 02:51:47.889582 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_119e7456847d4df99177b395cc26fcc4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:47.890132 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_119e7456847d4df99177b395cc26fcc4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:47.891749 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 71ea229381d540fdae9b2d7bf3eac2b6
I20260318 02:51:47.892409 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_2f58164571244099848c2984bd08ef81" } new_table_name: "default.Table_efaa800f4855410e821d931040ec96f8" modify_external_catalogs: true
I20260318 02:51:47.895493 759 tablet_service.cc:1558] Processing DeleteTablet for tablet f5784c1c633045eaba000b7f0ea137c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:47 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:47.895750 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 71ea229381d540fdae9b2d7bf3eac2b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:47 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:47.896924 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b715c5a31ba4515996595de89f1d62c with delete_type TABLET_DATA_DELETED (replaced by tablet 7cae709e0915495e96177beffb910b01) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:47.901248 2660 raft_consensus.cc:493] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.901403 2660 raft_consensus.cc:515] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.902290 2660 leader_election.cc:290] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:47.903290 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b55cf85d7842e59f0ed92aecdcd5d0" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:47.903543 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b55cf85d7842e59f0ed92aecdcd5d0" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:47.904161 719 leader_election.cc:343] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:47.904582 719 leader_election.cc:343] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:47.904678 719 leader_election.cc:304] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:47.905110 2660 raft_consensus.cc:2749] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:47.917791 1174 tablet_bootstrap.cc:654] T 565add8c21f343f2b11c12a9bb7ff111 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.918877 1173 tablet_bootstrap.cc:654] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.925740 1172 tablet_bootstrap.cc:492] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:47.925904 1172 ts_tablet_manager.cc:1403] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.308s user 0.030s sys 0.060s
I20260318 02:51:47.926721 1172 raft_consensus.cc:359] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:47.926997 1172 raft_consensus.cc:385] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.927052 1172 raft_consensus.cc:740] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.927237 1172 consensus_queue.cc:260] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:47.927738 1172 ts_tablet_manager.cc:1434] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:47.928020 1172 tablet_bootstrap.cc:492] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:47.929225 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 17699eee74be4698b84ee6f604aec41a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17699eee74be4698b84ee6f604aec41a already in progress: creating tablet
W20260318 02:51:47.929443 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet dd97103da8924a4583cf5fe300073446 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd97103da8924a4583cf5fe300073446 already in progress: creating tablet
I20260318 02:51:47.930140 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b715c5a31ba4515996595de89f1d62c with delete_type TABLET_DATA_DELETED (replaced by tablet 7cae709e0915495e96177beffb910b01) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:47.930382 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b715c5a31ba4515996595de89f1d62c with delete_type TABLET_DATA_DELETED (replaced by tablet 7cae709e0915495e96177beffb910b01) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:47.931538 900 tablet_service.cc:1558] Processing DeleteTablet for tablet f5784c1c633045eaba000b7f0ea137c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:47 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:47.931979 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet f5784c1c633045eaba000b7f0ea137c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:47 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:47.932484 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 71ea229381d540fdae9b2d7bf3eac2b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:47 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:47.932823 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 71ea229381d540fdae9b2d7bf3eac2b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:47 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:47.933629 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 8b715c5a31ba4515996595de89f1d62c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b715c5a31ba4515996595de89f1d62c already in progress: creating tablet
W20260318 02:51:47.933832 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f5784c1c633045eaba000b7f0ea137c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5784c1c633045eaba000b7f0ea137c0 already in progress: creating tablet
W20260318 02:51:47.934000 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 71ea229381d540fdae9b2d7bf3eac2b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71ea229381d540fdae9b2d7bf3eac2b6 already in progress: creating tablet
I20260318 02:51:47.937002 1172 tablet_bootstrap.cc:654] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.951749 2764 raft_consensus.cc:493] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:47.951920 2764 raft_consensus.cc:515] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:47.952347 449 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_676a667361dd4f23afbda31df87958fb [id=831b3293b7eb44c6acb5de02d0769c1d] alter complete (version 2)
I20260318 02:51:47.952551 2764 leader_election.cc:290] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:47.953358 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7e83a50e6b984e6c980fbbbf0ea38c05" } new_table_name: "default.Table_4d73d25d095f4d1abe8974c255baf5e7" modify_external_catalogs: true
W20260318 02:51:47.953769 860 leader_election.cc:343] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 9777963ff20c4a799de2870555f6b335
W20260318 02:51:47.954557 862 leader_election.cc:343] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 9777963ff20c4a799de2870555f6b335
I20260318 02:51:47.954654 862 leader_election.cc:304] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:47.954875 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_4976f48030094963afeecc3ae6c7e9b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:47.955015 2764 raft_consensus.cc:2749] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:47.955380 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4976f48030094963afeecc3ae6c7e9b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:47.956868 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4a368894951942b7be9928e9781a7378" } new_table_name: "default.Table_f204abd79d7c4f6180c829e2867e7b2e" modify_external_catalogs: true
I20260318 02:51:47.958906 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet f2c7972bf42744699012425706ac4667
I20260318 02:51:47.959636 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b397b2200ec7443fba6e48e178f2e4ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:47.960140 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b397b2200ec7443fba6e48e178f2e4ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:47.961364 1175 ts_tablet_manager.cc:1929] T 49afed40c7aa4f2d913daed8055a098e P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:47.961484 1175 log.cc:1199] T 49afed40c7aa4f2d913daed8055a098e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/49afed40c7aa4f2d913daed8055a098e
I20260318 02:51:47.961943 1175 ts_tablet_manager.cc:1950] T 49afed40c7aa4f2d913daed8055a098e P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:47.962086 749 tablet_service.cc:1558] Processing DeleteTablet for tablet f2c7972bf42744699012425706ac4667 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:47 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:47.962255 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1328) took 1063 ms. Trace:
I20260318 02:51:47.962329 1175 rpcz_store.cc:276] 0318 02:51:46.898622 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:46.898670 (+ 48us) service_pool.cc:225] Handling call
0318 02:51:47.599943 (+701273us) ts_tablet_manager.cc:1151] Deleting tablet 49afed40c7aa4f2d913daed8055a098e
0318 02:51:47.599954 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:47.604081 (+ 4127us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:47.961229 (+357148us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:47.962236 (+ 1007us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":701104}
I20260318 02:51:47.962520 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet bfdb59b3a53a447eab72947d1bbdb5bb
I20260318 02:51:47.962811 1175 tablet_replica.cc:333] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:47.962994 1175 raft_consensus.cc:2243] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:47.963155 1175 raft_consensus.cc:2272] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:47.963310 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0211c18d42094a2189c21f03e04ea384"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:47.963708 1175 ts_tablet_manager.cc:1916] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:47.963902 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0211c18d42094a2189c21f03e04ea384 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:47.966636 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_56beb1ca03424d678071acc86399a892" } new_table_name: "default.Table_c30aa0c720704109b154c9314d028fc0" modify_external_catalogs: true
I20260318 02:51:47.970873 1174 tablet_bootstrap.cc:492] T 565add8c21f343f2b11c12a9bb7ff111 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:47.971019 1174 ts_tablet_manager.cc:1403] T 565add8c21f343f2b11c12a9bb7ff111 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.106s user 0.003s sys 0.000s
I20260318 02:51:47.971760 1174 raft_consensus.cc:359] T 565add8c21f343f2b11c12a9bb7ff111 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:47.971932 1174 raft_consensus.cc:385] T 565add8c21f343f2b11c12a9bb7ff111 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.971980 1174 raft_consensus.cc:740] T 565add8c21f343f2b11c12a9bb7ff111 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.972162 1174 consensus_queue.cc:260] T 565add8c21f343f2b11c12a9bb7ff111 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:47.972963 749 tablet_service.cc:1558] Processing DeleteTablet for tablet bfdb59b3a53a447eab72947d1bbdb5bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:47 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:47.973115 1174 ts_tablet_manager.cc:1434] T 565add8c21f343f2b11c12a9bb7ff111 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:47.973364 1174 tablet_bootstrap.cc:492] T 8b715c5a31ba4515996595de89f1d62c P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:47.976454 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bf6517e55af54c3dae05ed6bceaa7638 consensus state has no leader
I20260318 02:51:47.977594 1173 tablet_bootstrap.cc:492] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:47.977741 1173 ts_tablet_manager.cc:1403] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.127s user 0.004s sys 0.000s
I20260318 02:51:47.978487 1173 raft_consensus.cc:359] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:47.978660 1173 raft_consensus.cc:385] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:47.978714 1173 raft_consensus.cc:740] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:47.978962 1173 consensus_queue.cc:260] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:47.980276 1173 ts_tablet_manager.cc:1434] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:47.981178 1173 tablet_bootstrap.cc:492] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:47.983911 1173 tablet_bootstrap.cc:654] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:47.987412 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet f2c7972bf42744699012425706ac4667 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:47 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:47.988511 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet bfdb59b3a53a447eab72947d1bbdb5bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:47 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:47.989758 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:47.989979 1184 tablet_replica.cc:333] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:47.990162 1184 raft_consensus.cc:2243] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:47.990302 1184 raft_consensus.cc:2272] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:47.990814 1184 ts_tablet_manager.cc:1916] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:47.997784 1184 ts_tablet_manager.cc:1929] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:47.999059 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 49afed40c7aa4f2d913daed8055a098e (table default.Table_8e1825ed6ac14c60b72e23cbbce1b677 [id=df327d7be3fc46d0b969529acb5684c5]) successfully deleted
I20260318 02:51:47.998544 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 2dab268da5e843cab5c28a521217df97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:48.000047 2152 raft_consensus.cc:493] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.001319 2152 raft_consensus.cc:515] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.001991 2152 leader_election.cc:290] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:48.002475 1184 log.cc:1199] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/6a65ccfd73234e8fb2bea5b6911cb3f1
I20260318 02:51:48.003162 1184 ts_tablet_manager.cc:1950] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:48.006708 1184 tablet_replica.cc:333] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:48.006991 1184 raft_consensus.cc:2243] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.007295 1184 raft_consensus.cc:2272] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.007246 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c05f7a75527410e9c5cde0dbc6bc10e" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:48.007434 779 raft_consensus.cc:2468] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:48.007910 1184 ts_tablet_manager.cc:1916] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.009868 999 leader_election.cc:304] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:48.010111 2152 raft_consensus.cc:2804] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:48.010177 2152 raft_consensus.cc:493] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:48.010232 2152 raft_consensus.cc:3060] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:48.012893 2152 raft_consensus.cc:515] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.013984 2152 leader_election.cc:290] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:48.014963 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c05f7a75527410e9c5cde0dbc6bc10e" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:48.015127 777 raft_consensus.cc:3060] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:48.017453 2665 consensus_queue.cc:1048] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:48.017726 777 raft_consensus.cc:2468] T 9c05f7a75527410e9c5cde0dbc6bc10e P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:48.018270 999 leader_election.cc:304] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:48.018517 2665 raft_consensus.cc:2804] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:48.018615 2665 raft_consensus.cc:697] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:48.018841 2665 consensus_queue.cc:237] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.024065 1172 tablet_bootstrap.cc:492] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:48.025193 1172 ts_tablet_manager.cc:1403] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.097s user 0.005s sys 0.000s
I20260318 02:51:48.026321 1172 raft_consensus.cc:359] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.031731 1172 raft_consensus.cc:385] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.032088 1172 raft_consensus.cc:740] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.036123 1172 consensus_queue.cc:260] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.027611 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 824b9dc6982f425c9518c0ea3560bf84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:48.037058 1172 ts_tablet_manager.cc:1434] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260318 02:51:48.038401 1172 tablet_bootstrap.cc:492] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:48.050096 443 consensus_peers.cc:597] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a -> Peer 971baf5b9e4644c990dbf4d4fc7ba900 (127.0.104.188:41593): Couldn't send request to peer 971baf5b9e4644c990dbf4d4fc7ba900. Status: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260318 02:51:48.051467 2660 raft_consensus.cc:493] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.051712 2660 raft_consensus.cc:515] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.052388 2660 leader_election.cc:290] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:48.053651 1174 tablet_bootstrap.cc:654] T 8b715c5a31ba4515996595de89f1d62c P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.055811 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306367152e834668bbf5fcadd008b3ea" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:48.056420 719 leader_election.cc:343] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.056668 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306367152e834668bbf5fcadd008b3ea" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:48.057201 719 leader_election.cc:343] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.057317 719 leader_election.cc:304] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:48.057700 2660 raft_consensus.cc:2749] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.068068 1172 tablet_bootstrap.cc:654] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.071458 1174 tablet_bootstrap.cc:492] T 8b715c5a31ba4515996595de89f1d62c P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:48.071626 1174 ts_tablet_manager.cc:1403] T 8b715c5a31ba4515996595de89f1d62c P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.098s user 0.002s sys 0.001s
I20260318 02:51:48.072429 1174 raft_consensus.cc:359] T 8b715c5a31ba4515996595de89f1d62c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.072611 1174 raft_consensus.cc:385] T 8b715c5a31ba4515996595de89f1d62c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.072659 1174 raft_consensus.cc:740] T 8b715c5a31ba4515996595de89f1d62c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.072881 1174 consensus_queue.cc:260] T 8b715c5a31ba4515996595de89f1d62c P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.073362 1174 ts_tablet_manager.cc:1434] T 8b715c5a31ba4515996595de89f1d62c P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:48.073757 1174 tablet_bootstrap.cc:492] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:48.074383 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c05f7a75527410e9c5cde0dbc6bc10e" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:48.074746 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c05f7a75527410e9c5cde0dbc6bc10e" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:48.075027 907 tablet_service.cc:1558] Processing DeleteTablet for tablet bfdb59b3a53a447eab72947d1bbdb5bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:47 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:48.080822 900 tablet_service.cc:1558] Processing DeleteTablet for tablet f2c7972bf42744699012425706ac4667 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:47 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:48.082873 997 leader_election.cc:343] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:48.083227 997 leader_election.cc:343] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:48.083489 997 consensus_peers.cc:597] T 6e2a586892a24c71a956dbbe382484c9 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:48.088055 927 raft_consensus.cc:3060] T d7f21df58fac437da5747becfa3f28b4 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:48.090106 1175 ts_tablet_manager.cc:1929] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.090210 1175 log.cc:1199] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/64c2a579264e43b9a1e25ded000d4d9f
I20260318 02:51:48.090472 1175 ts_tablet_manager.cc:1950] T 64c2a579264e43b9a1e25ded000d4d9f P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:48.094833 2820 tablet.cc:1723] T d7f21df58fac437da5747becfa3f28b4 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:48.095309 1173 tablet_bootstrap.cc:492] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:48.095461 1173 ts_tablet_manager.cc:1403] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.115s user 0.000s sys 0.003s
I20260318 02:51:48.096259 1173 raft_consensus.cc:359] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.096441 1173 raft_consensus.cc:385] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.096499 1173 raft_consensus.cc:740] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.096747 1173 consensus_queue.cc:260] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.097386 1173 ts_tablet_manager.cc:1434] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:48.097924 1173 tablet_bootstrap.cc:492] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:48.104555 1174 tablet_bootstrap.cc:654] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.108577 2764 raft_consensus.cc:493] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.108759 2764 raft_consensus.cc:515] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:48.109390 2764 leader_election.cc:290] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:48.112641 860 leader_election.cc:343] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: f37ab96f13444fcbb5cfc3ad92d53c35
W20260318 02:51:48.114092 862 leader_election.cc:343] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: f37ab96f13444fcbb5cfc3ad92d53c35
I20260318 02:51:48.114231 862 leader_election.cc:304] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:48.114696 2764 raft_consensus.cc:2749] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.115638 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1329) took 1216 ms. Trace:
I20260318 02:51:48.115793 1175 rpcz_store.cc:276] 0318 02:51:46.899156 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:46.899203 (+ 47us) service_pool.cc:225] Handling call
0318 02:51:47.962753 (+1063550us) ts_tablet_manager.cc:1151] Deleting tablet 64c2a579264e43b9a1e25ded000d4d9f
0318 02:51:47.962763 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:47.966703 (+ 3940us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:48.089993 (+123290us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:48.115620 (+ 25627us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1063398}
I20260318 02:51:48.116376 1175 tablet_replica.cc:333] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:48.116638 1175 raft_consensus.cc:2243] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.116882 1175 raft_consensus.cc:2272] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.117697 1175 ts_tablet_manager.cc:1916] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.117069 1173 tablet_bootstrap.cc:654] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.144570 1172 tablet_bootstrap.cc:492] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:48.144901 1172 ts_tablet_manager.cc:1403] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.107s user 0.003s sys 0.001s
I20260318 02:51:48.145924 1172 raft_consensus.cc:359] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.146188 1172 raft_consensus.cc:385] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.146282 1172 raft_consensus.cc:740] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.146584 1172 consensus_queue.cc:260] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.148173 1172 ts_tablet_manager.cc:1434] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:48.161444 1184 ts_tablet_manager.cc:1929] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.161723 1184 log.cc:1199] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/2dab268da5e843cab5c28a521217df97
I20260318 02:51:48.162137 1184 ts_tablet_manager.cc:1950] T 2dab268da5e843cab5c28a521217df97 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:48.167407 1174 tablet_bootstrap.cc:492] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:48.167601 1174 ts_tablet_manager.cc:1403] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.094s user 0.004s sys 0.000s
I20260318 02:51:48.168424 1174 raft_consensus.cc:359] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.168640 1174 raft_consensus.cc:385] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.168732 1174 raft_consensus.cc:740] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.170149 1172 tablet_bootstrap.cc:492] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:48.175254 1184 tablet_replica.cc:333] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:48.175612 1184 raft_consensus.cc:2243] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.175856 1184 raft_consensus.cc:2272] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.176481 1184 ts_tablet_manager.cc:1916] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.179481 2704 raft_consensus.cc:2272] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:48.181625 441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 182576us
I20260318 02:51:48.182394 1174 consensus_queue.cc:260] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.183497 1174 ts_tablet_manager.cc:1434] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260318 02:51:48.183871 1174 tablet_bootstrap.cc:492] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:48.185683 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8845dbc4ad3a499bb77aa9b6e24b554d consensus state has no leader
I20260318 02:51:48.186106 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_db9fecb248a5432e8f68d134c6bc0a65"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:48.186813 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db9fecb248a5432e8f68d134c6bc0a65 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:48.189706 1173 tablet_bootstrap.cc:492] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:48.189853 1173 ts_tablet_manager.cc:1403] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.092s user 0.003s sys 0.001s
I20260318 02:51:48.190555 1173 raft_consensus.cc:359] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.190716 1173 raft_consensus.cc:385] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.190763 1173 raft_consensus.cc:740] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.190992 1173 consensus_queue.cc:260] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.192202 454 catalog_manager.cc:5671] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:48.192548 454 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 895aa252b9f243d89e972d1b717ee910 (table default.Table_2afe66e6b2374e3c9b8e4692abb54d07 [id=6f9eb9fbda9846d495f3e70e229a5590]). Expected version 1 got 0
I20260318 02:51:48.192938 1173 ts_tablet_manager.cc:1434] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:48.193526 1173 tablet_bootstrap.cc:492] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:48.193531 927 raft_consensus.cc:3060] T 7e6f40a5d3f14a779c26d73bf58f302b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:48.194679 749 tablet_service.cc:1511] Processing CreateTablet for tablet 88d1146de5cb467f8f4cf476c633957e (DEFAULT_TABLE table=default.Table_3d116ef2f5d54b9eb9f9bdb405ec8d50 [id=ff679c8e0e054297853ae74736a39b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.195084 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d1146de5cb467f8f4cf476c633957e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.197206 453 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_d5ddb641ef9245ca92ab35d8ac25b157 [id=fb45f238426142faa79cbe89242c7418] alter complete (version 1)
I20260318 02:51:48.197361 2704 ts_tablet_manager.cc:1916] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.197631 2835 raft_consensus.cc:493] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.197758 2835 raft_consensus.cc:515] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.198349 2835 leader_election.cc:290] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:48.198945 759 tablet_service.cc:1558] Processing DeleteTablet for tablet 77a17ef7cfee4d65808b11e9cb51e7df with delete_type TABLET_DATA_DELETED (replaced by tablet a6edb840adc6464cadfe58a98d51b5ff) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:48.199000 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 4052eede3f404b84ac27e21a204bf5a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:48.199683 762 tablet_service.cc:1558] Processing DeleteTablet for tablet defda79dd0f34c37ae16ea808df0754b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:48.199864 758 tablet_service.cc:1558] Processing DeleteTablet for tablet f5b55cf85d7842e59f0ed92aecdcd5d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:48.200433 1174 tablet_bootstrap.cc:654] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.202694 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 306367152e834668bbf5fcadd008b3ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:48.202868 2764 raft_consensus.cc:493] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.202997 2764 raft_consensus.cc:515] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.203596 2764 leader_election.cc:290] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:48.203955 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1284c6e90d4beb8223fd807d7888ec" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:48.204540 999 leader_election.cc:343] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: fd1284c6e90d4beb8223fd807d7888ec
I20260318 02:51:48.204540 753 tablet_service.cc:1511] Processing CreateTablet for tablet 5547cbe97d7143049f5e7b7838c3448e (DEFAULT_TABLE table=default.Table_183266f4fcdc4cf6a58bb6bc48fb33d3 [id=24206cbac1444b7e9a221df20159e2d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.204941 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5547cbe97d7143049f5e7b7838c3448e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:48.204938 997 leader_election.cc:343] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.205044 997 leader_election.cc:304] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:48.205034 860 leader_election.cc:343] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 6bb381f10d87414f9c1a99942216adc7
W20260318 02:51:48.205580 862 leader_election.cc:343] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 6bb381f10d87414f9c1a99942216adc7
I20260318 02:51:48.205689 862 leader_election.cc:304] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:48.205914 2764 raft_consensus.cc:2749] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.207809 1175 ts_tablet_manager.cc:1929] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.208056 1175 log.cc:1199] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/783c886a99994d6c8d9add724277819a
I20260318 02:51:48.208493 1175 ts_tablet_manager.cc:1950] T 783c886a99994d6c8d9add724277819a P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:48.208983 2835 raft_consensus.cc:2749] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.211009 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1326) took 1313 ms. Trace:
I20260318 02:51:48.211110 1175 rpcz_store.cc:276] 0318 02:51:46.897736 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:46.899490 (+ 1754us) service_pool.cc:225] Handling call
0318 02:51:48.116327 (+1216837us) ts_tablet_manager.cc:1151] Deleting tablet 783c886a99994d6c8d9add724277819a
0318 02:51:48.116338 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:48.163691 (+ 47353us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:48.166486 (+ 2795us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:48.210989 (+ 44503us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1216622}
I20260318 02:51:48.211442 1175 tablet_replica.cc:333] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:48.211642 1175 raft_consensus.cc:2243] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.211826 1175 raft_consensus.cc:2272] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.211845 451 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet c58290c2d1c742d3b45dfb5caf52c75b (table default.Table_944521fea0294e3381643693804fd723 [id=18d79b10f75b43efa4946ca8979a4235]). Expected version 1 got 0
I20260318 02:51:48.212397 1175 ts_tablet_manager.cc:1916] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.214113 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 565add8c21f343f2b11c12a9bb7ff111 with delete_type TABLET_DATA_DELETED (replaced by tablet 036c17d033b145a681843d14f67ab575) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:48.214121 762 tablet_service.cc:1558] Processing DeleteTablet for tablet 3291ecec94e642e3a995a2d7006619e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:48.217666 1173 tablet_bootstrap.cc:654] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.218461 1172 tablet_bootstrap.cc:654] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.218463 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ab58e545a9bc4de9831cbc9029078cee" } new_table_name: "default.Table_7a7e4c39ac994735a3d20036c4c46632" modify_external_catalogs: true
I20260318 02:51:48.225114 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1ebda2302f8b4849ab927606afe18f58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:48.225698 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ebda2302f8b4849ab927606afe18f58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:48.227727 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_be1eed0aeb674672b865ed49c2e3b89a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:48.228163 2704 ts_tablet_manager.cc:1929] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.228291 2704 log.cc:1199] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/5a92761edfe74a9798da4d93964383ea
W20260318 02:51:48.228267 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be1eed0aeb674672b865ed49c2e3b89a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:48.228582 2704 ts_tablet_manager.cc:1950] T 5a92761edfe74a9798da4d93964383ea P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:48.229882 762 tablet_service.cc:1511] Processing CreateTablet for tablet 50e794ae929b4902922e17c4d2181f99 (DEFAULT_TABLE table=default.Table_7e04ba863ea34e95854d94b4a8b7caaf [id=2fb7078eed2e48c78895106dfedc0f41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.230265 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e794ae929b4902922e17c4d2181f99. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:48.230379 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet f2c7972bf42744699012425706ac4667 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2c7972bf42744699012425706ac4667 already in progress: creating tablet
W20260318 02:51:48.230644 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet bfdb59b3a53a447eab72947d1bbdb5bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfdb59b3a53a447eab72947d1bbdb5bb already in progress: creating tablet
I20260318 02:51:48.230770 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 (table default.Table_ce996d68b1144b3aa44ab9618af7d43e [id=aa309b4ad7d6425d853518c95e0e0461]) successfully deleted
I20260318 02:51:48.230894 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 2dab268da5e843cab5c28a521217df97 (table default.Table_c6d53ff287654d37b638cd812b89127f [id=b8168c5ff40940f4ad3d544513810e9b]) successfully deleted
I20260318 02:51:48.231005 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 64c2a579264e43b9a1e25ded000d4d9f (table default.Table_c662869530134cb08ab6cc52957d07d9 [id=fda071b90fe64716b46fd1ab46f4b934]) successfully deleted
I20260318 02:51:48.231122 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 783c886a99994d6c8d9add724277819a (table default.Table_cfd83086efd94aeeac453573d0c9350b [id=f1416944463a4ad98086e63fe84cf76f]) successfully deleted
I20260318 02:51:48.231994 900 tablet_service.cc:1511] Processing CreateTablet for tablet 88d1146de5cb467f8f4cf476c633957e (DEFAULT_TABLE table=default.Table_3d116ef2f5d54b9eb9f9bdb405ec8d50 [id=ff679c8e0e054297853ae74736a39b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.232196 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 88d1146de5cb467f8f4cf476c633957e (DEFAULT_TABLE table=default.Table_3d116ef2f5d54b9eb9f9bdb405ec8d50 [id=ff679c8e0e054297853ae74736a39b72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.232579 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d1146de5cb467f8f4cf476c633957e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.233022 1174 tablet_bootstrap.cc:492] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:48.233165 1174 ts_tablet_manager.cc:1403] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.049s user 0.005s sys 0.000s
I20260318 02:51:48.235466 1174 raft_consensus.cc:359] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.235651 1174 raft_consensus.cc:385] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.235704 1174 raft_consensus.cc:740] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.235968 1174 consensus_queue.cc:260] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.236210 758 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe2acbe35174209afe1c37eeb4f8d3a (DEFAULT_TABLE table=default.Table_d4e06073c326433daaa437bbe54e3f55 [id=fc99230e980347fcbebcd99488c24c8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.236567 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe2acbe35174209afe1c37eeb4f8d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.237370 1174 ts_tablet_manager.cc:1434] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:48.240101 1175 ts_tablet_manager.cc:1929] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.240216 1175 log.cc:1199] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/184ce58aa96d4e70ad7b2783f19ccdeb
I20260318 02:51:48.240490 1175 ts_tablet_manager.cc:1950] T 184ce58aa96d4e70ad7b2783f19ccdeb P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:48.241127 1174 tablet_bootstrap.cc:492] T d26c7c573c40412f88b9c6cc71a3c648 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:48.242628 1172 tablet_bootstrap.cc:492] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:48.242781 1172 ts_tablet_manager.cc:1403] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.074s user 0.002s sys 0.001s
I20260318 02:51:48.243515 1172 raft_consensus.cc:359] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.243683 1172 raft_consensus.cc:385] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.243741 1172 raft_consensus.cc:740] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.245747 1173 tablet_bootstrap.cc:492] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:48.245918 1173 ts_tablet_manager.cc:1403] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.003s
I20260318 02:51:48.246733 1173 raft_consensus.cc:359] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.246910 2704 tablet_replica.cc:333] T 8b715c5a31ba4515996595de89f1d62c P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:48.246913 1173 raft_consensus.cc:385] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.246969 1173 raft_consensus.cc:740] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.246995 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 5a92761edfe74a9798da4d93964383ea (table default.Table_8b91091dce7d43b9b2abf2ef5262b12c [id=519eccded71a4f229484640ce6c21a89]) successfully deleted
I20260318 02:51:48.247191 1173 consensus_queue.cc:260] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:48.247298 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 17699eee74be4698b84ee6f604aec41a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17699eee74be4698b84ee6f604aec41a already in progress: creating tablet
W20260318 02:51:48.247462 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet dd97103da8924a4583cf5fe300073446 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd97103da8924a4583cf5fe300073446 already in progress: creating tablet
W20260318 02:51:48.247586 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f5784c1c633045eaba000b7f0ea137c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5784c1c633045eaba000b7f0ea137c0 already in progress: creating tablet
W20260318 02:51:48.247711 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 71ea229381d540fdae9b2d7bf3eac2b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71ea229381d540fdae9b2d7bf3eac2b6 already in progress: creating tablet
I20260318 02:51:48.247890 1173 ts_tablet_manager.cc:1434] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:48.249464 2704 raft_consensus.cc:2243] T 8b715c5a31ba4515996595de89f1d62c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.249650 2704 raft_consensus.cc:2272] T 8b715c5a31ba4515996595de89f1d62c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.250479 1174 tablet_bootstrap.cc:654] T d26c7c573c40412f88b9c6cc71a3c648 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.250813 2660 raft_consensus.cc:493] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.250950 2660 raft_consensus.cc:515] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.251183 1172 consensus_queue.cc:260] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.251525 2660 leader_election.cc:290] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:48.252961 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291ecec94e642e3a995a2d7006619e7" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:48.253963 719 leader_election.cc:343] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.255048 1172 ts_tablet_manager.cc:1434] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260318 02:51:48.255585 1172 tablet_bootstrap.cc:492] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:48.257653 1172 tablet_bootstrap.cc:654] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.261107 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291ecec94e642e3a995a2d7006619e7" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:48.261801 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1330) took 1261 ms. Trace:
W20260318 02:51:48.261796 719 leader_election.cc:343] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.261911 719 leader_election.cc:304] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:48.262276 2660 raft_consensus.cc:2749] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.262251 1175 rpcz_store.cc:276] 0318 02:51:47.000289 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:47.000351 (+ 62us) service_pool.cc:225] Handling call
0318 02:51:48.211398 (+1211047us) ts_tablet_manager.cc:1151] Deleting tablet 184ce58aa96d4e70ad7b2783f19ccdeb
0318 02:51:48.211407 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:48.215331 (+ 3924us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:48.239997 (+ 24666us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:48.261785 (+ 21788us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1210853}
I20260318 02:51:48.262583 1175 tablet_replica.cc:333] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:48.262753 1175 raft_consensus.cc:2243] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.262898 1175 raft_consensus.cc:2272] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.262192 1173 tablet_bootstrap.cc:492] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:48.264394 749 tablet_service.cc:1511] Processing CreateTablet for tablet 43d6382684d84c9dbab108d8dc9d0176 (DEFAULT_TABLE table=default.Table_f388a339b3c044c7a02d829be6a973f2 [id=6d058440c65d44b78d0248a4e627010f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.265125 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43d6382684d84c9dbab108d8dc9d0176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.270040 1173 tablet_bootstrap.cc:654] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.272351 907 tablet_service.cc:1511] Processing CreateTablet for tablet 5547cbe97d7143049f5e7b7838c3448e (DEFAULT_TABLE table=default.Table_183266f4fcdc4cf6a58bb6bc48fb33d3 [id=24206cbac1444b7e9a221df20159e2d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.273602 1175 ts_tablet_manager.cc:1916] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.259315 2835 consensus_queue.cc:1048] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:48.260113 2831 raft_consensus.cc:493] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.275038 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 5547cbe97d7143049f5e7b7838c3448e (DEFAULT_TABLE table=default.Table_183266f4fcdc4cf6a58bb6bc48fb33d3 [id=24206cbac1444b7e9a221df20159e2d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.275482 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5547cbe97d7143049f5e7b7838c3448e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.276889 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d1146de5cb467f8f4cf476c633957e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.277055 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5547cbe97d7143049f5e7b7838c3448e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.275013 2831 raft_consensus.cc:515] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:48.282173 2831 leader_election.cc:290] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
W20260318 02:51:48.283425 999 leader_election.cc:343] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: ce82c595e30a4878be25be8eb3d30790
I20260318 02:51:48.283610 2704 ts_tablet_manager.cc:1916] T 8b715c5a31ba4515996595de89f1d62c P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.284405 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce82c595e30a4878be25be8eb3d30790" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:48.284969 997 leader_election.cc:343] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.285099 997 leader_election.cc:304] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:48.285336 2831 raft_consensus.cc:2749] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.294401 2820 tablet.cc:1723] T 7e6f40a5d3f14a779c26d73bf58f302b P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260318 02:51:48.298924 2831 raft_consensus.cc:493] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.299116 2831 raft_consensus.cc:515] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.299786 2831 leader_election.cc:290] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:48.300788 1174 tablet_bootstrap.cc:492] T d26c7c573c40412f88b9c6cc71a3c648 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:48.300931 1174 ts_tablet_manager.cc:1403] T d26c7c573c40412f88b9c6cc71a3c648 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.060s user 0.004s sys 0.000s
I20260318 02:51:48.301172 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b01131720748688ca6c28985a3b3ff" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:48.301638 1174 raft_consensus.cc:359] T d26c7c573c40412f88b9c6cc71a3c648 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.301798 1174 raft_consensus.cc:385] T d26c7c573c40412f88b9c6cc71a3c648 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260318 02:51:48.301759 999 leader_election.cc:343] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: d0b01131720748688ca6c28985a3b3ff
I20260318 02:51:48.301846 1174 raft_consensus.cc:740] T d26c7c573c40412f88b9c6cc71a3c648 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.302057 1174 consensus_queue.cc:260] T d26c7c573c40412f88b9c6cc71a3c648 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:48.302230 997 leader_election.cc:343] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.302321 997 leader_election.cc:304] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:48.302551 1174 ts_tablet_manager.cc:1434] T d26c7c573c40412f88b9c6cc71a3c648 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:48.302847 1174 tablet_bootstrap.cc:492] T 5f63108c062348b1ba995ea16f40a695 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:48.303072 2831 raft_consensus.cc:2749] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.305061 1174 tablet_bootstrap.cc:654] T 5f63108c062348b1ba995ea16f40a695 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:48.313223 997 consensus_peers.cc:597] T 453a1c6f16194cab91c0223e2eeda7ab P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:48.316552 1175 ts_tablet_manager.cc:1929] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.319622 1173 tablet_bootstrap.cc:492] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:48.319784 1173 ts_tablet_manager.cc:1403] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.000s
I20260318 02:51:48.320839 1173 raft_consensus.cc:359] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.321022 1173 raft_consensus.cc:385] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.321067 1173 raft_consensus.cc:740] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.321309 1173 consensus_queue.cc:260] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.322736 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 50e794ae929b4902922e17c4d2181f99 (DEFAULT_TABLE table=default.Table_7e04ba863ea34e95854d94b4a8b7caaf [id=2fb7078eed2e48c78895106dfedc0f41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.323196 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e794ae929b4902922e17c4d2181f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.323328 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe2acbe35174209afe1c37eeb4f8d3a (DEFAULT_TABLE table=default.Table_d4e06073c326433daaa437bbe54e3f55 [id=fc99230e980347fcbebcd99488c24c8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.323735 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe2acbe35174209afe1c37eeb4f8d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.325312 907 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe2acbe35174209afe1c37eeb4f8d3a (DEFAULT_TABLE table=default.Table_d4e06073c326433daaa437bbe54e3f55 [id=fc99230e980347fcbebcd99488c24c8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.326031 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe2acbe35174209afe1c37eeb4f8d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.330180 900 tablet_service.cc:1511] Processing CreateTablet for tablet 50e794ae929b4902922e17c4d2181f99 (DEFAULT_TABLE table=default.Table_7e04ba863ea34e95854d94b4a8b7caaf [id=2fb7078eed2e48c78895106dfedc0f41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.330734 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50e794ae929b4902922e17c4d2181f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.335626 1173 ts_tablet_manager.cc:1434] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260318 02:51:48.336597 1172 tablet_bootstrap.cc:492] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:48.336988 1172 ts_tablet_manager.cc:1403] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.081s user 0.004s sys 0.000s
I20260318 02:51:48.337836 1172 raft_consensus.cc:359] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.338092 1172 raft_consensus.cc:385] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.338186 1172 raft_consensus.cc:740] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.338466 1172 consensus_queue.cc:260] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.339738 1172 ts_tablet_manager.cc:1434] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:48.340574 896 tablet_service.cc:1511] Processing CreateTablet for tablet 43d6382684d84c9dbab108d8dc9d0176 (DEFAULT_TABLE table=default.Table_f388a339b3c044c7a02d829be6a973f2 [id=6d058440c65d44b78d0248a4e627010f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:48.340914 997 consensus_peers.cc:597] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:48.341056 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43d6382684d84c9dbab108d8dc9d0176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.341572 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 43d6382684d84c9dbab108d8dc9d0176 (DEFAULT_TABLE table=default.Table_f388a339b3c044c7a02d829be6a973f2 [id=6d058440c65d44b78d0248a4e627010f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260318 02:51:48.346693 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 54ba25c5ad3747bf9845245e29561dc9 consensus state has no leader
I20260318 02:51:48.351408 448 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 7e6f40a5d3f14a779c26d73bf58f302b (table default.Table_91e64c048d4048168906fcd3d1a5b3d0 [id=05445eb067cb46a5803415774772c91e]). Expected version 2 got 0
I20260318 02:51:48.351583 1173 tablet_bootstrap.cc:492] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:48.353188 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0c0ba4c3df1348149d99921eddf79c1c" } modify_external_catalogs: true
I20260318 02:51:48.353379 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_0c0ba4c3df1348149d99921eddf79c1c" } modify_external_catalogs: true
W20260318 02:51:48.354714 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7a534e0050514e2b8f0a06d73f4dc1ea consensus state has no leader
I20260318 02:51:48.355039 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e9bb52155a63478ba4b650c36ee5412a" } modify_external_catalogs: true
I20260318 02:51:48.355185 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_e9bb52155a63478ba4b650c36ee5412a" } modify_external_catalogs: true
I20260318 02:51:48.356036 1174 tablet_bootstrap.cc:492] T 5f63108c062348b1ba995ea16f40a695 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:48.356182 1174 ts_tablet_manager.cc:1403] T 5f63108c062348b1ba995ea16f40a695 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.053s user 0.009s sys 0.005s
I20260318 02:51:48.356590 1173 tablet_bootstrap.cc:654] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.356662 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_57d7276060f440ef8d0b901990a82d25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:48.357016 1174 raft_consensus.cc:359] T 5f63108c062348b1ba995ea16f40a695 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.357187 1174 raft_consensus.cc:385] T 5f63108c062348b1ba995ea16f40a695 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.357250 1174 raft_consensus.cc:740] T 5f63108c062348b1ba995ea16f40a695 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
W20260318 02:51:48.357281 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57d7276060f440ef8d0b901990a82d25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:48.359936 2704 ts_tablet_manager.cc:1929] T 8b715c5a31ba4515996595de89f1d62c P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.360880 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 033338a607b145e5bc34fc9281f13067
I20260318 02:51:48.361531 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f204b14825c948129adf562227d9a237"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:48.362102 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f204b14825c948129adf562227d9a237 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:48.362234 1175 log.cc:1199] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/2ebcf120100349319d27615b6e0c7550
I20260318 02:51:48.362655 1175 ts_tablet_manager.cc:1950] T 2ebcf120100349319d27615b6e0c7550 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:48.360608 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_281e478e833f4d13a05ddcf65d026047" } modify_external_catalogs: true
I20260318 02:51:48.364300 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_281e478e833f4d13a05ddcf65d026047" } modify_external_catalogs: true
I20260318 02:51:48.362524 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 033338a607b145e5bc34fc9281f13067 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:47 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:48.364665 2704 log.cc:1199] T 8b715c5a31ba4515996595de89f1d62c P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/8b715c5a31ba4515996595de89f1d62c
I20260318 02:51:48.364929 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1331) took 1364 ms. Trace:
I20260318 02:51:48.365299 2704 ts_tablet_manager.cc:1950] T 8b715c5a31ba4515996595de89f1d62c P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:48.365406 1175 rpcz_store.cc:276] 0318 02:51:47.000603 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:47.000653 (+ 50us) service_pool.cc:225] Handling call
0318 02:51:48.262537 (+1261884us) ts_tablet_manager.cc:1151] Deleting tablet 2ebcf120100349319d27615b6e0c7550
0318 02:51:48.262547 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:48.313421 (+ 50874us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:48.316431 (+ 3010us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:48.364912 (+ 48481us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1261690}
I20260318 02:51:48.365902 1175 tablet_replica.cc:333] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:48.366379 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_40ab4cd6e66a433abe4cb9eb1a6baf82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:48.366899 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40ab4cd6e66a433abe4cb9eb1a6baf82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:48.368968 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9733b5f166b440c0b3ca3cf509108ccb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:48.369467 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9733b5f166b440c0b3ca3cf509108ccb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:48.371383 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 42fc3a9965804b5eb0c9f96eabc38553 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:48.371896 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 8b715c5a31ba4515996595de89f1d62c (table default.Table_c88cc2fd710a4910992ba3010b134825 [id=e98f510836594d8ebb0da395137875ff]) successfully deleted
I20260318 02:51:48.372081 2704 tablet_replica.cc:333] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:48.372264 2704 raft_consensus.cc:2243] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.372408 2704 raft_consensus.cc:2272] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:48.372414 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet f2c7972bf42744699012425706ac4667 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2c7972bf42744699012425706ac4667 already in progress: creating tablet
W20260318 02:51:48.372598 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet bfdb59b3a53a447eab72947d1bbdb5bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfdb59b3a53a447eab72947d1bbdb5bb already in progress: creating tablet
I20260318 02:51:48.372926 2704 ts_tablet_manager.cc:1916] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.379202 1175 raft_consensus.cc:2243] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.379438 1175 raft_consensus.cc:2272] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.380009 1175 ts_tablet_manager.cc:1916] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.380748 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 184ce58aa96d4e70ad7b2783f19ccdeb (table default.Table_f7c512acb00946069cb735b743f8b2af [id=3e7b4f46e6c04379b32c2d39de6aa759]) successfully deleted
I20260318 02:51:48.381330 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 2ebcf120100349319d27615b6e0c7550 (table default.Table_1424aa1a08ae4f3584a9f415cd41b6e7 [id=566d84b4953c4753a0b3a2bc060aae3b]) successfully deleted
I20260318 02:51:48.382450 907 tablet_service.cc:1558] Processing DeleteTablet for tablet f37ab96f13444fcbb5cfc3ad92d53c35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:37 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:48.382941 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 20a492fdea6c44ba8439614b0dcc2ba6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:48.383628 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet d0b01131720748688ca6c28985a3b3ff with delete_type TABLET_DATA_DELETED (replaced by tablet fa68d30736044b71b38938fded1b314b) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:48.383860 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet ce82c595e30a4878be25be8eb3d30790 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:48.384301 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet fd1284c6e90d4beb8223fd807d7888ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:48.384698 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c89f413a26a43ef95c850d7c44f85b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:48.385128 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet b894f0772a754196a3e651b38c46f001 with delete_type TABLET_DATA_DELETED (replaced by tablet 977a25a368734b11a8b2cefef88be651) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:48.385562 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 033338a607b145e5bc34fc9281f13067 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:47 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:48.385795 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 033338a607b145e5bc34fc9281f13067 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:47 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:48.386755 1173 tablet_bootstrap.cc:492] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:48.386900 1173 ts_tablet_manager.cc:1403] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.000s
I20260318 02:51:48.384635 1174 consensus_queue.cc:260] T 5f63108c062348b1ba995ea16f40a695 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.387696 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 21e6e89e5a0a4d1bb952e74be1b7e551 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:48.387914 1173 raft_consensus.cc:359] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.388060 1173 raft_consensus.cc:385] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.388108 1173 raft_consensus.cc:740] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.388316 1173 consensus_queue.cc:260] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.391847 1174 ts_tablet_manager.cc:1434] T 5f63108c062348b1ba995ea16f40a695 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.036s user 0.003s sys 0.000s
I20260318 02:51:48.392421 1174 tablet_bootstrap.cc:492] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:48.395242 1173 ts_tablet_manager.cc:1434] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260318 02:51:48.395581 1174 tablet_bootstrap.cc:654] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.401908 1173 tablet_bootstrap.cc:492] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:48.402642 1184 ts_tablet_manager.cc:1929] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.402866 1184 log.cc:1199] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/824b9dc6982f425c9518c0ea3560bf84
I20260318 02:51:48.403250 1184 ts_tablet_manager.cc:1950] T 824b9dc6982f425c9518c0ea3560bf84 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:48.403563 1173 tablet_bootstrap.cc:654] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.416018 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43d6382684d84c9dbab108d8dc9d0176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.419906 2704 ts_tablet_manager.cc:1929] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.420058 2704 log.cc:1199] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/77a17ef7cfee4d65808b11e9cb51e7df
I20260318 02:51:48.420356 2704 ts_tablet_manager.cc:1950] T 77a17ef7cfee4d65808b11e9cb51e7df P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:48.422111 1175 ts_tablet_manager.cc:1929] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.422241 1175 log.cc:1199] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/85e6ad2a9817444caecb78eabde5d222
I20260318 02:51:48.422502 1175 ts_tablet_manager.cc:1950] T 85e6ad2a9817444caecb78eabde5d222 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:48.422899 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1332) took 1407 ms. Trace:
I20260318 02:51:48.422988 1175 rpcz_store.cc:276] 0318 02:51:47.015248 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:47.015299 (+ 51us) service_pool.cc:225] Handling call
0318 02:51:48.365848 (+1350549us) ts_tablet_manager.cc:1151] Deleting tablet 85e6ad2a9817444caecb78eabde5d222
0318 02:51:48.365860 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:48.407593 (+ 41733us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:48.421993 (+ 14400us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:48.422881 (+ 888us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1347921}
I20260318 02:51:48.423316 1175 tablet_replica.cc:333] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:48.423511 1175 raft_consensus.cc:2243] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.423561 1172 tablet_bootstrap.cc:492] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:48.423681 1175 raft_consensus.cc:2272] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.424211 1175 ts_tablet_manager.cc:1916] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.425900 1173 tablet_bootstrap.cc:492] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:48.426034 1173 ts_tablet_manager.cc:1403] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.002s
W20260318 02:51:48.426379 443 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 54ba25c5ad3747bf9845245e29561dc9 (table default.Table_f204abd79d7c4f6180c829e2867e7b2e [id=e924bfd8bcec4ee58f1b4d94208e0f80], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 54ba25c5ad3747bf9845245e29561dc9 consensus state has no leader
I20260318 02:51:48.426867 1173 raft_consensus.cc:359] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.427040 1173 raft_consensus.cc:385] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.427093 1173 raft_consensus.cc:740] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.427322 1173 consensus_queue.cc:260] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.428074 1184 tablet_replica.cc:333] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:48.428300 1184 raft_consensus.cc:2243] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.428483 1184 raft_consensus.cc:2272] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.429097 1184 ts_tablet_manager.cc:1916] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.431314 1173 ts_tablet_manager.cc:1434] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260318 02:51:48.432211 1173 tablet_bootstrap.cc:492] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:48.439230 1173 tablet_bootstrap.cc:654] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.442312 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 77a17ef7cfee4d65808b11e9cb51e7df (table default.Table_4c6d7289bf5c4971892927a94cbf91f6 [id=94a6d43822c04d3ba847366297c204f9]) successfully deleted
W20260318 02:51:48.443645 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c515b5afd964ef8b8213f4b57a9046c consensus state has no leader
I20260318 02:51:48.443899 1174 tablet_bootstrap.cc:492] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:48.444051 1174 ts_tablet_manager.cc:1403] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.052s user 0.009s sys 0.004s
I20260318 02:51:48.444883 1174 raft_consensus.cc:359] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.445060 1174 raft_consensus.cc:385] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.445107 1174 raft_consensus.cc:740] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.445307 1174 consensus_queue.cc:260] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.445425 2704 tablet_replica.cc:333] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:48.445642 2704 raft_consensus.cc:2243] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.446167 451 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet d26c7c573c40412f88b9c6cc71a3c648 (table default.Table_7a2639fca231445ab4c600a8b49ccc7c [id=807a5b3e8d1f4221b8284faa1735f31b]). Expected version 1 got 0
I20260318 02:51:48.445773 2704 raft_consensus.cc:2272] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.446825 2704 ts_tablet_manager.cc:1916] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.451715 1174 ts_tablet_manager.cc:1434] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260318 02:51:48.451892 453 catalog_manager.cc:5671] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:48.452291 453 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 9c05f7a75527410e9c5cde0dbc6bc10e (table default.Table_fed9534e8e3d410ab1775c885744cc2a [id=113b6b3abc1a4dcc91c49be4704a159c]). Expected version 2 got 0
I20260318 02:51:48.452638 453 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet b698d732a905469caaf564d9512ba02c (table default.Table_6238662cdd5443a694ee4feec8bc0413 [id=eb11e3d1c3ef4295ac9b6ee657ac233a]). Expected version 1 got 0
I20260318 02:51:48.453469 2660 raft_consensus.cc:493] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.453593 2660 raft_consensus.cc:515] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:48.454191 2660 leader_election.cc:290] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:48.454865 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defda79dd0f34c37ae16ea808df0754b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:48.455381 719 leader_election.cc:343] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.459286 1174 tablet_bootstrap.cc:492] T e993481bf55747b0a6a1c996c6917408 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:48.459267 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defda79dd0f34c37ae16ea808df0754b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:48.460146 719 leader_election.cc:343] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.460291 719 leader_election.cc:304] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:48.461424 1174 tablet_bootstrap.cc:654] T e993481bf55747b0a6a1c996c6917408 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.467821 1174 tablet_bootstrap.cc:492] T e993481bf55747b0a6a1c996c6917408 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:48.467993 1174 ts_tablet_manager.cc:1403] T e993481bf55747b0a6a1c996c6917408 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.002s
I20260318 02:51:48.469008 1174 raft_consensus.cc:359] T e993481bf55747b0a6a1c996c6917408 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.469195 1174 raft_consensus.cc:385] T e993481bf55747b0a6a1c996c6917408 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.469247 1174 raft_consensus.cc:740] T e993481bf55747b0a6a1c996c6917408 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.469429 1174 consensus_queue.cc:260] T e993481bf55747b0a6a1c996c6917408 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.469875 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f63108c062348b1ba995ea16f40a695 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:48.469892 753 tablet_service.cc:1558] Processing DeleteTablet for tablet ed193d1b80be496298dae6fafef94577 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:48.469441 2660 raft_consensus.cc:2749] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.475528 1174 ts_tablet_manager.cc:1434] T e993481bf55747b0a6a1c996c6917408 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260318 02:51:48.476207 1174 tablet_bootstrap.cc:492] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:48.477250 753 tablet_service.cc:1558] Processing DeleteTablet for tablet e993481bf55747b0a6a1c996c6917408 with delete_type TABLET_DATA_DELETED (replaced by tablet ffa9d9dcc70e402099b414029f062d6e) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:48.453178 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f141890f83124edb914868a35fc73df2" } modify_external_catalogs: true
I20260318 02:51:48.477605 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_f141890f83124edb914868a35fc73df2" } modify_external_catalogs: true
I20260318 02:51:48.453492 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 0ab9bdc476f64d758637a12148f2b092
I20260318 02:51:48.478286 1174 tablet_bootstrap.cc:654] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.453706 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 821c1f9f90504d2580d311682fc19a5a
I20260318 02:51:48.454120 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c662869530134cb08ab6cc52957d07d9" } new_table_name: "default.Table_a8a578e287fd4630a9438a901774c85c" modify_external_catalogs: true
I20260318 02:51:48.454535 452 master_service.cc:954] ReplaceTablet: received request to replace tablet b54248ad606643a292dff193c35d6a00 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:48.470155 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 5aeffffd34f047eeaa9a8a5100c7aad2
I20260318 02:51:48.482314 453 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet c58290c2d1c742d3b45dfb5caf52c75b (table default.Table_944521fea0294e3381643693804fd723 [id=18d79b10f75b43efa4946ca8979a4235]). Expected version 1 got 0
I20260318 02:51:48.483387 753 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ab9bdc476f64d758637a12148f2b092 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:48 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:48.483620 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 821c1f9f90504d2580d311682fc19a5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:48 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:48.483625 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aeffffd34f047eeaa9a8a5100c7aad2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:48 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:48.484786 1173 tablet_bootstrap.cc:492] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:48.484937 1173 ts_tablet_manager.cc:1403] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.000s
I20260318 02:51:48.485793 1173 raft_consensus.cc:359] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.485972 1173 raft_consensus.cc:385] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.486029 1173 raft_consensus.cc:740] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.486268 1173 consensus_queue.cc:260] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.489403 1173 ts_tablet_manager.cc:1434] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:48.489734 1173 tablet_bootstrap.cc:492] T 6e2a586892a24c71a956dbbe382484c9 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:48.491667 1173 tablet_bootstrap.cc:654] T 6e2a586892a24c71a956dbbe382484c9 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:48.494772 441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.189:45933, user_credentials={real_user=slave}} blocked reactor thread for 94312.7us
I20260318 02:51:48.498955 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 821c1f9f90504d2580d311682fc19a5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:48 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:48.499797 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 821c1f9f90504d2580d311682fc19a5a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:48 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:48.500193 1174 tablet_bootstrap.cc:492] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:48.500358 1174 ts_tablet_manager.cc:1403] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.005s
I20260318 02:51:48.500728 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aeffffd34f047eeaa9a8a5100c7aad2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:48 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:48.501236 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aeffffd34f047eeaa9a8a5100c7aad2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:48 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:48.501204 1174 raft_consensus.cc:359] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:48.501374 1174 raft_consensus.cc:385] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.501431 1174 raft_consensus.cc:740] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.501686 1174 consensus_queue.cc:260] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:48.502177 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 4df7d75e696a4aec981de3963c282b0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:48.502427 1174 ts_tablet_manager.cc:1434] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:48.502709 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f04e5699531479d8b76edb0e2d2873c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:48.503585 1173 tablet_bootstrap.cc:492] T 6e2a586892a24c71a956dbbe382484c9 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:48.503660 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 82858fd64d534d1abcad12bc4a93cda7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:26 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:48.503724 1173 ts_tablet_manager.cc:1403] T 6e2a586892a24c71a956dbbe382484c9 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.004s
I20260318 02:51:48.504261 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 85e6ad2a9817444caecb78eabde5d222 (table default.Table_c23e7504b2474f1686592467b684da52 [id=96801ef3b02b4ab6b22d34157d05bb49]) successfully deleted
I20260318 02:51:48.504508 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ab9bdc476f64d758637a12148f2b092 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:48 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:48.505954 1174 tablet_bootstrap.cc:492] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:48.507413 1173 raft_consensus.cc:359] T 6e2a586892a24c71a956dbbe382484c9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.507624 1173 raft_consensus.cc:385] T 6e2a586892a24c71a956dbbe382484c9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.507692 1173 raft_consensus.cc:740] T 6e2a586892a24c71a956dbbe382484c9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.508863 1173 consensus_queue.cc:260] T 6e2a586892a24c71a956dbbe382484c9 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.508987 1172 tablet_bootstrap.cc:654] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.512192 1173 ts_tablet_manager.cc:1434] T 6e2a586892a24c71a956dbbe382484c9 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260318 02:51:48.512508 1173 tablet_bootstrap.cc:492] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:48.513170 1174 tablet_bootstrap.cc:654] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.516755 1173 tablet_bootstrap.cc:654] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.523599 758 tablet_service.cc:1558] Processing DeleteTablet for tablet fa077243d5634d888f3a191b7f9d2d19 with delete_type TABLET_DATA_DELETED (replaced by tablet f2c7972bf42744699012425706ac4667) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:48.530030 1173 tablet_bootstrap.cc:492] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:48.530197 1173 ts_tablet_manager.cc:1403] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.008s
I20260318 02:51:48.531064 1173 raft_consensus.cc:359] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.531250 1173 raft_consensus.cc:385] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.531301 1173 raft_consensus.cc:740] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.531497 1173 consensus_queue.cc:260] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.533061 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ab9bdc476f64d758637a12148f2b092 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:48 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:48.533991 1173 ts_tablet_manager.cc:1434] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260318 02:51:48.535694 1173 tablet_bootstrap.cc:492] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:48.546066 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 824b9dc6982f425c9518c0ea3560bf84 (table default.Table_d20052125a004fa088aea68c2ec6d98f [id=64bdf02991a64246b7431e6e3c0e1268]) successfully deleted
I20260318 02:51:48.546597 449 master_service.cc:954] ReplaceTablet: received request to replace tablet 6eae03ae22c440e69502471b6d36f240 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:48.548151 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_8a18082bff4744809fe3fe184dc25788" } new_table_name: "default.Table_0dd06945073d47f487f6822ab272f23e" modify_external_catalogs: true
W20260318 02:51:48.550055 423 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 90719.2us
I20260318 02:51:48.551594 1173 tablet_bootstrap.cc:654] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.553625 2704 ts_tablet_manager.cc:1929] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.553750 2704 log.cc:1199] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/4052eede3f404b84ac27e21a204bf5a9
I20260318 02:51:48.554014 2704 ts_tablet_manager.cc:1950] T 4052eede3f404b84ac27e21a204bf5a9 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:48.555444 1175 ts_tablet_manager.cc:1929] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.555569 1175 log.cc:1199] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/59c6741a6d154d8f99d487c6590d2d26
I20260318 02:51:48.555837 1175 ts_tablet_manager.cc:1950] T 59c6741a6d154d8f99d487c6590d2d26 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:48.558507 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1333) took 1533 ms. Trace:
I20260318 02:51:48.558624 1175 rpcz_store.cc:276] 0318 02:51:47.025322 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:47.025661 (+ 339us) service_pool.cc:225] Handling call
0318 02:51:48.423268 (+1397607us) ts_tablet_manager.cc:1151] Deleting tablet 59c6741a6d154d8f99d487c6590d2d26
0318 02:51:48.423278 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:48.451558 (+ 28280us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:48.555330 (+103772us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:48.558483 (+ 3153us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1395226}
I20260318 02:51:48.559212 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1348) took 1278 ms. Trace:
I20260318 02:51:48.559301 1175 rpcz_store.cc:276] 0318 02:51:47.281049 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:47.281099 (+ 50us) service_pool.cc:225] Handling call
0318 02:51:48.559084 (+1277985us) ts_tablet_manager.cc:1151] Deleting tablet 28f06d6037fa426296ee68adbb6f689a
0318 02:51:48.559094 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:48.559195 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1277755}
I20260318 02:51:48.560223 2764 raft_consensus.cc:493] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.560359 2764 raft_consensus.cc:515] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.561167 2764 leader_election.cc:290] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:48.562096 862 leader_election.cc:343] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 21e6e89e5a0a4d1bb952e74be1b7e551
W20260318 02:51:48.562493 860 leader_election.cc:343] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 21e6e89e5a0a4d1bb952e74be1b7e551
I20260318 02:51:48.562606 860 leader_election.cc:304] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:48.562855 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_79489cca59114b02bb26b88fd5f27727"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:48.563602 2764 raft_consensus.cc:2749] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:48.563763 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79489cca59114b02bb26b88fd5f27727 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:48.567240 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1347) took 1286 ms. Trace:
I20260318 02:51:48.567910 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 4052eede3f404b84ac27e21a204bf5a9 (table default.Table_f4cd103bfd1d46beb3655a4dc4c8c3b8 [id=9995967cb4594c8b89df60677db4cad6]) successfully deleted
I20260318 02:51:48.568190 1175 rpcz_store.cc:276] 0318 02:51:47.280940 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:47.281804 (+ 864us) service_pool.cc:225] Handling call
0318 02:51:48.567101 (+1285297us) ts_tablet_manager.cc:1151] Deleting tablet 36c3a417e8c04108b22d28674e570b9b
0318 02:51:48.567114 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:48.567218 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1285122}
I20260318 02:51:48.568802 2704 tablet_replica.cc:333] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad: stopping tablet replica
W20260318 02:51:48.569048 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ce282f91c2f44b59c0b6ea836ad5d0e consensus state has no leader
I20260318 02:51:48.569108 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1352) took 1103 ms. Trace:
I20260318 02:51:48.569173 1175 rpcz_store.cc:276] 0318 02:51:47.465609 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:47.465667 (+ 58us) service_pool.cc:225] Handling call
0318 02:51:48.568984 (+1103317us) ts_tablet_manager.cc:1151] Deleting tablet 4ce1bf41b33842ab9ade884ae84daf96
0318 02:51:48.568994 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:48.569090 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1103112}
I20260318 02:51:48.569490 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b54248ad606643a292dff193c35d6a00
I20260318 02:51:48.569603 2704 raft_consensus.cc:2243] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.569752 2704 raft_consensus.cc:2272] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.569923 452 catalog_manager.cc:6741] ReplaceTablet: tablet b54248ad606643a292dff193c35d6a00 deleted and replaced by tablet 7ed1a8b946ba4bbfa0f7864155b00561
I20260318 02:51:48.570297 2704 ts_tablet_manager.cc:1916] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.570796 758 tablet_service.cc:1558] Processing DeleteTablet for tablet b54248ad606643a292dff193c35d6a00 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ed1a8b946ba4bbfa0f7864155b00561) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:48.573897 1173 tablet_bootstrap.cc:492] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:48.574064 1173 ts_tablet_manager.cc:1403] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.040s user 0.001s sys 0.001s
I20260318 02:51:48.576393 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1353) took 1108 ms. Trace:
I20260318 02:51:48.576501 1175 rpcz_store.cc:276] 0318 02:51:47.467794 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:47.467890 (+ 96us) service_pool.cc:225] Handling call
0318 02:51:48.576246 (+1108356us) ts_tablet_manager.cc:1151] Deleting tablet c8d7aad0f2c545628a13b2ad3269dcd6
0318 02:51:48.576258 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:48.576370 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1108170}
I20260318 02:51:48.577039 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1354) took 1070 ms. Trace:
I20260318 02:51:48.577126 1175 rpcz_store.cc:276] 0318 02:51:47.506838 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:47.507398 (+ 560us) service_pool.cc:225] Handling call
0318 02:51:48.576932 (+1069534us) ts_tablet_manager.cc:1151] Deleting tablet 558073d59dcf4fc5b4bfd1d9685415a1
0318 02:51:48.576941 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:48.577022 (+ 81us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1069263}
I20260318 02:51:48.577476 1175 tablet_replica.cc:333] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:48.577674 1175 raft_consensus.cc:2243] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.577828 1175 raft_consensus.cc:2272] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.578398 1175 ts_tablet_manager.cc:1916] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.583470 900 tablet_service.cc:1558] Processing DeleteTablet for tablet a384923c86ee42d6a47ed3f68e6811df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:28 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:48.584232 1175 ts_tablet_manager.cc:1929] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.584331 1175 log.cc:1199] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/9777963ff20c4a799de2870555f6b335
I20260318 02:51:48.584425 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 59c6741a6d154d8f99d487c6590d2d26 (table default.Table_f4978db62ff94982b1fbb4afc8e96b29 [id=9c9b005136654a8e874925b6bbef33a4]) successfully deleted
W20260318 02:51:48.584671 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 28f06d6037fa426296ee68adbb6f689a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28f06d6037fa426296ee68adbb6f689a already in progress: creating tablet
W20260318 02:51:48.584928 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 36c3a417e8c04108b22d28674e570b9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36c3a417e8c04108b22d28674e570b9b already in progress: creating tablet
W20260318 02:51:48.585100 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 4ce1bf41b33842ab9ade884ae84daf96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ce1bf41b33842ab9ade884ae84daf96 already in progress: creating tablet
W20260318 02:51:48.585265 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet c8d7aad0f2c545628a13b2ad3269dcd6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8d7aad0f2c545628a13b2ad3269dcd6 already in progress: creating tablet
W20260318 02:51:48.585445 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 558073d59dcf4fc5b4bfd1d9685415a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 558073d59dcf4fc5b4bfd1d9685415a1 already in progress: creating tablet
I20260318 02:51:48.589634 1172 tablet_bootstrap.cc:492] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:48.589849 1172 ts_tablet_manager.cc:1403] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.166s user 0.003s sys 0.000s
I20260318 02:51:48.590641 1172 raft_consensus.cc:359] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.590837 1172 raft_consensus.cc:385] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.590895 1172 raft_consensus.cc:740] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.591167 1172 consensus_queue.cc:260] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.594707 2704 ts_tablet_manager.cc:1929] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.594841 2704 log.cc:1199] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/defda79dd0f34c37ae16ea808df0754b
I20260318 02:51:48.595132 2704 ts_tablet_manager.cc:1950] T defda79dd0f34c37ae16ea808df0754b P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:48.596225 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet defda79dd0f34c37ae16ea808df0754b (table default.Table_3aa749750bd542738790c713a8ff0713 [id=c6ec8a81c28d493396980349b4ea31d8]) successfully deleted
I20260318 02:51:48.598368 2704 tablet_replica.cc:333] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:48.598600 2704 raft_consensus.cc:2243] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.598799 2704 raft_consensus.cc:2272] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.598850 1172 ts_tablet_manager.cc:1434] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260318 02:51:48.599402 2704 ts_tablet_manager.cc:1916] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.605154 2665 raft_consensus.cc:493] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.605311 2665 raft_consensus.cc:515] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.605929 2665 leader_election.cc:290] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:48.608055 1172 tablet_bootstrap.cc:492] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:48.609781 1172 tablet_bootstrap.cc:654] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.613827 1184 ts_tablet_manager.cc:1929] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.614022 1184 log.cc:1199] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/d0b01131720748688ca6c28985a3b3ff
I20260318 02:51:48.614349 1184 ts_tablet_manager.cc:1950] T d0b01131720748688ca6c28985a3b3ff P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:48.615423 453 master_service.cc:954] ReplaceTablet: received request to replace tablet 75ca99ca24f14cd48f29e49168ebca3f from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:48.616321 453 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b19e155d16bd4725a2d4200eda764366" } new_table_name: "default.Table_53a00bcb50d64505a4131155a712937c" modify_external_catalogs: true
I20260318 02:51:48.617991 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a83d4ad8611a474cb2cd999a44fc28e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:48.618009 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2bf9bdf74b284b40b242d081b9daccc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:48.618578 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bf9bdf74b284b40b242d081b9daccc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:48.606745 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "498f592fa2fb46748f7752004780fe46" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:48.619702 781 raft_consensus.cc:2468] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:48.620230 999 leader_election.cc:304] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:48.620749 2665 raft_consensus.cc:2804] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:48.620872 2665 raft_consensus.cc:493] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:48.620926 2665 raft_consensus.cc:3060] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:48.623405 2665 raft_consensus.cc:515] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.624475 2704 ts_tablet_manager.cc:1929] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.624598 2704 log.cc:1199] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/f5b55cf85d7842e59f0ed92aecdcd5d0
I20260318 02:51:48.625698 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "498f592fa2fb46748f7752004780fe46" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:48.625877 781 raft_consensus.cc:3060] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:48.628443 781 raft_consensus.cc:2468] T 498f592fa2fb46748f7752004780fe46 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:48.629436 999 leader_election.cc:304] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:48.629662 2152 raft_consensus.cc:2804] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:48.629793 2152 raft_consensus.cc:697] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:48.629949 2665 leader_election.cc:290] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:48.630028 2152 consensus_queue.cc:237] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:48.618578 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a83d4ad8611a474cb2cd999a44fc28e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:48.634879 2704 ts_tablet_manager.cc:1950] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:48.635896 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet f5b55cf85d7842e59f0ed92aecdcd5d0 (table default.Table_036cfacba4504adc8db1ed111b34e126 [id=c1a274b091ba4334ba2f6d983a0baf09]) successfully deleted
I20260318 02:51:48.636255 2704 tablet_replica.cc:333] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:48.636444 2704 raft_consensus.cc:2243] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.636600 2704 raft_consensus.cc:2272] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.637137 2704 ts_tablet_manager.cc:1916] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.637213 2835 consensus_queue.cc:1048] T 895aa252b9f243d89e972d1b717ee910 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:48.647071 2764 raft_consensus.cc:493] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.647241 2764 raft_consensus.cc:515] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.647882 2764 leader_election.cc:290] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:48.648016 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4c1ff8f187b34eb59f2b189fbf314142" } new_table_name: "default.Table_cff80720c9934a89a2b6aa08499b22e7" modify_external_catalogs: true
W20260318 02:51:48.649691 860 leader_election.cc:343] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: b317cc133346412fb981b1c8e5b99c4d
W20260318 02:51:48.650940 862 leader_election.cc:343] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: b317cc133346412fb981b1c8e5b99c4d
I20260318 02:51:48.651058 862 leader_election.cc:304] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:48.651192 1175 ts_tablet_manager.cc:1950] T 9777963ff20c4a799de2870555f6b335 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:48.651547 2764 raft_consensus.cc:2749] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.652437 1173 raft_consensus.cc:359] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.652724 1173 raft_consensus.cc:385] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.652797 1173 raft_consensus.cc:740] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.652987 1173 consensus_queue.cc:260] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.653475 1173 ts_tablet_manager.cc:1434] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.079s user 0.002s sys 0.000s
I20260318 02:51:48.659744 1175 tablet_replica.cc:333] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:48.659956 1175 raft_consensus.cc:2243] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.660107 1175 raft_consensus.cc:2272] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.660701 1175 ts_tablet_manager.cc:1916] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.664692 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet b54248ad606643a292dff193c35d6a00 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ed1a8b946ba4bbfa0f7864155b00561) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:48.665328 1173 tablet_bootstrap.cc:492] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:48.667094 1173 tablet_bootstrap.cc:654] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.667356 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet fb5d1d828899472e8f48723b35e94d62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:48.668068 2753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260318 02:51:48.668571 2753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260318 02:51:48.668783 2753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260318 02:51:48.669169 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e578c7498b6404cb87f493127005500 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:48.671260 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_cf613165ecdf4b708b418fb1c9bba70e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:48.671881 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf613165ecdf4b708b418fb1c9bba70e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:48.674476 1174 tablet_bootstrap.cc:492] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:48.674633 1174 ts_tablet_manager.cc:1403] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.169s user 0.030s sys 0.020s
I20260318 02:51:48.675446 1174 raft_consensus.cc:359] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.675626 1174 raft_consensus.cc:385] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.675683 1174 raft_consensus.cc:740] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.675911 1174 consensus_queue.cc:260] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.677258 1174 ts_tablet_manager.cc:1434] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:48.678151 1174 tablet_bootstrap.cc:492] T 41fb820f152748b093ca0e0a2f663a78 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:48.678604 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet b10fd13bf3ea48b0896b34fce478e25a with delete_type TABLET_DATA_DELETED (replaced by tablet 053efeef673f4535993b29d102884408) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:48.679647 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet d0b01131720748688ca6c28985a3b3ff (table default.Table_85c16d674e834595911be295a8222653 [id=c21facd3dbe74a239960adf801256801]) successfully deleted
I20260318 02:51:48.679733 1174 tablet_bootstrap.cc:654] T 41fb820f152748b093ca0e0a2f663a78 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.682065 1172 tablet_bootstrap.cc:492] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:48.682219 1172 ts_tablet_manager.cc:1403] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.074s user 0.003s sys 0.000s
I20260318 02:51:48.682973 1175 ts_tablet_manager.cc:1929] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.682948 1172 raft_consensus.cc:359] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.683094 1175 log.cc:1199] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/c4051c8e4d3d49829f9eac8e36baab2f
I20260318 02:51:48.683105 1172 raft_consensus.cc:385] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.683145 1172 raft_consensus.cc:740] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
W20260318 02:51:48.685004 2753 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260318 02:51:48.685168 2753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
I20260318 02:51:48.685480 1172 consensus_queue.cc:260] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:48.685297 2753 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260318 02:51:48.685850 2753 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260318 02:51:48.689599 1172 ts_tablet_manager.cc:1434] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260318 02:51:48.690006 1172 tablet_bootstrap.cc:492] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:48.691926 1172 tablet_bootstrap.cc:654] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.693251 2835 raft_consensus.cc:493] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.693390 2835 raft_consensus.cc:515] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.693980 2835 leader_election.cc:290] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:48.683368 1175 ts_tablet_manager.cc:1950] T c4051c8e4d3d49829f9eac8e36baab2f P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
W20260318 02:51:48.695322 999 leader_election.cc:343] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: b10fd13bf3ea48b0896b34fce478e25a
I20260318 02:51:48.699133 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1362) took 1019 ms. Trace:
I20260318 02:51:48.699265 1175 rpcz_store.cc:276] 0318 02:51:47.679653 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:47.679699 (+ 46us) service_pool.cc:225] Handling call
0318 02:51:48.657995 (+978296us) ts_tablet_manager.cc:1151] Deleting tablet c4051c8e4d3d49829f9eac8e36baab2f
0318 02:51:48.659696 (+ 1701us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:48.663639 (+ 3943us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:48.682852 (+ 19213us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:48.699106 (+ 16254us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":828832}
I20260318 02:51:48.699617 1175 tablet_replica.cc:333] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:48.703658 1175 raft_consensus.cc:2243] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.703840 1175 raft_consensus.cc:2272] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.704388 1175 ts_tablet_manager.cc:1916] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.704524 2660 raft_consensus.cc:493] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.704674 2660 raft_consensus.cc:515] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.705317 2660 leader_election.cc:290] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:48.706097 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fc3a9965804b5eb0c9f96eabc38553" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:48.706640 719 leader_election.cc:343] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.709306 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fc3a9965804b5eb0c9f96eabc38553" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:48.711712 719 leader_election.cc:343] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.711850 719 leader_election.cc:304] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:48.712328 2660 raft_consensus.cc:2749] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.714373 1174 tablet_bootstrap.cc:492] T 41fb820f152748b093ca0e0a2f663a78 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:48.714558 2704 ts_tablet_manager.cc:1929] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.714690 2704 log.cc:1199] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/306367152e834668bbf5fcadd008b3ea
I20260318 02:51:48.714974 2704 ts_tablet_manager.cc:1950] T 306367152e834668bbf5fcadd008b3ea P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:48.717968 2753 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.104.148:43937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.104.190:39451,127.0.104.189:45933,127.0.104.188:41593
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.104.188:41593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.104.188
--webserver_port=37041
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type FASTDEBUG
built by None at 18 Mar 2026 02:43:20 UTC on bdcb31816ec0
build id 10982
ASAN enabled
I20260318 02:51:48.718816 1173 tablet_bootstrap.cc:492] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:48.718976 1173 ts_tablet_manager.cc:1403] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.054s user 0.003s sys 0.006s
I20260318 02:51:48.719780 1173 raft_consensus.cc:359] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.719964 1173 raft_consensus.cc:385] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.720029 1173 raft_consensus.cc:740] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.720222 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 6eae03ae22c440e69502471b6d36f240
I20260318 02:51:48.720227 1173 consensus_queue.cc:260] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.720674 449 catalog_manager.cc:6741] ReplaceTablet: tablet 6eae03ae22c440e69502471b6d36f240 deleted and replaced by tablet 14044cb9f79d44f2a7cfeb43c03b7d1e
I20260318 02:51:48.721339 2704 tablet_replica.cc:333] T 565add8c21f343f2b11c12a9bb7ff111 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:48.721536 2704 raft_consensus.cc:2243] T 565add8c21f343f2b11c12a9bb7ff111 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.721666 2704 raft_consensus.cc:2272] T 565add8c21f343f2b11c12a9bb7ff111 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.722209 2704 ts_tablet_manager.cc:1916] T 565add8c21f343f2b11c12a9bb7ff111 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:48.723670 455 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5947c34f2c8f4c5a9ad09703ca1bfed0 consensus state has no leader
I20260318 02:51:48.726115 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_119e7456847d4df99177b395cc26fcc4" } modify_external_catalogs: true
I20260318 02:51:48.726306 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_119e7456847d4df99177b395cc26fcc4" } modify_external_catalogs: true
I20260318 02:51:48.714547 1174 ts_tablet_manager.cc:1403] T 41fb820f152748b093ca0e0a2f663a78 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.006s
I20260318 02:51:48.727425 1174 raft_consensus.cc:359] T 41fb820f152748b093ca0e0a2f663a78 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.727592 1174 raft_consensus.cc:385] T 41fb820f152748b093ca0e0a2f663a78 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.727638 1174 raft_consensus.cc:740] T 41fb820f152748b093ca0e0a2f663a78 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.727834 1174 consensus_queue.cc:260] T 41fb820f152748b093ca0e0a2f663a78 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.728327 1174 ts_tablet_manager.cc:1434] T 41fb820f152748b093ca0e0a2f663a78 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:48.728613 1174 tablet_bootstrap.cc:492] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:48.730583 449 master_service.cc:954] ReplaceTablet: received request to replace tablet 9a5afc5611d3481e9a6d48381dc67e86 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:48.730993 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "498f592fa2fb46748f7752004780fe46" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:48.731478 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "498f592fa2fb46748f7752004780fe46" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:48.731841 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 306367152e834668bbf5fcadd008b3ea (table default.Table_20b2dbf580454a4a993130bde0ae0265 [id=41496f910c434ed4a7affece7e7efb74]) successfully deleted
I20260318 02:51:48.731937 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10fd13bf3ea48b0896b34fce478e25a" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:48.733516 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eae03ae22c440e69502471b6d36f240 with delete_type TABLET_DATA_DELETED (replaced by tablet 14044cb9f79d44f2a7cfeb43c03b7d1e) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:48.733949 997 leader_election.cc:343] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:48.734306 997 leader_election.cc:343] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:48.734555 997 leader_election.cc:343] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.734635 997 leader_election.cc:304] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:48.734871 2152 raft_consensus.cc:2749] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.736564 900 tablet_service.cc:1558] Processing DeleteTablet for tablet b54248ad606643a292dff193c35d6a00 with delete_type TABLET_DATA_DELETED (replaced by tablet 7ed1a8b946ba4bbfa0f7864155b00561) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:48.739946 2753 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260318 02:51:48.742980 1173 ts_tablet_manager.cc:1434] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20260318 02:51:48.744637 2753 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260318 02:51:48.748762 1173 tablet_bootstrap.cc:492] T 895aa252b9f243d89e972d1b717ee910 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:48.751211 2870 raft_consensus.cc:493] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.751439 1172 tablet_bootstrap.cc:492] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:48.751374 2870 raft_consensus.cc:515] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.751608 1172 ts_tablet_manager.cc:1403] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.062s user 0.008s sys 0.015s
I20260318 02:51:48.752401 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aeffffd34f047eeaa9a8a5100c7aad2" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:48.753029 1174 tablet_bootstrap.cc:654] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.753321 2870 leader_election.cc:290] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:48.753887 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aeffffd34f047eeaa9a8a5100c7aad2" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:48.754426 862 leader_election.cc:304] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:48.754683 2870 raft_consensus.cc:2749] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.755095 2660 raft_consensus.cc:493] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.755234 2660 raft_consensus.cc:515] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:48.755805 2660 leader_election.cc:290] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:48.756311 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa077243d5634d888f3a191b7f9d2d19" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:48.756868 719 leader_election.cc:343] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.757385 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa077243d5634d888f3a191b7f9d2d19" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:48.757926 719 leader_election.cc:343] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.758029 719 leader_election.cc:304] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:48.758456 2660 raft_consensus.cc:2749] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.752424 1172 raft_consensus.cc:359] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.759328 1172 raft_consensus.cc:385] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.759380 1172 raft_consensus.cc:740] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.759572 1172 consensus_queue.cc:260] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.759734 1184 tablet_replica.cc:333] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:48.759928 1184 raft_consensus.cc:2243] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
W20260318 02:51:48.761941 441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.189:45933, user_credentials={real_user=slave}} blocked reactor thread for 44466.9us
I20260318 02:51:48.762539 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eae03ae22c440e69502471b6d36f240 with delete_type TABLET_DATA_DELETED (replaced by tablet 14044cb9f79d44f2a7cfeb43c03b7d1e) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:48.762780 1184 raft_consensus.cc:2272] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.763301 1184 ts_tablet_manager.cc:1916] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.764147 1172 ts_tablet_manager.cc:1434] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260318 02:51:48.767073 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 9777963ff20c4a799de2870555f6b335 (table default.Table_6de905c387094641af62b74f3e0cee37 [id=f8c2021fcd4c4fb2b807bf8fa92088dd]) successfully deleted
I20260318 02:51:48.767290 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet c4051c8e4d3d49829f9eac8e36baab2f (table default.Table_fe03be40cbc54d21927bda17030ed005 [id=3665ac075f964d4c8e2cdda80cbef8a4]) successfully deleted
I20260318 02:51:48.767926 2870 raft_consensus.cc:493] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.768113 2870 raft_consensus.cc:515] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.769112 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1284c6e90d4beb8223fd807d7888ec" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:48.769291 1063 raft_consensus.cc:2468] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 0.
I20260318 02:51:48.769745 860 leader_election.cc:304] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:48.770018 2764 raft_consensus.cc:2804] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:48.770084 2764 raft_consensus.cc:493] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:48.770138 2764 raft_consensus.cc:3060] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:48.770195 2877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260318 02:51:48.771522 1172 tablet_bootstrap.cc:492] T e418df45882c435a8276e46a8abf6bdd P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:48.772554 2764 raft_consensus.cc:515] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.773233 1172 tablet_bootstrap.cc:654] T e418df45882c435a8276e46a8abf6bdd P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.773465 2764 leader_election.cc:290] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Requested vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:48.773964 2878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260318 02:51:48.774084 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1284c6e90d4beb8223fd807d7888ec" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:48.774245 1063 raft_consensus.cc:3060] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:48.775374 2704 ts_tablet_manager.cc:1929] T 565add8c21f343f2b11c12a9bb7ff111 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.775486 2704 log.cc:1199] T 565add8c21f343f2b11c12a9bb7ff111 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/565add8c21f343f2b11c12a9bb7ff111
I20260318 02:51:48.775777 2704 ts_tablet_manager.cc:1950] T 565add8c21f343f2b11c12a9bb7ff111 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:48.776889 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 565add8c21f343f2b11c12a9bb7ff111 (table default.Table_b735de7cc516403da40f10ec36cf25f1 [id=e3979c7eefe84cd7bb1dd36fa9351b7e]) successfully deleted
I20260318 02:51:48.777311 1063 raft_consensus.cc:2468] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b25f4f05e0c94c8db825d5afa0b8bf18 in term 1.
I20260318 02:51:48.777420 1174 tablet_bootstrap.cc:492] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:48.777554 1174 ts_tablet_manager.cc:1403] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.000s
I20260318 02:51:48.778246 860 leader_election.cc:304] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18; no voters:
I20260318 02:51:48.778237 1174 raft_consensus.cc:359] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.778380 1174 raft_consensus.cc:385] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.778420 1174 raft_consensus.cc:740] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.778589 1174 consensus_queue.cc:260] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.779021 1174 ts_tablet_manager.cc:1434] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260318 02:51:48.779214 2764 raft_consensus.cc:2804] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:48.781733 2704 tablet_replica.cc:333] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:48.781937 1174 tablet_bootstrap.cc:492] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:48.782282 862 leader_election.cc:343] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: fd1284c6e90d4beb8223fd807d7888ec
I20260318 02:51:48.783452 1174 tablet_bootstrap.cc:654] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:48.783442 453 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d8bf09a136846eaababb5593e1833fc consensus state has no leader
I20260318 02:51:48.784359 2870 leader_election.cc:290] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:48.784621 862 leader_election.cc:343] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: fd1284c6e90d4beb8223fd807d7888ec
I20260318 02:51:48.781916 2704 raft_consensus.cc:2243] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.785370 2704 raft_consensus.cc:2272] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.785853 1173 tablet_bootstrap.cc:654] T 895aa252b9f243d89e972d1b717ee910 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.786008 2704 ts_tablet_manager.cc:1916] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.787385 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3f853afbb0104fe0a6e0652ccc682718" } new_table_name: "default.Table_e59df3c75359485f8bcdfd5723787ad6" modify_external_catalogs: true
I20260318 02:51:48.788887 2764 raft_consensus.cc:697] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Becoming Leader. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Running, Role: LEADER
W20260318 02:51:48.789116 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2c35a8af5d92445a851c8847f75476f9 consensus state has no leader
I20260318 02:51:48.789157 2764 consensus_queue.cc:237] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.789460 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e411160a28b641718494e6813eb0da0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:48.789985 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e411160a28b641718494e6813eb0da0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:48.792228 1174 tablet_bootstrap.cc:492] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:48.792353 1174 ts_tablet_manager.cc:1403] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.004s
I20260318 02:51:48.793133 1174 raft_consensus.cc:359] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.793290 1174 raft_consensus.cc:385] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.793335 1174 raft_consensus.cc:740] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.794571 1174 consensus_queue.cc:260] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.795071 1174 ts_tablet_manager.cc:1434] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:48.795161 1172 tablet_bootstrap.cc:492] T e418df45882c435a8276e46a8abf6bdd P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:48.795133 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3d3d645ae0a143d7ae807fdfb89ba9f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:48.795285 1172 ts_tablet_manager.cc:1403] T e418df45882c435a8276e46a8abf6bdd P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260318 02:51:48.795367 1174 tablet_bootstrap.cc:492] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
W20260318 02:51:48.795702 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d3d645ae0a143d7ae807fdfb89ba9f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:48.795904 2884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260318 02:51:48.796065 1172 raft_consensus.cc:359] T e418df45882c435a8276e46a8abf6bdd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.796226 1172 raft_consensus.cc:385] T e418df45882c435a8276e46a8abf6bdd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.796275 1172 raft_consensus.cc:740] T e418df45882c435a8276e46a8abf6bdd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.796464 1172 consensus_queue.cc:260] T e418df45882c435a8276e46a8abf6bdd P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.796955 1172 ts_tablet_manager.cc:1434] T e418df45882c435a8276e46a8abf6bdd P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:48.797655 1174 tablet_bootstrap.cc:654] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.797869 1172 tablet_bootstrap.cc:492] T 6deb99f7937144f39409929f99b135c5 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:48.799242 457 catalog_manager.cc:5671] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:48.799664 2753 server_base.cc:1060] running on GCE node
I20260318 02:51:48.800685 2753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260318 02:51:48.802345 1175 ts_tablet_manager.cc:1929] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.802356 455 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 895aa252b9f243d89e972d1b717ee910 (table default.Table_2afe66e6b2374e3c9b8e4692abb54d07 [id=6f9eb9fbda9846d495f3e70e229a5590]). Expected version 1 got 0
I20260318 02:51:48.802446 1175 log.cc:1199] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/6bb381f10d87414f9c1a99942216adc7
I20260318 02:51:48.802472 1172 tablet_bootstrap.cc:654] T 6deb99f7937144f39409929f99b135c5 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.802711 1175 ts_tablet_manager.cc:1950] T 6bb381f10d87414f9c1a99942216adc7 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:48.802780 2660 raft_consensus.cc:493] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.802987 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1367) took 1098 ms. Trace:
I20260318 02:51:48.802949 2660 raft_consensus.cc:515] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.803056 1175 rpcz_store.cc:276] 0318 02:51:47.704803 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:47.704855 (+ 52us) service_pool.cc:225] Handling call
0318 02:51:48.699567 (+994712us) ts_tablet_manager.cc:1151] Deleting tablet 6bb381f10d87414f9c1a99942216adc7
0318 02:51:48.699577 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:48.764570 (+ 64993us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:48.802235 (+ 37665us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:48.802971 (+ 736us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":870163}
I20260318 02:51:48.803135 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_04dd597f143f4f348680cdee23d0fd5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:48.803350 1175 tablet_replica.cc:333] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:48.803516 1175 raft_consensus.cc:2243] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.803524 2660 leader_election.cc:290] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:48.803653 1175 raft_consensus.cc:2272] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:48.803656 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04dd597f143f4f348680cdee23d0fd5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:48.804185 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac9581312964ad6afcc96f798fa534a" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:48.804567 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ac9581312964ad6afcc96f798fa534a" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:48.804663 719 leader_election.cc:343] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:48.805009 719 leader_election.cc:343] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.805085 719 leader_election.cc:304] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:48.805382 2660 raft_consensus.cc:2749] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.806653 1174 tablet_bootstrap.cc:492] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:48.806762 1174 ts_tablet_manager.cc:1403] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260318 02:51:48.807463 1174 raft_consensus.cc:359] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.807626 1174 raft_consensus.cc:385] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.807675 1174 raft_consensus.cc:740] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.807878 1174 consensus_queue.cc:260] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.809820 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_f4e9b2273a2d48eb89f2cc6abf6412d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:48.810370 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4e9b2273a2d48eb89f2cc6abf6412d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:48.810396 1174 ts_tablet_manager.cc:1434] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260318 02:51:48.810667 1174 tablet_bootstrap.cc:492] T 59ce7583e7f545f18145b4e55e1fbb81 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:48.812204 1174 tablet_bootstrap.cc:654] T 59ce7583e7f545f18145b4e55e1fbb81 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.816157 2704 ts_tablet_manager.cc:1929] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.816267 2704 log.cc:1199] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/3291ecec94e642e3a995a2d7006619e7
I20260318 02:51:48.816592 2704 ts_tablet_manager.cc:1950] T 3291ecec94e642e3a995a2d7006619e7 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:48.817950 2835 raft_consensus.cc:493] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.818096 2835 raft_consensus.cc:515] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.818171 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 3291ecec94e642e3a995a2d7006619e7 (table default.Table_faeb6cafbd43447591559ebb7ede6da3 [id=93f86e39848a4bd598b3154930bcaafb]) successfully deleted
I20260318 02:51:48.818362 2753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
W20260318 02:51:48.818428 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 033338a607b145e5bc34fc9281f13067 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 033338a607b145e5bc34fc9281f13067 already in progress: creating tablet
I20260318 02:51:48.818667 2835 leader_election.cc:290] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:48.819325 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 9a5afc5611d3481e9a6d48381dc67e86
I20260318 02:51:48.819486 1174 tablet_bootstrap.cc:492] T 59ce7583e7f545f18145b4e55e1fbb81 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:48.819669 2753 hybrid_clock.cc:648] HybridClock initialized: now 1773802308819580 us; error 82 us; skew 500 ppm
I20260318 02:51:48.819830 449 catalog_manager.cc:6741] ReplaceTablet: tablet 9a5afc5611d3481e9a6d48381dc67e86 deleted and replaced by tablet 457a4b623072460d96cc5d11b675cceb
I20260318 02:51:48.820122 2753 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260318 02:51:48.821178 758 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a5afc5611d3481e9a6d48381dc67e86 with delete_type TABLET_DATA_DELETED (replaced by tablet 457a4b623072460d96cc5d11b675cceb) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:48.821615 454 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_3904ac9a603b4024bb758ae6fc98c684"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:48.822135 454 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3904ac9a603b4024bb758ae6fc98c684 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:48.822171 1174 ts_tablet_manager.cc:1403] T 59ce7583e7f545f18145b4e55e1fbb81 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260318 02:51:48.822705 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b698d732a905469caaf564d9512ba02c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:48.822882 777 raft_consensus.cc:2468] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:48.822909 1174 raft_consensus.cc:359] T 59ce7583e7f545f18145b4e55e1fbb81 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.823052 1174 raft_consensus.cc:385] T 59ce7583e7f545f18145b4e55e1fbb81 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.823101 1174 raft_consensus.cc:740] T 59ce7583e7f545f18145b4e55e1fbb81 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.823271 1174 consensus_queue.cc:260] T 59ce7583e7f545f18145b4e55e1fbb81 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.823364 999 leader_election.cc:304] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:48.823792 2835 raft_consensus.cc:2804] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:48.823870 2835 raft_consensus.cc:493] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:48.823928 2835 raft_consensus.cc:3060] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:48.824005 1174 ts_tablet_manager.cc:1434] T 59ce7583e7f545f18145b4e55e1fbb81 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:48.824241 1174 tablet_bootstrap.cc:492] T ca4e1eec9a2148488295416cd68ca607 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:48.825754 1174 tablet_bootstrap.cc:654] T ca4e1eec9a2148488295416cd68ca607 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:48.826298 2835 raft_consensus.cc:515] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.827103 1175 ts_tablet_manager.cc:1916] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.827515 2835 leader_election.cc:290] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:48.827576 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b698d732a905469caaf564d9512ba02c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:48.827736 777 raft_consensus.cc:3060] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:48.827739 2704 tablet_replica.cc:333] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:48.828002 2704 raft_consensus.cc:2243] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.828159 2704 raft_consensus.cc:2272] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.828693 2704 ts_tablet_manager.cc:1916] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.828824 758 tablet_service.cc:1511] Processing CreateTablet for tablet 2de0e7ba1b4342f2954aeb736d6a8902 (DEFAULT_TABLE table=default.Table_4976f48030094963afeecc3ae6c7e9b0 [id=a1745c5707ca48a2b03777da8a6cd001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.828888 749 tablet_service.cc:1511] Processing CreateTablet for tablet 83760c5d9e734b5eb4b04a6fd2ebf8b1 (DEFAULT_TABLE table=default.Table_a886da56344648d48d38d83f4d8c1986 [id=45d100c06d7e49a08ce5ca5fed4e4977]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.829427 753 tablet_service.cc:1511] Processing CreateTablet for tablet 7f76aa810963488da34cb9797cb460d0 (DEFAULT_TABLE table=default.Table_72fe6064160f43009ee01778bf3b8724 [id=73f18c890ad24bde8b1a4f848ad2b423]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.830106 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de0e7ba1b4342f2954aeb736d6a8902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.830121 2660 raft_consensus.cc:493] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.830243 2660 raft_consensus.cc:515] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.830797 2660 leader_election.cc:290] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:48.831478 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83760c5d9e734b5eb4b04a6fd2ebf8b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.831492 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cda2afa253041449b3c5dcb0547160b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:48.832845 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f76aa810963488da34cb9797cb460d0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:48.836396 719 leader_election.cc:343] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.836637 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eae03ae22c440e69502471b6d36f240 with delete_type TABLET_DATA_DELETED (replaced by tablet 14044cb9f79d44f2a7cfeb43c03b7d1e) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:48.830297 777 raft_consensus.cc:2468] T b698d732a905469caaf564d9512ba02c P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:48.840914 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f527a0ba0914924bc7f604ae8a48393 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:48.841197 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_73b7417949204d95bd6115bb0a4c26be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:48.841914 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73b7417949204d95bd6115bb0a4c26be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:48.842124 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b698d732a905469caaf564d9512ba02c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:48.842931 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b698d732a905469caaf564d9512ba02c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:48.844463 997 leader_election.cc:343] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:48.845196 997 leader_election.cc:343] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.846087 1174 tablet_bootstrap.cc:492] T ca4e1eec9a2148488295416cd68ca607 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:48.846258 1174 ts_tablet_manager.cc:1403] T ca4e1eec9a2148488295416cd68ca607 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.002s
I20260318 02:51:48.847151 1174 raft_consensus.cc:359] T ca4e1eec9a2148488295416cd68ca607 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:48.847342 1174 raft_consensus.cc:385] T ca4e1eec9a2148488295416cd68ca607 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.847390 1174 raft_consensus.cc:740] T ca4e1eec9a2148488295416cd68ca607 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.847572 1174 consensus_queue.cc:260] T ca4e1eec9a2148488295416cd68ca607 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:48.848119 1174 ts_tablet_manager.cc:1434] T ca4e1eec9a2148488295416cd68ca607 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:48.848400 1174 tablet_bootstrap.cc:492] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:48.854115 2704 ts_tablet_manager.cc:1929] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.855109 2764 raft_consensus.cc:493] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.855265 2764 raft_consensus.cc:515] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.854260 758 tablet_service.cc:1511] Processing CreateTablet for tablet a4f9cc4dfa664af2ae4d4b73d19fa499 (DEFAULT_TABLE table=default.Table_6349037f9ffc41d18ef322698885aea5 [id=849aed18c2924d0da376a9a4edfa232d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.855887 2704 log.cc:1199] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/42fc3a9965804b5eb0c9f96eabc38553
I20260318 02:51:48.854858 753 tablet_service.cc:1511] Processing CreateTablet for tablet ae4537c922b54151995ed787323a2580 (DEFAULT_TABLE table=default.Table_69a57541ae934bd6947a6380a12a6b15 [id=e6291d732a764e76a96cd5707fb37978]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.856161 2704 ts_tablet_manager.cc:1950] T 42fc3a9965804b5eb0c9f96eabc38553 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:48.855775 1174 tablet_bootstrap.cc:654] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:48.856860 862 leader_election.cc:343] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 4df7d75e696a4aec981de3963c282b0d
I20260318 02:51:48.860932 749 tablet_service.cc:1511] Processing CreateTablet for tablet 5e7631e303654f7e972e2cc2f7f6d47a (DEFAULT_TABLE table=default.Table_6c5efa5b460245ed8de1a2593c6655a1 [id=af289884f69e45e78618c3b2047fd887]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.861282 2764 leader_election.cc:290] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:48.865428 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f9cc4dfa664af2ae4d4b73d19fa499. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:48.865772 441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.189:45933, user_credentials={real_user=slave}} blocked reactor thread for 87934.5us
I20260318 02:51:48.866590 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae4537c922b54151995ed787323a2580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.867738 907 tablet_service.cc:1558] Processing DeleteTablet for tablet fd1284c6e90d4beb8223fd807d7888ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:27 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:48.868263 907 tablet_service.cc:1558] Processing DeleteTablet for tablet d0b01131720748688ca6c28985a3b3ff with delete_type TABLET_DATA_DELETED (replaced by tablet fa68d30736044b71b38938fded1b314b) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:48.868693 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a5afc5611d3481e9a6d48381dc67e86 with delete_type TABLET_DATA_DELETED (replaced by tablet 457a4b623072460d96cc5d11b675cceb) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:48.869937 907 tablet_service.cc:1511] Processing CreateTablet for tablet 2de0e7ba1b4342f2954aeb736d6a8902 (DEFAULT_TABLE table=default.Table_4976f48030094963afeecc3ae6c7e9b0 [id=a1745c5707ca48a2b03777da8a6cd001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.870314 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de0e7ba1b4342f2954aeb736d6a8902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.873147 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a5afc5611d3481e9a6d48381dc67e86 with delete_type TABLET_DATA_DELETED (replaced by tablet 457a4b623072460d96cc5d11b675cceb) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:48.874352 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e7631e303654f7e972e2cc2f7f6d47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.875063 2704 tablet_replica.cc:333] T 5f63108c062348b1ba995ea16f40a695 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:48.875978 2704 raft_consensus.cc:2243] T 5f63108c062348b1ba995ea16f40a695 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.876217 2704 raft_consensus.cc:2272] T 5f63108c062348b1ba995ea16f40a695 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.876915 2704 ts_tablet_manager.cc:1916] T 5f63108c062348b1ba995ea16f40a695 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.877638 762 tablet_service.cc:1511] Processing CreateTablet for tablet 2b1cac40accf4df3be4a906305b28706 (DEFAULT_TABLE table=default.Table_5a1ab6b7b3db4dfeb0dba6b1254a032c [id=8a6f6a976da34a72aef0b4c4b5a753a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.877655 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 42fc3a9965804b5eb0c9f96eabc38553 (table default.Table_4174268bc53e4124b60df6ac9ee39eae [id=34ae57119f9549aeb0123c5d46118cf5]) successfully deleted
I20260318 02:51:48.878017 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b1cac40accf4df3be4a906305b28706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.882007 756 tablet_service.cc:1511] Processing CreateTablet for tablet 9425763843b54ce9a9d216046d6ce17e (DEFAULT_TABLE table=default.Table_70703d3573974121b1631b1fd237b09c [id=c90ab66a183247aeb9748edd763b00ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.882344 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9425763843b54ce9a9d216046d6ce17e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.883545 759 tablet_service.cc:1511] Processing CreateTablet for tablet 2c5400cd0c2a447b9d8b7381dcadf0be (DEFAULT_TABLE table=default.Table_119e7456847d4df99177b395cc26fcc4 [id=ce5bea0e46b446dd92e5c6a2c298916e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.883873 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c5400cd0c2a447b9d8b7381dcadf0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.885332 750 tablet_service.cc:1511] Processing CreateTablet for tablet b770b09798a6433daf9ec06128dee689 (DEFAULT_TABLE table=default.Table_dd64f667c9894282a95897cd143f0965 [id=dbdfbeca4a1e43d0be38eef03bc10bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.885679 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b770b09798a6433daf9ec06128dee689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.878014 1184 ts_tablet_manager.cc:1929] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.888938 1184 log.cc:1199] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/ce82c595e30a4878be25be8eb3d30790
I20260318 02:51:48.889014 761 tablet_service.cc:1511] Processing CreateTablet for tablet 7cae709e0915495e96177beffb910b01 (DEFAULT_TABLE table=default.Table_c88cc2fd710a4910992ba3010b134825 [id=e98f510836594d8ebb0da395137875ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.889215 1184 ts_tablet_manager.cc:1950] T ce82c595e30a4878be25be8eb3d30790 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:48.889312 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cae709e0915495e96177beffb910b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.890103 766 tablet_service.cc:1511] Processing CreateTablet for tablet 8dbaa63491ba4ad1b863f4417e3d2e40 (DEFAULT_TABLE table=default.Table_7d8be37120444625a37452a9660aaa43 [id=7ccbabfaed4640f8bfb8adc8f60f7a73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.890408 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dbaa63491ba4ad1b863f4417e3d2e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.891887 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cda2afa253041449b3c5dcb0547160b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:48.892047 999 leader_election.cc:304] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:48.892405 2835 raft_consensus.cc:493] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.892531 2835 raft_consensus.cc:515] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:48.893065 2835 leader_election.cc:290] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
W20260318 02:51:48.893916 860 leader_election.cc:343] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 4df7d75e696a4aec981de3963c282b0d
I20260318 02:51:48.894028 860 leader_election.cc:304] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:48.896287 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c89f413a26a43ef95c850d7c44f85b2" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:48.896588 719 leader_election.cc:343] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.896734 719 leader_election.cc:304] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:48.896808 997 leader_election.cc:343] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.897406 2835 raft_consensus.cc:2804] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:48.897543 2835 raft_consensus.cc:697] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
W20260318 02:51:48.897661 999 leader_election.cc:343] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 5c89f413a26a43ef95c850d7c44f85b2
I20260318 02:51:48.897766 999 leader_election.cc:304] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:48.898007 2660 raft_consensus.cc:2749] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.898169 2831 raft_consensus.cc:2749] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.897773 2835 consensus_queue.cc:237] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.903388 2764 raft_consensus.cc:2749] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.904274 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 2de0e7ba1b4342f2954aeb736d6a8902 (DEFAULT_TABLE table=default.Table_4976f48030094963afeecc3ae6c7e9b0 [id=a1745c5707ca48a2b03777da8a6cd001]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.905014 907 tablet_service.cc:1511] Processing CreateTablet for tablet 83760c5d9e734b5eb4b04a6fd2ebf8b1 (DEFAULT_TABLE table=default.Table_a886da56344648d48d38d83f4d8c1986 [id=45d100c06d7e49a08ce5ca5fed4e4977]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.905449 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83760c5d9e734b5eb4b04a6fd2ebf8b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.907531 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de0e7ba1b4342f2954aeb736d6a8902. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.911216 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 83760c5d9e734b5eb4b04a6fd2ebf8b1 (DEFAULT_TABLE table=default.Table_a886da56344648d48d38d83f4d8c1986 [id=45d100c06d7e49a08ce5ca5fed4e4977]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.911595 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83760c5d9e734b5eb4b04a6fd2ebf8b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.915110 1184 tablet_replica.cc:333] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:48.917951 900 tablet_service.cc:1511] Processing CreateTablet for tablet 7f76aa810963488da34cb9797cb460d0 (DEFAULT_TABLE table=default.Table_72fe6064160f43009ee01778bf3b8724 [id=73f18c890ad24bde8b1a4f848ad2b423]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.918350 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f76aa810963488da34cb9797cb460d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.918334 1184 raft_consensus.cc:2243] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.918483 1184 raft_consensus.cc:2272] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.919011 1184 ts_tablet_manager.cc:1916] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.920279 1175 ts_tablet_manager.cc:1929] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.920372 1175 log.cc:1199] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/b317cc133346412fb981b1c8e5b99c4d
I20260318 02:51:48.920619 1175 ts_tablet_manager.cc:1950] T b317cc133346412fb981b1c8e5b99c4d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:48.915341 1172 tablet_bootstrap.cc:492] T 6deb99f7937144f39409929f99b135c5 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:48.923205 1172 ts_tablet_manager.cc:1403] T 6deb99f7937144f39409929f99b135c5 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.125s user 0.014s sys 0.003s
I20260318 02:51:48.925460 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 7f76aa810963488da34cb9797cb460d0 (DEFAULT_TABLE table=default.Table_72fe6064160f43009ee01778bf3b8724 [id=73f18c890ad24bde8b1a4f848ad2b423]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.925542 1172 raft_consensus.cc:359] T 6deb99f7937144f39409929f99b135c5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.925731 1172 raft_consensus.cc:385] T 6deb99f7937144f39409929f99b135c5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.925786 1172 raft_consensus.cc:740] T 6deb99f7937144f39409929f99b135c5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.926031 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f76aa810963488da34cb9797cb460d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.929708 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1368) took 1224 ms. Trace:
I20260318 02:51:48.929817 1175 rpcz_store.cc:276] 0318 02:51:47.705103 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:47.705150 (+ 47us) service_pool.cc:225] Handling call
0318 02:51:48.803306 (+1098156us) ts_tablet_manager.cc:1151] Deleting tablet b317cc133346412fb981b1c8e5b99c4d
0318 02:51:48.803315 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:48.871093 (+ 67778us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:48.920185 (+ 49092us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:48.929689 (+ 9504us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":973751}
I20260318 02:51:48.931529 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1369) took 1141 ms. Trace:
I20260318 02:51:48.931619 1175 rpcz_store.cc:276] 0318 02:51:47.789863 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:47.789915 (+ 52us) service_pool.cc:225] Handling call
0318 02:51:48.931393 (+1141478us) ts_tablet_manager.cc:1151] Deleting tablet dd97103da8924a4583cf5fe300073446
0318 02:51:48.931404 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:48.931509 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1100972}
I20260318 02:51:48.932901 900 tablet_service.cc:1511] Processing CreateTablet for tablet a4f9cc4dfa664af2ae4d4b73d19fa499 (DEFAULT_TABLE table=default.Table_6349037f9ffc41d18ef322698885aea5 [id=849aed18c2924d0da376a9a4edfa232d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.933193 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1370) took 1142 ms. Trace:
I20260318 02:51:48.933271 1175 rpcz_store.cc:276] 0318 02:51:47.790413 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:47.790460 (+ 47us) service_pool.cc:225] Handling call
0318 02:51:48.933087 (+1142627us) ts_tablet_manager.cc:1151] Deleting tablet 17699eee74be4698b84ee6f604aec41a
0318 02:51:48.933096 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:48.933178 (+ 82us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1102482}
I20260318 02:51:48.933373 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f9cc4dfa664af2ae4d4b73d19fa499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.936128 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1371) took 1006 ms. Trace:
I20260318 02:51:48.936208 1175 rpcz_store.cc:276] 0318 02:51:47.929943 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:47.930071 (+ 128us) service_pool.cc:225] Handling call
0318 02:51:48.936017 (+1005946us) ts_tablet_manager.cc:1151] Deleting tablet 8b715c5a31ba4515996595de89f1d62c
0318 02:51:48.936026 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:48.936111 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1005739}
I20260318 02:51:48.926017 1172 consensus_queue.cc:260] T 6deb99f7937144f39409929f99b135c5 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.938095 1172 ts_tablet_manager.cc:1434] T 6deb99f7937144f39409929f99b135c5 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260318 02:51:48.940168 2764 raft_consensus.cc:493] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.940346 2764 raft_consensus.cc:515] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.940979 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1372) took 1009 ms. Trace:
I20260318 02:51:48.941051 1175 rpcz_store.cc:276] 0318 02:51:47.931440 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:47.931489 (+ 49us) service_pool.cc:225] Handling call
0318 02:51:48.940869 (+1009380us) ts_tablet_manager.cc:1151] Deleting tablet f5784c1c633045eaba000b7f0ea137c0
0318 02:51:48.940878 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:48.940963 (+ 85us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1009204}
W20260318 02:51:48.941752 860 leader_election.cc:343] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 2f04e5699531479d8b76edb0e2d2873c
I20260318 02:51:48.942242 2764 leader_election.cc:290] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:48.942334 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1373) took 1009 ms. Trace:
I20260318 02:51:48.943953 2660 raft_consensus.cc:493] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.944083 2660 raft_consensus.cc:515] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.944648 2660 leader_election.cc:290] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:48.945063 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed193d1b80be496298dae6fafef94577" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:48.945490 719 leader_election.cc:343] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:48.945716 862 leader_election.cc:343] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 2f04e5699531479d8b76edb0e2d2873c
I20260318 02:51:48.945832 862 leader_election.cc:304] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:48.946450 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed193d1b80be496298dae6fafef94577" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:48.946744 2764 raft_consensus.cc:2749] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.942404 1175 rpcz_store.cc:276] 0318 02:51:47.932391 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:47.932443 (+ 52us) service_pool.cc:225] Handling call
0318 02:51:48.942239 (+1009796us) ts_tablet_manager.cc:1151] Deleting tablet 71ea229381d540fdae9b2d7bf3eac2b6
0318 02:51:48.942248 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:48.942322 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1009632}
W20260318 02:51:48.947266 719 leader_election.cc:343] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:48.947381 719 leader_election.cc:304] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:48.947834 2660 raft_consensus.cc:2749] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.948491 1172 tablet_bootstrap.cc:492] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:48.951243 1175 tablet_replica.cc:333] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:48.952108 896 tablet_service.cc:1511] Processing CreateTablet for tablet 5e7631e303654f7e972e2cc2f7f6d47a (DEFAULT_TABLE table=default.Table_6c5efa5b460245ed8de1a2593c6655a1 [id=af289884f69e45e78618c3b2047fd887]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.952489 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e7631e303654f7e972e2cc2f7f6d47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.952827 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 2b1cac40accf4df3be4a906305b28706 (DEFAULT_TABLE table=default.Table_5a1ab6b7b3db4dfeb0dba6b1254a032c [id=8a6f6a976da34a72aef0b4c4b5a753a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.952960 892 tablet_service.cc:1511] Processing CreateTablet for tablet 2b1cac40accf4df3be4a906305b28706 (DEFAULT_TABLE table=default.Table_5a1ab6b7b3db4dfeb0dba6b1254a032c [id=8a6f6a976da34a72aef0b4c4b5a753a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.953166 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b1cac40accf4df3be4a906305b28706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.953290 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b1cac40accf4df3be4a906305b28706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.953775 1031 tablet_service.cc:1511] Processing CreateTablet for tablet ae4537c922b54151995ed787323a2580 (DEFAULT_TABLE table=default.Table_69a57541ae934bd6947a6380a12a6b15 [id=e6291d732a764e76a96cd5707fb37978]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.954067 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae4537c922b54151995ed787323a2580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.954212 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 6bb381f10d87414f9c1a99942216adc7 (table default.Table_944b58673e2348228ec36d8ba31e25b4 [id=b175f925e78640e586132f07ed6e44c0]) successfully deleted
I20260318 02:51:48.954559 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet b317cc133346412fb981b1c8e5b99c4d (table default.Table_39aee165029f47559776d7610e509b6a [id=dbaa2341227b48d19ec73a413513358a]) successfully deleted
W20260318 02:51:48.954712 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet dd97103da8924a4583cf5fe300073446 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd97103da8924a4583cf5fe300073446 already in progress: creating tablet
W20260318 02:51:48.954857 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 17699eee74be4698b84ee6f604aec41a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17699eee74be4698b84ee6f604aec41a already in progress: creating tablet
W20260318 02:51:48.954979 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 8b715c5a31ba4515996595de89f1d62c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b715c5a31ba4515996595de89f1d62c already in progress: creating tablet
W20260318 02:51:48.955199 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f5784c1c633045eaba000b7f0ea137c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5784c1c633045eaba000b7f0ea137c0 already in progress: creating tablet
W20260318 02:51:48.955361 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 71ea229381d540fdae9b2d7bf3eac2b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 71ea229381d540fdae9b2d7bf3eac2b6 already in progress: creating tablet
W20260318 02:51:48.955492 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet bfdb59b3a53a447eab72947d1bbdb5bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bfdb59b3a53a447eab72947d1bbdb5bb already in progress: creating tablet
W20260318 02:51:48.955634 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet f2c7972bf42744699012425706ac4667 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2c7972bf42744699012425706ac4667 already in progress: creating tablet
I20260318 02:51:48.956218 901 tablet_service.cc:1511] Processing CreateTablet for tablet 2c5400cd0c2a447b9d8b7381dcadf0be (DEFAULT_TABLE table=default.Table_119e7456847d4df99177b395cc26fcc4 [id=ce5bea0e46b446dd92e5c6a2c298916e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.956503 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c5400cd0c2a447b9d8b7381dcadf0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.956960 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 5e7631e303654f7e972e2cc2f7f6d47a (DEFAULT_TABLE table=default.Table_6c5efa5b460245ed8de1a2593c6655a1 [id=af289884f69e45e78618c3b2047fd887]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.952958 903 tablet_service.cc:1511] Processing CreateTablet for tablet 9425763843b54ce9a9d216046d6ce17e (DEFAULT_TABLE table=default.Table_70703d3573974121b1631b1fd237b09c [id=c90ab66a183247aeb9748edd763b00ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.957238 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e7631e303654f7e972e2cc2f7f6d47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.957371 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9425763843b54ce9a9d216046d6ce17e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.958777 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 9425763843b54ce9a9d216046d6ce17e (DEFAULT_TABLE table=default.Table_70703d3573974121b1631b1fd237b09c [id=c90ab66a183247aeb9748edd763b00ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.959061 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9425763843b54ce9a9d216046d6ce17e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.964988 2835 raft_consensus.cc:493] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:48.965116 2835 raft_consensus.cc:515] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.965888 2835 leader_election.cc:290] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:48.970244 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e578c7498b6404cb87f493127005500" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:48.970943 997 leader_election.cc:343] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:48.973227 999 leader_election.cc:343] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 8e578c7498b6404cb87f493127005500
I20260318 02:51:48.973366 999 leader_election.cc:304] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:48.973611 2831 raft_consensus.cc:2749] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:48.978894 1184 ts_tablet_manager.cc:1929] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.979022 1184 log.cc:1199] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/fd1284c6e90d4beb8223fd807d7888ec
I20260318 02:51:48.979283 1184 ts_tablet_manager.cc:1950] T fd1284c6e90d4beb8223fd807d7888ec P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:48.980136 1184 tablet_replica.cc:333] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:48.980324 1184 raft_consensus.cc:2243] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.980453 1184 raft_consensus.cc:2272] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.984000 761 tablet_service.cc:1511] Processing CreateTablet for tablet 701d194fa563462296d33d85d279eeba (DEFAULT_TABLE table=default.Table_6c961a722c82458eb3d186f364834b85 [id=b0b33b6b5c684bd28fd339ee7ea6834d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.984702 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701d194fa563462296d33d85d279eeba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.989537 1173 tablet_bootstrap.cc:492] T 895aa252b9f243d89e972d1b717ee910 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:48.989683 1173 ts_tablet_manager.cc:1403] T 895aa252b9f243d89e972d1b717ee910 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.241s user 0.012s sys 0.001s
I20260318 02:51:48.990334 1173 raft_consensus.cc:359] T 895aa252b9f243d89e972d1b717ee910 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.990499 1173 raft_consensus.cc:385] T 895aa252b9f243d89e972d1b717ee910 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:48.990557 1173 raft_consensus.cc:740] T 895aa252b9f243d89e972d1b717ee910 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:48.990720 1184 ts_tablet_manager.cc:1916] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.990777 1173 consensus_queue.cc:260] T 895aa252b9f243d89e972d1b717ee910 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:48.991346 1173 ts_tablet_manager.cc:1434] T 895aa252b9f243d89e972d1b717ee910 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260318 02:51:48.991436 1175 raft_consensus.cc:2243] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:48.991847 1175 raft_consensus.cc:2272] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:48.991719 1030 tablet_service.cc:1511] Processing CreateTablet for tablet a4f9cc4dfa664af2ae4d4b73d19fa499 (DEFAULT_TABLE table=default.Table_6349037f9ffc41d18ef322698885aea5 [id=849aed18c2924d0da376a9a4edfa232d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.992337 1175 ts_tablet_manager.cc:1916] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:48.992399 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 2c5400cd0c2a447b9d8b7381dcadf0be (DEFAULT_TABLE table=default.Table_119e7456847d4df99177b395cc26fcc4 [id=ce5bea0e46b446dd92e5c6a2c298916e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.992537 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f9cc4dfa664af2ae4d4b73d19fa499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.992753 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c5400cd0c2a447b9d8b7381dcadf0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.994194 903 tablet_service.cc:1511] Processing CreateTablet for tablet 7cae709e0915495e96177beffb910b01 (DEFAULT_TABLE table=default.Table_c88cc2fd710a4910992ba3010b134825 [id=e98f510836594d8ebb0da395137875ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.994863 2704 ts_tablet_manager.cc:1929] T 5f63108c062348b1ba995ea16f40a695 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:48.995218 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 7cae709e0915495e96177beffb910b01 (DEFAULT_TABLE table=default.Table_c88cc2fd710a4910992ba3010b134825 [id=e98f510836594d8ebb0da395137875ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.995411 896 tablet_service.cc:1511] Processing CreateTablet for tablet 8dbaa63491ba4ad1b863f4417e3d2e40 (DEFAULT_TABLE table=default.Table_7d8be37120444625a37452a9660aaa43 [id=7ccbabfaed4640f8bfb8adc8f60f7a73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.995668 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cae709e0915495e96177beffb910b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.996188 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet ce82c595e30a4878be25be8eb3d30790 (table default.Table_cf5f0ff49fa24bf18b21a4ebbe45d2e4 [id=c532f0623efe4c3f8d9c90ae9c3d02c3]) successfully deleted
I20260318 02:51:48.996955 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet fd1284c6e90d4beb8223fd807d7888ec (table default.Table_86b70df7bd76402aaa4c0b1faa730a62 [id=d1dd0940c55b4a4a97cf0f8543ebcaf8]) successfully deleted
I20260318 02:51:48.996958 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 8dbaa63491ba4ad1b863f4417e3d2e40 (DEFAULT_TABLE table=default.Table_7d8be37120444625a37452a9660aaa43 [id=7ccbabfaed4640f8bfb8adc8f60f7a73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.997377 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dbaa63491ba4ad1b863f4417e3d2e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:48.997538 901 tablet_service.cc:1511] Processing CreateTablet for tablet b770b09798a6433daf9ec06128dee689 (DEFAULT_TABLE table=default.Table_dd64f667c9894282a95897cd143f0965 [id=dbdfbeca4a1e43d0be38eef03bc10bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.995411 900 tablet_service.cc:1511] Processing CreateTablet for tablet ae4537c922b54151995ed787323a2580 (DEFAULT_TABLE table=default.Table_69a57541ae934bd6947a6380a12a6b15 [id=e6291d732a764e76a96cd5707fb37978]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:48.998710 2753 webserver.cc:492] Webserver started at http://127.0.104.188:37041/ using document root <none> and password file <none>
I20260318 02:51:48.999868 2753 fs_manager.cc:362] Metadata directory not provided
I20260318 02:51:49.000008 2753 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260318 02:51:49.004781 1035 tablet_service.cc:1511] Processing CreateTablet for tablet b770b09798a6433daf9ec06128dee689 (DEFAULT_TABLE table=default.Table_dd64f667c9894282a95897cd143f0965 [id=dbdfbeca4a1e43d0be38eef03bc10bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.005025 893 tablet_service.cc:1511] Processing CreateTablet for tablet 701d194fa563462296d33d85d279eeba (DEFAULT_TABLE table=default.Table_6c961a722c82458eb3d186f364834b85 [id=b0b33b6b5c684bd28fd339ee7ea6834d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.005200 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b770b09798a6433daf9ec06128dee689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.006093 2704 log.cc:1199] T 5f63108c062348b1ba995ea16f40a695 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/5f63108c062348b1ba995ea16f40a695
I20260318 02:51:49.006300 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 701d194fa563462296d33d85d279eeba (DEFAULT_TABLE table=default.Table_6c961a722c82458eb3d186f364834b85 [id=b0b33b6b5c684bd28fd339ee7ea6834d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.006524 2704 ts_tablet_manager.cc:1950] T 5f63108c062348b1ba995ea16f40a695 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:49.006630 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701d194fa563462296d33d85d279eeba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.014523 2704 tablet_replica.cc:333] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:49.014523 1184 ts_tablet_manager.cc:1929] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.014634 1184 log.cc:1199] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/5c89f413a26a43ef95c850d7c44f85b2
I20260318 02:51:49.014845 2704 raft_consensus.cc:2243] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.015913 2704 raft_consensus.cc:2272] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.016534 2704 ts_tablet_manager.cc:1916] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.017303 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 5f63108c062348b1ba995ea16f40a695 (table default.Table_6799c18042274bc9a7f0a18d69756ecb [id=bc2b86c84e194e1ca11aa9724a09dec2]) successfully deleted
I20260318 02:51:49.022329 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b770b09798a6433daf9ec06128dee689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.024621 1175 ts_tablet_manager.cc:1929] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.025079 1184 ts_tablet_manager.cc:1950] T 5c89f413a26a43ef95c850d7c44f85b2 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:49.026026 1184 tablet_replica.cc:333] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:49.026273 1184 raft_consensus.cc:2243] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.026459 1184 raft_consensus.cc:2272] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.027199 1173 tablet_bootstrap.cc:492] T 453a1c6f16194cab91c0223e2eeda7ab P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:49.018224 1172 tablet_bootstrap.cc:654] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:49.021152 997 consensus_peers.cc:597] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:49.027194 1184 ts_tablet_manager.cc:1916] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.028575 1173 tablet_bootstrap.cc:654] T 453a1c6f16194cab91c0223e2eeda7ab P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.030236 1174 tablet_bootstrap.cc:492] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:49.030376 1174 ts_tablet_manager.cc:1403] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.182s user 0.000s sys 0.003s
I20260318 02:51:49.031134 1174 raft_consensus.cc:359] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.031325 1174 raft_consensus.cc:385] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.031395 1174 raft_consensus.cc:740] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.031858 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae4537c922b54151995ed787323a2580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.032282 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cae709e0915495e96177beffb910b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.032822 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701d194fa563462296d33d85d279eeba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.033728 2859 raft_consensus.cc:493] T d26c7c573c40412f88b9c6cc71a3c648 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.033903 2859 raft_consensus.cc:515] T d26c7c573c40412f88b9c6cc71a3c648 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.033951 2753 fs_manager.cc:714] Time spent opening directory manager: real 0.031s user 0.005s sys 0.002s
I20260318 02:51:49.034605 2859 leader_election.cc:290] T d26c7c573c40412f88b9c6cc71a3c648 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:49.036098 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26c7c573c40412f88b9c6cc71a3c648" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:49.036376 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26c7c573c40412f88b9c6cc71a3c648" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:49.036815 719 leader_election.cc:343] T d26c7c573c40412f88b9c6cc71a3c648 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:49.037322 719 leader_election.cc:343] T d26c7c573c40412f88b9c6cc71a3c648 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.037448 719 leader_election.cc:304] T d26c7c573c40412f88b9c6cc71a3c648 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:49.037942 2859 raft_consensus.cc:2749] T d26c7c573c40412f88b9c6cc71a3c648 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:49.038781 2704 ts_tablet_manager.cc:1929] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.038899 2704 log.cc:1199] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/ed193d1b80be496298dae6fafef94577
I20260318 02:51:49.039218 2704 ts_tablet_manager.cc:1950] T ed193d1b80be496298dae6fafef94577 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:49.040115 2704 tablet_replica.cc:333] T e993481bf55747b0a6a1c996c6917408 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:49.040341 2704 raft_consensus.cc:2243] T e993481bf55747b0a6a1c996c6917408 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.040518 2704 raft_consensus.cc:2272] T e993481bf55747b0a6a1c996c6917408 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.041710 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet ed193d1b80be496298dae6fafef94577 (table default.Table_c374a4de160944ef9e12b190b7947bcc [id=19c97904f14f4e7883a746c65506eaf4]) successfully deleted
I20260318 02:51:49.044207 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dbaa63491ba4ad1b863f4417e3d2e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.048216 1184 ts_tablet_manager.cc:1929] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.048331 1184 log.cc:1199] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/b894f0772a754196a3e651b38c46f001
I20260318 02:51:49.048585 1184 ts_tablet_manager.cc:1950] T b894f0772a754196a3e651b38c46f001 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:49.049142 2831 raft_consensus.cc:493] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.049276 2831 raft_consensus.cc:515] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.049901 2831 leader_election.cc:290] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:49.050828 999 leader_election.cc:343] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: fb5d1d828899472e8f48723b35e94d62
I20260318 02:51:49.053135 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb5d1d828899472e8f48723b35e94d62" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:49.053704 997 leader_election.cc:343] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.053819 997 leader_election.cc:304] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:49.054230 2831 raft_consensus.cc:2749] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:49.054381 2704 ts_tablet_manager.cc:1916] T e993481bf55747b0a6a1c996c6917408 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.055351 2899 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260318 02:51:49.056143 1174 consensus_queue.cc:260] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.059283 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 5c89f413a26a43ef95c850d7c44f85b2 (table default.Table_9f269c4844cc473580c4743dd9be3dea [id=997461446ec8473382964afdb61aafb3]) successfully deleted
I20260318 02:51:49.059785 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet b894f0772a754196a3e651b38c46f001 (table default.Table_b3839730b36c41868e3760527839bafb [id=c5fda294c63f4731b2890404b92def44]) successfully deleted
I20260318 02:51:49.060577 2831 consensus_queue.cc:1048] T 9c05f7a75527410e9c5cde0dbc6bc10e P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:49.063943 1184 tablet_replica.cc:333] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:49.064368 1184 raft_consensus.cc:2243] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:49.064482 2753 fs_manager.cc:730] Time spent opening block manager: real 0.023s user 0.002s sys 0.001s
I20260318 02:51:49.064692 2753 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data,/tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/wal
uuid: "971baf5b9e4644c990dbf4d4fc7ba900"
format_stamp: "Formatted at 2026-03-18 02:51:16 on dist-test-slave-km68"
I20260318 02:51:49.065752 2753 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260318 02:51:49.064996 1184 raft_consensus.cc:2272] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.068488 2859 raft_consensus.cc:493] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.068652 2859 raft_consensus.cc:515] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.069270 2859 leader_election.cc:290] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:49.069553 1184 ts_tablet_manager.cc:1916] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.070528 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b4933dda1e465bb1d14d20433f3772" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:49.070955 719 leader_election.cc:343] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.071233 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b4933dda1e465bb1d14d20433f3772" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:49.071795 719 leader_election.cc:343] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.071906 719 leader_election.cc:304] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:49.072353 2660 raft_consensus.cc:2749] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:49.081293 1175 log.cc:1199] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/f37ab96f13444fcbb5cfc3ad92d53c35
I20260318 02:51:49.081424 2764 raft_consensus.cc:493] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.081574 2764 raft_consensus.cc:515] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.082223 2764 leader_election.cc:290] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:49.083491 862 leader_election.cc:343] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 20a492fdea6c44ba8439614b0dcc2ba6
W20260318 02:51:49.083827 860 leader_election.cc:343] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 20a492fdea6c44ba8439614b0dcc2ba6
I20260318 02:51:49.083920 860 leader_election.cc:304] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:49.084314 2764 raft_consensus.cc:2749] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:49.084937 1175 ts_tablet_manager.cc:1950] T f37ab96f13444fcbb5cfc3ad92d53c35 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:49.085369 1175 tablet_replica.cc:333] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:49.085680 2665 raft_consensus.cc:493] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.085801 2665 raft_consensus.cc:515] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.086344 2665 leader_election.cc:290] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:49.086742 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75f367cde75433d86a4ee9384e57761" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:49.086934 777 raft_consensus.cc:2468] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:49.087289 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75f367cde75433d86a4ee9384e57761" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:49.087648 999 leader_election.cc:304] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
W20260318 02:51:49.087779 997 leader_election.cc:343] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.087884 2665 raft_consensus.cc:2804] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:49.087973 2665 raft_consensus.cc:493] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:49.088032 2665 raft_consensus.cc:3060] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:49.090515 2665 raft_consensus.cc:515] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.091686 2665 leader_election.cc:290] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:49.092185 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75f367cde75433d86a4ee9384e57761" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:49.092305 2704 ts_tablet_manager.cc:1929] T e993481bf55747b0a6a1c996c6917408 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.092406 777 raft_consensus.cc:3060] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:49.092425 2704 log.cc:1199] T e993481bf55747b0a6a1c996c6917408 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/e993481bf55747b0a6a1c996c6917408
I20260318 02:51:49.093668 1172 tablet_bootstrap.cc:492] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:49.093801 1172 ts_tablet_manager.cc:1403] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.145s user 0.005s sys 0.009s
I20260318 02:51:49.094534 1172 raft_consensus.cc:359] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:49.080953 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6659a0d0ee3c435187cdcf3920f1d5e7 consensus state has no leader
I20260318 02:51:49.094791 1172 raft_consensus.cc:385] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.094846 1172 raft_consensus.cc:740] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.095058 1172 consensus_queue.cc:260] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.095340 777 raft_consensus.cc:2468] T a75f367cde75433d86a4ee9384e57761 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:49.096410 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75f367cde75433d86a4ee9384e57761" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:49.081668 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 15cae82c808a435e86f8c514e415d546
I20260318 02:51:49.096956 999 leader_election.cc:304] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
W20260318 02:51:49.097901 997 leader_election.cc:343] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.098518 2152 raft_consensus.cc:2804] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:49.098630 2152 raft_consensus.cc:697] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:49.098869 2152 consensus_queue.cc:237] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.082755 457 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 895aa252b9f243d89e972d1b717ee910 (table default.Table_2afe66e6b2374e3c9b8e4692abb54d07 [id=6f9eb9fbda9846d495f3e70e229a5590]). Expected version 1 got 0
I20260318 02:51:49.100916 457 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 3cda2afa253041449b3c5dcb0547160b (table default.Table_36fe3a38bffa40f2b21e245f4fe2e57c [id=5650557102db4b8d817f64db612bb519]). Expected version 1 got 0
I20260318 02:51:49.072358 1174 ts_tablet_manager.cc:1434] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.042s user 0.000s sys 0.002s
I20260318 02:51:49.102059 1174 tablet_bootstrap.cc:492] T 540498d9949349f39796087173099d69 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:49.103550 1172 ts_tablet_manager.cc:1434] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260318 02:51:49.104377 1172 tablet_bootstrap.cc:492] T 14c35d41da7146faa89d8af3bb5f5140 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:49.085534 1175 raft_consensus.cc:2243] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.104926 1175 raft_consensus.cc:2272] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.107789 452 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 895aa252b9f243d89e972d1b717ee910 (table default.Table_2afe66e6b2374e3c9b8e4692abb54d07 [id=6f9eb9fbda9846d495f3e70e229a5590]). Expected version 1 got 0
I20260318 02:51:49.108469 1175 ts_tablet_manager.cc:1916] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.110809 452 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ca056f93d2b34add91c12aaf8b2ba513" } modify_external_catalogs: true
I20260318 02:51:49.110906 921 raft_consensus.cc:3060] T 6e2a586892a24c71a956dbbe382484c9 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:49.110994 452 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ca056f93d2b34add91c12aaf8b2ba513" } modify_external_catalogs: true
I20260318 02:51:49.111239 1172 tablet_bootstrap.cc:654] T 14c35d41da7146faa89d8af3bb5f5140 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.112092 1184 ts_tablet_manager.cc:1929] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:49.113754 1184 log.cc:1199] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/5aeffffd34f047eeaa9a8a5100c7aad2
I20260318 02:51:49.114303 1184 ts_tablet_manager.cc:1950] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:49.115900 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 895aa252b9f243d89e972d1b717ee910 (table default.Table_2afe66e6b2374e3c9b8e4692abb54d07 [id=6f9eb9fbda9846d495f3e70e229a5590]). Expected version 1 got 0
I20260318 02:51:49.116115 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet a75f367cde75433d86a4ee9384e57761 (table default.Table_ed6ebe71dc614470a951f2e484f28d88 [id=837cbf1e256f46f484ceb9ffa208891c]). Expected version 1 got 0
I20260318 02:51:49.116254 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 3073fbe00c5d45b6b3100e927e0cc5c3 (table default.Table_f368a8dc34ae4ea7815aea031af47ed3 [id=2c3964f728cc4231805fe553a37766ae]). Expected version 1 got 0
I20260318 02:51:49.119271 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 15cae82c808a435e86f8c514e415d546 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:48 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.119550 749 tablet_service.cc:1558] Processing DeleteTablet for tablet ca4e1eec9a2148488295416cd68ca607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:34 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.119561 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 59ce7583e7f545f18145b4e55e1fbb81 with delete_type TABLET_DATA_DELETED (replaced by tablet 6934cf71f9034febb5e0ebfa410fb94b) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.120199 766 tablet_service.cc:1558] Processing DeleteTablet for tablet de38fe3eb88147eab65f3dfed37fbf7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:39 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.120285 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ac9581312964ad6afcc96f798fa534a with delete_type TABLET_DATA_DELETED (replaced by tablet 7dbcee4d14064cbdbcf7641cfc1c58d4) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.120671 749 tablet_service.cc:1558] Processing DeleteTablet for tablet f95ebc89fd2545b1835a1bc10414248d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:36 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.116493 456 catalog_manager.cc:5671] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:49.122824 456 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet b698d732a905469caaf564d9512ba02c (table default.Table_6238662cdd5443a694ee4feec8bc0413 [id=eb11e3d1c3ef4295ac9b6ee657ac233a]). Expected version 1 got 0
I20260318 02:51:49.107395 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_061349cc00fd49a8b616b9b60caae177" } modify_external_catalogs: true
I20260318 02:51:49.125010 2704 ts_tablet_manager.cc:1950] T e993481bf55747b0a6a1c996c6917408 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:49.124998 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_061349cc00fd49a8b616b9b60caae177" } modify_external_catalogs: true
I20260318 02:51:49.128491 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet e993481bf55747b0a6a1c996c6917408 (table default.Table_614e1c29256e4ddbb9a5dfb12f4a27f2 [id=c868efae5833440b90596b5de5d7b800]) successfully deleted
W20260318 02:51:49.128876 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 0ab9bdc476f64d758637a12148f2b092 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ab9bdc476f64d758637a12148f2b092 already in progress: creating tablet
I20260318 02:51:49.124975 1174 tablet_bootstrap.cc:654] T 540498d9949349f39796087173099d69 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.130873 1173 tablet_bootstrap.cc:492] T 453a1c6f16194cab91c0223e2eeda7ab P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
W20260318 02:51:49.130916 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 821c1f9f90504d2580d311682fc19a5a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 821c1f9f90504d2580d311682fc19a5a already in progress: creating tablet
I20260318 02:51:49.131026 1173 ts_tablet_manager.cc:1403] T 453a1c6f16194cab91c0223e2eeda7ab P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.104s user 0.001s sys 0.008s
I20260318 02:51:49.131387 2704 tablet_replica.cc:333] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:49.131651 2704 raft_consensus.cc:2243] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.131719 1173 raft_consensus.cc:359] T 453a1c6f16194cab91c0223e2eeda7ab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.131898 1173 raft_consensus.cc:385] T 453a1c6f16194cab91c0223e2eeda7ab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.131956 1173 raft_consensus.cc:740] T 453a1c6f16194cab91c0223e2eeda7ab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.136358 1184 tablet_replica.cc:333] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:49.136947 1184 raft_consensus.cc:2243] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.137184 1184 raft_consensus.cc:2272] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.137210 1174 tablet_bootstrap.cc:492] T 540498d9949349f39796087173099d69 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:49.137341 1174 ts_tablet_manager.cc:1403] T 540498d9949349f39796087173099d69 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.001s
W20260318 02:51:49.137414 441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.104.131:37025, user_credentials={real_user=slave}} blocked reactor thread for 77666.2us
I20260318 02:51:49.137929 1184 ts_tablet_manager.cc:1916] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.138082 1174 raft_consensus.cc:359] T 540498d9949349f39796087173099d69 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.138248 1174 raft_consensus.cc:385] T 540498d9949349f39796087173099d69 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.138300 1174 raft_consensus.cc:740] T 540498d9949349f39796087173099d69 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.138612 1174 consensus_queue.cc:260] T 540498d9949349f39796087173099d69 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.140763 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet 15cae82c808a435e86f8c514e415d546 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:48 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:49.141067 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 15cae82c808a435e86f8c514e415d546 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:48 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:49.142253 1174 ts_tablet_manager.cc:1434] T 540498d9949349f39796087173099d69 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:49.142737 1174 tablet_bootstrap.cc:492] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:49.142714 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet f37ab96f13444fcbb5cfc3ad92d53c35 (table default.Table_a9ca2b8e5b9042279576e9b9c6701069 [id=3066ad66b0914b759c32fe9296ca90bc]) successfully deleted
I20260318 02:51:49.143790 1172 tablet_bootstrap.cc:492] T 14c35d41da7146faa89d8af3bb5f5140 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:49.143989 1172 ts_tablet_manager.cc:1403] T 14c35d41da7146faa89d8af3bb5f5140 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.002s
I20260318 02:51:49.144778 1174 tablet_bootstrap.cc:654] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.144941 1172 raft_consensus.cc:359] T 14c35d41da7146faa89d8af3bb5f5140 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.145334 1172 raft_consensus.cc:385] T 14c35d41da7146faa89d8af3bb5f5140 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.145601 1172 raft_consensus.cc:740] T 14c35d41da7146faa89d8af3bb5f5140 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.145885 1172 consensus_queue.cc:260] T 14c35d41da7146faa89d8af3bb5f5140 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.149760 1172 ts_tablet_manager.cc:1434] T 14c35d41da7146faa89d8af3bb5f5140 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260318 02:51:49.150130 1172 tablet_bootstrap.cc:492] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:49.151881 1172 tablet_bootstrap.cc:654] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.154893 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 2c5400cd0c2a447b9d8b7381dcadf0be
I20260318 02:51:49.158039 1184 ts_tablet_manager.cc:1929] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.159683 455 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 9c05f7a75527410e9c5cde0dbc6bc10e (table default.Table_fed9534e8e3d410ab1775c885744cc2a [id=113b6b3abc1a4dcc91c49be4704a159c]). Expected version 2 got 0
I20260318 02:51:49.161167 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_944521fea0294e3381643693804fd723" } modify_external_catalogs: true
I20260318 02:51:49.161336 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_944521fea0294e3381643693804fd723" } modify_external_catalogs: true
I20260318 02:51:49.162899 450 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_40ab4cd6e66a433abe4cb9eb1a6baf82" } new_table_name: "default.Table_f9271e4f6a4742bb9e1184c7bf898f10" modify_external_catalogs: true
I20260318 02:51:49.164244 454 master_service.cc:954] ReplaceTablet: received request to replace tablet df9d5919242a41aa8e119570f75b7c24 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:49.165736 1174 tablet_bootstrap.cc:492] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:49.165874 1174 ts_tablet_manager.cc:1403] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20260318 02:51:49.165787 1173 consensus_queue.cc:260] T 453a1c6f16194cab91c0223e2eeda7ab P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.165972 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6906102872944fcb9652909f23caa1cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:49.166491 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6906102872944fcb9652909f23caa1cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:49.166514 1174 raft_consensus.cc:359] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.166677 1174 raft_consensus.cc:385] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.166725 1174 raft_consensus.cc:740] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.166945 1174 consensus_queue.cc:260] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.168085 749 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c5400cd0c2a447b9d8b7381dcadf0be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:48 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.168259 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 99b4933dda1e465bb1d14d20433f3772 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.168921 2859 raft_consensus.cc:493] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.169060 2859 raft_consensus.cc:515] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.169593 2859 leader_election.cc:290] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:49.170663 1174 ts_tablet_manager.cc:1434] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260318 02:51:49.170819 449 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_ce283b50a5884aa99ab7110cc3d0c158" } new_table_name: "default.Table_fa998677e8a249bf859946971e44c9b8" modify_external_catalogs: true
I20260318 02:51:49.171437 1174 tablet_bootstrap.cc:492] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:49.170228 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95ebc89fd2545b1835a1bc10414248d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:49.171859 1184 log.cc:1199] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/fb5d1d828899472e8f48723b35e94d62
I20260318 02:51:49.171701 2152 raft_consensus.cc:493] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.172086 2152 raft_consensus.cc:515] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.172201 1184 ts_tablet_manager.cc:1950] T fb5d1d828899472e8f48723b35e94d62 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
W20260318 02:51:49.172458 719 leader_election.cc:343] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.172840 2152 leader_election.cc:290] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:49.173151 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3b37df330984378b81b367446d34748" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:49.173646 997 leader_election.cc:343] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:49.174309 999 leader_election.cc:343] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: d3b37df330984378b81b367446d34748
I20260318 02:51:49.174407 999 leader_election.cc:304] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:49.174558 1184 tablet_replica.cc:333] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:49.174624 2152 raft_consensus.cc:2749] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:49.174757 1184 raft_consensus.cc:2243] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.174876 1184 raft_consensus.cc:2272] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.175397 1184 ts_tablet_manager.cc:1916] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.175947 1174 tablet_bootstrap.cc:654] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.184123 1172 tablet_bootstrap.cc:492] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:49.184283 1172 ts_tablet_manager.cc:1403] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.002s
I20260318 02:51:49.185071 1172 raft_consensus.cc:359] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.185257 1172 raft_consensus.cc:385] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.185310 1172 raft_consensus.cc:740] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.185542 1172 consensus_queue.cc:260] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.186057 1172 ts_tablet_manager.cc:1434] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:49.186331 1172 tablet_bootstrap.cc:492] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:49.189675 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 597a9271dedf4e789926e7e65fd79dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.192036 455 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_1068ed12c0774560af59c6eb9d2f292c" } new_table_name: "default.Table_3c0a83dcbb7b49b1858e72778990f485" modify_external_catalogs: true
I20260318 02:51:49.192574 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95ebc89fd2545b1835a1bc10414248d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:49.193055 719 leader_election.cc:343] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.193199 719 leader_election.cc:304] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:49.193282 1173 ts_tablet_manager.cc:1434] T 453a1c6f16194cab91c0223e2eeda7ab P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.062s user 0.000s sys 0.002s
I20260318 02:51:49.193426 2859 raft_consensus.cc:2749] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:49.193588 1173 tablet_bootstrap.cc:492] T 9c05f7a75527410e9c5cde0dbc6bc10e P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:49.194945 1173 tablet_bootstrap.cc:654] T 9c05f7a75527410e9c5cde0dbc6bc10e P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:49.196695 441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.189:45933, user_credentials={real_user=slave}} blocked reactor thread for 47883us
W20260318 02:51:49.196957 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 033338a607b145e5bc34fc9281f13067 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 033338a607b145e5bc34fc9281f13067 already in progress: creating tablet
W20260318 02:51:49.197161 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 821c1f9f90504d2580d311682fc19a5a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 821c1f9f90504d2580d311682fc19a5a already in progress: creating tablet
I20260318 02:51:49.197283 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 5aeffffd34f047eeaa9a8a5100c7aad2 (table default.Table_281e478e833f4d13a05ddcf65d026047 [id=1622bac5bf0d47f1a91406ff11a0e116]) successfully deleted
W20260318 02:51:49.197417 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 0ab9bdc476f64d758637a12148f2b092 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ab9bdc476f64d758637a12148f2b092 already in progress: creating tablet
W20260318 02:51:49.197568 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet b54248ad606643a292dff193c35d6a00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b54248ad606643a292dff193c35d6a00 already in progress: creating tablet
I20260318 02:51:49.197791 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet fb5d1d828899472e8f48723b35e94d62 (table default.Table_7692f02c62f94771bc39331507161bb2 [id=60f0afdd0f9f4c5196ea491b90991241]) successfully deleted
I20260318 02:51:49.198314 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c5400cd0c2a447b9d8b7381dcadf0be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:48 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:49.199657 1184 ts_tablet_manager.cc:1929] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.199800 1184 log.cc:1199] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/8e578c7498b6404cb87f493127005500
I20260318 02:51:49.203981 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c5400cd0c2a447b9d8b7381dcadf0be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:48 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:49.204689 1174 tablet_bootstrap.cc:492] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:49.204851 1174 ts_tablet_manager.cc:1403] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.001s
I20260318 02:51:49.205631 1174 raft_consensus.cc:359] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.205801 1174 raft_consensus.cc:385] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.205843 1174 raft_consensus.cc:740] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.205984 2859 raft_consensus.cc:493] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.206053 1174 consensus_queue.cc:260] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.206106 2859 raft_consensus.cc:515] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.206823 2859 leader_election.cc:290] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:49.207581 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a9271dedf4e789926e7e65fd79dfc" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:49.208806 719 leader_election.cc:343] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.209362 1174 ts_tablet_manager.cc:1434] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260318 02:51:49.209676 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "597a9271dedf4e789926e7e65fd79dfc" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:49.210640 719 leader_election.cc:343] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.210760 719 leader_election.cc:304] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:49.211685 2859 raft_consensus.cc:2749] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:49.211901 1174 tablet_bootstrap.cc:492] T abfa81c3c78a498285e2961530272a39 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:49.212965 1184 ts_tablet_manager.cc:1950] T 8e578c7498b6404cb87f493127005500 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:49.214519 2704 raft_consensus.cc:2272] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.214980 1174 tablet_bootstrap.cc:654] T abfa81c3c78a498285e2961530272a39 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.215093 2704 ts_tablet_manager.cc:1916] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.216938 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 8e578c7498b6404cb87f493127005500 (table default.Table_f41e180b423949a7a0f65976f1b993ed [id=c0c36670f3a04ac8a2a792bc64a8249f]) successfully deleted
I20260318 02:51:49.218029 1184 tablet_replica.cc:333] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:49.218259 1184 raft_consensus.cc:2243] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.218443 1184 raft_consensus.cc:2272] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.226204 1184 ts_tablet_manager.cc:1916] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.233489 2704 ts_tablet_manager.cc:1929] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:49.233641 2704 log.cc:1199] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/5aeffffd34f047eeaa9a8a5100c7aad2
I20260318 02:51:49.233990 2704 ts_tablet_manager.cc:1950] T 5aeffffd34f047eeaa9a8a5100c7aad2 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:49.235399 456 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b6e28e78c8ce47bc8a4b3a78f29d43ba" } new_table_name: "default.Table_f8c3447d0fe44825b715b33200c944fe" modify_external_catalogs: true
I20260318 02:51:49.236665 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet c844057d612049d8b90ee51ad8f3ec0b
I20260318 02:51:49.237295 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_75d70b99ebde4152b30bb0ed03420615"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:49.237833 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75d70b99ebde4152b30bb0ed03420615 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:49.239081 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet c58290c2d1c742d3b45dfb5caf52c75b
I20260318 02:51:49.239727 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_aacaf8a3de5e4ff186d32a943a53a373"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:49.240265 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aacaf8a3de5e4ff186d32a943a53a373 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:49.241479 450 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6391ce8612eb43fb82ef13791ef6e4b4 has no consensus state
I20260318 02:51:49.243757 1184 ts_tablet_manager.cc:1929] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.243880 1184 log.cc:1199] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/b10fd13bf3ea48b0896b34fce478e25a
I20260318 02:51:49.244925 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet df9d5919242a41aa8e119570f75b7c24
I20260318 02:51:49.245288 454 catalog_manager.cc:6741] ReplaceTablet: tablet df9d5919242a41aa8e119570f75b7c24 deleted and replaced by tablet 6ae512afd84d4340abf08cd78997de7e
W20260318 02:51:49.245885 449 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0af921934443453f81bcd6bf22544352 consensus state has no leader
I20260318 02:51:49.246313 448 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 895aa252b9f243d89e972d1b717ee910 (table default.Table_2afe66e6b2374e3c9b8e4692abb54d07 [id=6f9eb9fbda9846d495f3e70e229a5590]). Expected version 1 got 0
I20260318 02:51:49.247093 2859 raft_consensus.cc:493] T 540498d9949349f39796087173099d69 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.247242 2859 raft_consensus.cc:515] T 540498d9949349f39796087173099d69 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.247876 2859 leader_election.cc:290] T 540498d9949349f39796087173099d69 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:49.249082 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 5aeffffd34f047eeaa9a8a5100c7aad2 (table default.Table_281e478e833f4d13a05ddcf65d026047 [id=1622bac5bf0d47f1a91406ff11a0e116]) successfully deleted
I20260318 02:51:49.249459 749 tablet_service.cc:1558] Processing DeleteTablet for tablet c844057d612049d8b90ee51ad8f3ec0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.249675 756 tablet_service.cc:1558] Processing DeleteTablet for tablet df9d5919242a41aa8e119570f75b7c24 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ae512afd84d4340abf08cd78997de7e) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.244558 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_8dc2dd2d94f341fb86d5d14fedace764"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:49.250276 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8dc2dd2d94f341fb86d5d14fedace764 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:49.250630 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 53b0d1315274460d848afcfd4f88ee6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.250836 761 tablet_service.cc:1558] Processing DeleteTablet for tablet c58290c2d1c742d3b45dfb5caf52c75b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.251873 2704 tablet_replica.cc:333] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:49.252148 2704 raft_consensus.cc:2243] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.252379 2704 raft_consensus.cc:2272] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.252878 1184 ts_tablet_manager.cc:1950] T b10fd13bf3ea48b0896b34fce478e25a P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:49.253484 2704 ts_tablet_manager.cc:1916] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.256116 927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540498d9949349f39796087173099d69" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:49.256989 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540498d9949349f39796087173099d69" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:49.257541 719 leader_election.cc:343] T 540498d9949349f39796087173099d69 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:49.257782 719 leader_election.cc:343] T 540498d9949349f39796087173099d69 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.257882 719 leader_election.cc:304] T 540498d9949349f39796087173099d69 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:49.258085 1184 tablet_replica.cc:333] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:49.258291 2859 raft_consensus.cc:2749] T 540498d9949349f39796087173099d69 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:49.258587 1184 raft_consensus.cc:2243] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:49.258862 2764 raft_consensus.cc:493] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.259001 2764 raft_consensus.cc:515] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.259652 2764 leader_election.cc:290] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:49.261051 860 leader_election.cc:343] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: a384923c86ee42d6a47ed3f68e6811df
I20260318 02:51:49.262645 900 tablet_service.cc:1558] Processing DeleteTablet for tablet c844057d612049d8b90ee51ad8f3ec0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:49.262825 862 leader_election.cc:343] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: a384923c86ee42d6a47ed3f68e6811df
I20260318 02:51:49.262933 862 leader_election.cc:304] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:49.263402 2764 raft_consensus.cc:2749] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:49.261543 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 6deb99f7937144f39409929f99b135c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:49.262117 1031 tablet_service.cc:1558] Processing DeleteTablet for tablet e418df45882c435a8276e46a8abf6bdd with delete_type TABLET_DATA_DELETED (replaced by tablet b510f3c213104798971cf84c95e357d7) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:49.263203 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet c844057d612049d8b90ee51ad8f3ec0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:49.264046 1184 raft_consensus.cc:2272] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.264369 900 tablet_service.cc:1558] Processing DeleteTablet for tablet c58290c2d1c742d3b45dfb5caf52c75b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:49.267980 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet c58290c2d1c742d3b45dfb5caf52c75b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:49.267611 1184 ts_tablet_manager.cc:1916] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.269611 900 tablet_service.cc:1558] Processing DeleteTablet for tablet df9d5919242a41aa8e119570f75b7c24 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ae512afd84d4340abf08cd78997de7e) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:49.273301 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet df9d5919242a41aa8e119570f75b7c24 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ae512afd84d4340abf08cd78997de7e) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:49.275856 1174 tablet_bootstrap.cc:492] T abfa81c3c78a498285e2961530272a39 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:49.276021 1174 ts_tablet_manager.cc:1403] T abfa81c3c78a498285e2961530272a39 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.064s user 0.001s sys 0.003s
I20260318 02:51:49.276837 1175 ts_tablet_manager.cc:1929] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.276816 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet b10fd13bf3ea48b0896b34fce478e25a (table default.Table_3c703c59a09d493d8c132dd9a026135f [id=a06743180c9e418590b66e4476eba4d5]) successfully deleted
I20260318 02:51:49.276957 1175 log.cc:1199] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/20a492fdea6c44ba8439614b0dcc2ba6
I20260318 02:51:49.277256 1175 ts_tablet_manager.cc:1950] T 20a492fdea6c44ba8439614b0dcc2ba6 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:49.277887 1175 tablet_replica.cc:333] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:49.278082 1175 raft_consensus.cc:2243] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.278245 1175 raft_consensus.cc:2272] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.278826 1175 ts_tablet_manager.cc:1916] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:49.279242 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 6eae03ae22c440e69502471b6d36f240 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6eae03ae22c440e69502471b6d36f240 already in progress: creating tablet
I20260318 02:51:49.284991 2704 ts_tablet_manager.cc:1929] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.285805 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 20a492fdea6c44ba8439614b0dcc2ba6 (table default.Table_d2f73355578d4f4391b25e72718cfa1e [id=0bd115a0960941ff9d49b4566fe1c666]) successfully deleted
W20260318 02:51:49.286090 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 033338a607b145e5bc34fc9281f13067 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 033338a607b145e5bc34fc9281f13067 already in progress: creating tablet
I20260318 02:51:49.291477 2753 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260318 02:51:49.292658 1172 tablet_bootstrap.cc:654] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.292742 2753 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260318 02:51:49.286772 1174 raft_consensus.cc:359] T abfa81c3c78a498285e2961530272a39 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.292949 1174 raft_consensus.cc:385] T abfa81c3c78a498285e2961530272a39 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.293030 1174 raft_consensus.cc:740] T abfa81c3c78a498285e2961530272a39 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.293071 2753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260318 02:51:49.293509 1174 consensus_queue.cc:260] T abfa81c3c78a498285e2961530272a39 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.294123 1174 ts_tablet_manager.cc:1434] T abfa81c3c78a498285e2961530272a39 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260318 02:51:49.295047 1174 tablet_bootstrap.cc:492] T a6d2dd53085848d6bd7237b07a5f81d0 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:49.297209 1174 tablet_bootstrap.cc:654] T a6d2dd53085848d6bd7237b07a5f81d0 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.302433 2859 raft_consensus.cc:493] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.302618 2859 raft_consensus.cc:515] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.303273 2859 leader_election.cc:290] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:49.303741 1172 tablet_bootstrap.cc:492] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:49.303889 1172 ts_tablet_manager.cc:1403] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.118s user 0.001s sys 0.008s
I20260318 02:51:49.304184 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de38fe3eb88147eab65f3dfed37fbf7d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:49.304765 719 leader_election.cc:343] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.304737 1172 raft_consensus.cc:359] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.304890 1172 raft_consensus.cc:385] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.304937 1172 raft_consensus.cc:740] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.305171 1172 consensus_queue.cc:260] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.306445 1172 ts_tablet_manager.cc:1434] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260318 02:51:49.306485 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de38fe3eb88147eab65f3dfed37fbf7d" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:49.308547 719 leader_election.cc:343] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.308676 719 leader_election.cc:304] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:49.309062 2859 raft_consensus.cc:2749] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:49.309777 2704 log.cc:1199] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/fa077243d5634d888f3a191b7f9d2d19
I20260318 02:51:49.310138 761 tablet_service.cc:1558] Processing DeleteTablet for tablet abfa81c3c78a498285e2961530272a39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:31 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.310144 2704 ts_tablet_manager.cc:1950] T fa077243d5634d888f3a191b7f9d2d19 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:49.312551 1174 tablet_bootstrap.cc:492] T a6d2dd53085848d6bd7237b07a5f81d0 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:49.312755 1174 ts_tablet_manager.cc:1403] T a6d2dd53085848d6bd7237b07a5f81d0 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.001s
I20260318 02:51:49.314309 1173 tablet_bootstrap.cc:492] T 9c05f7a75527410e9c5cde0dbc6bc10e P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:49.314451 1173 ts_tablet_manager.cc:1403] T 9c05f7a75527410e9c5cde0dbc6bc10e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.121s user 0.008s sys 0.003s
I20260318 02:51:49.314626 1172 tablet_bootstrap.cc:492] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:49.316058 1174 raft_consensus.cc:359] T a6d2dd53085848d6bd7237b07a5f81d0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.316229 1174 raft_consensus.cc:385] T a6d2dd53085848d6bd7237b07a5f81d0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.316273 1174 raft_consensus.cc:740] T a6d2dd53085848d6bd7237b07a5f81d0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.316507 1172 tablet_bootstrap.cc:654] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.318732 1184 ts_tablet_manager.cc:1929] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:49.323422 2704 tablet_replica.cc:333] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:49.323498 1175 ts_tablet_manager.cc:1929] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.323638 1175 log.cc:1199] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/21e6e89e5a0a4d1bb952e74be1b7e551
I20260318 02:51:49.323987 1175 ts_tablet_manager.cc:1950] T 21e6e89e5a0a4d1bb952e74be1b7e551 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:49.326582 2704 raft_consensus.cc:2243] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.326853 2704 raft_consensus.cc:2272] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.327520 2704 ts_tablet_manager.cc:1916] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.323706 1174 consensus_queue.cc:260] T a6d2dd53085848d6bd7237b07a5f81d0 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.329514 1174 ts_tablet_manager.cc:1434] T a6d2dd53085848d6bd7237b07a5f81d0 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20260318 02:51:49.329917 1174 tablet_bootstrap.cc:492] T 868605c58c1d4744ab8930313e7dcaa9 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:49.329890 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet fa077243d5634d888f3a191b7f9d2d19 (table default.Table_33682c1fb3284897980e07d95f302cad [id=46bae779de56403ab810fc4dcde25233]) successfully deleted
W20260318 02:51:49.330180 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet b54248ad606643a292dff193c35d6a00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b54248ad606643a292dff193c35d6a00 already in progress: creating tablet
W20260318 02:51:49.330369 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 6eae03ae22c440e69502471b6d36f240 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6eae03ae22c440e69502471b6d36f240 already in progress: creating tablet
I20260318 02:51:49.331223 1175 tablet_replica.cc:333] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:49.331414 1175 raft_consensus.cc:2243] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.331585 1174 tablet_bootstrap.cc:654] T 868605c58c1d4744ab8930313e7dcaa9 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.332912 1184 log.cc:1199] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/9a5afc5611d3481e9a6d48381dc67e86
I20260318 02:51:49.333271 1184 ts_tablet_manager.cc:1950] T 9a5afc5611d3481e9a6d48381dc67e86 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:49.334184 1175 raft_consensus.cc:2272] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.334889 1175 ts_tablet_manager.cc:1916] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.341674 1184 tablet_replica.cc:333] T 6deb99f7937144f39409929f99b135c5 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:49.342595 1184 raft_consensus.cc:2243] T 6deb99f7937144f39409929f99b135c5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.342859 1184 raft_consensus.cc:2272] T 6deb99f7937144f39409929f99b135c5 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.343442 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 9a5afc5611d3481e9a6d48381dc67e86 (table default.Table_5048646e181b43af9e8798938115b3eb [id=e03eb5ce646645e393ddc268a1aabf1f]) successfully deleted
I20260318 02:51:49.343591 453 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_30d193096882439e98bf7220e7a3931c" } modify_external_catalogs: true
W20260318 02:51:49.343744 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 15cae82c808a435e86f8c514e415d546 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15cae82c808a435e86f8c514e415d546 already in progress: creating tablet
I20260318 02:51:49.343772 1184 ts_tablet_manager.cc:1916] T 6deb99f7937144f39409929f99b135c5 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.343765 453 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_30d193096882439e98bf7220e7a3931c" } modify_external_catalogs: true
W20260318 02:51:49.344002 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 2c5400cd0c2a447b9d8b7381dcadf0be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c5400cd0c2a447b9d8b7381dcadf0be already in progress: creating tablet
I20260318 02:51:49.344167 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 21e6e89e5a0a4d1bb952e74be1b7e551 (table default.Table_997fb2399fa943e9b940ce4e2b1f31ca [id=e3ae42e4eb124dcebd6692574f6d0a9b]) successfully deleted
W20260318 02:51:49.344357 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 821c1f9f90504d2580d311682fc19a5a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 821c1f9f90504d2580d311682fc19a5a already in progress: creating tablet
I20260318 02:51:49.344803 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_c291010cdfb64ef7bedaa156ed3338ff" } new_table_name: "default.Table_82a5d7c4c65547b3b73634778cd52794" modify_external_catalogs: true
I20260318 02:51:49.350422 1173 raft_consensus.cc:359] T 9c05f7a75527410e9c5cde0dbc6bc10e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.350636 1173 raft_consensus.cc:385] T 9c05f7a75527410e9c5cde0dbc6bc10e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.350708 1173 raft_consensus.cc:740] T 9c05f7a75527410e9c5cde0dbc6bc10e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.350921 1173 consensus_queue.cc:260] T 9c05f7a75527410e9c5cde0dbc6bc10e P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:49.356299 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9b6c390e30f34760aafecc557503ea4d consensus state has no leader
I20260318 02:51:49.356885 2152 raft_consensus.cc:493] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.357038 2152 raft_consensus.cc:515] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.357553 450 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 9c05f7a75527410e9c5cde0dbc6bc10e (table default.Table_fed9534e8e3d410ab1775c885744cc2a [id=113b6b3abc1a4dcc91c49be4704a159c]). Expected version 2 got 0
I20260318 02:51:49.357656 2152 leader_election.cc:290] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:49.358224 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3073fbe00c5d45b6b3100e927e0cc5c3" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:49.358425 777 raft_consensus.cc:2468] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:49.360241 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3073fbe00c5d45b6b3100e927e0cc5c3" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:49.360566 999 leader_election.cc:304] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
W20260318 02:51:49.360817 997 leader_election.cc:343] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.361160 2831 raft_consensus.cc:2804] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:49.361259 2831 raft_consensus.cc:493] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:49.361328 2831 raft_consensus.cc:3060] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:49.363974 2831 raft_consensus.cc:515] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.364544 2704 ts_tablet_manager.cc:1929] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:49.365234 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3073fbe00c5d45b6b3100e927e0cc5c3" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:49.365211 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3073fbe00c5d45b6b3100e927e0cc5c3" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:49.365417 777 raft_consensus.cc:3060] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:49.365798 997 leader_election.cc:343] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.366921 1174 tablet_bootstrap.cc:492] T 868605c58c1d4744ab8930313e7dcaa9 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:49.364651 2831 leader_election.cc:290] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:49.367983 1174 ts_tablet_manager.cc:1403] T 868605c58c1d4744ab8930313e7dcaa9 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.001s
I20260318 02:51:49.368021 777 raft_consensus.cc:2468] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:49.368795 1173 ts_tablet_manager.cc:1434] T 9c05f7a75527410e9c5cde0dbc6bc10e P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.054s user 0.002s sys 0.001s
I20260318 02:51:49.368700 1174 raft_consensus.cc:359] T 868605c58c1d4744ab8930313e7dcaa9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.368889 1174 raft_consensus.cc:385] T 868605c58c1d4744ab8930313e7dcaa9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.368944 1174 raft_consensus.cc:740] T 868605c58c1d4744ab8930313e7dcaa9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.369854 999 leader_election.cc:304] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:49.370882 2831 raft_consensus.cc:2804] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:49.371019 2831 raft_consensus.cc:697] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:49.371276 2831 consensus_queue.cc:237] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.372478 1173 tablet_bootstrap.cc:492] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:49.382643 1174 consensus_queue.cc:260] T 868605c58c1d4744ab8930313e7dcaa9 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.383299 1174 ts_tablet_manager.cc:1434] T 868605c58c1d4744ab8930313e7dcaa9 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20260318 02:51:49.383740 1174 tablet_bootstrap.cc:492] T 258dc29e4e4245289b7e450837edcd24 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:49.384549 2764 raft_consensus.cc:493] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.384692 2764 raft_consensus.cc:515] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.385308 2764 leader_election.cc:290] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:49.386502 860 leader_election.cc:343] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 6f527a0ba0914924bc7f604ae8a48393
I20260318 02:51:49.386629 457 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 9c05f7a75527410e9c5cde0dbc6bc10e (table default.Table_fed9534e8e3d410ab1775c885744cc2a [id=113b6b3abc1a4dcc91c49be4704a159c]). Expected version 2 got 0
I20260318 02:51:49.388650 2764 raft_consensus.cc:493] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.388805 2764 raft_consensus.cc:515] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:49.389364 862 leader_election.cc:343] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 6f527a0ba0914924bc7f604ae8a48393
I20260318 02:51:49.389488 862 leader_election.cc:304] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:49.390012 2926 raft_consensus.cc:2749] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:49.390122 860 leader_election.cc:343] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 82858fd64d534d1abcad12bc4a93cda7
I20260318 02:51:49.389364 2764 leader_election.cc:290] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:49.391413 862 leader_election.cc:343] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 82858fd64d534d1abcad12bc4a93cda7
I20260318 02:51:49.391539 862 leader_election.cc:304] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:49.391745 2926 raft_consensus.cc:2749] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:49.403055 450 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet a6d2dd53085848d6bd7237b07a5f81d0 (table default.Table_558f141be2cb4cb4848fa3585dd6d35e [id=74aaf5efafc14e5faae1d6a0d60d0bb8]). Expected version 3 got 0
I20260318 02:51:49.407121 2704 log.cc:1199] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/9a5afc5611d3481e9a6d48381dc67e86
I20260318 02:51:49.407618 2704 ts_tablet_manager.cc:1950] T 9a5afc5611d3481e9a6d48381dc67e86 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:49.411124 452 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 16f00e7e7ca847e9a5ebfd9bb5809147
I20260318 02:51:49.412078 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 16f00e7e7ca847e9a5ebfd9bb5809147 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.413005 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_86f6b709c47944cc97ac197e614d17d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:49.413203 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 16f00e7e7ca847e9a5ebfd9bb5809147 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:37544
W20260318 02:51:49.413621 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86f6b709c47944cc97ac197e614d17d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:49.414978 1173 tablet_bootstrap.cc:654] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.415064 455 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9d4cd5f5e3bc4d91a21015ed772debc1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:49.415158 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 16f00e7e7ca847e9a5ebfd9bb5809147 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:38664
W20260318 02:51:49.415802 455 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d4cd5f5e3bc4d91a21015ed772debc1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:49.418464 1184 ts_tablet_manager.cc:1929] T 6deb99f7937144f39409929f99b135c5 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.418591 1184 log.cc:1199] T 6deb99f7937144f39409929f99b135c5 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/6deb99f7937144f39409929f99b135c5
I20260318 02:51:49.418898 1184 ts_tablet_manager.cc:1950] T 6deb99f7937144f39409929f99b135c5 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:49.419160 450 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b11d9e2237894ee182579c007c13d475" } modify_external_catalogs: true
I20260318 02:51:49.419219 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 868605c58c1d4744ab8930313e7dcaa9 with delete_type TABLET_DATA_DELETED (replaced by tablet ca765bc27f564ab9ab419bcf2aeda59f) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.419339 450 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_b11d9e2237894ee182579c007c13d475" } modify_external_catalogs: true
I20260318 02:51:49.421205 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 9a5afc5611d3481e9a6d48381dc67e86 (table default.Table_5048646e181b43af9e8798938115b3eb [id=e03eb5ce646645e393ddc268a1aabf1f]) successfully deleted
W20260318 02:51:49.421978 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 15cae82c808a435e86f8c514e415d546 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15cae82c808a435e86f8c514e415d546 already in progress: creating tablet
I20260318 02:51:49.422679 2704 tablet_replica.cc:333] T ca4e1eec9a2148488295416cd68ca607 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:49.422907 2704 raft_consensus.cc:2243] T ca4e1eec9a2148488295416cd68ca607 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.423054 2704 raft_consensus.cc:2272] T ca4e1eec9a2148488295416cd68ca607 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.423594 2704 ts_tablet_manager.cc:1916] T ca4e1eec9a2148488295416cd68ca607 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.424286 448 catalog_manager.cc:5671] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:49.424659 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet a75f367cde75433d86a4ee9384e57761 (table default.Table_ed6ebe71dc614470a951f2e484f28d88 [id=837cbf1e256f46f484ceb9ffa208891c]). Expected version 1 got 0
I20260318 02:51:49.424897 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet bac04b3e4ad448b09a1a25a754b44aad (table default.Table_c0a9aae588ef49148c04338c906dab4a [id=1532d6dc2cc641998f9c120075fa04b4]). Expected version 1 got 0
I20260318 02:51:49.425155 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 895aa252b9f243d89e972d1b717ee910 (table default.Table_2afe66e6b2374e3c9b8e4692abb54d07 [id=6f9eb9fbda9846d495f3e70e229a5590]). Expected version 1 got 0
I20260318 02:51:49.425348 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet e998e290291c443394f478c4ac1cfbd2 (table default.Table_5d59b3f280d345a3937fff6df372fcff [id=00651cbebdb046c9975ecfa30f08fce5]). Expected version 2 got 0
I20260318 02:51:49.425648 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet b698d732a905469caaf564d9512ba02c (table default.Table_6238662cdd5443a694ee4feec8bc0413 [id=eb11e3d1c3ef4295ac9b6ee657ac233a]). Expected version 1 got 0
I20260318 02:51:49.425940 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 68b0f0cd89234e72a052f3f9f964aa35 (table default.Table_3c0a83dcbb7b49b1858e72778990f485 [id=9a52b01ffd5b4f7e8a7a20a817aa842f]). Expected version 3 got 2
I20260318 02:51:49.421818 1172 tablet_bootstrap.cc:492] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:49.426381 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet cb29fd9d6fc845b2aaffe34c290fd5ca (table default.Table_496f16dbb28a4f2d947c6f7d15d8ad9f [id=cc1e96ac2459417795a39cf88dd1edcf]). Expected version 2 got 0
I20260318 02:51:49.426530 448 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 9c05f7a75527410e9c5cde0dbc6bc10e (table default.Table_fed9534e8e3d410ab1775c885744cc2a [id=113b6b3abc1a4dcc91c49be4704a159c]). Expected version 2 got 0
I20260318 02:51:49.426546 1172 ts_tablet_manager.cc:1403] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.114s user 0.001s sys 0.015s
I20260318 02:51:49.427346 1172 raft_consensus.cc:359] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.427536 1172 raft_consensus.cc:385] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.427591 1172 raft_consensus.cc:740] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.427806 1172 consensus_queue.cc:260] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.428115 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 6deb99f7937144f39409929f99b135c5 (table default.Table_039d1d42521f4f9f8be161d0b97004f7 [id=19ba004fc5d143ffae445b129ce28b05]) successfully deleted
I20260318 02:51:49.428277 1172 ts_tablet_manager.cc:1434] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:49.428655 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_678b715cb9a44ebfb6c72e52a6d5eb40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:49.428875 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_7bf0891cb44046dfad491cb4a0a140f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:49.429246 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_678b715cb9a44ebfb6c72e52a6d5eb40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:49.429313 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7bf0891cb44046dfad491cb4a0a140f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:49.430430 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d8366ea91a234e01851bc65a47d9a36d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:49.430902 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8366ea91a234e01851bc65a47d9a36d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:49.432358 443 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 2c35a8af5d92445a851c8847f75476f9 (table default.Table_cff80720c9934a89a2b6aa08499b22e7 [id=01148f7db8934decb958485d618c88a0], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2c35a8af5d92445a851c8847f75476f9 consensus state has no leader
I20260318 02:51:49.433573 452 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_b0a1f6d00f4345b982049e897878a04f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:49.434109 452 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0a1f6d00f4345b982049e897878a04f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:49.438287 1172 tablet_bootstrap.cc:492] T 831a7cb00e7040a7ade210c755dbff4a P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:49.442577 2704 ts_tablet_manager.cc:1929] T ca4e1eec9a2148488295416cd68ca607 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.442744 2704 log.cc:1199] T ca4e1eec9a2148488295416cd68ca607 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/ca4e1eec9a2148488295416cd68ca607
I20260318 02:51:49.443076 2704 ts_tablet_manager.cc:1950] T ca4e1eec9a2148488295416cd68ca607 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:49.443351 900 tablet_service.cc:1511] Processing CreateTablet for tablet ed779341a50a4bcb876b48ec3dc5922d (DEFAULT_TABLE table=default.Table_cf613165ecdf4b708b418fb1c9bba70e [id=bb9793e492f145d48b88567bfc40f976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.443768 2926 raft_consensus.cc:493] T 9c05f7a75527410e9c5cde0dbc6bc10e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.443845 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed779341a50a4bcb876b48ec3dc5922d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.443950 2926 raft_consensus.cc:515] T 9c05f7a75527410e9c5cde0dbc6bc10e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.445101 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c05f7a75527410e9c5cde0dbc6bc10e" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:49.446038 761 tablet_service.cc:1511] Processing CreateTablet for tablet ed779341a50a4bcb876b48ec3dc5922d (DEFAULT_TABLE table=default.Table_cf613165ecdf4b708b418fb1c9bba70e [id=bb9793e492f145d48b88567bfc40f976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.446460 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed779341a50a4bcb876b48ec3dc5922d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.446619 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet ca4e1eec9a2148488295416cd68ca607 (table default.Table_496e7d616c09464a884078334d256839 [id=f6fae39c375b41e096459fe397b69b72]) successfully deleted
I20260318 02:51:49.446977 2704 tablet_replica.cc:333] T 59ce7583e7f545f18145b4e55e1fbb81 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:49.447162 2704 raft_consensus.cc:2243] T 59ce7583e7f545f18145b4e55e1fbb81 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.447286 2704 raft_consensus.cc:2272] T 59ce7583e7f545f18145b4e55e1fbb81 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.447774 2704 ts_tablet_manager.cc:1916] T 59ce7583e7f545f18145b4e55e1fbb81 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.448364 1172 tablet_bootstrap.cc:654] T 831a7cb00e7040a7ade210c755dbff4a P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.449061 766 tablet_service.cc:1511] Processing CreateTablet for tablet c251480945fb42aa93c760973ad067e9 (DEFAULT_TABLE table=default.Table_2bf9bdf74b284b40b242d081b9daccc7 [id=f194dfb5aa5146f4926aa102f0c15bd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.449455 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c251480945fb42aa93c760973ad067e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.450209 896 tablet_service.cc:1511] Processing CreateTablet for tablet c251480945fb42aa93c760973ad067e9 (DEFAULT_TABLE table=default.Table_2bf9bdf74b284b40b242d081b9daccc7 [id=f194dfb5aa5146f4926aa102f0c15bd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.450645 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c251480945fb42aa93c760973ad067e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.462791 2665 consensus_queue.cc:1048] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:49.466833 455 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_39f3697e6d8047fa8af7d8312c902c41" } modify_external_catalogs: true
I20260318 02:51:49.467039 455 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_39f3697e6d8047fa8af7d8312c902c41" } modify_external_catalogs: true
I20260318 02:51:49.469609 1175 ts_tablet_manager.cc:1929] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.469741 1175 log.cc:1199] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/5aeffffd34f047eeaa9a8a5100c7aad2
I20260318 02:51:49.469735 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4d5e18ca2f9b4e6bbf9144bd39ad38a3" } modify_external_catalogs: true
I20260318 02:51:49.469820 454 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_17df338b31d74ae787181f5263811168" } new_table_name: "default.Table_386a76c59db54064a93581f02cf381fe" modify_external_catalogs: true
I20260318 02:51:49.469898 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_4d5e18ca2f9b4e6bbf9144bd39ad38a3" } modify_external_catalogs: true
I20260318 02:51:49.470032 1175 ts_tablet_manager.cc:1950] T 5aeffffd34f047eeaa9a8a5100c7aad2 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:49.473248 450 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 7b388b964c5f402ea4485d266563d07a
I20260318 02:51:49.473999 453 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet c44a07e379844d99be5edfcfa72c6e40
I20260318 02:51:49.477200 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b388b964c5f402ea4485d266563d07a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:49.478324 900 tablet_service.cc:1558] Processing DeleteTablet for tablet c44a07e379844d99be5edfcfa72c6e40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:49.479157 777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c05f7a75527410e9c5cde0dbc6bc10e" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:49.479260 2926 leader_election.cc:290] T 9c05f7a75527410e9c5cde0dbc6bc10e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:49.479745 862 leader_election.cc:304] T 9c05f7a75527410e9c5cde0dbc6bc10e P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:49.481979 2926 raft_consensus.cc:2749] T 9c05f7a75527410e9c5cde0dbc6bc10e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:49.482386 448 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_36fe3a38bffa40f2b21e245f4fe2e57c" } new_table_name: "default.Table_38ee79dacdd6468691d751680b665f28" modify_external_catalogs: true
I20260318 02:51:49.482450 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_50962224abd7467492507d0af7c6a030" } new_table_name: "default.Table_e12cc41eed194bcb94937d6b262cafc8" modify_external_catalogs: true
I20260318 02:51:49.483040 900 tablet_service.cc:1511] Processing CreateTablet for tablet 30c4e42a55914561a9f4ee330594eef6 (DEFAULT_TABLE table=default.Table_79489cca59114b02bb26b88fd5f27727 [id=1c0ad0fb6d2a4bba92324b7c44cf2b7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.483428 900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c4e42a55914561a9f4ee330594eef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.482744 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_30c36464ab104d5c91ebcae0c0a30853"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:49.484283 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30c36464ab104d5c91ebcae0c0a30853 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:49.487200 1175 tablet_replica.cc:333] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:49.487823 1175 raft_consensus.cc:2243] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.487984 1175 raft_consensus.cc:2272] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.427453 1184 tablet_replica.cc:333] T e418df45882c435a8276e46a8abf6bdd P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:49.488483 1175 ts_tablet_manager.cc:1916] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.488449 1184 raft_consensus.cc:2243] T e418df45882c435a8276e46a8abf6bdd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.489687 1184 raft_consensus.cc:2272] T e418df45882c435a8276e46a8abf6bdd P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.494521 1184 ts_tablet_manager.cc:1916] T e418df45882c435a8276e46a8abf6bdd P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.500607 756 tablet_service.cc:1511] Processing CreateTablet for tablet 30c4e42a55914561a9f4ee330594eef6 (DEFAULT_TABLE table=default.Table_79489cca59114b02bb26b88fd5f27727 [id=1c0ad0fb6d2a4bba92324b7c44cf2b7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.501075 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c4e42a55914561a9f4ee330594eef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.501701 766 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b388b964c5f402ea4485d266563d07a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.501886 761 tablet_service.cc:1558] Processing DeleteTablet for tablet c44a07e379844d99be5edfcfa72c6e40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.503201 896 tablet_service.cc:1511] Processing CreateTablet for tablet bdc5919ba5494b19933490cf84d00a50 (DEFAULT_TABLE table=default.Table_9733b5f166b440c0b3ca3cf509108ccb [id=22668d7d69a54dec958c8e4b9d49882e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.503593 896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc5919ba5494b19933490cf84d00a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.510306 893 tablet_service.cc:1511] Processing CreateTablet for tablet 6391ce8612eb43fb82ef13791ef6e4b4 (DEFAULT_TABLE table=default.Table_f9271e4f6a4742bb9e1184c7bf898f10 [id=fb3b7dfba0564470a775af63bb14cd08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.510753 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6391ce8612eb43fb82ef13791ef6e4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.510838 756 tablet_service.cc:1511] Processing CreateTablet for tablet bdc5919ba5494b19933490cf84d00a50 (DEFAULT_TABLE table=default.Table_9733b5f166b440c0b3ca3cf509108ccb [id=22668d7d69a54dec958c8e4b9d49882e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.511198 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc5919ba5494b19933490cf84d00a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.518474 893 tablet_service.cc:1511] Processing CreateTablet for tablet 447293607a574047b961dd2987637464 (DEFAULT_TABLE table=default.Table_be1eed0aeb674672b865ed49c2e3b89a [id=2e96004959824fe5a3c680fb9444e837]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.518976 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447293607a574047b961dd2987637464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.519943 761 tablet_service.cc:1511] Processing CreateTablet for tablet 6391ce8612eb43fb82ef13791ef6e4b4 (DEFAULT_TABLE table=default.Table_f9271e4f6a4742bb9e1184c7bf898f10 [id=fb3b7dfba0564470a775af63bb14cd08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.523008 2704 ts_tablet_manager.cc:1929] T 59ce7583e7f545f18145b4e55e1fbb81 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.524859 903 tablet_service.cc:1511] Processing CreateTablet for tablet 54d2805b01f54d8ba35742d85f3e548e (DEFAULT_TABLE table=default.Table_db9fecb248a5432e8f68d134c6bc0a65 [id=c574df7f444a4548a5f43c25632a31f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.525234 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54d2805b01f54d8ba35742d85f3e548e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.523463 2859 raft_consensus.cc:493] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.527128 2704 log.cc:1199] T 59ce7583e7f545f18145b4e55e1fbb81 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/59ce7583e7f545f18145b4e55e1fbb81
I20260318 02:51:49.527158 2859 raft_consensus.cc:515] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.527428 2704 ts_tablet_manager.cc:1950] T 59ce7583e7f545f18145b4e55e1fbb81 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:49.527755 2859 leader_election.cc:290] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:49.529094 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c35d41da7146faa89d8af3bb5f5140" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:49.529325 1062 raft_consensus.cc:2468] T 14c35d41da7146faa89d8af3bb5f5140 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 0.
I20260318 02:51:49.530166 719 leader_election.cc:304] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:49.530570 2859 raft_consensus.cc:2804] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:49.530644 2859 raft_consensus.cc:493] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:49.530699 2859 raft_consensus.cc:3060] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:49.531558 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c35d41da7146faa89d8af3bb5f5140" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:49.533850 719 leader_election.cc:343] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.534401 2859 raft_consensus.cc:515] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.536120 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c35d41da7146faa89d8af3bb5f5140" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:49.536362 1062 raft_consensus.cc:3060] T 14c35d41da7146faa89d8af3bb5f5140 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:49.536616 1184 ts_tablet_manager.cc:1929] T e418df45882c435a8276e46a8abf6bdd P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.536746 1184 log.cc:1199] T e418df45882c435a8276e46a8abf6bdd P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/e418df45882c435a8276e46a8abf6bdd
I20260318 02:51:49.537035 1184 ts_tablet_manager.cc:1950] T e418df45882c435a8276e46a8abf6bdd P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:49.537560 903 tablet_service.cc:1511] Processing CreateTablet for tablet c036914048004860b8303d4bae5a1ca3 (DEFAULT_TABLE table=default.Table_0211c18d42094a2189c21f03e04ea384 [id=f5608ed616224059a5b2ac7ce050f6d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.538130 1184 tablet_replica.cc:333] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:49.538313 1184 raft_consensus.cc:2243] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:49.538630 1184 raft_consensus.cc:2272] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.539124 1062 raft_consensus.cc:2468] T 14c35d41da7146faa89d8af3bb5f5140 P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 1.
I20260318 02:51:49.539176 1184 ts_tablet_manager.cc:1916] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.540277 2835 raft_consensus.cc:493] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.540411 2835 raft_consensus.cc:515] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.540989 2660 raft_consensus.cc:493] T a6d2dd53085848d6bd7237b07a5f81d0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.541149 2660 raft_consensus.cc:515] T a6d2dd53085848d6bd7237b07a5f81d0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.541728 2660 leader_election.cc:290] T a6d2dd53085848d6bd7237b07a5f81d0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:49.541800 892 tablet_service.cc:1511] Processing CreateTablet for tablet 7f492709f0cb465ab760c62f6216642a (DEFAULT_TABLE table=default.Table_57d7276060f440ef8d0b901990a82d25 [id=09c582027e074e89a13e816f4197c1d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.542356 2835 leader_election.cc:290] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:49.543198 719 leader_election.cc:304] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:49.544000 2660 raft_consensus.cc:2804] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election won for term 1
W20260318 02:51:49.545603 999 leader_election.cc:343] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 4052eede3f404b84ac27e21a204bf5a9
I20260318 02:51:49.546664 2859 leader_election.cc:290] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:49.549398 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d2dd53085848d6bd7237b07a5f81d0" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:49.549616 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_a3f37e0f921d4f769099eecbfef537c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:49.549865 456 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_cb00584305a1450eb83b2596d7ae748c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:49.550235 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3f37e0f921d4f769099eecbfef537c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:49.550364 456 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb00584305a1450eb83b2596d7ae748c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:49.550510 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e4d1c046e9084ed1be3b80adbe31af98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:49.550908 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4d1c046e9084ed1be3b80adbe31af98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:49.551162 719 leader_election.cc:343] T a6d2dd53085848d6bd7237b07a5f81d0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.523754 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6391ce8612eb43fb82ef13791ef6e4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.557108 2926 raft_consensus.cc:493] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.557452 2926 raft_consensus.cc:515] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:49.559329 1112 tablet.cc:2379] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260318 02:51:49.560102 2926 leader_election.cc:290] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:49.560652 862 leader_election.cc:343] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: d0b01131720748688ca6c28985a3b3ff
W20260318 02:51:49.561550 860 leader_election.cc:343] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: d0b01131720748688ca6c28985a3b3ff
I20260318 02:51:49.561671 860 leader_election.cc:304] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
W20260318 02:51:49.564188 975 tablet.cc:2379] T 9c05f7a75527410e9c5cde0dbc6bc10e P b25f4f05e0c94c8db825d5afa0b8bf18: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260318 02:51:49.569664 2926 raft_consensus.cc:2749] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:49.571424 1039 tablet_service.cc:1511] Processing CreateTablet for tablet ed779341a50a4bcb876b48ec3dc5922d (DEFAULT_TABLE table=default.Table_cf613165ecdf4b708b418fb1c9bba70e [id=bb9793e492f145d48b88567bfc40f976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.571537 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b388b964c5f402ea4485d266563d07a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:49.571861 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed779341a50a4bcb876b48ec3dc5922d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.571956 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet c44a07e379844d99be5edfcfa72c6e40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:49.572315 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a5afc5611d3481e9a6d48381dc67e86 with delete_type TABLET_DATA_DELETED (replaced by tablet 457a4b623072460d96cc5d11b675cceb) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:49.572772 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet d3b37df330984378b81b367446d34748 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:41 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:49.573297 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 30c4e42a55914561a9f4ee330594eef6 (DEFAULT_TABLE table=default.Table_79489cca59114b02bb26b88fd5f27727 [id=1c0ad0fb6d2a4bba92324b7c44cf2b7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.573640 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c4e42a55914561a9f4ee330594eef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.577008 1031 tablet_service.cc:1511] Processing CreateTablet for tablet c251480945fb42aa93c760973ad067e9 (DEFAULT_TABLE table=default.Table_2bf9bdf74b284b40b242d081b9daccc7 [id=f194dfb5aa5146f4926aa102f0c15bd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.577344 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c251480945fb42aa93c760973ad067e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.581357 1027 tablet_service.cc:1511] Processing CreateTablet for tablet 6391ce8612eb43fb82ef13791ef6e4b4 (DEFAULT_TABLE table=default.Table_f9271e4f6a4742bb9e1184c7bf898f10 [id=fb3b7dfba0564470a775af63bb14cd08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.581523 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 447293607a574047b961dd2987637464 (DEFAULT_TABLE table=default.Table_be1eed0aeb674672b865ed49c2e3b89a [id=2e96004959824fe5a3c680fb9444e837]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.581717 1027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6391ce8612eb43fb82ef13791ef6e4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.581947 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447293607a574047b961dd2987637464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.581697 1030 tablet_service.cc:1511] Processing CreateTablet for tablet bdc5919ba5494b19933490cf84d00a50 (DEFAULT_TABLE table=default.Table_9733b5f166b440c0b3ca3cf509108ccb [id=22668d7d69a54dec958c8e4b9d49882e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.587641 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc5919ba5494b19933490cf84d00a50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.563215 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 5aeffffd34f047eeaa9a8a5100c7aad2 (table default.Table_281e478e833f4d13a05ddcf65d026047 [id=1622bac5bf0d47f1a91406ff11a0e116]) successfully deleted
I20260318 02:51:49.592348 907 tablet_service.cc:1511] Processing CreateTablet for tablet 457a4b623072460d96cc5d11b675cceb (DEFAULT_TABLE table=default.Table_5048646e181b43af9e8798938115b3eb [id=e03eb5ce646645e393ddc268a1aabf1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.595220 1173 tablet_bootstrap.cc:492] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:49.595511 1173 ts_tablet_manager.cc:1403] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.223s user 0.008s sys 0.001s
I20260318 02:51:49.596897 1173 raft_consensus.cc:359] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.597182 1173 raft_consensus.cc:385] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.597380 1173 raft_consensus.cc:740] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.597862 1173 consensus_queue.cc:260] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.598945 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 54d2805b01f54d8ba35742d85f3e548e (DEFAULT_TABLE table=default.Table_db9fecb248a5432e8f68d134c6bc0a65 [id=c574df7f444a4548a5f43c25632a31f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.599079 2859 raft_consensus.cc:493] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.599220 2859 raft_consensus.cc:515] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.599336 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54d2805b01f54d8ba35742d85f3e548e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.599963 1040 tablet_service.cc:1511] Processing CreateTablet for tablet c036914048004860b8303d4bae5a1ca3 (DEFAULT_TABLE table=default.Table_0211c18d42094a2189c21f03e04ea384 [id=f5608ed616224059a5b2ac7ce050f6d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.600314 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c036914048004860b8303d4bae5a1ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.600554 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 7f492709f0cb465ab760c62f6216642a (DEFAULT_TABLE table=default.Table_57d7276060f440ef8d0b901990a82d25 [id=09c582027e074e89a13e816f4197c1d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.600867 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f492709f0cb465ab760c62f6216642a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.600860 2859 leader_election.cc:290] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:49.601076 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0d1315274460d848afcfd4f88ee6e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:49.601541 719 leader_election.cc:343] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.601967 2927 tablet.cc:1723] T 68b0f0cd89234e72a052f3f9f964aa35 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:49.609382 1174 tablet_bootstrap.cc:654] T 258dc29e4e4245289b7e450837edcd24 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.613128 2859 raft_consensus.cc:493] T 41fb820f152748b093ca0e0a2f663a78 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.613291 2859 raft_consensus.cc:515] T 41fb820f152748b093ca0e0a2f663a78 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.614372 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fb820f152748b093ca0e0a2f663a78" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:49.615052 719 leader_election.cc:343] T 41fb820f152748b093ca0e0a2f663a78 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.616343 2859 leader_election.cc:290] T 41fb820f152748b093ca0e0a2f663a78 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:49.619206 2928 tablet.cc:1723] T 68b0f0cd89234e72a052f3f9f964aa35 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:49.626339 901 tablet_service.cc:1511] Processing CreateTablet for tablet 8fa6929cbd3c45898868b1f3929bf9a4 (DEFAULT_TABLE table=default.Table_b397b2200ec7443fba6e48e178f2e4ee [id=b0704b157e794d91a7344f52971e8cb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.628149 1172 tablet_bootstrap.cc:492] T 831a7cb00e7040a7ade210c755dbff4a P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:49.628484 1172 ts_tablet_manager.cc:1403] T 831a7cb00e7040a7ade210c755dbff4a P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.200s user 0.010s sys 0.010s
I20260318 02:51:49.628878 897 tablet_service.cc:1511] Processing CreateTablet for tablet 5be99b62dfc0414b86a2443f7b1fcd94 (DEFAULT_TABLE table=default.Table_a83d4ad8611a474cb2cd999a44fc28e5 [id=31ac945ee6294bfabdc31b5653d2d7c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.629835 902 tablet_service.cc:1511] Processing CreateTablet for tablet 14044cb9f79d44f2a7cfeb43c03b7d1e (DEFAULT_TABLE table=default.Table_08fedaf52dde4f54b4a789b2c06880ad [id=38c5002cd9084d20b832bd31f859f225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.630230 906 tablet_service.cc:1511] Processing CreateTablet for tablet 7ed1a8b946ba4bbfa0f7864155b00561 (DEFAULT_TABLE table=default.Table_d6caec70978b40caa5fae6a9d4261a5d [id=eaad96cc64104d2a9d42102c05d28305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.631254 1172 raft_consensus.cc:359] T 831a7cb00e7040a7ade210c755dbff4a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:49.631618 834 tablet.cc:2379] T 868605c58c1d4744ab8930313e7dcaa9 P 6a903d876086423b8016d705b98895ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260318 02:51:49.631641 1172 raft_consensus.cc:385] T 831a7cb00e7040a7ade210c755dbff4a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.631788 1172 raft_consensus.cc:740] T 831a7cb00e7040a7ade210c755dbff4a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.632205 1172 consensus_queue.cc:260] T 831a7cb00e7040a7ade210c755dbff4a P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.633332 1172 ts_tablet_manager.cc:1434] T 831a7cb00e7040a7ade210c755dbff4a P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260318 02:51:49.636966 1172 tablet_bootstrap.cc:492] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:49.637953 899 tablet_service.cc:1511] Processing CreateTablet for tablet ce692cb9c636415bbae7984bc917f3a4 (DEFAULT_TABLE table=default.Table_1ebda2302f8b4849ab927606afe18f58 [id=b445881b31234683af70fbbbe8b1463b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.639570 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 457a4b623072460d96cc5d11b675cceb (DEFAULT_TABLE table=default.Table_5048646e181b43af9e8798938115b3eb [id=e03eb5ce646645e393ddc268a1aabf1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.639992 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457a4b623072460d96cc5d11b675cceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.641623 2660 raft_consensus.cc:697] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Becoming Leader. State: Replica: 6a903d876086423b8016d705b98895ad, State: Running, Role: LEADER
I20260318 02:51:49.642122 2660 consensus_queue.cc:237] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.644950 2927 tablet.cc:1723] T 169f97b2320e4a5baae1dec29a1c7c36 P 9422bb7011f342b08be0b073a88c4c4d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:49.645309 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 8fa6929cbd3c45898868b1f3929bf9a4 (DEFAULT_TABLE table=default.Table_b397b2200ec7443fba6e48e178f2e4ee [id=b0704b157e794d91a7344f52971e8cb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.645578 1036 tablet_service.cc:1511] Processing CreateTablet for tablet 14044cb9f79d44f2a7cfeb43c03b7d1e (DEFAULT_TABLE table=default.Table_08fedaf52dde4f54b4a789b2c06880ad [id=38c5002cd9084d20b832bd31f859f225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.645700 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa6929cbd3c45898868b1f3929bf9a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.645838 1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14044cb9f79d44f2a7cfeb43c03b7d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.645663 2704 tablet_replica.cc:333] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:49.646014 2704 raft_consensus.cc:2243] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.646143 2704 raft_consensus.cc:2272] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.646605 2704 ts_tablet_manager.cc:1916] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.649135 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 5be99b62dfc0414b86a2443f7b1fcd94 (DEFAULT_TABLE table=default.Table_a83d4ad8611a474cb2cd999a44fc28e5 [id=31ac945ee6294bfabdc31b5653d2d7c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.649452 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5be99b62dfc0414b86a2443f7b1fcd94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.651229 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 7ed1a8b946ba4bbfa0f7864155b00561 (DEFAULT_TABLE table=default.Table_d6caec70978b40caa5fae6a9d4261a5d [id=eaad96cc64104d2a9d42102c05d28305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.651607 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed1a8b946ba4bbfa0f7864155b00561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.658742 1174 tablet_bootstrap.cc:492] T 258dc29e4e4245289b7e450837edcd24 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:49.658846 1175 ts_tablet_manager.cc:1929] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.658900 1174 ts_tablet_manager.cc:1403] T 258dc29e4e4245289b7e450837edcd24 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.275s user 0.007s sys 0.005s
I20260318 02:51:49.659024 2928 tablet.cc:1723] T 169f97b2320e4a5baae1dec29a1c7c36 P 6a903d876086423b8016d705b98895ad: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:49.664587 1174 raft_consensus.cc:359] T 258dc29e4e4245289b7e450837edcd24 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:49.666018 1174 raft_consensus.cc:385] T 258dc29e4e4245289b7e450837edcd24 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.666162 1174 raft_consensus.cc:740] T 258dc29e4e4245289b7e450837edcd24 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.666591 1174 consensus_queue.cc:260] T 258dc29e4e4245289b7e450837edcd24 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
W20260318 02:51:49.668103 443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.188:41593, user_credentials={real_user=slave}} blocked reactor thread for 153865us
I20260318 02:51:49.668987 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 59ce7583e7f545f18145b4e55e1fbb81 (table default.Table_ecc8c866d2154ffbbb606dba2a14c2c9 [id=38d754fc7768404493abfcd27874f157]) successfully deleted
I20260318 02:51:49.676781 450 catalog_manager.cc:5671] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:49.677124 1184 ts_tablet_manager.cc:1929] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:49.677254 1184 log.cc:1199] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/c58290c2d1c742d3b45dfb5caf52c75b
I20260318 02:51:49.677481 450 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 3073fbe00c5d45b6b3100e927e0cc5c3 (table default.Table_f368a8dc34ae4ea7815aea031af47ed3 [id=2c3964f728cc4231805fe553a37766ae]). Expected version 1 got 0
I20260318 02:51:49.677625 1184 ts_tablet_manager.cc:1950] T c58290c2d1c742d3b45dfb5caf52c75b P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:49.679163 1184 tablet_replica.cc:333] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:49.679380 1184 raft_consensus.cc:2243] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.679539 1184 raft_consensus.cc:2272] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.680099 1184 ts_tablet_manager.cc:1916] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.682631 455 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 9a8c924687e347c38bc16219429eea80
I20260318 02:51:49.683714 1172 tablet_bootstrap.cc:654] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:49.693682 997 consensus_peers.cc:597] T 498f592fa2fb46748f7752004780fe46 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:49.670740 766 tablet_service.cc:1511] Processing CreateTablet for tablet c036914048004860b8303d4bae5a1ca3 (DEFAULT_TABLE table=default.Table_0211c18d42094a2189c21f03e04ea384 [id=f5608ed616224059a5b2ac7ce050f6d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.695129 2704 ts_tablet_manager.cc:1929] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.695228 766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c036914048004860b8303d4bae5a1ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.695302 2704 log.cc:1199] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/de38fe3eb88147eab65f3dfed37fbf7d
I20260318 02:51:49.695595 2704 ts_tablet_manager.cc:1950] T de38fe3eb88147eab65f3dfed37fbf7d P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:49.696736 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet de38fe3eb88147eab65f3dfed37fbf7d (table default.Table_358abbb589e2401b867ed3d33640193e [id=86689429165c473fb0e44ba50d02daf0]) successfully deleted
I20260318 02:51:49.697077 2704 tablet_replica.cc:333] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:49.697255 2704 raft_consensus.cc:2243] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.697394 2704 raft_consensus.cc:2272] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.698207 2704 ts_tablet_manager.cc:1916] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.670909 749 tablet_service.cc:1511] Processing CreateTablet for tablet 7f492709f0cb465ab760c62f6216642a (DEFAULT_TABLE table=default.Table_57d7276060f440ef8d0b901990a82d25 [id=09c582027e074e89a13e816f4197c1d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.671783 753 tablet_service.cc:1511] Processing CreateTablet for tablet 8fa6929cbd3c45898868b1f3929bf9a4 (DEFAULT_TABLE table=default.Table_b397b2200ec7443fba6e48e178f2e4ee [id=b0704b157e794d91a7344f52971e8cb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.672187 762 tablet_service.cc:1511] Processing CreateTablet for tablet 5be99b62dfc0414b86a2443f7b1fcd94 (DEFAULT_TABLE table=default.Table_a83d4ad8611a474cb2cd999a44fc28e5 [id=31ac945ee6294bfabdc31b5653d2d7c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.672860 758 tablet_service.cc:1511] Processing CreateTablet for tablet 7ed1a8b946ba4bbfa0f7864155b00561 (DEFAULT_TABLE table=default.Table_d6caec70978b40caa5fae6a9d4261a5d [id=eaad96cc64104d2a9d42102c05d28305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.672902 759 tablet_service.cc:1511] Processing CreateTablet for tablet 14044cb9f79d44f2a7cfeb43c03b7d1e (DEFAULT_TABLE table=default.Table_08fedaf52dde4f54b4a789b2c06880ad [id=38c5002cd9084d20b832bd31f859f225]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.673699 754 tablet_service.cc:1511] Processing CreateTablet for tablet f450cb4feddc4ce293784dbe2aad842e (DEFAULT_TABLE table=default.Table_f204b14825c948129adf562227d9a237 [id=7054ca32d11740689a69401a5ff81cd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.701599 1172 tablet_bootstrap.cc:492] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:49.701737 1172 ts_tablet_manager.cc:1403] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.066s user 0.004s sys 0.000s
I20260318 02:51:49.702518 1172 raft_consensus.cc:359] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.702699 1172 raft_consensus.cc:385] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.702765 1172 raft_consensus.cc:740] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.702951 1172 consensus_queue.cc:260] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.703433 1172 ts_tablet_manager.cc:1434] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:49.703724 1172 tablet_bootstrap.cc:492] T 306367152e834668bbf5fcadd008b3ea P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:49.704834 749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f492709f0cb465ab760c62f6216642a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.705369 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet e418df45882c435a8276e46a8abf6bdd (table default.Table_b87c8d210af448238e2ed324e0fa82b3 [id=3b169945a7bc477bb1a48b662948f322]) successfully deleted
I20260318 02:51:49.705617 1172 tablet_bootstrap.cc:654] T 306367152e834668bbf5fcadd008b3ea P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:49.705895 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet c844057d612049d8b90ee51ad8f3ec0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c844057d612049d8b90ee51ad8f3ec0b already in progress: creating tablet
I20260318 02:51:49.706787 2704 ts_tablet_manager.cc:1929] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.707392 2704 log.cc:1199] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/1ac9581312964ad6afcc96f798fa534a
I20260318 02:51:49.707851 2704 ts_tablet_manager.cc:1950] T 1ac9581312964ad6afcc96f798fa534a P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:49.708773 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 1ac9581312964ad6afcc96f798fa534a (table default.Table_09ec6b975c384c24bc5e3e6dbe92caa6 [id=cafdea84974648a2b072c366228502ce]) successfully deleted
I20260318 02:51:49.708966 762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5be99b62dfc0414b86a2443f7b1fcd94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.709053 2704 tablet_replica.cc:333] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:49.709209 2704 raft_consensus.cc:2243] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.709331 2704 raft_consensus.cc:2272] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.709806 2704 ts_tablet_manager.cc:1916] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.712924 753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa6929cbd3c45898868b1f3929bf9a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.715718 2704 ts_tablet_manager.cc:1929] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.715811 2704 log.cc:1199] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/f95ebc89fd2545b1835a1bc10414248d
I20260318 02:51:49.715823 758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed1a8b946ba4bbfa0f7864155b00561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.716084 2704 ts_tablet_manager.cc:1950] T f95ebc89fd2545b1835a1bc10414248d P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:49.717095 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet f95ebc89fd2545b1835a1bc10414248d (table default.Table_2fab8241144b4ef39c7a088f8829bb80 [id=8695bce5538d4e1197fd227c3bd00d9e]) successfully deleted
W20260318 02:51:49.717767 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 2c5400cd0c2a447b9d8b7381dcadf0be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c5400cd0c2a447b9d8b7381dcadf0be already in progress: creating tablet
I20260318 02:51:49.718030 2704 tablet_replica.cc:333] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:49.718206 2704 raft_consensus.cc:2243] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.718343 2704 raft_consensus.cc:2272] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.718838 2704 ts_tablet_manager.cc:1916] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.721006 754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f450cb4feddc4ce293784dbe2aad842e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.723994 2704 ts_tablet_manager.cc:1929] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.724087 2704 log.cc:1199] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/99b4933dda1e465bb1d14d20433f3772
I20260318 02:51:49.724324 2704 ts_tablet_manager.cc:1950] T 99b4933dda1e465bb1d14d20433f3772 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:49.724740 759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14044cb9f79d44f2a7cfeb43c03b7d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.676091 761 tablet_service.cc:1511] Processing CreateTablet for tablet 447293607a574047b961dd2987637464 (DEFAULT_TABLE table=default.Table_be1eed0aeb674672b865ed49c2e3b89a [id=2e96004959824fe5a3c680fb9444e837]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.732559 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447293607a574047b961dd2987637464. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.684324 765 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a8c924687e347c38bc16219429eea80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:49.670214 756 tablet_service.cc:1511] Processing CreateTablet for tablet 54d2805b01f54d8ba35742d85f3e548e (DEFAULT_TABLE table=default.Table_db9fecb248a5432e8f68d134c6bc0a65 [id=c574df7f444a4548a5f43c25632a31f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.734073 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54d2805b01f54d8ba35742d85f3e548e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.671334 750 tablet_service.cc:1511] Processing CreateTablet for tablet 457a4b623072460d96cc5d11b675cceb (DEFAULT_TABLE table=default.Table_5048646e181b43af9e8798938115b3eb [id=e03eb5ce646645e393ddc268a1aabf1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.737058 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457a4b623072460d96cc5d11b675cceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.737867 1039 tablet_service.cc:1511] Processing CreateTablet for tablet f450cb4feddc4ce293784dbe2aad842e (DEFAULT_TABLE table=default.Table_f204b14825c948129adf562227d9a237 [id=7054ca32d11740689a69401a5ff81cd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.739069 1040 tablet_service.cc:1511] Processing CreateTablet for tablet ce692cb9c636415bbae7984bc917f3a4 (DEFAULT_TABLE table=default.Table_1ebda2302f8b4849ab927606afe18f58 [id=b445881b31234683af70fbbbe8b1463b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.673280 748 tablet_service.cc:1511] Processing CreateTablet for tablet ce692cb9c636415bbae7984bc917f3a4 (DEFAULT_TABLE table=default.Table_1ebda2302f8b4849ab927606afe18f58 [id=b445881b31234683af70fbbbe8b1463b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.739542 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce692cb9c636415bbae7984bc917f3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.667636 1174 ts_tablet_manager.cc:1434] T 258dc29e4e4245289b7e450837edcd24 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260318 02:51:49.746050 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet c58290c2d1c742d3b45dfb5caf52c75b (table default.Table_944521fea0294e3381643693804fd723 [id=18d79b10f75b43efa4946ca8979a4235]) successfully deleted
W20260318 02:51:49.746300 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet df9d5919242a41aa8e119570f75b7c24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df9d5919242a41aa8e119570f75b7c24 already in progress: creating tablet
W20260318 02:51:49.746477 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 16f00e7e7ca847e9a5ebfd9bb5809147 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16f00e7e7ca847e9a5ebfd9bb5809147 already in progress: creating tablet
W20260318 02:51:49.746668 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 7b388b964c5f402ea4485d266563d07a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b388b964c5f402ea4485d266563d07a already in progress: creating tablet
W20260318 02:51:49.746832 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet c44a07e379844d99be5edfcfa72c6e40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c44a07e379844d99be5edfcfa72c6e40 already in progress: creating tablet
W20260318 02:51:49.746994 441 catalog_manager.cc:4969] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 9a5afc5611d3481e9a6d48381dc67e86 because the tablet was not found. No further retry: Not found: Tablet not found: 9a5afc5611d3481e9a6d48381dc67e86
I20260318 02:51:49.748235 1174 tablet_bootstrap.cc:492] T d30e39476d93400c8c79dd529688e7e0 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:49.748963 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 99b4933dda1e465bb1d14d20433f3772 (table default.Table_deecd27166cf4d969acab284d9e382e0 [id=1fb417c4159b4cab98eb4d3f308f88a2]) successfully deleted
I20260318 02:51:49.749236 2704 tablet_replica.cc:333] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:49.749482 2704 raft_consensus.cc:2243] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.749691 2704 raft_consensus.cc:2272] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.750260 2704 ts_tablet_manager.cc:1916] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.751116 1174 tablet_bootstrap.cc:654] T d30e39476d93400c8c79dd529688e7e0 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.659106 1175 log.cc:1199] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/4df7d75e696a4aec981de3963c282b0d
I20260318 02:51:49.659384 921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d2dd53085848d6bd7237b07a5f81d0" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:49.660105 924 raft_consensus.cc:3060] T 895aa252b9f243d89e972d1b717ee910 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
W20260318 02:51:49.753575 719 leader_election.cc:343] T a6d2dd53085848d6bd7237b07a5f81d0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.753687 719 leader_election.cc:304] T a6d2dd53085848d6bd7237b07a5f81d0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:49.754014 2660 raft_consensus.cc:2749] T a6d2dd53085848d6bd7237b07a5f81d0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:49.660252 922 raft_consensus.cc:3060] T 453a1c6f16194cab91c0223e2eeda7ab P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:49.752081 2942 tablet.cc:1723] T 68b0f0cd89234e72a052f3f9f964aa35 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260318 02:51:49.758184 2704 ts_tablet_manager.cc:1929] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.758383 2704 log.cc:1199] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/597a9271dedf4e789926e7e65fd79dfc
I20260318 02:51:49.758728 2704 ts_tablet_manager.cc:1950] T 597a9271dedf4e789926e7e65fd79dfc P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:49.660322 925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4052eede3f404b84ac27e21a204bf5a9" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:49.662304 920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b0d1315274460d848afcfd4f88ee6e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:49.663561 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41fb820f152748b093ca0e0a2f663a78" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:49.759923 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 597a9271dedf4e789926e7e65fd79dfc (table default.Table_554a425f9acb4c92ab87a63ff39b8790 [id=f198d9d6f4844bda879e96c9d2ff92a3]) successfully deleted
W20260318 02:51:49.760526 719 leader_election.cc:343] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.760637 719 leader_election.cc:304] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:49.761030 719 leader_election.cc:343] T 41fb820f152748b093ca0e0a2f663a78 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.761116 719 leader_election.cc:304] T 41fb820f152748b093ca0e0a2f663a78 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:49.761296 2937 raft_consensus.cc:2749] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:49.761432 2937 raft_consensus.cc:2749] T 41fb820f152748b093ca0e0a2f663a78 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:49.762567 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet c844057d612049d8b90ee51ad8f3ec0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c844057d612049d8b90ee51ad8f3ec0b already in progress: creating tablet
I20260318 02:51:49.671799 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c35d41da7146faa89d8af3bb5f5140" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:49.694418 860 consensus_peers.cc:597] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 -> Peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Couldn't send request to peer 9422bb7011f342b08be0b073a88c4c4d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fd1284c6e90d4beb8223fd807d7888ec. This is attempt 1: this message will repeat every 5th retry.
W20260318 02:51:49.762928 860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.104.131:37025, user_credentials={real_user=slave}} blocked reactor thread for 68553.7us
W20260318 02:51:49.763383 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet df9d5919242a41aa8e119570f75b7c24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df9d5919242a41aa8e119570f75b7c24 already in progress: creating tablet
W20260318 02:51:49.763845 719 leader_election.cc:343] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.764247 2704 tablet_replica.cc:333] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:49.764495 2704 raft_consensus.cc:2243] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.764683 2704 raft_consensus.cc:2272] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.765269 2704 ts_tablet_manager.cc:1916] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.765619 1174 tablet_bootstrap.cc:492] T d30e39476d93400c8c79dd529688e7e0 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:49.765779 1174 ts_tablet_manager.cc:1403] T d30e39476d93400c8c79dd529688e7e0 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.002s
I20260318 02:51:49.766393 1174 raft_consensus.cc:359] T d30e39476d93400c8c79dd529688e7e0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.766556 1174 raft_consensus.cc:385] T d30e39476d93400c8c79dd529688e7e0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.766604 1174 raft_consensus.cc:740] T d30e39476d93400c8c79dd529688e7e0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.766837 1174 consensus_queue.cc:260] T d30e39476d93400c8c79dd529688e7e0 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.768631 1175 ts_tablet_manager.cc:1950] T 4df7d75e696a4aec981de3963c282b0d P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:49.771776 1174 ts_tablet_manager.cc:1434] T d30e39476d93400c8c79dd529688e7e0 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260318 02:51:49.772850 2704 ts_tablet_manager.cc:1929] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.773010 2704 log.cc:1199] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/53b0d1315274460d848afcfd4f88ee6e
I20260318 02:51:49.773351 2704 ts_tablet_manager.cc:1950] T 53b0d1315274460d848afcfd4f88ee6e P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:49.774339 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 53b0d1315274460d848afcfd4f88ee6e (table default.Table_eb858b839de14ff58abebe876d3ff752 [id=6c1803680f9b4bb4940646e81346cff6]) successfully deleted
I20260318 02:51:49.774730 2704 tablet_replica.cc:333] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:49.775440 2704 raft_consensus.cc:2243] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.775753 2704 raft_consensus.cc:2272] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.776327 2704 ts_tablet_manager.cc:1916] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.775007 1174 tablet_bootstrap.cc:492] T 495c8ace1cdb4741aa2ffa1f85dfb25e P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:49.778868 1174 tablet_bootstrap.cc:654] T 495c8ace1cdb4741aa2ffa1f85dfb25e P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.710841 893 tablet_service.cc:1511] Processing CreateTablet for tablet f450cb4feddc4ce293784dbe2aad842e (DEFAULT_TABLE table=default.Table_f204b14825c948129adf562227d9a237 [id=7054ca32d11740689a69401a5ff81cd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:49.738476 1173 ts_tablet_manager.cc:1434] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.143s user 0.002s sys 0.000s
I20260318 02:51:49.749126 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14044cb9f79d44f2a7cfeb43c03b7d1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.781809 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f450cb4feddc4ce293784dbe2aad842e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.784868 899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce692cb9c636415bbae7984bc917f3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.785638 2704 ts_tablet_manager.cc:1929] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:49.785732 2704 log.cc:1199] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/c58290c2d1c742d3b45dfb5caf52c75b
I20260318 02:51:49.786006 2704 ts_tablet_manager.cc:1950] T c58290c2d1c742d3b45dfb5caf52c75b P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:49.786989 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet c58290c2d1c742d3b45dfb5caf52c75b (table default.Table_944521fea0294e3381643693804fd723 [id=18d79b10f75b43efa4946ca8979a4235]) successfully deleted
I20260318 02:51:49.787653 1173 tablet_bootstrap.cc:492] T ce82c595e30a4878be25be8eb3d30790 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:49.788076 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457a4b623072460d96cc5d11b675cceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.789326 2704 tablet_replica.cc:333] T abfa81c3c78a498285e2961530272a39 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:49.789541 2704 raft_consensus.cc:2243] T abfa81c3c78a498285e2961530272a39 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.789703 2704 raft_consensus.cc:2272] T abfa81c3c78a498285e2961530272a39 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.789736 1173 tablet_bootstrap.cc:654] T ce82c595e30a4878be25be8eb3d30790 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.790210 2704 ts_tablet_manager.cc:1916] T abfa81c3c78a498285e2961530272a39 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.791358 2931 raft_consensus.cc:493] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.791502 2931 raft_consensus.cc:515] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.792068 2931 leader_election.cc:290] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:49.792830 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa6929cbd3c45898868b1f3929bf9a4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:49.793097 999 leader_election.cc:343] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 5a92761edfe74a9798da4d93964383ea
W20260318 02:51:49.794719 997 leader_election.cc:343] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.794826 997 leader_election.cc:304] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:49.795060 2152 raft_consensus.cc:2749] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:49.795166 2831 consensus_queue.cc:1048] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:49.796479 1174 tablet_bootstrap.cc:492] T 495c8ace1cdb4741aa2ffa1f85dfb25e P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:49.796623 1174 ts_tablet_manager.cc:1403] T 495c8ace1cdb4741aa2ffa1f85dfb25e P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.004s
I20260318 02:51:49.796949 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed1a8b946ba4bbfa0f7864155b00561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.797331 1174 raft_consensus.cc:359] T 495c8ace1cdb4741aa2ffa1f85dfb25e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.797519 1174 raft_consensus.cc:385] T 495c8ace1cdb4741aa2ffa1f85dfb25e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.797566 1174 raft_consensus.cc:740] T 495c8ace1cdb4741aa2ffa1f85dfb25e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.797744 1174 consensus_queue.cc:260] T 495c8ace1cdb4741aa2ffa1f85dfb25e P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.798225 1174 ts_tablet_manager.cc:1434] T 495c8ace1cdb4741aa2ffa1f85dfb25e P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:49.798508 1174 tablet_bootstrap.cc:492] T 60a4e38c14f84e6ba9d0402b62f7432c P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:49.800122 1174 tablet_bootstrap.cc:654] T 60a4e38c14f84e6ba9d0402b62f7432c P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.800861 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5be99b62dfc0414b86a2443f7b1fcd94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.803021 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a92761edfe74a9798da4d93964383ea" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:49.803833 2704 ts_tablet_manager.cc:1929] T abfa81c3c78a498285e2961530272a39 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.803931 2704 log.cc:1199] T abfa81c3c78a498285e2961530272a39 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/abfa81c3c78a498285e2961530272a39
I20260318 02:51:49.804214 2704 ts_tablet_manager.cc:1950] T abfa81c3c78a498285e2961530272a39 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:49.805853 892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f492709f0cb465ab760c62f6216642a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.808506 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet abfa81c3c78a498285e2961530272a39 (table default.Table_dc6c21598a584c8cb3d4a6de3f7f5567 [id=15bdf2c4b80447bfa3a92eb882c07396]) successfully deleted
I20260318 02:51:49.809029 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f450cb4feddc4ce293784dbe2aad842e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.809231 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce692cb9c636415bbae7984bc917f3a4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:49.809541 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 16f00e7e7ca847e9a5ebfd9bb5809147 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16f00e7e7ca847e9a5ebfd9bb5809147 already in progress: creating tablet
I20260318 02:51:49.810110 2704 tablet_replica.cc:333] T 868605c58c1d4744ab8930313e7dcaa9 P 6a903d876086423b8016d705b98895ad: stopping tablet replica
I20260318 02:51:49.810315 2704 raft_consensus.cc:2243] T 868605c58c1d4744ab8930313e7dcaa9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.810482 2704 raft_consensus.cc:2272] T 868605c58c1d4744ab8930313e7dcaa9 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.812215 2704 ts_tablet_manager.cc:1916] T 868605c58c1d4744ab8930313e7dcaa9 P 6a903d876086423b8016d705b98895ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.815981 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c036914048004860b8303d4bae5a1ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:49.820050 2704 ts_tablet_manager.cc:1929] T 868605c58c1d4744ab8930313e7dcaa9 P 6a903d876086423b8016d705b98895ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.820194 2704 log.cc:1199] T 868605c58c1d4744ab8930313e7dcaa9 P 6a903d876086423b8016d705b98895ad: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-0/wal/wals/868605c58c1d4744ab8930313e7dcaa9
I20260318 02:51:49.820333 1184 ts_tablet_manager.cc:1929] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.820439 1184 log.cc:1199] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/d3b37df330984378b81b367446d34748
I20260318 02:51:49.820729 1184 ts_tablet_manager.cc:1950] T d3b37df330984378b81b367446d34748 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:49.821655 1174 tablet_bootstrap.cc:492] T 60a4e38c14f84e6ba9d0402b62f7432c P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:49.821813 1174 ts_tablet_manager.cc:1403] T 60a4e38c14f84e6ba9d0402b62f7432c P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.008s
W20260318 02:51:49.822031 997 leader_election.cc:343] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.822150 997 leader_election.cc:304] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:49.822364 2665 raft_consensus.cc:2749] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:49.822556 1174 raft_consensus.cc:359] T 60a4e38c14f84e6ba9d0402b62f7432c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.822753 1174 raft_consensus.cc:385] T 60a4e38c14f84e6ba9d0402b62f7432c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.822830 1174 raft_consensus.cc:740] T 60a4e38c14f84e6ba9d0402b62f7432c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.823088 1174 consensus_queue.cc:260] T 60a4e38c14f84e6ba9d0402b62f7432c P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.824009 1174 ts_tablet_manager.cc:1434] T 60a4e38c14f84e6ba9d0402b62f7432c P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:49.824280 1172 tablet_bootstrap.cc:492] T 306367152e834668bbf5fcadd008b3ea P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:49.824312 1174 tablet_bootstrap.cc:492] T 5ba2b7cd82df4c19b2b434a6ba045e3b P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:49.824467 1172 ts_tablet_manager.cc:1403] T 306367152e834668bbf5fcadd008b3ea P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.121s user 0.001s sys 0.005s
I20260318 02:51:49.825985 1174 tablet_bootstrap.cc:654] T 5ba2b7cd82df4c19b2b434a6ba045e3b P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.827319 2955 tablet.cc:1723] T 169f97b2320e4a5baae1dec29a1c7c36 P b25f4f05e0c94c8db825d5afa0b8bf18: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260318 02:51:49.827514 2704 ts_tablet_manager.cc:1950] T 868605c58c1d4744ab8930313e7dcaa9 P 6a903d876086423b8016d705b98895ad: Deleting consensus metadata
I20260318 02:51:49.828801 443 catalog_manager.cc:5002] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): tablet 868605c58c1d4744ab8930313e7dcaa9 (table default.Table_997790cbbac74789b5c64a54d0c44ff3 [id=c3eb102920ff46d89bf713e574a91a5b]) successfully deleted
I20260318 02:51:49.834148 1172 raft_consensus.cc:359] T 306367152e834668bbf5fcadd008b3ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.834344 1172 raft_consensus.cc:385] T 306367152e834668bbf5fcadd008b3ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.834393 1172 raft_consensus.cc:740] T 306367152e834668bbf5fcadd008b3ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.834609 1172 consensus_queue.cc:260] T 306367152e834668bbf5fcadd008b3ea P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.835711 1172 ts_tablet_manager.cc:1434] T 306367152e834668bbf5fcadd008b3ea P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260318 02:51:49.836380 1172 tablet_bootstrap.cc:492] T defda79dd0f34c37ae16ea808df0754b P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:49.842900 997 consensus_peers.cc:597] T b698d732a905469caaf564d9512ba02c P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260318 02:51:49.843979 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 7b388b964c5f402ea4485d266563d07a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b388b964c5f402ea4485d266563d07a already in progress: creating tablet
W20260318 02:51:49.844686 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet c44a07e379844d99be5edfcfa72c6e40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c44a07e379844d99be5edfcfa72c6e40 already in progress: creating tablet
W20260318 02:51:49.845504 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 9a8c924687e347c38bc16219429eea80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a8c924687e347c38bc16219429eea80 already in progress: creating tablet
I20260318 02:51:49.845634 896 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a8c924687e347c38bc16219429eea80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:49.848418 1174 tablet_bootstrap.cc:492] T 5ba2b7cd82df4c19b2b434a6ba045e3b P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:49.848611 1174 ts_tablet_manager.cc:1403] T 5ba2b7cd82df4c19b2b434a6ba045e3b P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.001s
I20260318 02:51:49.849429 1174 raft_consensus.cc:359] T 5ba2b7cd82df4c19b2b434a6ba045e3b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.849633 1174 raft_consensus.cc:385] T 5ba2b7cd82df4c19b2b434a6ba045e3b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.849697 1174 raft_consensus.cc:740] T 5ba2b7cd82df4c19b2b434a6ba045e3b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.849943 1174 consensus_queue.cc:260] T 5ba2b7cd82df4c19b2b434a6ba045e3b P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.850423 1174 ts_tablet_manager.cc:1434] T 5ba2b7cd82df4c19b2b434a6ba045e3b P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:49.852579 1174 tablet_bootstrap.cc:492] T 572553569bbe4731b2580f1d22ee4fdd P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:49.751470 900 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:40 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:49.854209 1174 tablet_bootstrap.cc:654] T 572553569bbe4731b2580f1d22ee4fdd P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:49.862564 862 consensus_peers.cc:597] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 -> Peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Couldn't send request to peer 6a903d876086423b8016d705b98895ad. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fd1284c6e90d4beb8223fd807d7888ec. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:49.869009 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1388) took 1366 ms. Trace:
I20260318 02:51:49.869131 1175 rpcz_store.cc:276] 0318 02:51:48.502092 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:48.502137 (+ 45us) service_pool.cc:225] Handling call
0318 02:51:49.486678 (+984541us) ts_tablet_manager.cc:1151] Deleting tablet 4df7d75e696a4aec981de3963c282b0d
0318 02:51:49.486687 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:49.552496 (+ 65809us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:49.658739 (+106243us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:49.868991 (+210252us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":984377}
I20260318 02:51:49.869473 1175 tablet_replica.cc:333] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:49.869668 1175 raft_consensus.cc:2243] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.869830 1175 raft_consensus.cc:2272] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.870391 1175 ts_tablet_manager.cc:1916] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.885808 2835 raft_consensus.cc:493] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.886055 2835 raft_consensus.cc:515] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.886723 2835 leader_election.cc:290] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:49.887924 999 leader_election.cc:343] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 77a17ef7cfee4d65808b11e9cb51e7df
W20260318 02:51:49.889941 454 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb2152297eba46ac91e95de4157dd52c consensus state has no leader
I20260318 02:51:49.891937 454 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 895aa252b9f243d89e972d1b717ee910 (table default.Table_2afe66e6b2374e3c9b8e4692abb54d07 [id=6f9eb9fbda9846d495f3e70e229a5590]). Expected version 1 got 0
I20260318 02:51:49.892021 457 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 7c4b6f64c20e4e2e86a1e2f4ff628319
W20260318 02:51:49.892935 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4aab5486caa24d09a9e43c3db0df5d79 consensus state has no leader
I20260318 02:51:49.893230 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_31b24fd18b9b40ab89543ca570eac050" } new_table_name: "default.Table_f6bc857a1cf449f6b114aec30ada1bc9" modify_external_catalogs: true
I20260318 02:51:49.893357 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c4b6f64c20e4e2e86a1e2f4ff628319 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:49.894124 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 7c4b6f64c20e4e2e86a1e2f4ff628319 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c4b6f64c20e4e2e86a1e2f4ff628319 already in progress: creating tablet
I20260318 02:51:49.894910 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_e062633ba6d34bfcabd7de8fc4396e31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:49.895109 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 4df7d75e696a4aec981de3963c282b0d (table default.Table_5ed5970032fe44119b015cb6bbcd91d0 [id=5b9c6b78b2a94e55af6944b71dd51850]) successfully deleted
W20260318 02:51:49.892941 448 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3cda2afa253041449b3c5dcb0547160b consensus state has no leader
I20260318 02:51:49.896481 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_2a8070b0a1894efa968e05964a1d4bda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:49.897037 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a8070b0a1894efa968e05964a1d4bda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:49.892695 457 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3443cae78cf74ae4a5cb61411ef7a6a6" } new_table_name: "default.Table_7541f31f1614446fabcdb775f74b1e48" modify_external_catalogs: true
I20260318 02:51:49.899549 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a17ef7cfee4d65808b11e9cb51e7df" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:49.895439 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e062633ba6d34bfcabd7de8fc4396e31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:49.904232 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a8c924687e347c38bc16219429eea80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:49.892673 454 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_61a1261da65d47c4802ca3a883412e41" } modify_external_catalogs: true
I20260318 02:51:49.904640 454 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_61a1261da65d47c4802ca3a883412e41" } modify_external_catalogs: true
W20260318 02:51:49.906231 997 leader_election.cc:343] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.906361 997 leader_election.cc:304] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:49.907562 2835 raft_consensus.cc:2749] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:49.908464 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c4b6f64c20e4e2e86a1e2f4ff628319 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:49.909657 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c4b6f64c20e4e2e86a1e2f4ff628319 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:49.909937 1173 tablet_bootstrap.cc:492] T ce82c595e30a4878be25be8eb3d30790 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:49.910105 1173 ts_tablet_manager.cc:1403] T ce82c595e30a4878be25be8eb3d30790 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.123s user 0.003s sys 0.000s
I20260318 02:51:49.910905 1173 raft_consensus.cc:359] T ce82c595e30a4878be25be8eb3d30790 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:49.911147 1173 raft_consensus.cc:385] T ce82c595e30a4878be25be8eb3d30790 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.911249 1173 raft_consensus.cc:740] T ce82c595e30a4878be25be8eb3d30790 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.911646 1173 consensus_queue.cc:260] T ce82c595e30a4878be25be8eb3d30790 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } }
I20260318 02:51:49.912245 1172 tablet_bootstrap.cc:654] T defda79dd0f34c37ae16ea808df0754b P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.918467 1173 ts_tablet_manager.cc:1434] T ce82c595e30a4878be25be8eb3d30790 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
W20260318 02:51:49.920007 997 consensus_peers.cc:597] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:49.925858 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet d3b37df330984378b81b367446d34748 (table default.Table_fe927bc33c094a8bbec3557ad85c8e15 [id=ee1d866cd2674882bf473a546725ff76]) successfully deleted
I20260318 02:51:49.930168 1173 tablet_bootstrap.cc:492] T 5dd894706cc2466a8cd4e4df67856862 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:49.932065 1173 tablet_bootstrap.cc:654] T 5dd894706cc2466a8cd4e4df67856862 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.933964 1174 tablet_bootstrap.cc:492] T 572553569bbe4731b2580f1d22ee4fdd P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:49.934206 1174 ts_tablet_manager.cc:1403] T 572553569bbe4731b2580f1d22ee4fdd P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.082s user 0.006s sys 0.030s
I20260318 02:51:49.935010 1174 raft_consensus.cc:359] T 572553569bbe4731b2580f1d22ee4fdd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.935284 1174 raft_consensus.cc:385] T 572553569bbe4731b2580f1d22ee4fdd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.935385 1174 raft_consensus.cc:740] T 572553569bbe4731b2580f1d22ee4fdd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.935658 1174 consensus_queue.cc:260] T 572553569bbe4731b2580f1d22ee4fdd P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.936331 1174 ts_tablet_manager.cc:1434] T 572553569bbe4731b2580f1d22ee4fdd P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:49.939128 1174 tablet_bootstrap.cc:492] T d7c40c4cda934922ba7df2775ce892fe P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:49.940786 449 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3728303752c24f76b34471c6dea7725c" } modify_external_catalogs: true
I20260318 02:51:49.940984 449 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_3728303752c24f76b34471c6dea7725c" } modify_external_catalogs: true
I20260318 02:51:49.941059 450 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_6bca162ecee9459ab2c5655aecec5d3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:49.941788 456 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7d15c7f8f6214d5aba96a8c9fd76cb35" } modify_external_catalogs: true
I20260318 02:51:49.941931 456 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_7d15c7f8f6214d5aba96a8c9fd76cb35" } modify_external_catalogs: true
W20260318 02:51:49.942718 450 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6bca162ecee9459ab2c5655aecec5d3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:49.943280 453 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 895aa252b9f243d89e972d1b717ee910 (table default.Table_2afe66e6b2374e3c9b8e4692abb54d07 [id=6f9eb9fbda9846d495f3e70e229a5590]). Expected version 1 got 0
I20260318 02:51:49.943367 1174 tablet_bootstrap.cc:654] T d7c40c4cda934922ba7df2775ce892fe P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.947129 1175 ts_tablet_manager.cc:1929] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.947271 1175 log.cc:1199] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/2f04e5699531479d8b76edb0e2d2873c
I20260318 02:51:49.947574 1175 ts_tablet_manager.cc:1950] T 2f04e5699531479d8b76edb0e2d2873c P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:49.947921 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1389) took 1445 ms. Trace:
I20260318 02:51:49.948012 1175 rpcz_store.cc:276] 0318 02:51:48.502570 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:48.502672 (+ 102us) service_pool.cc:225] Handling call
0318 02:51:49.869429 (+1366757us) ts_tablet_manager.cc:1151] Deleting tablet 2f04e5699531479d8b76edb0e2d2873c
0318 02:51:49.869438 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:49.937954 (+ 68516us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:49.947003 (+ 9049us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:49.947894 (+ 891us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1366544}
I20260318 02:51:49.948352 1175 tablet_replica.cc:333] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:49.948552 1175 raft_consensus.cc:2243] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.960523 1173 tablet_bootstrap.cc:492] T 5dd894706cc2466a8cd4e4df67856862 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:49.960834 1173 ts_tablet_manager.cc:1403] T 5dd894706cc2466a8cd4e4df67856862 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.000s
I20260318 02:51:49.961694 1173 raft_consensus.cc:359] T 5dd894706cc2466a8cd4e4df67856862 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.961973 1173 raft_consensus.cc:385] T 5dd894706cc2466a8cd4e4df67856862 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.962081 1173 raft_consensus.cc:740] T 5dd894706cc2466a8cd4e4df67856862 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.962354 1173 consensus_queue.cc:260] T 5dd894706cc2466a8cd4e4df67856862 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.964421 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 2f04e5699531479d8b76edb0e2d2873c (table default.Table_9e6e77bf748f460894d85c701ccfad5b [id=ddd8b0b49c334776b49a59c18e75453c]) successfully deleted
I20260318 02:51:49.968218 1174 tablet_bootstrap.cc:492] T d7c40c4cda934922ba7df2775ce892fe P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:49.968456 1174 ts_tablet_manager.cc:1403] T d7c40c4cda934922ba7df2775ce892fe P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.007s
I20260318 02:51:49.968905 1173 ts_tablet_manager.cc:1434] T 5dd894706cc2466a8cd4e4df67856862 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260318 02:51:49.969295 1174 raft_consensus.cc:359] T d7c40c4cda934922ba7df2775ce892fe P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.970252 1174 raft_consensus.cc:385] T d7c40c4cda934922ba7df2775ce892fe P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.970451 1174 raft_consensus.cc:740] T d7c40c4cda934922ba7df2775ce892fe P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.970662 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 4052eede3f404b84ac27e21a204bf5a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:43 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:49.970974 1184 tablet_replica.cc:333] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:49.970875 1174 consensus_queue.cc:260] T d7c40c4cda934922ba7df2775ce892fe P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.971235 1184 raft_consensus.cc:2243] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:49.971431 1184 raft_consensus.cc:2272] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.972061 1184 ts_tablet_manager.cc:1916] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.975556 1173 tablet_bootstrap.cc:492] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:49.977402 1173 tablet_bootstrap.cc:654] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.977697 1174 ts_tablet_manager.cc:1434] T d7c40c4cda934922ba7df2775ce892fe P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.009s user 0.000s sys 0.001s
W20260318 02:51:49.977738 423 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 94039.4us
I20260318 02:51:49.978238 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a92761edfe74a9798da4d93964383ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:32 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:49.982527 1174 tablet_bootstrap.cc:492] T 71c53e67f27a4047a370d00d223961e6 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:49.983901 1174 tablet_bootstrap.cc:654] T 71c53e67f27a4047a370d00d223961e6 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:49.985564 2937 raft_consensus.cc:493] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:49.985684 2937 raft_consensus.cc:515] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.977602 1175 raft_consensus.cc:2272] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:49.986232 2937 leader_election.cc:290] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:49.986375 1175 ts_tablet_manager.cc:1916] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:49.988346 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831a7cb00e7040a7ade210c755dbff4a" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:49.988538 1062 raft_consensus.cc:2468] T 831a7cb00e7040a7ade210c755dbff4a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 0.
I20260318 02:51:49.988978 719 leader_election.cc:304] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:49.989226 2937 raft_consensus.cc:2804] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:49.989284 2937 raft_consensus.cc:493] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:49.989333 2937 raft_consensus.cc:3060] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:49.991034 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831a7cb00e7040a7ade210c755dbff4a" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:49.991848 2937 raft_consensus.cc:515] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.992409 2937 leader_election.cc:290] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
W20260318 02:51:49.992900 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 9a8c924687e347c38bc16219429eea80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a8c924687e347c38bc16219429eea80 already in progress: creating tablet
W20260318 02:51:49.993115 719 leader_election.cc:343] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:49.993151 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 7c4b6f64c20e4e2e86a1e2f4ff628319 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c4b6f64c20e4e2e86a1e2f4ff628319 already in progress: creating tablet
I20260318 02:51:49.993721 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831a7cb00e7040a7ade210c755dbff4a" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d"
I20260318 02:51:49.993916 1062 raft_consensus.cc:3060] T 831a7cb00e7040a7ade210c755dbff4a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:49.996407 1062 raft_consensus.cc:2468] T 831a7cb00e7040a7ade210c755dbff4a P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a903d876086423b8016d705b98895ad in term 1.
I20260318 02:51:49.996490 1175 ts_tablet_manager.cc:1929] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:49.996594 1175 log.cc:1199] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/82858fd64d534d1abcad12bc4a93cda7
I20260318 02:51:49.996883 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831a7cb00e7040a7ade210c755dbff4a" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
I20260318 02:51:49.996906 719 leader_election.cc:304] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
W20260318 02:51:49.997407 719 leader_election.cc:343] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:49.997721 1173 tablet_bootstrap.cc:492] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:49.997751 2937 raft_consensus.cc:2804] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:49.997861 2937 raft_consensus.cc:697] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [term 1 LEADER]: Becoming Leader. State: Replica: 6a903d876086423b8016d705b98895ad, State: Running, Role: LEADER
I20260318 02:51:49.997917 1173 ts_tablet_manager.cc:1403] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260318 02:51:49.998104 2937 consensus_queue.cc:237] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.998631 1173 raft_consensus.cc:359] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:49.998771 1173 raft_consensus.cc:385] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:49.998811 1173 raft_consensus.cc:740] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:49.998993 1173 consensus_queue.cc:260] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:50.002496 452 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 831a7cb00e7040a7ade210c755dbff4a consensus state has no leader
W20260318 02:51:50.004491 457 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2d0da7541a44acd8486d71731e7a5eb consensus state has no leader
I20260318 02:51:50.004925 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet d77381b5591b449a89328f0819e242a7
I20260318 02:51:50.005370 454 master_service.cc:954] ReplaceTablet: received request to replace tablet b4f47ccf0b194919902cc4142b097bf3 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:50.005802 450 master_service.cc:954] ReplaceTablet: received request to replace tablet f2f1023702ab42118253e4bbd603f7f7 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:50.005807 756 tablet_service.cc:1558] Processing DeleteTablet for tablet d77381b5591b449a89328f0819e242a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:50.005896 1173 ts_tablet_manager.cc:1434] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260318 02:51:50.006420 1173 tablet_bootstrap.cc:492] T c58290c2d1c742d3b45dfb5caf52c75b P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:50.006897 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet d77381b5591b449a89328f0819e242a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d77381b5591b449a89328f0819e242a7 already in progress: creating tablet
I20260318 02:51:50.007262 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 43844dd8883e45dbaa92d4058e9af9fb
I20260318 02:51:50.007846 456 master_service.cc:954] ReplaceTablet: received request to replace tablet 848769c787374a2f83fcf68691da4111 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:50.008445 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 43844dd8883e45dbaa92d4058e9af9fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:49862
W20260318 02:51:50.009056 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 43844dd8883e45dbaa92d4058e9af9fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43844dd8883e45dbaa92d4058e9af9fb already in progress: creating tablet
I20260318 02:51:50.009686 1174 tablet_bootstrap.cc:492] T 71c53e67f27a4047a370d00d223961e6 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:50.009835 1174 ts_tablet_manager.cc:1403] T 71c53e67f27a4047a370d00d223961e6 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.001s
I20260318 02:51:50.010669 1174 raft_consensus.cc:359] T 71c53e67f27a4047a370d00d223961e6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.010856 1174 raft_consensus.cc:385] T 71c53e67f27a4047a370d00d223961e6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.010919 1174 raft_consensus.cc:740] T 71c53e67f27a4047a370d00d223961e6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.011116 1174 consensus_queue.cc:260] T 71c53e67f27a4047a370d00d223961e6 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.011402 453 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_f8c3447d0fe44825b715b33200c944fe [id=6eab717971914229a4386a1579b11b4a] alter complete (version 1)
I20260318 02:51:50.011587 1174 ts_tablet_manager.cc:1434] T 71c53e67f27a4047a370d00d223961e6 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:50.015703 1174 tablet_bootstrap.cc:492] T b07006bc31584865a0a5eb407e7ccc16 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:50.017854 1174 tablet_bootstrap.cc:654] T b07006bc31584865a0a5eb407e7ccc16 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.027194 1175 ts_tablet_manager.cc:1950] T 82858fd64d534d1abcad12bc4a93cda7 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:50.027565 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1390) took 1524 ms. Trace:
I20260318 02:51:50.027663 1175 rpcz_store.cc:276] 0318 02:51:48.503576 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:48.503624 (+ 48us) service_pool.cc:225] Handling call
0318 02:51:49.948301 (+1444677us) ts_tablet_manager.cc:1151] Deleting tablet 82858fd64d534d1abcad12bc4a93cda7
0318 02:51:49.948311 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:49.989375 (+ 41064us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:49.996362 (+ 6987us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:50.027546 (+ 31184us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1444523}
I20260318 02:51:50.028215 1173 tablet_bootstrap.cc:654] T c58290c2d1c742d3b45dfb5caf52c75b P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.030189 893 tablet_service.cc:1558] Processing DeleteTablet for tablet d77381b5591b449a89328f0819e242a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:50.030537 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1385) took 1530 ms. Trace:
I20260318 02:51:50.030620 1175 rpcz_store.cc:276] 0318 02:51:48.497408 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:48.533004 (+ 35596us) service_pool.cc:225] Handling call
0318 02:51:50.027960 (+1494956us) ts_tablet_manager.cc:1151] Deleting tablet 0ab9bdc476f64d758637a12148f2b092
0318 02:51:50.027969 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:50.028077 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1494711}
I20260318 02:51:50.031006 1175 tablet_replica.cc:333] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:50.031189 1175 raft_consensus.cc:2243] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:50.031345 1175 raft_consensus.cc:2272] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:50.031991 1175 ts_tablet_manager.cc:1916] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:50.032155 1184 ts_tablet_manager.cc:1929] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:50.032320 1184 log.cc:1199] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/4052eede3f404b84ac27e21a204bf5a9
I20260318 02:51:50.032656 1184 ts_tablet_manager.cc:1950] T 4052eede3f404b84ac27e21a204bf5a9 P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:50.033742 1184 tablet_replica.cc:333] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:50.034067 1184 raft_consensus.cc:2243] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:50.034264 1184 raft_consensus.cc:2272] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:50.034922 1184 ts_tablet_manager.cc:1916] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:50.037380 1172 tablet_bootstrap.cc:492] T defda79dd0f34c37ae16ea808df0754b P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.037590 1172 ts_tablet_manager.cc:1403] T defda79dd0f34c37ae16ea808df0754b P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.202s user 0.005s sys 0.002s
I20260318 02:51:50.038303 922 raft_consensus.cc:3060] T 9c05f7a75527410e9c5cde0dbc6bc10e P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:50.045909 1174 tablet_bootstrap.cc:492] T b07006bc31584865a0a5eb407e7ccc16 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:50.046180 1174 ts_tablet_manager.cc:1403] T b07006bc31584865a0a5eb407e7ccc16 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.012s
I20260318 02:51:50.046931 1173 tablet_bootstrap.cc:492] T c58290c2d1c742d3b45dfb5caf52c75b P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:50.047139 1173 ts_tablet_manager.cc:1403] T c58290c2d1c742d3b45dfb5caf52c75b P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.002s
I20260318 02:51:50.046926 1174 raft_consensus.cc:359] T b07006bc31584865a0a5eb407e7ccc16 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.048044 1174 raft_consensus.cc:385] T b07006bc31584865a0a5eb407e7ccc16 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.048260 1174 raft_consensus.cc:740] T b07006bc31584865a0a5eb407e7ccc16 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.048734 1174 consensus_queue.cc:260] T b07006bc31584865a0a5eb407e7ccc16 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.049410 457 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_d41811bdc9f5491ab1d5a4cd2e302714"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:50.050048 457 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d41811bdc9f5491ab1d5a4cd2e302714 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:50.051362 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9c413ff19e4a455089446f327b0f4aa5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:50.051877 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c413ff19e4a455089446f327b0f4aa5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:50.052805 1174 ts_tablet_manager.cc:1434] T b07006bc31584865a0a5eb407e7ccc16 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260318 02:51:50.053370 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_1f42ea9094224b57804fd1c7fb9a956d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:50.053898 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f42ea9094224b57804fd1c7fb9a956d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:50.054067 1174 tablet_bootstrap.cc:492] T 9f274ae7a6834ca98f01575fcf8b161e P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:50.056038 1174 tablet_bootstrap.cc:654] T 9f274ae7a6834ca98f01575fcf8b161e P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.062723 1173 raft_consensus.cc:359] T c58290c2d1c742d3b45dfb5caf52c75b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.063042 1173 raft_consensus.cc:385] T c58290c2d1c742d3b45dfb5caf52c75b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.063133 1173 raft_consensus.cc:740] T c58290c2d1c742d3b45dfb5caf52c75b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.063465 1173 consensus_queue.cc:260] T c58290c2d1c742d3b45dfb5caf52c75b P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.064846 2937 raft_consensus.cc:493] T 71c53e67f27a4047a370d00d223961e6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.064990 2937 raft_consensus.cc:515] T 71c53e67f27a4047a370d00d223961e6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.065552 2937 leader_election.cc:290] T 71c53e67f27a4047a370d00d223961e6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:50.066279 2937 raft_consensus.cc:493] T 258dc29e4e4245289b7e450837edcd24 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.066403 2937 raft_consensus.cc:515] T 258dc29e4e4245289b7e450837edcd24 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:50.066900 2937 leader_election.cc:290] T 258dc29e4e4245289b7e450837edcd24 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:50.066843 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c53e67f27a4047a370d00d223961e6" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:50.067332 719 leader_election.cc:343] T 71c53e67f27a4047a370d00d223961e6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.070261 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258dc29e4e4245289b7e450837edcd24" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:50.070746 719 leader_election.cc:343] T 258dc29e4e4245289b7e450837edcd24 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.071611 1173 ts_tablet_manager.cc:1434] T c58290c2d1c742d3b45dfb5caf52c75b P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20260318 02:51:50.072693 1173 tablet_bootstrap.cc:492] T 498f592fa2fb46748f7752004780fe46 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:50.072964 2937 raft_consensus.cc:493] T d30e39476d93400c8c79dd529688e7e0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.072988 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 43844dd8883e45dbaa92d4058e9af9fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:50.073081 2937 raft_consensus.cc:515] T d30e39476d93400c8c79dd529688e7e0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.073637 2937 leader_election.cc:290] T d30e39476d93400c8c79dd529688e7e0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:50.075874 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30e39476d93400c8c79dd529688e7e0" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:50.076400 719 leader_election.cc:343] T d30e39476d93400c8c79dd529688e7e0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.076614 2926 raft_consensus.cc:493] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.076748 2926 raft_consensus.cc:515] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.077451 2926 leader_election.cc:290] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:50.078344 862 leader_election.cc:343] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 6a65ccfd73234e8fb2bea5b6911cb3f1
W20260318 02:51:50.079145 860 leader_election.cc:343] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 6a65ccfd73234e8fb2bea5b6911cb3f1
I20260318 02:51:50.079264 860 leader_election.cc:304] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:50.079699 2926 raft_consensus.cc:2749] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.083114 2926 raft_consensus.cc:493] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.083248 2926 raft_consensus.cc:515] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.083885 2926 leader_election.cc:290] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:50.085418 862 leader_election.cc:343] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 824b9dc6982f425c9518c0ea3560bf84
I20260318 02:51:50.085644 1173 tablet_bootstrap.cc:654] T 498f592fa2fb46748f7752004780fe46 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
W20260318 02:51:50.086665 860 leader_election.cc:343] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Not found: Tablet not found: 824b9dc6982f425c9518c0ea3560bf84
I20260318 02:51:50.088416 860 leader_election.cc:304] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:50.088874 2926 raft_consensus.cc:2749] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.066604 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71c53e67f27a4047a370d00d223961e6" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:50.067891 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "258dc29e4e4245289b7e450837edcd24" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:50.069744 2831 raft_consensus.cc:493] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.074309 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d30e39476d93400c8c79dd529688e7e0" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:50.092929 2831 raft_consensus.cc:515] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.093760 2831 leader_election.cc:290] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:50.081009 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet d77381b5591b449a89328f0819e242a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:50.081314 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 43844dd8883e45dbaa92d4058e9af9fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:50.088311 1175 ts_tablet_manager.cc:1929] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:50.094269 1175 log.cc:1199] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/a384923c86ee42d6a47ed3f68e6811df
I20260318 02:51:50.094614 1175 ts_tablet_manager.cc:1950] T a384923c86ee42d6a47ed3f68e6811df P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
W20260318 02:51:50.094645 719 leader_election.cc:343] T 71c53e67f27a4047a370d00d223961e6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.094763 719 leader_election.cc:304] T 71c53e67f27a4047a370d00d223961e6 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.095032 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1391) took 1528 ms. Trace:
W20260318 02:51:50.095146 719 leader_election.cc:343] T 258dc29e4e4245289b7e450837edcd24 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.095108 1175 rpcz_store.cc:276] 0318 02:51:48.566666 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:48.583402 (+ 16736us) service_pool.cc:225] Handling call
0318 02:51:50.030959 (+1447557us) ts_tablet_manager.cc:1151] Deleting tablet a384923c86ee42d6a47ed3f68e6811df
0318 02:51:50.030968 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:50.034932 (+ 3964us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:50.088210 (+ 53278us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:50.094906 (+ 6696us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1447337}
I20260318 02:51:50.095227 719 leader_election.cc:304] T 258dc29e4e4245289b7e450837edcd24 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.095523 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1392) took 1364 ms. Trace:
W20260318 02:51:50.095556 719 leader_election.cc:343] T d30e39476d93400c8c79dd529688e7e0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.095631 719 leader_election.cc:304] T d30e39476d93400c8c79dd529688e7e0 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.095589 1175 rpcz_store.cc:276] 0318 02:51:48.730708 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:48.736501 (+ 5793us) service_pool.cc:225] Handling call
0318 02:51:50.095399 (+1358898us) ts_tablet_manager.cc:1151] Deleting tablet b54248ad606643a292dff193c35d6a00
0318 02:51:50.095408 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:50.095508 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1358693}
I20260318 02:51:50.095899 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1393) took 1264 ms. Trace:
I20260318 02:51:50.095916 2937 raft_consensus.cc:2749] T 71c53e67f27a4047a370d00d223961e6 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.095959 1175 rpcz_store.cc:276] 0318 02:51:48.830983 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:48.836573 (+ 5590us) service_pool.cc:225] Handling call
0318 02:51:50.095802 (+1259229us) ts_tablet_manager.cc:1151] Deleting tablet 6eae03ae22c440e69502471b6d36f240
0318 02:51:50.095811 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:50.095885 (+ 74us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1259020}
I20260318 02:51:50.096045 2937 raft_consensus.cc:2749] T 258dc29e4e4245289b7e450837edcd24 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.096143 2937 raft_consensus.cc:2749] T d30e39476d93400c8c79dd529688e7e0 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.096313 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb29fd9d6fc845b2aaffe34c290fd5ca" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:50.096287 1172 raft_consensus.cc:359] T defda79dd0f34c37ae16ea808df0754b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:50.096436 1172 raft_consensus.cc:385] T defda79dd0f34c37ae16ea808df0754b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.096459 779 raft_consensus.cc:2468] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:50.096483 1172 raft_consensus.cc:740] T defda79dd0f34c37ae16ea808df0754b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.096961 999 leader_election.cc:304] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters:
I20260318 02:51:50.097486 1173 tablet_bootstrap.cc:492] T 498f592fa2fb46748f7752004780fe46 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:50.097482 2831 raft_consensus.cc:2804] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:50.097551 2831 raft_consensus.cc:493] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:50.097620 2831 raft_consensus.cc:3060] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:50.097759 1173 ts_tablet_manager.cc:1403] T 498f592fa2fb46748f7752004780fe46 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.003s
I20260318 02:51:50.098443 1173 raft_consensus.cc:359] T 498f592fa2fb46748f7752004780fe46 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.098678 1173 raft_consensus.cc:385] T 498f592fa2fb46748f7752004780fe46 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.098762 1173 raft_consensus.cc:740] T 498f592fa2fb46748f7752004780fe46 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.099013 1173 consensus_queue.cc:260] T 498f592fa2fb46748f7752004780fe46 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.099998 1173 ts_tablet_manager.cc:1434] T 498f592fa2fb46748f7752004780fe46 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:50.100430 2831 raft_consensus.cc:515] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.101795 2831 leader_election.cc:290] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:50.103091 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb29fd9d6fc845b2aaffe34c290fd5ca" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:50.103260 779 raft_consensus.cc:3060] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:50.103276 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb29fd9d6fc845b2aaffe34c290fd5ca" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:50.103929 997 leader_election.cc:343] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.105715 1175 tablet_replica.cc:333] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:50.105902 1175 raft_consensus.cc:2243] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:50.105988 779 raft_consensus.cc:2468] T cb29fd9d6fc845b2aaffe34c290fd5ca P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:50.106029 1175 raft_consensus.cc:2272] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:50.106273 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb29fd9d6fc845b2aaffe34c290fd5ca" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:50.106388 999 leader_election.cc:304] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.106774 1173 tablet_bootstrap.cc:492] T bac04b3e4ad448b09a1a25a754b44aad P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:50.106935 997 leader_election.cc:343] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.107415 2831 raft_consensus.cc:2804] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:50.107669 2831 raft_consensus.cc:697] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:50.108433 2831 consensus_queue.cc:237] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.080693 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 4052eede3f404b84ac27e21a204bf5a9 (table default.Table_f4cd103bfd1d46beb3655a4dc4c8c3b8 [id=9995967cb4594c8b89df60677db4cad6]) successfully deleted
I20260318 02:51:50.114180 1173 tablet_bootstrap.cc:654] T bac04b3e4ad448b09a1a25a754b44aad P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.115376 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 82858fd64d534d1abcad12bc4a93cda7 (table default.Table_e81f3622048c415e977ce897e4edcacf [id=74f992023abb491eb564bdfd68b19b98]) successfully deleted
I20260318 02:51:50.116276 1172 consensus_queue.cc:260] T defda79dd0f34c37ae16ea808df0754b P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:50.116889 1175 ts_tablet_manager.cc:1916] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260318 02:51:50.121001 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 0ab9bdc476f64d758637a12148f2b092 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ab9bdc476f64d758637a12148f2b092 already in progress: creating tablet
I20260318 02:51:50.121243 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet a384923c86ee42d6a47ed3f68e6811df (table default.Table_594a288e26f245c8a9c365f583bced74 [id=a653573522fe43da9c796fc1c7c638f9]) successfully deleted
W20260318 02:51:50.121408 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet b54248ad606643a292dff193c35d6a00 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b54248ad606643a292dff193c35d6a00 already in progress: creating tablet
W20260318 02:51:50.121560 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 6eae03ae22c440e69502471b6d36f240 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6eae03ae22c440e69502471b6d36f240 already in progress: creating tablet
I20260318 02:51:50.125046 1172 ts_tablet_manager.cc:1434] T defda79dd0f34c37ae16ea808df0754b P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.030s user 0.001s sys 0.001s
I20260318 02:51:50.127293 1172 tablet_bootstrap.cc:492] T 565add8c21f343f2b11c12a9bb7ff111 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.137940 2859 raft_consensus.cc:493] T 60a4e38c14f84e6ba9d0402b62f7432c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.138108 2859 raft_consensus.cc:515] T 60a4e38c14f84e6ba9d0402b62f7432c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.138710 2859 leader_election.cc:290] T 60a4e38c14f84e6ba9d0402b62f7432c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:50.139521 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a4e38c14f84e6ba9d0402b62f7432c" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:50.140097 719 leader_election.cc:343] T 60a4e38c14f84e6ba9d0402b62f7432c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.140331 457 master_service.cc:954] ReplaceTablet: received request to replace tablet 0cda13385dbb4c6daa211e933c1f93a1 from {username='slave'} at 127.0.0.1:47158
I20260318 02:51:50.141018 457 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bf8a4d0fd01741ef9f71f8880663e4e5" } modify_external_catalogs: true
I20260318 02:51:50.141161 457 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_bf8a4d0fd01741ef9f71f8880663e4e5" } modify_external_catalogs: true
I20260318 02:51:50.141822 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_26dffb94c5c84a55b8cd19e3a64b6d36" } new_table_name: "default.Table_698dd0bba6a142d19751275a8c2e1af1" modify_external_catalogs: true
I20260318 02:51:50.143213 448 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_79489cca59114b02bb26b88fd5f27727" } modify_external_catalogs: true
I20260318 02:51:50.143342 448 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_79489cca59114b02bb26b88fd5f27727" } modify_external_catalogs: true
I20260318 02:51:50.146325 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a4e38c14f84e6ba9d0402b62f7432c" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:50.146863 1173 tablet_bootstrap.cc:492] T bac04b3e4ad448b09a1a25a754b44aad P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
W20260318 02:51:50.146863 719 leader_election.cc:343] T 60a4e38c14f84e6ba9d0402b62f7432c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.146988 719 leader_election.cc:304] T 60a4e38c14f84e6ba9d0402b62f7432c P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.147135 1173 ts_tablet_manager.cc:1403] T bac04b3e4ad448b09a1a25a754b44aad P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.000s
I20260318 02:51:50.147387 2859 raft_consensus.cc:2749] T 60a4e38c14f84e6ba9d0402b62f7432c P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.148012 1173 raft_consensus.cc:359] T bac04b3e4ad448b09a1a25a754b44aad P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.148247 1173 raft_consensus.cc:385] T bac04b3e4ad448b09a1a25a754b44aad P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.148347 1173 raft_consensus.cc:740] T bac04b3e4ad448b09a1a25a754b44aad P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.148633 1173 consensus_queue.cc:260] T bac04b3e4ad448b09a1a25a754b44aad P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.154731 1173 ts_tablet_manager.cc:1434] T bac04b3e4ad448b09a1a25a754b44aad P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260318 02:51:50.155295 1173 tablet_bootstrap.cc:492] T 2dab268da5e843cab5c28a521217df97 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:50.161535 1172 tablet_bootstrap.cc:654] T 565add8c21f343f2b11c12a9bb7ff111 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.162667 1173 tablet_bootstrap.cc:654] T 2dab268da5e843cab5c28a521217df97 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.142853 1175 ts_tablet_manager.cc:1929] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:50.164314 1175 log.cc:1199] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/6f527a0ba0914924bc7f604ae8a48393
I20260318 02:51:50.164762 1175 ts_tablet_manager.cc:1950] T 6f527a0ba0914924bc7f604ae8a48393 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:50.165591 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1394) took 1334 ms. Trace:
I20260318 02:51:50.165729 1175 rpcz_store.cc:276] 0318 02:51:48.831081 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:48.840843 (+ 9762us) service_pool.cc:225] Handling call
0318 02:51:50.096151 (+1255308us) ts_tablet_manager.cc:1151] Deleting tablet 6f527a0ba0914924bc7f604ae8a48393
0318 02:51:50.096159 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:50.135580 (+ 39421us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:50.142749 (+ 7169us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:50.165570 (+ 22821us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1255064}
I20260318 02:51:50.166261 1175 tablet_replica.cc:333] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:50.166582 1175 raft_consensus.cc:2243] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: Raft consensus shutting down.
I20260318 02:51:50.166918 1175 pending_rounds.cc:70] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18: Trying to abort 1 pending ops.
I20260318 02:51:50.167024 1175 pending_rounds.cc:77] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265494256803483648 op_type: NO_OP noop_request { }
I20260318 02:51:50.167208 1175 raft_consensus.cc:2889] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260318 02:51:50.167352 1175 raft_consensus.cc:2272] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:50.167968 1175 ts_tablet_manager.cc:1916] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:50.168061 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 6f527a0ba0914924bc7f604ae8a48393 (table default.Table_3064939f4dfb44dba19bb6f8f9c6f250 [id=b56547120b2645cc9c7cbd6078f7a039]) successfully deleted
I20260318 02:51:50.169881 455 catalog_manager.cc:5671] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a903d876086423b8016d705b98895ad (127.0.104.129). New cstate: current_term: 1 leader_uuid: "6a903d876086423b8016d705b98895ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:50.171115 452 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet b698d732a905469caaf564d9512ba02c (table default.Table_6238662cdd5443a694ee4feec8bc0413 [id=eb11e3d1c3ef4295ac9b6ee657ac233a]). Expected version 1 got 0
I20260318 02:51:50.171459 452 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet 831a7cb00e7040a7ade210c755dbff4a (table default.Table_f6bc857a1cf449f6b114aec30ada1bc9 [id=0cdd67bea79141b9b8dd73a581deb69c]). Expected version 1 got 0
I20260318 02:51:50.171844 453 catalog_manager.cc:6216] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: default.Table_3c0a83dcbb7b49b1858e72778990f485 [id=9a52b01ffd5b4f7e8a7a20a817aa842f] alter complete (version 3)
W20260318 02:51:50.171998 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee5faed619d140fd99df5f104eb6adf9 consensus state has no leader
I20260318 02:51:50.172291 451 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_5df4cb71ac9f42b9936d125977cd3a3d" } new_table_name: "default.Table_c7c94f99794e4251b0acfc0a3eac3fcb" modify_external_catalogs: true
I20260318 02:51:50.172319 453 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_0c6476aedfad430397ddd23f09c92219"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:50.172889 453 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c6476aedfad430397ddd23f09c92219 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:50.182605 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 306367152e834668bbf5fcadd008b3ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:46 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:50.183871 452 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet bac04b3e4ad448b09a1a25a754b44aad (table default.Table_c0a9aae588ef49148c04338c906dab4a [id=1532d6dc2cc641998f9c120075fa04b4]). Expected version 1 got 0
I20260318 02:51:50.184254 452 catalog_manager.cc:5763] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443) does not have the latest schema for tablet 9c05f7a75527410e9c5cde0dbc6bc10e (table default.Table_fed9534e8e3d410ab1775c885744cc2a [id=113b6b3abc1a4dcc91c49be4704a159c]). Expected version 2 got 0
I20260318 02:51:50.185078 1174 tablet_bootstrap.cc:492] T 9f274ae7a6834ca98f01575fcf8b161e P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:50.185231 1174 ts_tablet_manager.cc:1403] T 9f274ae7a6834ca98f01575fcf8b161e P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.132s user 0.027s sys 0.021s
I20260318 02:51:50.185985 1174 raft_consensus.cc:359] T 9f274ae7a6834ca98f01575fcf8b161e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.186105 1184 ts_tablet_manager.cc:1929] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:50.186154 1174 raft_consensus.cc:385] T 9f274ae7a6834ca98f01575fcf8b161e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.186203 1174 raft_consensus.cc:740] T 9f274ae7a6834ca98f01575fcf8b161e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.186218 1184 log.cc:1199] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/5a92761edfe74a9798da4d93964383ea
I20260318 02:51:50.186511 1184 ts_tablet_manager.cc:1950] T 5a92761edfe74a9798da4d93964383ea P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:50.186455 1174 consensus_queue.cc:260] T 9f274ae7a6834ca98f01575fcf8b161e P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.186935 1174 ts_tablet_manager.cc:1434] T 9f274ae7a6834ca98f01575fcf8b161e P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260318 02:51:50.190361 756 tablet_service.cc:1511] Processing CreateTablet for tablet 5c99df0cedd040faa224c6b97e68cb3d (DEFAULT_TABLE table=default.Table_b0a1f6d00f4345b982049e897878a04f [id=17942e0688cf4b708f6a59bb463d4ec0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.190748 1174 tablet_bootstrap.cc:492] T 15f79ab1c38141adaed4bd381df26d9b P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:50.190785 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c99df0cedd040faa224c6b97e68cb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.191239 452 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47158:
table { table_name: "default.Table_d5ddb641ef9245ca92ab35d8ac25b157" } new_table_name: "default.Table_3530a7978e5141d5abf7f669726c537d" modify_external_catalogs: true
I20260318 02:51:50.192629 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 77a17ef7cfee4d65808b11e9cb51e7df with delete_type TABLET_DATA_DELETED (replaced by tablet a6edb840adc6464cadfe58a98d51b5ff) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:50.192993 893 tablet_service.cc:1558] Processing DeleteTablet for tablet ce82c595e30a4878be25be8eb3d30790 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:33 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:50.193614 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 824b9dc6982f425c9518c0ea3560bf84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:29 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:50.194115 893 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dd894706cc2466a8cd4e4df67856862 with delete_type TABLET_DATA_DELETED (replaced by tablet fc96b13affd442eca3b671a3741b6000) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:50.194104 748 tablet_service.cc:1511] Processing CreateTablet for tablet 73f8871e0a0a4de88f8d38f724e9028f (DEFAULT_TABLE table=default.Table_d8366ea91a234e01851bc65a47d9a36d [id=07424811308a4901b2b1460ab4c9f540]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.194402 1174 tablet_bootstrap.cc:654] T 15f79ab1c38141adaed4bd381df26d9b P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.194506 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f8871e0a0a4de88f8d38f724e9028f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.194983 893 tablet_service.cc:1511] Processing CreateTablet for tablet 5c99df0cedd040faa224c6b97e68cb3d (DEFAULT_TABLE table=default.Table_b0a1f6d00f4345b982049e897878a04f [id=17942e0688cf4b708f6a59bb463d4ec0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.196120 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 5c99df0cedd040faa224c6b97e68cb3d (DEFAULT_TABLE table=default.Table_b0a1f6d00f4345b982049e897878a04f [id=17942e0688cf4b708f6a59bb463d4ec0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.196993 903 tablet_service.cc:1511] Processing CreateTablet for tablet 73f8871e0a0a4de88f8d38f724e9028f (DEFAULT_TABLE table=default.Table_d8366ea91a234e01851bc65a47d9a36d [id=07424811308a4901b2b1460ab4c9f540]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.197656 2859 raft_consensus.cc:493] T 9f274ae7a6834ca98f01575fcf8b161e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.197781 2859 raft_consensus.cc:515] T 9f274ae7a6834ca98f01575fcf8b161e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.198376 2859 leader_election.cc:290] T 9f274ae7a6834ca98f01575fcf8b161e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:50.198989 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f274ae7a6834ca98f01575fcf8b161e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:50.199061 449 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 295ac73a106e4a7e87d001a79f80cb99
I20260318 02:51:50.199767 449 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_16192384409e4f9b891080d30b7ffd44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:50.200292 449 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16192384409e4f9b891080d30b7ffd44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260318 02:51:50.201449 719 leader_election.cc:343] T 9f274ae7a6834ca98f01575fcf8b161e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.201964 448 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 30c4e42a55914561a9f4ee330594eef6
I20260318 02:51:50.202580 448 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_ddbe1813111d466a8725a3eeeff2a56d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260318 02:51:50.202716 1174 tablet_bootstrap.cc:492] T 15f79ab1c38141adaed4bd381df26d9b P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:50.202827 1174 ts_tablet_manager.cc:1403] T 15f79ab1c38141adaed4bd381df26d9b P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.002s
W20260318 02:51:50.203056 448 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddbe1813111d466a8725a3eeeff2a56d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:50.203516 1174 raft_consensus.cc:359] T 15f79ab1c38141adaed4bd381df26d9b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.203653 1174 raft_consensus.cc:385] T 15f79ab1c38141adaed4bd381df26d9b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.203693 1174 raft_consensus.cc:740] T 15f79ab1c38141adaed4bd381df26d9b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.204656 756 tablet_service.cc:1558] Processing DeleteTablet for tablet 295ac73a106e4a7e87d001a79f80cb99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:50.204903 750 tablet_service.cc:1558] Processing DeleteTablet for tablet 30c4e42a55914561a9f4ee330594eef6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:50 UTC) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:50.205587 1174 consensus_queue.cc:260] T 15f79ab1c38141adaed4bd381df26d9b P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:50.205847 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 295ac73a106e4a7e87d001a79f80cb99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 295ac73a106e4a7e87d001a79f80cb99 already in progress: creating tablet
I20260318 02:51:50.206074 1174 ts_tablet_manager.cc:1434] T 15f79ab1c38141adaed4bd381df26d9b P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
W20260318 02:51:50.206099 443 catalog_manager.cc:4982] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): delete failed for tablet 30c4e42a55914561a9f4ee330594eef6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30c4e42a55914561a9f4ee330594eef6 already in progress: creating tablet
W20260318 02:51:50.209108 451 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e1d897fa1eb9435e8a4b59f4a984336a consensus state has no leader
I20260318 02:51:50.209389 1174 tablet_bootstrap.cc:492] T 33f93d766c44461cb0f5f4bfba09a744 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:50.209470 451 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47158:
name: "default.Table_9c2ec2d0ae73482d8520aabba8166202"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260318 02:51:50.210000 451 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c2ec2d0ae73482d8520aabba8166202 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260318 02:51:50.210968 1174 tablet_bootstrap.cc:654] T 33f93d766c44461cb0f5f4bfba09a744 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.212872 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f274ae7a6834ca98f01575fcf8b161e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:50.213393 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c99df0cedd040faa224c6b97e68cb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.214197 1184 tablet_replica.cc:333] T 306367152e834668bbf5fcadd008b3ea P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:50.214375 1184 raft_consensus.cc:2243] T 306367152e834668bbf5fcadd008b3ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:50.214515 1184 raft_consensus.cc:2272] T 306367152e834668bbf5fcadd008b3ea P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:50.214538 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 73f8871e0a0a4de88f8d38f724e9028f (DEFAULT_TABLE table=default.Table_d8366ea91a234e01851bc65a47d9a36d [id=07424811308a4901b2b1460ab4c9f540]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.214918 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f8871e0a0a4de88f8d38f724e9028f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:50.215474 719 leader_election.cc:343] T 9f274ae7a6834ca98f01575fcf8b161e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.215590 719 leader_election.cc:304] T 9f274ae7a6834ca98f01575fcf8b161e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.215955 2859 raft_consensus.cc:2749] T 9f274ae7a6834ca98f01575fcf8b161e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.219003 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 295ac73a106e4a7e87d001a79f80cb99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:50.219813 748 tablet_service.cc:1511] Processing CreateTablet for tablet 5faedf126399414ca47dc891cb41cd5d (DEFAULT_TABLE table=default.Table_9d4cd5f5e3bc4d91a21015ed772debc1 [id=90da9bd650db40548057ca95f3f920fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.220561 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5faedf126399414ca47dc891cb41cd5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.220950 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 30c4e42a55914561a9f4ee330594eef6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:50 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:50.221124 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 295ac73a106e4a7e87d001a79f80cb99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:49 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:50.222000 1030 tablet_service.cc:1558] Processing DeleteTablet for tablet 30c4e42a55914561a9f4ee330594eef6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:50 UTC) from {username='slave'} at 127.0.0.1:38664
I20260318 02:51:50.225549 2931 consensus_queue.cc:1048] T a75f367cde75433d86a4ee9384e57761 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:50.227522 2859 raft_consensus.cc:493] T 572553569bbe4731b2580f1d22ee4fdd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.227659 2859 raft_consensus.cc:515] T 572553569bbe4731b2580f1d22ee4fdd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.228207 2859 leader_election.cc:290] T 572553569bbe4731b2580f1d22ee4fdd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:50.228875 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572553569bbe4731b2580f1d22ee4fdd" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:50.229576 1172 tablet_bootstrap.cc:492] T 565add8c21f343f2b11c12a9bb7ff111 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.229728 1172 ts_tablet_manager.cc:1403] T 565add8c21f343f2b11c12a9bb7ff111 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.104s user 0.005s sys 0.001s
W20260318 02:51:50.229943 719 leader_election.cc:343] T 572553569bbe4731b2580f1d22ee4fdd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.230501 1172 raft_consensus.cc:359] T 565add8c21f343f2b11c12a9bb7ff111 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:50.230623 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572553569bbe4731b2580f1d22ee4fdd" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:50.231063 719 leader_election.cc:343] T 572553569bbe4731b2580f1d22ee4fdd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.231175 719 leader_election.cc:304] T 572553569bbe4731b2580f1d22ee4fdd P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.231534 2859 raft_consensus.cc:2749] T 572553569bbe4731b2580f1d22ee4fdd P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.233510 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f8871e0a0a4de88f8d38f724e9028f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.233722 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c99df0cedd040faa224c6b97e68cb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.230667 1172 raft_consensus.cc:385] T 565add8c21f343f2b11c12a9bb7ff111 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.235723 1172 raft_consensus.cc:740] T 565add8c21f343f2b11c12a9bb7ff111 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.236048 1172 consensus_queue.cc:260] T 565add8c21f343f2b11c12a9bb7ff111 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:50.236863 1172 ts_tablet_manager.cc:1434] T 565add8c21f343f2b11c12a9bb7ff111 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260318 02:51:50.237172 1172 tablet_bootstrap.cc:492] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.239305 1172 tablet_bootstrap.cc:654] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.241149 750 tablet_service.cc:1511] Processing CreateTablet for tablet afddd3b6f2474e028b7138b93fc14ce3 (DEFAULT_TABLE table=default.Table_aacaf8a3de5e4ff186d32a943a53a373 [id=8abe111649b247a0bd7330e57259add1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.241515 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afddd3b6f2474e028b7138b93fc14ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.244758 756 tablet_service.cc:1511] Processing CreateTablet for tablet 8687ca5fac004274a258b87a3ac9bc06 (DEFAULT_TABLE table=default.Table_3d3d645ae0a143d7ae807fdfb89ba9f3 [id=8c17558d1a684706bf81e2ecca66bdd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.245183 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8687ca5fac004274a258b87a3ac9bc06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.247094 761 tablet_service.cc:1511] Processing CreateTablet for tablet 1f588254440f448bb69efadca325cd74 (DEFAULT_TABLE table=default.Table_3904ac9a603b4024bb758ae6fc98c684 [id=834d1d164a2a4b9ea9a8b80aec3be89f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.247468 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f588254440f448bb69efadca325cd74. 1 dirs total, 0 dirs full, 0 dirs failed
W20260318 02:51:50.249818 997 consensus_peers.cc:597] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:50.250706 765 tablet_service.cc:1511] Processing CreateTablet for tablet f8f87b33bbed462bb33b79e6b935371c (DEFAULT_TABLE table=default.Table_04dd597f143f4f348680cdee23d0fd5c [id=bd86abe6aeef494fb53ef4f6cf422a06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.251049 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f87b33bbed462bb33b79e6b935371c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.253758 1174 tablet_bootstrap.cc:492] T 33f93d766c44461cb0f5f4bfba09a744 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:50.253880 1174 ts_tablet_manager.cc:1403] T 33f93d766c44461cb0f5f4bfba09a744 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.045s user 0.008s sys 0.007s
I20260318 02:51:50.254170 761 tablet_service.cc:1511] Processing CreateTablet for tablet 82d1bf4369e0445d84b93d539e7fc2cf (DEFAULT_TABLE table=default.Table_f4e9b2273a2d48eb89f2cc6abf6412d0 [id=7339be39a8ab480189419ae44a343324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.254527 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d1bf4369e0445d84b93d539e7fc2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.255277 750 tablet_service.cc:1511] Processing CreateTablet for tablet 3b402c4d253e44d0a473f5116c31a610 (DEFAULT_TABLE table=default.Table_86f6b709c47944cc97ac197e614d17d6 [id=01af477790b64986bb5108a91520d897]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.255636 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b402c4d253e44d0a473f5116c31a610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.261240 1174 raft_consensus.cc:359] T 33f93d766c44461cb0f5f4bfba09a744 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.261435 1174 raft_consensus.cc:385] T 33f93d766c44461cb0f5f4bfba09a744 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.261487 1174 raft_consensus.cc:740] T 33f93d766c44461cb0f5f4bfba09a744 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.263260 1174 consensus_queue.cc:260] T 33f93d766c44461cb0f5f4bfba09a744 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.263818 1174 ts_tablet_manager.cc:1434] T 33f93d766c44461cb0f5f4bfba09a744 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:50.264093 1174 tablet_bootstrap.cc:492] T 0f499c464eb14164a2df3abc2d4a47c7 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:50.265239 761 tablet_service.cc:1511] Processing CreateTablet for tablet 71c41c41ec8d43158c7831ca8b7891e1 (DEFAULT_TABLE table=default.Table_678b715cb9a44ebfb6c72e52a6d5eb40 [id=51830ad4873149799e39dd566c1aeeb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.265684 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c41c41ec8d43158c7831ca8b7891e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.266724 748 tablet_service.cc:1511] Processing CreateTablet for tablet 15969624c6a24141bfa16794637954f9 (DEFAULT_TABLE table=default.Table_75d70b99ebde4152b30bb0ed03420615 [id=b6cb24f5ae4341b2b0cf7b3b95bb4014]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.267068 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15969624c6a24141bfa16794637954f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.273881 1174 tablet_bootstrap.cc:654] T 0f499c464eb14164a2df3abc2d4a47c7 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.275758 1175 ts_tablet_manager.cc:1929] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260318 02:51:50.275908 1175 log.cc:1199] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/fd1284c6e90d4beb8223fd807d7888ec
I20260318 02:51:50.276281 1175 ts_tablet_manager.cc:1950] T fd1284c6e90d4beb8223fd807d7888ec P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:50.277164 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1395) took 1409 ms. Trace:
I20260318 02:51:50.277275 1175 rpcz_store.cc:276] 0318 02:51:48.867618 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:48.867679 (+ 61us) service_pool.cc:225] Handling call
0318 02:51:50.166212 (+1298533us) ts_tablet_manager.cc:1151] Deleting tablet fd1284c6e90d4beb8223fd807d7888ec
0318 02:51:50.166222 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:50.251132 (+ 84910us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:50.272330 (+ 21198us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:50.277140 (+ 4810us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1298322}
I20260318 02:51:50.277753 1175 tablet_replica.cc:333] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:50.277963 1175 raft_consensus.cc:2243] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:50.278118 1175 raft_consensus.cc:2272] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:50.278561 761 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae512afd84d4340abf08cd78997de7e (DEFAULT_TABLE table=default.Table_3446374754d742b3b14fd6e6ee092923 [id=ebdc5d4f5bd8480c8d0399b94497d350]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.278662 1175 ts_tablet_manager.cc:1916] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:50.279865 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae512afd84d4340abf08cd78997de7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.283452 756 tablet_service.cc:1511] Processing CreateTablet for tablet 9d8c78624a274cf9898afa5058a82619 (DEFAULT_TABLE table=default.Table_7bf0891cb44046dfad491cb4a0a140f3 [id=dbfbdd8b868445528ea04b7b7c83fc0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.283872 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d8c78624a274cf9898afa5058a82619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.293386 1172 tablet_bootstrap.cc:492] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.293428 1184 ts_tablet_manager.cc:1916] T 306367152e834668bbf5fcadd008b3ea P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:50.293591 1172 ts_tablet_manager.cc:1403] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.000s
I20260318 02:51:50.294982 1172 raft_consensus.cc:359] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.295192 1172 raft_consensus.cc:385] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.295257 1172 raft_consensus.cc:740] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.295476 1172 consensus_queue.cc:260] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.296239 1172 ts_tablet_manager.cc:1434] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:50.296571 1172 tablet_bootstrap.cc:492] T 99b4933dda1e465bb1d14d20433f3772 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.297181 893 tablet_service.cc:1511] Processing CreateTablet for tablet 5faedf126399414ca47dc891cb41cd5d (DEFAULT_TABLE table=default.Table_9d4cd5f5e3bc4d91a21015ed772debc1 [id=90da9bd650db40548057ca95f3f920fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.297693 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5faedf126399414ca47dc891cb41cd5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.297936 750 tablet_service.cc:1511] Processing CreateTablet for tablet 544ffc1ccf2244f69eee1f78ddd71e78 (DEFAULT_TABLE table=default.Table_6906102872944fcb9652909f23caa1cd [id=749ee258bc6741b286301ab384fde3ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.298403 1172 tablet_bootstrap.cc:654] T 99b4933dda1e465bb1d14d20433f3772 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.298527 750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 544ffc1ccf2244f69eee1f78ddd71e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.302062 748 tablet_service.cc:1511] Processing CreateTablet for tablet bac948d255fc45d1bfd4f0f844d9a788 (DEFAULT_TABLE table=default.Table_e411160a28b641718494e6813eb0da0f [id=df57085a03fe46d7b3dd7a32ad4f3c5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.303107 748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac948d255fc45d1bfd4f0f844d9a788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.305948 2152 consensus_queue.cc:1048] T 3073fbe00c5d45b6b3100e927e0cc5c3 P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:50.308152 761 tablet_service.cc:1511] Processing CreateTablet for tablet 567fc0f4a11d4be286c776a19223e8a7 (DEFAULT_TABLE table=default.Table_8dc2dd2d94f341fb86d5d14fedace764 [id=b5bb89021d3445e0b3b89787b45d0591]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.308646 761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 567fc0f4a11d4be286c776a19223e8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.310673 756 tablet_service.cc:1511] Processing CreateTablet for tablet 79d4e98b67ec4dc1bd26b6d1122ef088 (DEFAULT_TABLE table=default.Table_73b7417949204d95bd6115bb0a4c26be [id=669323a4b2044cf58b27d6888948f462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.311209 756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d4e98b67ec4dc1bd26b6d1122ef088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.313585 1174 tablet_bootstrap.cc:492] T 0f499c464eb14164a2df3abc2d4a47c7 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:50.313735 1174 ts_tablet_manager.cc:1403] T 0f499c464eb14164a2df3abc2d4a47c7 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.007s
I20260318 02:51:50.314458 1174 raft_consensus.cc:359] T 0f499c464eb14164a2df3abc2d4a47c7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.314626 1174 raft_consensus.cc:385] T 0f499c464eb14164a2df3abc2d4a47c7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.314683 1174 raft_consensus.cc:740] T 0f499c464eb14164a2df3abc2d4a47c7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.316203 1174 consensus_queue.cc:260] T 0f499c464eb14164a2df3abc2d4a47c7 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.318253 1174 ts_tablet_manager.cc:1434] T 0f499c464eb14164a2df3abc2d4a47c7 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260318 02:51:50.319278 1174 tablet_bootstrap.cc:492] T f7f8240ed325401da6344c8ee033ad43 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:50.319962 1172 tablet_bootstrap.cc:492] T 99b4933dda1e465bb1d14d20433f3772 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.320160 1172 ts_tablet_manager.cc:1403] T 99b4933dda1e465bb1d14d20433f3772 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.000s
I20260318 02:51:50.320837 1174 tablet_bootstrap.cc:654] T f7f8240ed325401da6344c8ee033ad43 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.321194 1172 raft_consensus.cc:359] T 99b4933dda1e465bb1d14d20433f3772 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.321489 1172 raft_consensus.cc:385] T 99b4933dda1e465bb1d14d20433f3772 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.321599 1172 raft_consensus.cc:740] T 99b4933dda1e465bb1d14d20433f3772 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.321866 1172 consensus_queue.cc:260] T 99b4933dda1e465bb1d14d20433f3772 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.322645 1172 ts_tablet_manager.cc:1434] T 99b4933dda1e465bb1d14d20433f3772 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:50.322962 1172 tablet_bootstrap.cc:492] T de38fe3eb88147eab65f3dfed37fbf7d P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.323681 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 5faedf126399414ca47dc891cb41cd5d (DEFAULT_TABLE table=default.Table_9d4cd5f5e3bc4d91a21015ed772debc1 [id=90da9bd650db40548057ca95f3f920fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.323804 903 tablet_service.cc:1511] Processing CreateTablet for tablet afddd3b6f2474e028b7138b93fc14ce3 (DEFAULT_TABLE table=default.Table_aacaf8a3de5e4ff186d32a943a53a373 [id=8abe111649b247a0bd7330e57259add1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.324061 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5faedf126399414ca47dc891cb41cd5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.324185 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afddd3b6f2474e028b7138b93fc14ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.327154 1175 ts_tablet_manager.cc:1929] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:50.327275 1175 log.cc:1199] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/d0b01131720748688ca6c28985a3b3ff
I20260318 02:51:50.327570 1175 ts_tablet_manager.cc:1950] T d0b01131720748688ca6c28985a3b3ff P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:50.329802 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1396) took 1461 ms. Trace:
I20260318 02:51:50.329893 1175 rpcz_store.cc:276] 0318 02:51:48.868169 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:48.868217 (+ 48us) service_pool.cc:225] Handling call
0318 02:51:50.277609 (+1409392us) ts_tablet_manager.cc:1151] Deleting tablet d0b01131720748688ca6c28985a3b3ff
0318 02:51:50.277693 (+ 84us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:50.317585 (+ 39892us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:50.326999 (+ 9414us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:50.329780 (+ 2781us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1409222}
I20260318 02:51:50.330201 1175 tablet_replica.cc:333] T 9a5afc5611d3481e9a6d48381dc67e86 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:50.330405 1175 raft_consensus.cc:2243] T 9a5afc5611d3481e9a6d48381dc67e86 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:50.330588 1175 raft_consensus.cc:2272] T 9a5afc5611d3481e9a6d48381dc67e86 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:50.331244 1175 ts_tablet_manager.cc:1916] T 9a5afc5611d3481e9a6d48381dc67e86 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:50.333077 1172 tablet_bootstrap.cc:654] T de38fe3eb88147eab65f3dfed37fbf7d P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.337519 1175 ts_tablet_manager.cc:1929] T 9a5afc5611d3481e9a6d48381dc67e86 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260318 02:51:50.337659 1175 log.cc:1199] T 9a5afc5611d3481e9a6d48381dc67e86 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/9a5afc5611d3481e9a6d48381dc67e86
I20260318 02:51:50.338004 1175 ts_tablet_manager.cc:1950] T 9a5afc5611d3481e9a6d48381dc67e86 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:50.338837 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1397) took 1470 ms. Trace:
I20260318 02:51:50.338963 1175 rpcz_store.cc:276] 0318 02:51:48.868617 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:48.868660 (+ 43us) service_pool.cc:225] Handling call
0318 02:51:50.330156 (+1461496us) ts_tablet_manager.cc:1151] Deleting tablet 9a5afc5611d3481e9a6d48381dc67e86
0318 02:51:50.330165 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:50.334055 (+ 3890us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:50.337398 (+ 3343us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:50.338794 (+ 1396us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1461339}
I20260318 02:51:50.339407 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1411) took 1199 ms. Trace:
I20260318 02:51:50.339514 1175 rpcz_store.cc:276] 0318 02:51:49.140248 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:49.141012 (+ 764us) service_pool.cc:225] Handling call
0318 02:51:50.339254 (+1198242us) ts_tablet_manager.cc:1151] Deleting tablet 15cae82c808a435e86f8c514e415d546
0318 02:51:50.339265 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:50.339368 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1198003}
I20260318 02:51:50.339880 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1412) took 1141 ms. Trace:
I20260318 02:51:50.339978 1175 rpcz_store.cc:276] 0318 02:51:49.198204 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:49.198260 (+ 56us) service_pool.cc:225] Handling call
0318 02:51:50.339758 (+1141498us) ts_tablet_manager.cc:1151] Deleting tablet 2c5400cd0c2a447b9d8b7381dcadf0be
0318 02:51:50.339766 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:50.339842 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1141320}
I20260318 02:51:50.340292 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1413) took 1077 ms. Trace:
I20260318 02:51:50.340380 1175 rpcz_store.cc:276] 0318 02:51:49.262547 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:49.262599 (+ 52us) service_pool.cc:225] Handling call
0318 02:51:50.340185 (+1077586us) ts_tablet_manager.cc:1151] Deleting tablet c844057d612049d8b90ee51ad8f3ec0b
0318 02:51:50.340194 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:50.340261 (+ 67us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1077418}
I20260318 02:51:50.340651 1175 tablet_replica.cc:333] T c58290c2d1c742d3b45dfb5caf52c75b P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:50.341485 1174 tablet_bootstrap.cc:492] T f7f8240ed325401da6344c8ee033ad43 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:50.341631 1174 ts_tablet_manager.cc:1403] T f7f8240ed325401da6344c8ee033ad43 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.002s
I20260318 02:51:50.342423 1174 raft_consensus.cc:359] T f7f8240ed325401da6344c8ee033ad43 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.342598 1174 raft_consensus.cc:385] T f7f8240ed325401da6344c8ee033ad43 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.342691 1174 raft_consensus.cc:740] T f7f8240ed325401da6344c8ee033ad43 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.342918 1174 consensus_queue.cc:260] T f7f8240ed325401da6344c8ee033ad43 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.344482 1174 ts_tablet_manager.cc:1434] T f7f8240ed325401da6344c8ee033ad43 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260318 02:51:50.345045 1172 tablet_bootstrap.cc:492] T de38fe3eb88147eab65f3dfed37fbf7d P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.345197 1172 ts_tablet_manager.cc:1403] T de38fe3eb88147eab65f3dfed37fbf7d P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.002s
I20260318 02:51:50.345754 1174 tablet_bootstrap.cc:492] T dfb3e7fe7a834636a16ee8a772b73ee2 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:50.345999 1172 raft_consensus.cc:359] T de38fe3eb88147eab65f3dfed37fbf7d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.346185 1172 raft_consensus.cc:385] T de38fe3eb88147eab65f3dfed37fbf7d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.346243 1172 raft_consensus.cc:740] T de38fe3eb88147eab65f3dfed37fbf7d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.346493 1172 consensus_queue.cc:260] T de38fe3eb88147eab65f3dfed37fbf7d P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.347304 1172 ts_tablet_manager.cc:1434] T de38fe3eb88147eab65f3dfed37fbf7d P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:50.347474 1040 tablet_service.cc:1511] Processing CreateTablet for tablet afddd3b6f2474e028b7138b93fc14ce3 (DEFAULT_TABLE table=default.Table_aacaf8a3de5e4ff186d32a943a53a373 [id=8abe111649b247a0bd7330e57259add1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.347844 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afddd3b6f2474e028b7138b93fc14ce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.347851 903 tablet_service.cc:1511] Processing CreateTablet for tablet 8687ca5fac004274a258b87a3ac9bc06 (DEFAULT_TABLE table=default.Table_3d3d645ae0a143d7ae807fdfb89ba9f3 [id=8c17558d1a684706bf81e2ecca66bdd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.347566 1172 tablet_bootstrap.cc:492] T fa077243d5634d888f3a191b7f9d2d19 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.348240 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8687ca5fac004274a258b87a3ac9bc06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.348754 1174 tablet_bootstrap.cc:654] T dfb3e7fe7a834636a16ee8a772b73ee2 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.349684 1172 tablet_bootstrap.cc:654] T fa077243d5634d888f3a191b7f9d2d19 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.349676 1175 raft_consensus.cc:2243] T c58290c2d1c742d3b45dfb5caf52c75b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:50.349848 1175 raft_consensus.cc:2272] T c58290c2d1c742d3b45dfb5caf52c75b P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:50.351529 1175 ts_tablet_manager.cc:1916] T c58290c2d1c742d3b45dfb5caf52c75b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:50.357223 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 1f588254440f448bb69efadca325cd74 (DEFAULT_TABLE table=default.Table_3904ac9a603b4024bb758ae6fc98c684 [id=834d1d164a2a4b9ea9a8b80aec3be89f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.357519 907 tablet_service.cc:1511] Processing CreateTablet for tablet f8f87b33bbed462bb33b79e6b935371c (DEFAULT_TABLE table=default.Table_04dd597f143f4f348680cdee23d0fd5c [id=bd86abe6aeef494fb53ef4f6cf422a06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.357645 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f588254440f448bb69efadca325cd74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.357946 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f87b33bbed462bb33b79e6b935371c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.359817 1175 ts_tablet_manager.cc:1929] T c58290c2d1c742d3b45dfb5caf52c75b P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:50.359938 1175 log.cc:1199] T c58290c2d1c742d3b45dfb5caf52c75b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/c58290c2d1c742d3b45dfb5caf52c75b
I20260318 02:51:50.360234 1175 ts_tablet_manager.cc:1950] T c58290c2d1c742d3b45dfb5caf52c75b P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:50.361035 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1414) took 1096 ms. Trace:
I20260318 02:51:50.361136 1175 rpcz_store.cc:276] 0318 02:51:49.264233 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:49.264324 (+ 91us) service_pool.cc:225] Handling call
0318 02:51:50.340576 (+1076252us) ts_tablet_manager.cc:1151] Deleting tablet c58290c2d1c742d3b45dfb5caf52c75b
0318 02:51:50.340584 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:50.354404 (+ 13820us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:50.359688 (+ 5284us) tablet_metadata.cc:641] Metadata flushed
0318 02:51:50.360987 (+ 1299us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1076062}
W20260318 02:51:50.361923 443 consensus_peers.cc:597] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a -> Peer 971baf5b9e4644c990dbf4d4fc7ba900 (127.0.104.188:41593): Couldn't send request to peer 971baf5b9e4644c990dbf4d4fc7ba900. Status: Network error: Client connection negotiation failed: client connection to 127.0.104.188:41593: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260318 02:51:50.362466 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 8687ca5fac004274a258b87a3ac9bc06 (DEFAULT_TABLE table=default.Table_3d3d645ae0a143d7ae807fdfb89ba9f3 [id=8c17558d1a684706bf81e2ecca66bdd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.362843 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8687ca5fac004274a258b87a3ac9bc06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.365715 2660 raft_consensus.cc:493] T d7c40c4cda934922ba7df2775ce892fe P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.365867 2660 raft_consensus.cc:515] T d7c40c4cda934922ba7df2775ce892fe P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.366494 2660 leader_election.cc:290] T d7c40c4cda934922ba7df2775ce892fe P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:50.367151 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c40c4cda934922ba7df2775ce892fe" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:50.367810 719 leader_election.cc:343] T d7c40c4cda934922ba7df2775ce892fe P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.372941 1172 tablet_bootstrap.cc:492] T fa077243d5634d888f3a191b7f9d2d19 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.373091 1172 ts_tablet_manager.cc:1403] T fa077243d5634d888f3a191b7f9d2d19 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20260318 02:51:50.373492 1040 tablet_service.cc:1511] Processing CreateTablet for tablet f8f87b33bbed462bb33b79e6b935371c (DEFAULT_TABLE table=default.Table_04dd597f143f4f348680cdee23d0fd5c [id=bd86abe6aeef494fb53ef4f6cf422a06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.373929 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f87b33bbed462bb33b79e6b935371c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.374388 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 82d1bf4369e0445d84b93d539e7fc2cf (DEFAULT_TABLE table=default.Table_f4e9b2273a2d48eb89f2cc6abf6412d0 [id=7339be39a8ab480189419ae44a343324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.374722 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d1bf4369e0445d84b93d539e7fc2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.373842 1172 raft_consensus.cc:359] T fa077243d5634d888f3a191b7f9d2d19 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:50.376796 1172 raft_consensus.cc:385] T fa077243d5634d888f3a191b7f9d2d19 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.376876 1172 raft_consensus.cc:740] T fa077243d5634d888f3a191b7f9d2d19 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.377146 1172 consensus_queue.cc:260] T fa077243d5634d888f3a191b7f9d2d19 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:50.377719 1172 ts_tablet_manager.cc:1434] T fa077243d5634d888f3a191b7f9d2d19 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:50.378933 1172 tablet_bootstrap.cc:492] T 41fb820f152748b093ca0e0a2f663a78 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.379518 1174 tablet_bootstrap.cc:492] T dfb3e7fe7a834636a16ee8a772b73ee2 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:50.380245 1174 ts_tablet_manager.cc:1403] T dfb3e7fe7a834636a16ee8a772b73ee2 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.003s
I20260318 02:51:50.381072 1174 raft_consensus.cc:359] T dfb3e7fe7a834636a16ee8a772b73ee2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.381256 1174 raft_consensus.cc:385] T dfb3e7fe7a834636a16ee8a772b73ee2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.381642 1174 raft_consensus.cc:740] T dfb3e7fe7a834636a16ee8a772b73ee2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.381875 1174 consensus_queue.cc:260] T dfb3e7fe7a834636a16ee8a772b73ee2 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.383514 1174 ts_tablet_manager.cc:1434] T dfb3e7fe7a834636a16ee8a772b73ee2 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:50.386358 1174 tablet_bootstrap.cc:492] T ccff619ef27f48a59d5dd683fe5d09db P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:50.380793 1172 tablet_bootstrap.cc:654] T 41fb820f152748b093ca0e0a2f663a78 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.387099 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae512afd84d4340abf08cd78997de7e (DEFAULT_TABLE table=default.Table_3446374754d742b3b14fd6e6ee092923 [id=ebdc5d4f5bd8480c8d0399b94497d350]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.387501 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae512afd84d4340abf08cd78997de7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.388075 1174 tablet_bootstrap.cc:654] T ccff619ef27f48a59d5dd683fe5d09db P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.370078 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c40c4cda934922ba7df2775ce892fe" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:50.392664 1175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37544 (request call id 1415) took 1123 ms. Trace:
I20260318 02:51:50.392813 1175 rpcz_store.cc:276] 0318 02:51:49.269496 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:49.269559 (+ 63us) service_pool.cc:225] Handling call
0318 02:51:50.392517 (+1122958us) ts_tablet_manager.cc:1151] Deleting tablet df9d5919242a41aa8e119570f75b7c24
0318 02:51:50.392528 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0318 02:51:50.392604 (+ 76us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1122716}
W20260318 02:51:50.393006 719 leader_election.cc:343] T d7c40c4cda934922ba7df2775ce892fe P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.393126 719 leader_election.cc:304] T d7c40c4cda934922ba7df2775ce892fe P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.393487 2660 raft_consensus.cc:2749] T d7c40c4cda934922ba7df2775ce892fe P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.394294 1175 tablet_replica.cc:333] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:50.394534 1175 raft_consensus.cc:2243] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:50.394712 1175 raft_consensus.cc:2272] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:50.395455 1175 ts_tablet_manager.cc:1916] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:50.373713 907 tablet_service.cc:1511] Processing CreateTablet for tablet 82d1bf4369e0445d84b93d539e7fc2cf (DEFAULT_TABLE table=default.Table_f4e9b2273a2d48eb89f2cc6abf6412d0 [id=7339be39a8ab480189419ae44a343324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.384842 897 tablet_service.cc:1511] Processing CreateTablet for tablet 3b402c4d253e44d0a473f5116c31a610 (DEFAULT_TABLE table=default.Table_86f6b709c47944cc97ac197e614d17d6 [id=01af477790b64986bb5108a91520d897]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.385618 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 71c41c41ec8d43158c7831ca8b7891e1 (DEFAULT_TABLE table=default.Table_678b715cb9a44ebfb6c72e52a6d5eb40 [id=51830ad4873149799e39dd566c1aeeb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.397112 897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b402c4d253e44d0a473f5116c31a610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.397294 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c41c41ec8d43158c7831ca8b7891e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.385464 901 tablet_service.cc:1511] Processing CreateTablet for tablet 71c41c41ec8d43158c7831ca8b7891e1 (DEFAULT_TABLE table=default.Table_678b715cb9a44ebfb6c72e52a6d5eb40 [id=51830ad4873149799e39dd566c1aeeb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.386107 906 tablet_service.cc:1511] Processing CreateTablet for tablet 15969624c6a24141bfa16794637954f9 (DEFAULT_TABLE table=default.Table_75d70b99ebde4152b30bb0ed03420615 [id=b6cb24f5ae4341b2b0cf7b3b95bb4014]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.386597 902 tablet_service.cc:1511] Processing CreateTablet for tablet 6ae512afd84d4340abf08cd78997de7e (DEFAULT_TABLE table=default.Table_3446374754d742b3b14fd6e6ee092923 [id=ebdc5d4f5bd8480c8d0399b94497d350]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.401057 901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c41c41ec8d43158c7831ca8b7891e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.401305 906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15969624c6a24141bfa16794637954f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.386346 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 15969624c6a24141bfa16794637954f9 (DEFAULT_TABLE table=default.Table_75d70b99ebde4152b30bb0ed03420615 [id=b6cb24f5ae4341b2b0cf7b3b95bb4014]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.401737 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15969624c6a24141bfa16794637954f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.384822 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 3b402c4d253e44d0a473f5116c31a610 (DEFAULT_TABLE table=default.Table_86f6b709c47944cc97ac197e614d17d6 [id=01af477790b64986bb5108a91520d897]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.403402 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b402c4d253e44d0a473f5116c31a610. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.405164 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae512afd84d4340abf08cd78997de7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.405467 1172 tablet_bootstrap.cc:492] T 41fb820f152748b093ca0e0a2f663a78 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.405591 1172 ts_tablet_manager.cc:1403] T 41fb820f152748b093ca0e0a2f663a78 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.003s
I20260318 02:51:50.406303 1172 raft_consensus.cc:359] T 41fb820f152748b093ca0e0a2f663a78 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.406466 1172 raft_consensus.cc:385] T 41fb820f152748b093ca0e0a2f663a78 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.406512 1172 raft_consensus.cc:740] T 41fb820f152748b093ca0e0a2f663a78 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.406728 1172 consensus_queue.cc:260] T 41fb820f152748b093ca0e0a2f663a78 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.410557 1172 ts_tablet_manager.cc:1434] T 41fb820f152748b093ca0e0a2f663a78 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260318 02:51:50.411521 1172 tablet_bootstrap.cc:492] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.414254 902 tablet_service.cc:1511] Processing CreateTablet for tablet 9d8c78624a274cf9898afa5058a82619 (DEFAULT_TABLE table=default.Table_7bf0891cb44046dfad491cb4a0a140f3 [id=dbfbdd8b868445528ea04b7b7c83fc0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.414518 1172 tablet_bootstrap.cc:654] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.414809 902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d8c78624a274cf9898afa5058a82619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.415781 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d1bf4369e0445d84b93d539e7fc2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.423530 893 tablet_service.cc:1511] Processing CreateTablet for tablet 1f588254440f448bb69efadca325cd74 (DEFAULT_TABLE table=default.Table_3904ac9a603b4024bb758ae6fc98c684 [id=834d1d164a2a4b9ea9a8b80aec3be89f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.424100 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f588254440f448bb69efadca325cd74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.429453 1173 tablet_bootstrap.cc:492] T 2dab268da5e843cab5c28a521217df97 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:50.429481 1172 tablet_bootstrap.cc:492] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.429639 1172 ts_tablet_manager.cc:1403] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.001s
I20260318 02:51:50.430124 1173 ts_tablet_manager.cc:1403] T 2dab268da5e843cab5c28a521217df97 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.275s user 0.002s sys 0.004s
I20260318 02:51:50.430507 1172 raft_consensus.cc:359] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.430716 1172 raft_consensus.cc:385] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.430770 1172 raft_consensus.cc:740] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.431046 1172 consensus_queue.cc:260] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.431114 1173 raft_consensus.cc:359] T 2dab268da5e843cab5c28a521217df97 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.431820 1173 raft_consensus.cc:385] T 2dab268da5e843cab5c28a521217df97 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.431953 1173 raft_consensus.cc:740] T 2dab268da5e843cab5c28a521217df97 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.432245 1173 consensus_queue.cc:260] T 2dab268da5e843cab5c28a521217df97 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.436465 1174 tablet_bootstrap.cc:492] T ccff619ef27f48a59d5dd683fe5d09db P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:50.436625 1174 ts_tablet_manager.cc:1403] T ccff619ef27f48a59d5dd683fe5d09db P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.001s
I20260318 02:51:50.431571 1172 ts_tablet_manager.cc:1434] T f5b55cf85d7842e59f0ed92aecdcd5d0 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:50.437791 1174 raft_consensus.cc:359] T ccff619ef27f48a59d5dd683fe5d09db P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.437969 1174 raft_consensus.cc:385] T ccff619ef27f48a59d5dd683fe5d09db P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.438028 1174 raft_consensus.cc:740] T ccff619ef27f48a59d5dd683fe5d09db P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.438237 1174 consensus_queue.cc:260] T ccff619ef27f48a59d5dd683fe5d09db P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.438968 1172 tablet_bootstrap.cc:492] T e993481bf55747b0a6a1c996c6917408 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.439991 1174 ts_tablet_manager.cc:1434] T ccff619ef27f48a59d5dd683fe5d09db P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260318 02:51:50.440902 1174 tablet_bootstrap.cc:492] T 2a6f56dafead404eb1720276b07ea733 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:50.441401 1173 ts_tablet_manager.cc:1434] T 2dab268da5e843cab5c28a521217df97 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260318 02:51:50.442469 1174 tablet_bootstrap.cc:654] T 2a6f56dafead404eb1720276b07ea733 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.444614 1175 ts_tablet_manager.cc:1929] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:50.444808 1175 log.cc:1199] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/6a65ccfd73234e8fb2bea5b6911cb3f1
I20260318 02:51:50.445128 1175 ts_tablet_manager.cc:1950] T 6a65ccfd73234e8fb2bea5b6911cb3f1 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:50.446069 1175 tablet_replica.cc:333] T ce82c595e30a4878be25be8eb3d30790 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:50.446291 1175 raft_consensus.cc:2243] T ce82c595e30a4878be25be8eb3d30790 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:50.446472 1175 raft_consensus.cc:2272] T ce82c595e30a4878be25be8eb3d30790 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:50.447029 1175 ts_tablet_manager.cc:1916] T ce82c595e30a4878be25be8eb3d30790 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:50.450110 1172 tablet_bootstrap.cc:654] T e993481bf55747b0a6a1c996c6917408 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.450979 1173 tablet_bootstrap.cc:492] T 5c89f413a26a43ef95c850d7c44f85b2 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:50.452807 1173 tablet_bootstrap.cc:654] T 5c89f413a26a43ef95c850d7c44f85b2 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.454522 1035 tablet_service.cc:1511] Processing CreateTablet for tablet 9d8c78624a274cf9898afa5058a82619 (DEFAULT_TABLE table=default.Table_7bf0891cb44046dfad491cb4a0a140f3 [id=dbfbdd8b868445528ea04b7b7c83fc0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.454941 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d8c78624a274cf9898afa5058a82619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.455032 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet fd1284c6e90d4beb8223fd807d7888ec (table default.Table_86b70df7bd76402aaa4c0b1faa730a62 [id=d1dd0940c55b4a4a97cf0f8543ebcaf8]) successfully deleted
I20260318 02:51:50.455207 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet d0b01131720748688ca6c28985a3b3ff (table default.Table_85c16d674e834595911be295a8222653 [id=c21facd3dbe74a239960adf801256801]) successfully deleted
I20260318 02:51:50.455467 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 9a5afc5611d3481e9a6d48381dc67e86 (table default.Table_5048646e181b43af9e8798938115b3eb [id=e03eb5ce646645e393ddc268a1aabf1f]) successfully deleted
W20260318 02:51:50.455641 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 15cae82c808a435e86f8c514e415d546 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15cae82c808a435e86f8c514e415d546 already in progress: creating tablet
W20260318 02:51:50.455783 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 2c5400cd0c2a447b9d8b7381dcadf0be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c5400cd0c2a447b9d8b7381dcadf0be already in progress: creating tablet
W20260318 02:51:50.456142 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet c844057d612049d8b90ee51ad8f3ec0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c844057d612049d8b90ee51ad8f3ec0b already in progress: creating tablet
I20260318 02:51:50.456434 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet c58290c2d1c742d3b45dfb5caf52c75b (table default.Table_944521fea0294e3381643693804fd723 [id=18d79b10f75b43efa4946ca8979a4235]) successfully deleted
W20260318 02:51:50.456570 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet df9d5919242a41aa8e119570f75b7c24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df9d5919242a41aa8e119570f75b7c24 already in progress: creating tablet
W20260318 02:51:50.456743 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 16f00e7e7ca847e9a5ebfd9bb5809147 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16f00e7e7ca847e9a5ebfd9bb5809147 already in progress: creating tablet
W20260318 02:51:50.456885 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 7b388b964c5f402ea4485d266563d07a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b388b964c5f402ea4485d266563d07a already in progress: creating tablet
W20260318 02:51:50.457033 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet c44a07e379844d99be5edfcfa72c6e40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c44a07e379844d99be5edfcfa72c6e40 already in progress: creating tablet
W20260318 02:51:50.457345 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 9a8c924687e347c38bc16219429eea80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9a8c924687e347c38bc16219429eea80 already in progress: creating tablet
I20260318 02:51:50.457976 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 6a65ccfd73234e8fb2bea5b6911cb3f1 (table default.Table_ce996d68b1144b3aa44ab9618af7d43e [id=aa309b4ad7d6425d853518c95e0e0461]) successfully deleted
I20260318 02:51:50.462728 1174 tablet_bootstrap.cc:492] T 2a6f56dafead404eb1720276b07ea733 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:50.462868 1174 ts_tablet_manager.cc:1403] T 2a6f56dafead404eb1720276b07ea733 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.001s
I20260318 02:51:50.464246 1174 raft_consensus.cc:359] T 2a6f56dafead404eb1720276b07ea733 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.464430 1174 raft_consensus.cc:385] T 2a6f56dafead404eb1720276b07ea733 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.464481 1174 raft_consensus.cc:740] T 2a6f56dafead404eb1720276b07ea733 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.464681 1174 consensus_queue.cc:260] T 2a6f56dafead404eb1720276b07ea733 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.466044 1174 ts_tablet_manager.cc:1434] T 2a6f56dafead404eb1720276b07ea733 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260318 02:51:50.466949 1174 tablet_bootstrap.cc:492] T 793a87e8bcb442c1b6fb0ecfcbc71480 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:50.468639 1174 tablet_bootstrap.cc:654] T 793a87e8bcb442c1b6fb0ecfcbc71480 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.469316 1172 tablet_bootstrap.cc:492] T e993481bf55747b0a6a1c996c6917408 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.469482 1172 ts_tablet_manager.cc:1403] T e993481bf55747b0a6a1c996c6917408 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.002s
I20260318 02:51:50.470504 1172 raft_consensus.cc:359] T e993481bf55747b0a6a1c996c6917408 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.470714 1172 raft_consensus.cc:385] T e993481bf55747b0a6a1c996c6917408 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.470768 1172 raft_consensus.cc:740] T e993481bf55747b0a6a1c996c6917408 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.471035 1172 consensus_queue.cc:260] T e993481bf55747b0a6a1c996c6917408 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.474709 1172 ts_tablet_manager.cc:1434] T e993481bf55747b0a6a1c996c6917408 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:50.475273 1172 tablet_bootstrap.cc:492] T 3291ecec94e642e3a995a2d7006619e7 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.480813 1172 tablet_bootstrap.cc:654] T 3291ecec94e642e3a995a2d7006619e7 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.484604 1184 ts_tablet_manager.cc:1929] T 306367152e834668bbf5fcadd008b3ea P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:50.484881 1184 log.cc:1199] T 306367152e834668bbf5fcadd008b3ea P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/306367152e834668bbf5fcadd008b3ea
I20260318 02:51:50.485867 1175 ts_tablet_manager.cc:1929] T ce82c595e30a4878be25be8eb3d30790 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:50.485994 1175 log.cc:1199] T ce82c595e30a4878be25be8eb3d30790 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/ce82c595e30a4878be25be8eb3d30790
I20260318 02:51:50.486281 1175 ts_tablet_manager.cc:1950] T ce82c595e30a4878be25be8eb3d30790 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:50.486714 1175 tablet_replica.cc:333] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
I20260318 02:51:50.486894 1175 raft_consensus.cc:2243] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:50.487046 1175 raft_consensus.cc:2272] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:50.488874 1184 ts_tablet_manager.cc:1950] T 306367152e834668bbf5fcadd008b3ea P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:50.489709 1175 ts_tablet_manager.cc:1916] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:50.490046 1184 tablet_replica.cc:333] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d: stopping tablet replica
I20260318 02:51:50.490270 1184 raft_consensus.cc:2243] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:50.490454 1184 raft_consensus.cc:2272] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:50.495606 2660 raft_consensus.cc:493] T 33f93d766c44461cb0f5f4bfba09a744 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.495791 2660 raft_consensus.cc:515] T 33f93d766c44461cb0f5f4bfba09a744 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.496388 2660 leader_election.cc:290] T 33f93d766c44461cb0f5f4bfba09a744 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:50.497294 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f93d766c44461cb0f5f4bfba09a744" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:50.463162 455 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.104.129:41665 (request call id 281) took 776 ms (client timeout 1000 ms). Trace:
W20260318 02:51:50.498055 719 leader_election.cc:343] T 33f93d766c44461cb0f5f4bfba09a744 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:50.497611 455 rpcz_store.cc:269] 0318 02:51:49.686898 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:49.692937 (+ 6039us) service_pool.cc:225] Handling call
0318 02:51:50.463134 (+770197us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0318 02:51:50.176396 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0318 02:51:50.176475 (+ 79us) write_op.cc:432] Acquiring schema lock in shared mode
0318 02:51:50.176479 (+ 4us) write_op.cc:435] Acquired schema lock
0318 02:51:50.176481 (+ 2us) tablet.cc:661] Decoding operations
0318 02:51:50.176550 (+ 69us) write_op.cc:620] Acquiring the partition lock for write op
0318 02:51:50.176558 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0318 02:51:50.176563 (+ 5us) tablet.cc:684] Acquiring locks for 1 operations
0318 02:51:50.176602 (+ 39us) tablet.cc:700] Row locks acquired
0318 02:51:50.176604 (+ 2us) write_op.cc:260] PREPARE: finished
0318 02:51:50.176629 (+ 25us) write_op.cc:270] Start()
0318 02:51:50.176652 (+ 23us) write_op.cc:276] Timestamp: P: 1773802310176617 usec, L: 0
0318 02:51:50.176655 (+ 3us) op_driver.cc:348] REPLICATION: starting
0318 02:51:50.180803 (+ 4148us) log.cc:844] Serialized 533 byte log entry
0318 02:51:50.461076 (+280273us) op_driver.cc:464] REPLICATION: finished
0318 02:51:50.461456 (+ 380us) write_op.cc:301] APPLY: starting
0318 02:51:50.461479 (+ 23us) tablet.cc:1366] starting BulkCheckPresence
0318 02:51:50.461524 (+ 45us) tablet.cc:1369] finished BulkCheckPresence
0318 02:51:50.461565 (+ 41us) tablet.cc:1371] starting ApplyRowOperation cycle
0318 02:51:50.461639 (+ 74us) tablet.cc:1382] finished ApplyRowOperation cycle
0318 02:51:50.461675 (+ 36us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0318 02:51:50.461682 (+ 7us) write_op.cc:312] APPLY: finished
0318 02:51:50.461775 (+ 93us) log.cc:844] Serialized 23 byte log entry
0318 02:51:50.461844 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0318 02:51:50.461865 (+ 21us) write_op.cc:454] Released schema lock
0318 02:51:50.461873 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0318 02:51:50.461973 (+ 100us) write_op.cc:489] Releasing partition, row and schema locks
0318 02:51:50.461977 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":314,"apply.run_cpu_time_us":492,"apply.run_wall_time_us":491,"mutex_wait_us":2551,"num_ops":1,"prepare.queue_time_us":5574,"prepare.run_cpu_time_us":578,"prepare.run_wall_time_us":4777,"raft.queue_time_us":895,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":6,"replication_time_us":284375}]]}
I20260318 02:51:50.465765 453 catalog_manager.cc:5671] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131). New cstate: current_term: 1 leader_uuid: "9422bb7011f342b08be0b073a88c4c4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: UNKNOWN } } }
I20260318 02:51:50.505541 453 catalog_manager.cc:5763] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025) does not have the latest schema for tablet cb29fd9d6fc845b2aaffe34c290fd5ca (table default.Table_496f16dbb28a4f2d947c6f7d15d8ad9f [id=cc1e96ac2459417795a39cf88dd1edcf]). Expected version 2 got 0
W20260318 02:51:50.477584 443 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet 0af921934443453f81bcd6bf22544352 (table default.Table_fa998677e8a249bf859946971e44c9b8 [id=e20217e652e34d7591fbeaf29741c0ce], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0af921934443453f81bcd6bf22544352 consensus state has no leader
I20260318 02:51:50.517390 455 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 71c53e67f27a4047a370d00d223961e6 (table default.Table_3364639236c34063b210c13a3d726f6f [id=1628b8bd04ff4a2bba7298ae4497a222]). Expected version 1 got 0
I20260318 02:51:50.517977 455 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet ccff619ef27f48a59d5dd683fe5d09db (table default.Table_9d288316a7cc4b47b83ff8daa9ff9cb3 [id=ec8783e475dd4f05a3d822517ce924f4]). Expected version 1 got 0
I20260318 02:51:50.518276 455 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet a75f367cde75433d86a4ee9384e57761 (table default.Table_ed6ebe71dc614470a951f2e484f28d88 [id=837cbf1e256f46f484ceb9ffa208891c]). Expected version 1 got 0
I20260318 02:51:50.518527 455 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet d7c40c4cda934922ba7df2775ce892fe (table default.Table_5d78084524e04752a1d95e16642d880d [id=262f3187f30e45208a08fc060c867ba5]). Expected version 1 got 0
I20260318 02:51:50.518801 455 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 3073fbe00c5d45b6b3100e927e0cc5c3 (table default.Table_f368a8dc34ae4ea7815aea031af47ed3 [id=2c3964f728cc4231805fe553a37766ae]). Expected version 1 got 0
I20260318 02:51:50.519140 455 catalog_manager.cc:5671] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a903d876086423b8016d705b98895ad (127.0.104.129). New cstate: current_term: 1 leader_uuid: "6a903d876086423b8016d705b98895ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } health_report { overall_health: HEALTHY } } }
I20260318 02:51:50.519632 455 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet 831a7cb00e7040a7ade210c755dbff4a (table default.Table_f6bc857a1cf449f6b114aec30ada1bc9 [id=0cdd67bea79141b9b8dd73a581deb69c]). Expected version 1 got 0
I20260318 02:51:50.519866 455 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet d30e39476d93400c8c79dd529688e7e0 (table default.Table_65e155035fa4491e9d71e09c78082822 [id=60cd1ef01f934058a27163dc8c93df78]). Expected version 1 got 0
I20260318 02:51:50.520097 455 catalog_manager.cc:5763] TS 6a903d876086423b8016d705b98895ad (127.0.104.129:46711) does not have the latest schema for tablet b698d732a905469caaf564d9512ba02c (table default.Table_6238662cdd5443a694ee4feec8bc0413 [id=eb11e3d1c3ef4295ac9b6ee657ac233a]). Expected version 1 got 0
W20260318 02:51:50.523571 441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 65592.6us
W20260318 02:51:50.523939 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 7c4b6f64c20e4e2e86a1e2f4ff628319 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c4b6f64c20e4e2e86a1e2f4ff628319 already in progress: creating tablet
I20260318 02:51:50.525789 2660 consensus_queue.cc:1048] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:50.534072 1173 tablet_bootstrap.cc:492] T 5c89f413a26a43ef95c850d7c44f85b2 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:50.534888 1173 ts_tablet_manager.cc:1403] T 5c89f413a26a43ef95c850d7c44f85b2 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.084s user 0.000s sys 0.003s
W20260318 02:51:50.536749 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet d77381b5591b449a89328f0819e242a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d77381b5591b449a89328f0819e242a7 already in progress: creating tablet
W20260318 02:51:50.537384 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 43844dd8883e45dbaa92d4058e9af9fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43844dd8883e45dbaa92d4058e9af9fb already in progress: creating tablet
I20260318 02:51:50.537590 1173 raft_consensus.cc:359] T 5c89f413a26a43ef95c850d7c44f85b2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:50.538625 1173 raft_consensus.cc:385] T 5c89f413a26a43ef95c850d7c44f85b2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.539063 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet ce82c595e30a4878be25be8eb3d30790 (table default.Table_cf5f0ff49fa24bf18b21a4ebbe45d2e4 [id=c532f0623efe4c3f8d9c90ae9c3d02c3]) successfully deleted
I20260318 02:51:50.539259 1173 raft_consensus.cc:740] T 5c89f413a26a43ef95c850d7c44f85b2 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.539557 1175 ts_tablet_manager.cc:1929] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:50.539660 1175 log.cc:1199] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/824b9dc6982f425c9518c0ea3560bf84
I20260318 02:51:50.539934 1175 ts_tablet_manager.cc:1950] T 824b9dc6982f425c9518c0ea3560bf84 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:50.540500 1175 tablet_replica.cc:333] T 5dd894706cc2466a8cd4e4df67856862 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
W20260318 02:51:50.545122 719 consensus_peers.cc:597] T 14c35d41da7146faa89d8af3bb5f5140 P 6a903d876086423b8016d705b98895ad -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:50.540697 1175 raft_consensus.cc:2243] T 5dd894706cc2466a8cd4e4df67856862 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:50.549362 1175 raft_consensus.cc:2272] T 5dd894706cc2466a8cd4e4df67856862 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260318 02:51:50.549940 1175 ts_tablet_manager.cc:1916] T 5dd894706cc2466a8cd4e4df67856862 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:50.539863 1173 consensus_queue.cc:260] T 5c89f413a26a43ef95c850d7c44f85b2 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:50.555055 2937 raft_consensus.cc:493] T 495c8ace1cdb4741aa2ffa1f85dfb25e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.555262 2937 raft_consensus.cc:515] T 495c8ace1cdb4741aa2ffa1f85dfb25e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.555948 2937 leader_election.cc:290] T 495c8ace1cdb4741aa2ffa1f85dfb25e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:50.557653 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8ace1cdb4741aa2ffa1f85dfb25e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:50.558435 719 leader_election.cc:343] T 495c8ace1cdb4741aa2ffa1f85dfb25e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.558699 2937 raft_consensus.cc:493] T b07006bc31584865a0a5eb407e7ccc16 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.558822 2937 raft_consensus.cc:515] T b07006bc31584865a0a5eb407e7ccc16 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.559371 2937 leader_election.cc:290] T b07006bc31584865a0a5eb407e7ccc16 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:50.560765 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07006bc31584865a0a5eb407e7ccc16" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:50.561360 719 leader_election.cc:343] T b07006bc31584865a0a5eb407e7ccc16 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.561692 1175 ts_tablet_manager.cc:1929] T 5dd894706cc2466a8cd4e4df67856862 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:50.561808 1175 log.cc:1199] T 5dd894706cc2466a8cd4e4df67856862 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/5dd894706cc2466a8cd4e4df67856862
I20260318 02:51:50.562085 1175 ts_tablet_manager.cc:1950] T 5dd894706cc2466a8cd4e4df67856862 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:50.562318 1173 ts_tablet_manager.cc:1434] T 5c89f413a26a43ef95c850d7c44f85b2 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20260318 02:51:50.564112 1173 tablet_bootstrap.cc:492] T 33d90a619ae54227aaf95acd180af119 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:50.565821 1173 tablet_bootstrap.cc:654] T 33d90a619ae54227aaf95acd180af119 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.566831 2937 raft_consensus.cc:493] T f7f8240ed325401da6344c8ee033ad43 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.567013 2937 raft_consensus.cc:515] T f7f8240ed325401da6344c8ee033ad43 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.567713 2937 leader_election.cc:290] T f7f8240ed325401da6344c8ee033ad43 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:50.575441 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 5a92761edfe74a9798da4d93964383ea (table default.Table_8b91091dce7d43b9b2abf2ef5262b12c [id=519eccded71a4f229484640ce6c21a89]) successfully deleted
W20260318 02:51:50.575877 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet d77381b5591b449a89328f0819e242a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d77381b5591b449a89328f0819e242a7 already in progress: creating tablet
W20260318 02:51:50.576174 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 43844dd8883e45dbaa92d4058e9af9fb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43844dd8883e45dbaa92d4058e9af9fb already in progress: creating tablet
I20260318 02:51:50.577796 1174 tablet_bootstrap.cc:492] T 793a87e8bcb442c1b6fb0ecfcbc71480 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:50.577950 1174 ts_tablet_manager.cc:1403] T 793a87e8bcb442c1b6fb0ecfcbc71480 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.112s user 0.011s sys 0.019s
I20260318 02:51:50.497431 1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f93d766c44461cb0f5f4bfba09a744" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:50.498055 1172 tablet_bootstrap.cc:492] T 3291ecec94e642e3a995a2d7006619e7 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.578701 1174 raft_consensus.cc:359] T 793a87e8bcb442c1b6fb0ecfcbc71480 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.578859 1174 raft_consensus.cc:385] T 793a87e8bcb442c1b6fb0ecfcbc71480 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.560321 1062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07006bc31584865a0a5eb407e7ccc16" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:50.578908 1174 raft_consensus.cc:740] T 793a87e8bcb442c1b6fb0ecfcbc71480 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.578887 1172 ts_tablet_manager.cc:1403] T 3291ecec94e642e3a995a2d7006619e7 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.104s user 0.001s sys 0.004s
I20260318 02:51:50.579098 1174 consensus_queue.cc:260] T 793a87e8bcb442c1b6fb0ecfcbc71480 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.579586 1174 ts_tablet_manager.cc:1434] T 793a87e8bcb442c1b6fb0ecfcbc71480 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260318 02:51:50.579610 719 leader_election.cc:343] T 33f93d766c44461cb0f5f4bfba09a744 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.579732 719 leader_election.cc:304] T 33f93d766c44461cb0f5f4bfba09a744 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.579720 1172 raft_consensus.cc:359] T 3291ecec94e642e3a995a2d7006619e7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.579886 1174 tablet_bootstrap.cc:492] T 70dca1ffc22c4c029840635f1b312dff P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:50.579932 1172 raft_consensus.cc:385] T 3291ecec94e642e3a995a2d7006619e7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.580017 1172 raft_consensus.cc:740] T 3291ecec94e642e3a995a2d7006619e7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
W20260318 02:51:50.580129 719 leader_election.cc:343] T b07006bc31584865a0a5eb407e7ccc16 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.580216 719 leader_election.cc:304] T b07006bc31584865a0a5eb407e7ccc16 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.580220 1172 consensus_queue.cc:260] T 3291ecec94e642e3a995a2d7006619e7 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.580653 2859 raft_consensus.cc:2749] T 33f93d766c44461cb0f5f4bfba09a744 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.580753 1172 ts_tablet_manager.cc:1434] T 3291ecec94e642e3a995a2d7006619e7 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:50.580842 2859 raft_consensus.cc:2749] T b07006bc31584865a0a5eb407e7ccc16 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.581063 1172 tablet_bootstrap.cc:492] T ed193d1b80be496298dae6fafef94577 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.581825 1174 tablet_bootstrap.cc:654] T 70dca1ffc22c4c029840635f1b312dff P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.562041 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "495c8ace1cdb4741aa2ffa1f85dfb25e" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:50.571435 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f8240ed325401da6344c8ee033ad43" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:50.583631 719 leader_election.cc:343] T f7f8240ed325401da6344c8ee033ad43 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:50.584296 719 leader_election.cc:343] T 495c8ace1cdb4741aa2ffa1f85dfb25e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.584406 719 leader_election.cc:304] T 495c8ace1cdb4741aa2ffa1f85dfb25e P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.584936 2937 raft_consensus.cc:2749] T 495c8ace1cdb4741aa2ffa1f85dfb25e P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.582634 1172 tablet_bootstrap.cc:654] T ed193d1b80be496298dae6fafef94577 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.590726 1174 tablet_bootstrap.cc:492] T 70dca1ffc22c4c029840635f1b312dff P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:50.590901 1174 ts_tablet_manager.cc:1403] T 70dca1ffc22c4c029840635f1b312dff P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.006s
I20260318 02:51:50.591756 1174 raft_consensus.cc:359] T 70dca1ffc22c4c029840635f1b312dff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.591951 1174 raft_consensus.cc:385] T 70dca1ffc22c4c029840635f1b312dff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.591997 1174 raft_consensus.cc:740] T 70dca1ffc22c4c029840635f1b312dff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.592240 1174 consensus_queue.cc:260] T 70dca1ffc22c4c029840635f1b312dff P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.592782 1174 ts_tablet_manager.cc:1434] T 70dca1ffc22c4c029840635f1b312dff P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:50.593065 1174 tablet_bootstrap.cc:492] T c0349def0e4045f2b1e9a02dd654a174 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:50.594148 1172 tablet_bootstrap.cc:492] T ed193d1b80be496298dae6fafef94577 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.594317 1172 ts_tablet_manager.cc:1403] T ed193d1b80be496298dae6fafef94577 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260318 02:51:50.595268 1174 tablet_bootstrap.cc:654] T c0349def0e4045f2b1e9a02dd654a174 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.595095 1172 raft_consensus.cc:359] T ed193d1b80be496298dae6fafef94577 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.595499 1172 raft_consensus.cc:385] T ed193d1b80be496298dae6fafef94577 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.595569 1172 raft_consensus.cc:740] T ed193d1b80be496298dae6fafef94577 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.595785 1172 consensus_queue.cc:260] T ed193d1b80be496298dae6fafef94577 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.596585 1172 ts_tablet_manager.cc:1434] T ed193d1b80be496298dae6fafef94577 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:50.597131 1172 tablet_bootstrap.cc:492] T 42fc3a9965804b5eb0c9f96eabc38553 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.598829 1172 tablet_bootstrap.cc:654] T 42fc3a9965804b5eb0c9f96eabc38553 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.603624 1184 ts_tablet_manager.cc:1916] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:50.610188 1172 tablet_bootstrap.cc:492] T 42fc3a9965804b5eb0c9f96eabc38553 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.610364 1172 ts_tablet_manager.cc:1403] T 42fc3a9965804b5eb0c9f96eabc38553 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260318 02:51:50.612074 1172 raft_consensus.cc:359] T 42fc3a9965804b5eb0c9f96eabc38553 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.612288 1172 raft_consensus.cc:385] T 42fc3a9965804b5eb0c9f96eabc38553 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.612346 1172 raft_consensus.cc:740] T 42fc3a9965804b5eb0c9f96eabc38553 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.613194 1172 consensus_queue.cc:260] T 42fc3a9965804b5eb0c9f96eabc38553 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.613802 1172 ts_tablet_manager.cc:1434] T 42fc3a9965804b5eb0c9f96eabc38553 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260318 02:51:50.614887 1172 tablet_bootstrap.cc:492] T 5f63108c062348b1ba995ea16f40a695 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.616387 1172 tablet_bootstrap.cc:654] T 5f63108c062348b1ba995ea16f40a695 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.572016 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7f8240ed325401da6344c8ee033ad43" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:50.577958 2926 raft_consensus.cc:493] T bac04b3e4ad448b09a1a25a754b44aad P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.620940 2926 raft_consensus.cc:515] T bac04b3e4ad448b09a1a25a754b44aad P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.621678 2926 leader_election.cc:290] T bac04b3e4ad448b09a1a25a754b44aad P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:50.624081 719 leader_election.cc:343] T f7f8240ed325401da6344c8ee033ad43 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.624243 719 leader_election.cc:304] T f7f8240ed325401da6344c8ee033ad43 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.625007 779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac04b3e4ad448b09a1a25a754b44aad" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:50.625367 2937 raft_consensus.cc:2749] T f7f8240ed325401da6344c8ee033ad43 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.626117 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac04b3e4ad448b09a1a25a754b44aad" candidate_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:50.626745 860 leader_election.cc:304] T bac04b3e4ad448b09a1a25a754b44aad P b25f4f05e0c94c8db825d5afa0b8bf18 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b25f4f05e0c94c8db825d5afa0b8bf18; no voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d
I20260318 02:51:50.627242 2926 raft_consensus.cc:2749] T bac04b3e4ad448b09a1a25a754b44aad P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.629276 1172 tablet_bootstrap.cc:492] T 5f63108c062348b1ba995ea16f40a695 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.629448 1172 ts_tablet_manager.cc:1403] T 5f63108c062348b1ba995ea16f40a695 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260318 02:51:50.632160 922 raft_consensus.cc:3060] T 498f592fa2fb46748f7752004780fe46 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:50.634251 1172 raft_consensus.cc:359] T 5f63108c062348b1ba995ea16f40a695 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.635103 1172 raft_consensus.cc:385] T 5f63108c062348b1ba995ea16f40a695 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.635171 1172 raft_consensus.cc:740] T 5f63108c062348b1ba995ea16f40a695 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.635428 1172 consensus_queue.cc:260] T 5f63108c062348b1ba995ea16f40a695 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.636938 1172 ts_tablet_manager.cc:1434] T 5f63108c062348b1ba995ea16f40a695 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260318 02:51:50.637926 1172 tablet_bootstrap.cc:492] T f95ebc89fd2545b1835a1bc10414248d P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.640070 1172 tablet_bootstrap.cc:654] T f95ebc89fd2545b1835a1bc10414248d P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.650997 3045 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.104.188:41593 every 8 connection(s)
I20260318 02:51:50.651435 2753 rpc_server.cc:307] RPC server started. Bound to: 127.0.104.188:41593
I20260318 02:51:50.653478 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 306367152e834668bbf5fcadd008b3ea (table default.Table_20b2dbf580454a4a993130bde0ae0265 [id=41496f910c434ed4a7affece7e7efb74]) successfully deleted
I20260318 02:51:50.653775 2753 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/master-2/data/info.pb
I20260318 02:51:50.654763 893 tablet_service.cc:1511] Processing CreateTablet for tablet 544ffc1ccf2244f69eee1f78ddd71e78 (DEFAULT_TABLE table=default.Table_6906102872944fcb9652909f23caa1cd [id=749ee258bc6741b286301ab384fde3ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.657002 893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 544ffc1ccf2244f69eee1f78ddd71e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.657783 418 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvjTIu6/build/asan/bin/kudu as pid 2753
I20260318 02:51:50.663877 1172 tablet_bootstrap.cc:492] T f95ebc89fd2545b1835a1bc10414248d P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.664069 1172 ts_tablet_manager.cc:1403] T f95ebc89fd2545b1835a1bc10414248d P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.001s
I20260318 02:51:50.664893 1172 raft_consensus.cc:359] T f95ebc89fd2545b1835a1bc10414248d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.665125 1172 raft_consensus.cc:385] T f95ebc89fd2545b1835a1bc10414248d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.665195 1172 raft_consensus.cc:740] T f95ebc89fd2545b1835a1bc10414248d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.665457 1172 consensus_queue.cc:260] T f95ebc89fd2545b1835a1bc10414248d P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.668627 1172 ts_tablet_manager.cc:1434] T f95ebc89fd2545b1835a1bc10414248d P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260318 02:51:50.669032 1172 tablet_bootstrap.cc:492] T 8b715c5a31ba4515996595de89f1d62c P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.670699 1172 tablet_bootstrap.cc:654] T 8b715c5a31ba4515996595de89f1d62c P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.676492 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 544ffc1ccf2244f69eee1f78ddd71e78 (DEFAULT_TABLE table=default.Table_6906102872944fcb9652909f23caa1cd [id=749ee258bc6741b286301ab384fde3ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.676952 1035 tablet_service.cc:1511] Processing CreateTablet for tablet bac948d255fc45d1bfd4f0f844d9a788 (DEFAULT_TABLE table=default.Table_e411160a28b641718494e6813eb0da0f [id=df57085a03fe46d7b3dd7a32ad4f3c5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.676994 1030 tablet_service.cc:1511] Processing CreateTablet for tablet 567fc0f4a11d4be286c776a19223e8a7 (DEFAULT_TABLE table=default.Table_8dc2dd2d94f341fb86d5d14fedace764 [id=b5bb89021d3445e0b3b89787b45d0591]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.677591 1031 tablet_service.cc:1511] Processing CreateTablet for tablet 79d4e98b67ec4dc1bd26b6d1122ef088 (DEFAULT_TABLE table=default.Table_73b7417949204d95bd6115bb0a4c26be [id=669323a4b2044cf58b27d6888948f462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.677706 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 544ffc1ccf2244f69eee1f78ddd71e78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.677887 1031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d4e98b67ec4dc1bd26b6d1122ef088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.683369 1030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 567fc0f4a11d4be286c776a19223e8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.685133 1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac948d255fc45d1bfd4f0f844d9a788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.686194 903 tablet_service.cc:1511] Processing CreateTablet for tablet bac948d255fc45d1bfd4f0f844d9a788 (DEFAULT_TABLE table=default.Table_e411160a28b641718494e6813eb0da0f [id=df57085a03fe46d7b3dd7a32ad4f3c5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.686578 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac948d255fc45d1bfd4f0f844d9a788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.694092 907 tablet_service.cc:1511] Processing CreateTablet for tablet 79d4e98b67ec4dc1bd26b6d1122ef088 (DEFAULT_TABLE table=default.Table_73b7417949204d95bd6115bb0a4c26be [id=669323a4b2044cf58b27d6888948f462]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.694514 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d4e98b67ec4dc1bd26b6d1122ef088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.696679 903 tablet_service.cc:1511] Processing CreateTablet for tablet 567fc0f4a11d4be286c776a19223e8a7 (DEFAULT_TABLE table=default.Table_8dc2dd2d94f341fb86d5d14fedace764 [id=b5bb89021d3445e0b3b89787b45d0591]), partition=RANGE (key) PARTITION UNBOUNDED
I20260318 02:51:50.697073 903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 567fc0f4a11d4be286c776a19223e8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260318 02:51:50.700526 1172 tablet_bootstrap.cc:492] T 8b715c5a31ba4515996595de89f1d62c P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.708787 972 heartbeater.cc:344] Connected to a master server at 127.0.104.188:41593
I20260318 02:51:50.700690 1172 ts_tablet_manager.cc:1403] T 8b715c5a31ba4515996595de89f1d62c P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20260318 02:51:50.715304 1172 raft_consensus.cc:359] T 8b715c5a31ba4515996595de89f1d62c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.715497 1172 raft_consensus.cc:385] T 8b715c5a31ba4515996595de89f1d62c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.715545 1172 raft_consensus.cc:740] T 8b715c5a31ba4515996595de89f1d62c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.715726 1172 consensus_queue.cc:260] T 8b715c5a31ba4515996595de89f1d62c P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.716199 1172 ts_tablet_manager.cc:1434] T 8b715c5a31ba4515996595de89f1d62c P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:50.716466 1172 tablet_bootstrap.cc:492] T d26c7c573c40412f88b9c6cc71a3c648 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.720175 1109 heartbeater.cc:344] Connected to a master server at 127.0.104.188:41593
I20260318 02:51:50.721652 1172 tablet_bootstrap.cc:654] T d26c7c573c40412f88b9c6cc71a3c648 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.731702 3047 sys_catalog.cc:263] Verifying existing consensus state
I20260318 02:51:50.732033 2152 raft_consensus.cc:493] T ed193d1b80be496298dae6fafef94577 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.732178 2152 raft_consensus.cc:515] T ed193d1b80be496298dae6fafef94577 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.732810 2152 leader_election.cc:290] T ed193d1b80be496298dae6fafef94577 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:50.733209 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed193d1b80be496298dae6fafef94577" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:50.733733 997 leader_election.cc:343] T ed193d1b80be496298dae6fafef94577 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:50.734282 999 leader_election.cc:343] T ed193d1b80be496298dae6fafef94577 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: ed193d1b80be496298dae6fafef94577
I20260318 02:51:50.734400 999 leader_election.cc:304] T ed193d1b80be496298dae6fafef94577 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.734655 2152 raft_consensus.cc:2749] T ed193d1b80be496298dae6fafef94577 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.739508 2931 raft_consensus.cc:493] T defda79dd0f34c37ae16ea808df0754b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.739686 2931 raft_consensus.cc:515] T defda79dd0f34c37ae16ea808df0754b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:50.740278 2931 leader_election.cc:290] T defda79dd0f34c37ae16ea808df0754b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:50.740787 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "defda79dd0f34c37ae16ea808df0754b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:50.741290 997 leader_election.cc:343] T defda79dd0f34c37ae16ea808df0754b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:50.741822 999 leader_election.cc:343] T defda79dd0f34c37ae16ea808df0754b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: defda79dd0f34c37ae16ea808df0754b
I20260318 02:51:50.741940 999 leader_election.cc:304] T defda79dd0f34c37ae16ea808df0754b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.742318 2931 raft_consensus.cc:2749] T defda79dd0f34c37ae16ea808df0754b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.747740 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 824b9dc6982f425c9518c0ea3560bf84 (table default.Table_d20052125a004fa088aea68c2ec6d98f [id=64bdf02991a64246b7431e6e3c0e1268]) successfully deleted
I20260318 02:51:50.747740 907 tablet_service.cc:1558] Processing DeleteTablet for tablet 2dab268da5e843cab5c28a521217df97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-18 02:51:30 UTC) from {username='slave'} at 127.0.0.1:37544
I20260318 02:51:50.747972 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 5dd894706cc2466a8cd4e4df67856862 (table default.Table_d1bc10f5a27b4fee93fafa3a93ee9d05 [id=f4308b8efe454170bce7eff85fab0959]) successfully deleted
I20260318 02:51:50.748008 1175 tablet_replica.cc:333] T 2dab268da5e843cab5c28a521217df97 P b25f4f05e0c94c8db825d5afa0b8bf18: stopping tablet replica
W20260318 02:51:50.748163 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 295ac73a106e4a7e87d001a79f80cb99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 295ac73a106e4a7e87d001a79f80cb99 already in progress: creating tablet
I20260318 02:51:50.748183 1175 raft_consensus.cc:2243] T 2dab268da5e843cab5c28a521217df97 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260318 02:51:50.748327 1175 raft_consensus.cc:2272] T 2dab268da5e843cab5c28a521217df97 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260318 02:51:50.748342 441 catalog_manager.cc:4982] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): delete failed for tablet 30c4e42a55914561a9f4ee330594eef6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30c4e42a55914561a9f4ee330594eef6 already in progress: creating tablet
I20260318 02:51:50.748970 1175 ts_tablet_manager.cc:1916] T 2dab268da5e843cab5c28a521217df97 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260318 02:51:50.753796 1173 tablet_bootstrap.cc:492] T 33d90a619ae54227aaf95acd180af119 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:50.753940 1173 ts_tablet_manager.cc:1403] T 33d90a619ae54227aaf95acd180af119 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.190s user 0.003s sys 0.000s
I20260318 02:51:50.754673 1173 raft_consensus.cc:359] T 33d90a619ae54227aaf95acd180af119 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.754845 1173 raft_consensus.cc:385] T 33d90a619ae54227aaf95acd180af119 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.754899 1173 raft_consensus.cc:740] T 33d90a619ae54227aaf95acd180af119 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.755123 1173 consensus_queue.cc:260] T 33d90a619ae54227aaf95acd180af119 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.755589 1173 ts_tablet_manager.cc:1434] T 33d90a619ae54227aaf95acd180af119 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:50.756026 1175 ts_tablet_manager.cc:1929] T 2dab268da5e843cab5c28a521217df97 P b25f4f05e0c94c8db825d5afa0b8bf18: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:50.756129 1175 log.cc:1199] T 2dab268da5e843cab5c28a521217df97 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-1/wal/wals/2dab268da5e843cab5c28a521217df97
I20260318 02:51:50.756400 1175 ts_tablet_manager.cc:1950] T 2dab268da5e843cab5c28a521217df97 P b25f4f05e0c94c8db825d5afa0b8bf18: Deleting consensus metadata
I20260318 02:51:50.757542 2937 raft_consensus.cc:493] T 5ba2b7cd82df4c19b2b434a6ba045e3b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.757717 2937 raft_consensus.cc:515] T 5ba2b7cd82df4c19b2b434a6ba045e3b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.758378 2937 leader_election.cc:290] T 5ba2b7cd82df4c19b2b434a6ba045e3b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:50.759013 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba2b7cd82df4c19b2b434a6ba045e3b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:50.759559 719 leader_election.cc:343] T 5ba2b7cd82df4c19b2b434a6ba045e3b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.762528 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ba2b7cd82df4c19b2b434a6ba045e3b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:50.763110 719 leader_election.cc:343] T 5ba2b7cd82df4c19b2b434a6ba045e3b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.763274 719 leader_election.cc:304] T 5ba2b7cd82df4c19b2b434a6ba045e3b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.763787 2937 raft_consensus.cc:2749] T 5ba2b7cd82df4c19b2b434a6ba045e3b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.775974 1173 tablet_bootstrap.cc:492] T fb5d1d828899472e8f48723b35e94d62 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:50.777230 2937 raft_consensus.cc:493] T 0f499c464eb14164a2df3abc2d4a47c7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.777513 2937 raft_consensus.cc:515] T 0f499c464eb14164a2df3abc2d4a47c7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.778240 2937 leader_election.cc:290] T 0f499c464eb14164a2df3abc2d4a47c7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:50.779174 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f499c464eb14164a2df3abc2d4a47c7" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:50.780018 719 leader_election.cc:343] T 0f499c464eb14164a2df3abc2d4a47c7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.781556 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f499c464eb14164a2df3abc2d4a47c7" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:50.782352 719 leader_election.cc:343] T 0f499c464eb14164a2df3abc2d4a47c7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.782517 719 leader_election.cc:304] T 0f499c464eb14164a2df3abc2d4a47c7 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.783155 2937 raft_consensus.cc:2749] T 0f499c464eb14164a2df3abc2d4a47c7 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:50.792896 441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.104.130:37443, user_credentials={real_user=slave}} blocked reactor thread for 44399.7us
I20260318 02:51:50.798970 1173 tablet_bootstrap.cc:654] T fb5d1d828899472e8f48723b35e94d62 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.802209 1184 ts_tablet_manager.cc:1929] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260318 02:51:50.802490 1184 log.cc:1199] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d: Deleting WAL directory at /tmp/dist-test-taskvjTIu6/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1773802275441584-418-0/minicluster-data/ts-2/wal/wals/77a17ef7cfee4d65808b11e9cb51e7df
I20260318 02:51:50.802865 1184 ts_tablet_manager.cc:1950] T 77a17ef7cfee4d65808b11e9cb51e7df P 9422bb7011f342b08be0b073a88c4c4d: Deleting consensus metadata
I20260318 02:51:50.805691 1172 tablet_bootstrap.cc:492] T d26c7c573c40412f88b9c6cc71a3c648 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.805856 1172 ts_tablet_manager.cc:1403] T d26c7c573c40412f88b9c6cc71a3c648 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.089s user 0.014s sys 0.010s
I20260318 02:51:50.806543 1172 raft_consensus.cc:359] T d26c7c573c40412f88b9c6cc71a3c648 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.806713 1172 raft_consensus.cc:385] T d26c7c573c40412f88b9c6cc71a3c648 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.806777 1172 raft_consensus.cc:740] T d26c7c573c40412f88b9c6cc71a3c648 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.806983 1172 consensus_queue.cc:260] T d26c7c573c40412f88b9c6cc71a3c648 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.807483 1172 ts_tablet_manager.cc:1434] T d26c7c573c40412f88b9c6cc71a3c648 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260318 02:51:50.809537 719 consensus_peers.cc:597] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:50.810423 1172 tablet_bootstrap.cc:492] T ca4e1eec9a2148488295416cd68ca607 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.811689 3047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 971baf5b9e4644c990dbf4d4fc7ba900: Bootstrap starting.
I20260318 02:51:50.811838 1172 tablet_bootstrap.cc:654] T ca4e1eec9a2148488295416cd68ca607 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.816684 1172 tablet_bootstrap.cc:492] T ca4e1eec9a2148488295416cd68ca607 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.816843 1172 ts_tablet_manager.cc:1403] T ca4e1eec9a2148488295416cd68ca607 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.002s
I20260318 02:51:50.817605 1172 raft_consensus.cc:359] T ca4e1eec9a2148488295416cd68ca607 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:50.817770 1172 raft_consensus.cc:385] T ca4e1eec9a2148488295416cd68ca607 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.817818 1172 raft_consensus.cc:740] T ca4e1eec9a2148488295416cd68ca607 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.818050 1172 consensus_queue.cc:260] T ca4e1eec9a2148488295416cd68ca607 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:50.818688 1172 ts_tablet_manager.cc:1434] T ca4e1eec9a2148488295416cd68ca607 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260318 02:51:50.818960 1172 tablet_bootstrap.cc:492] T 59ce7583e7f545f18145b4e55e1fbb81 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.836786 1174 tablet_bootstrap.cc:492] T c0349def0e4045f2b1e9a02dd654a174 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:50.836961 1174 ts_tablet_manager.cc:1403] T c0349def0e4045f2b1e9a02dd654a174 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.244s user 0.073s sys 0.106s
I20260318 02:51:50.837741 1172 tablet_bootstrap.cc:654] T 59ce7583e7f545f18145b4e55e1fbb81 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.837692 1174 raft_consensus.cc:359] T c0349def0e4045f2b1e9a02dd654a174 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.837857 1174 raft_consensus.cc:385] T c0349def0e4045f2b1e9a02dd654a174 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.837934 1174 raft_consensus.cc:740] T c0349def0e4045f2b1e9a02dd654a174 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.838143 1174 consensus_queue.cc:260] T c0349def0e4045f2b1e9a02dd654a174 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.838646 1174 ts_tablet_manager.cc:1434] T c0349def0e4045f2b1e9a02dd654a174 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260318 02:51:50.839279 1174 tablet_bootstrap.cc:492] T 62af4992cca84830ab8317f734338365 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:50.843828 1174 tablet_bootstrap.cc:654] T 62af4992cca84830ab8317f734338365 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.844921 1172 tablet_bootstrap.cc:492] T 59ce7583e7f545f18145b4e55e1fbb81 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.845054 1172 ts_tablet_manager.cc:1403] T 59ce7583e7f545f18145b4e55e1fbb81 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.003s
I20260318 02:51:50.845708 1172 raft_consensus.cc:359] T 59ce7583e7f545f18145b4e55e1fbb81 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.845867 1172 raft_consensus.cc:385] T 59ce7583e7f545f18145b4e55e1fbb81 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.845907 1172 raft_consensus.cc:740] T 59ce7583e7f545f18145b4e55e1fbb81 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.846077 1172 consensus_queue.cc:260] T 59ce7583e7f545f18145b4e55e1fbb81 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.846444 831 heartbeater.cc:344] Connected to a master server at 127.0.104.188:41593
I20260318 02:51:50.851531 1172 ts_tablet_manager.cc:1434] T 59ce7583e7f545f18145b4e55e1fbb81 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260318 02:51:50.851862 1172 tablet_bootstrap.cc:492] T 1ac9581312964ad6afcc96f798fa534a P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.852478 1174 tablet_bootstrap.cc:492] T 62af4992cca84830ab8317f734338365 P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:50.852617 1174 ts_tablet_manager.cc:1403] T 62af4992cca84830ab8317f734338365 P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.002s
I20260318 02:51:50.853358 1174 raft_consensus.cc:359] T 62af4992cca84830ab8317f734338365 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.853494 1172 tablet_bootstrap.cc:654] T 1ac9581312964ad6afcc96f798fa534a P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.853538 1174 raft_consensus.cc:385] T 62af4992cca84830ab8317f734338365 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.853602 1174 raft_consensus.cc:740] T 62af4992cca84830ab8317f734338365 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.853804 1174 consensus_queue.cc:260] T 62af4992cca84830ab8317f734338365 P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.854277 1174 ts_tablet_manager.cc:1434] T 62af4992cca84830ab8317f734338365 P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260318 02:51:50.854576 2937 raft_consensus.cc:493] T 70dca1ffc22c4c029840635f1b312dff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.854719 2937 raft_consensus.cc:515] T 70dca1ffc22c4c029840635f1b312dff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.855331 2937 leader_election.cc:290] T 70dca1ffc22c4c029840635f1b312dff P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:50.855999 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70dca1ffc22c4c029840635f1b312dff" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:50.856438 1174 tablet_bootstrap.cc:492] T a628b6d2523344edbf78695a041113cf P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:50.856400 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70dca1ffc22c4c029840635f1b312dff" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:50.856941 719 leader_election.cc:343] T 70dca1ffc22c4c029840635f1b312dff P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:50.857158 719 leader_election.cc:343] T 70dca1ffc22c4c029840635f1b312dff P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.857262 719 leader_election.cc:304] T 70dca1ffc22c4c029840635f1b312dff P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.857635 2937 raft_consensus.cc:2749] T 70dca1ffc22c4c029840635f1b312dff P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.859302 1174 tablet_bootstrap.cc:654] T a628b6d2523344edbf78695a041113cf P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.879372 1173 tablet_bootstrap.cc:492] T fb5d1d828899472e8f48723b35e94d62 P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:50.879657 1173 ts_tablet_manager.cc:1403] T fb5d1d828899472e8f48723b35e94d62 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.104s user 0.002s sys 0.002s
I20260318 02:51:50.880750 1172 tablet_bootstrap.cc:492] T 1ac9581312964ad6afcc96f798fa534a P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.880901 1172 ts_tablet_manager.cc:1403] T 1ac9581312964ad6afcc96f798fa534a P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.003s
I20260318 02:51:50.881722 1172 raft_consensus.cc:359] T 1ac9581312964ad6afcc96f798fa534a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.881920 1172 raft_consensus.cc:385] T 1ac9581312964ad6afcc96f798fa534a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.881976 1172 raft_consensus.cc:740] T 1ac9581312964ad6afcc96f798fa534a P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.882175 1172 consensus_queue.cc:260] T 1ac9581312964ad6afcc96f798fa534a P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.883914 1173 raft_consensus.cc:359] T fb5d1d828899472e8f48723b35e94d62 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.884186 1173 raft_consensus.cc:385] T fb5d1d828899472e8f48723b35e94d62 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.884275 1173 raft_consensus.cc:740] T fb5d1d828899472e8f48723b35e94d62 P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.884578 1173 consensus_queue.cc:260] T fb5d1d828899472e8f48723b35e94d62 P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.885519 1172 ts_tablet_manager.cc:1434] T 1ac9581312964ad6afcc96f798fa534a P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260318 02:51:50.885819 1172 tablet_bootstrap.cc:492] T a6d2dd53085848d6bd7237b07a5f81d0 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.887341 1172 tablet_bootstrap.cc:654] T a6d2dd53085848d6bd7237b07a5f81d0 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.889639 2931 consensus_queue.cc:1048] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:50.897248 1173 ts_tablet_manager.cc:1434] T fb5d1d828899472e8f48723b35e94d62 P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.017s user 0.000s sys 0.002s
I20260318 02:51:50.900555 1174 tablet_bootstrap.cc:492] T a628b6d2523344edbf78695a041113cf P 6a903d876086423b8016d705b98895ad: No bootstrap required, opened a new log
I20260318 02:51:50.900765 1174 ts_tablet_manager.cc:1403] T a628b6d2523344edbf78695a041113cf P 6a903d876086423b8016d705b98895ad: Time spent bootstrapping tablet: real 0.044s user 0.022s sys 0.007s
I20260318 02:51:50.901551 1174 raft_consensus.cc:359] T a628b6d2523344edbf78695a041113cf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.901729 1174 raft_consensus.cc:385] T a628b6d2523344edbf78695a041113cf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.901800 1174 raft_consensus.cc:740] T a628b6d2523344edbf78695a041113cf P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a903d876086423b8016d705b98895ad, State: Initialized, Role: FOLLOWER
W20260318 02:51:50.909879 997 consensus_peers.cc:597] T cb29fd9d6fc845b2aaffe34c290fd5ca P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260318 02:51:50.910748 1173 tablet_bootstrap.cc:492] T 2f80f29dfd814acd8b7e143a72231dfd P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:50.914139 1174 consensus_queue.cc:260] T a628b6d2523344edbf78695a041113cf P 6a903d876086423b8016d705b98895ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.914732 1174 ts_tablet_manager.cc:1434] T a628b6d2523344edbf78695a041113cf P 6a903d876086423b8016d705b98895ad: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20260318 02:51:50.916587 1173 tablet_bootstrap.cc:654] T 2f80f29dfd814acd8b7e143a72231dfd P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.917747 1174 tablet_bootstrap.cc:492] T c0d9f28881ca49a6af360aa9c9b9aa29 P 6a903d876086423b8016d705b98895ad: Bootstrap starting.
I20260318 02:51:50.919627 1174 tablet_bootstrap.cc:654] T c0d9f28881ca49a6af360aa9c9b9aa29 P 6a903d876086423b8016d705b98895ad: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.933024 2937 raft_consensus.cc:493] T 2a6f56dafead404eb1720276b07ea733 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.933226 2937 raft_consensus.cc:515] T 2a6f56dafead404eb1720276b07ea733 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.933914 2937 leader_election.cc:290] T 2a6f56dafead404eb1720276b07ea733 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:50.935098 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6f56dafead404eb1720276b07ea733" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:50.935614 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6f56dafead404eb1720276b07ea733" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:50.936488 719 leader_election.cc:343] T 2a6f56dafead404eb1720276b07ea733 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:50.936872 719 leader_election.cc:343] T 2a6f56dafead404eb1720276b07ea733 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.936992 719 leader_election.cc:304] T 2a6f56dafead404eb1720276b07ea733 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.937474 2937 raft_consensus.cc:2749] T 2a6f56dafead404eb1720276b07ea733 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.944411 2152 raft_consensus.cc:493] T 42fc3a9965804b5eb0c9f96eabc38553 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.944574 2152 raft_consensus.cc:515] T 42fc3a9965804b5eb0c9f96eabc38553 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.945199 2152 leader_election.cc:290] T 42fc3a9965804b5eb0c9f96eabc38553 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:50.946620 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42fc3a9965804b5eb0c9f96eabc38553" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:50.947216 997 leader_election.cc:343] T 42fc3a9965804b5eb0c9f96eabc38553 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:50.947540 999 leader_election.cc:343] T 42fc3a9965804b5eb0c9f96eabc38553 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 42fc3a9965804b5eb0c9f96eabc38553
I20260318 02:51:50.947623 999 leader_election.cc:304] T 42fc3a9965804b5eb0c9f96eabc38553 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.948179 2831 raft_consensus.cc:2749] T 42fc3a9965804b5eb0c9f96eabc38553 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.954466 2937 consensus_queue.cc:1048] T 831a7cb00e7040a7ade210c755dbff4a P 6a903d876086423b8016d705b98895ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260318 02:51:50.954763 1173 tablet_bootstrap.cc:492] T 2f80f29dfd814acd8b7e143a72231dfd P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:50.954908 1173 ts_tablet_manager.cc:1403] T 2f80f29dfd814acd8b7e143a72231dfd P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.044s user 0.000s sys 0.002s
I20260318 02:51:50.967387 1172 tablet_bootstrap.cc:492] T a6d2dd53085848d6bd7237b07a5f81d0 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.967566 1172 ts_tablet_manager.cc:1403] T a6d2dd53085848d6bd7237b07a5f81d0 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.082s user 0.010s sys 0.005s
I20260318 02:51:50.968423 1172 raft_consensus.cc:359] T a6d2dd53085848d6bd7237b07a5f81d0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.968624 1172 raft_consensus.cc:385] T a6d2dd53085848d6bd7237b07a5f81d0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.968672 1172 raft_consensus.cc:740] T a6d2dd53085848d6bd7237b07a5f81d0 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.968889 1172 consensus_queue.cc:260] T a6d2dd53085848d6bd7237b07a5f81d0 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.969383 1172 ts_tablet_manager.cc:1434] T a6d2dd53085848d6bd7237b07a5f81d0 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:50.969691 1172 tablet_bootstrap.cc:492] T abfa81c3c78a498285e2961530272a39 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.971320 1172 tablet_bootstrap.cc:654] T abfa81c3c78a498285e2961530272a39 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.972317 1173 raft_consensus.cc:359] T 2f80f29dfd814acd8b7e143a72231dfd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.978430 2152 raft_consensus.cc:493] T de38fe3eb88147eab65f3dfed37fbf7d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:50.978605 2152 raft_consensus.cc:515] T de38fe3eb88147eab65f3dfed37fbf7d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.979229 2152 leader_election.cc:290] T de38fe3eb88147eab65f3dfed37fbf7d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:50.981009 999 leader_election.cc:343] T de38fe3eb88147eab65f3dfed37fbf7d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: de38fe3eb88147eab65f3dfed37fbf7d
I20260318 02:51:50.986481 1172 tablet_bootstrap.cc:492] T abfa81c3c78a498285e2961530272a39 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:50.986642 1172 ts_tablet_manager.cc:1403] T abfa81c3c78a498285e2961530272a39 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.004s
I20260318 02:51:50.987389 1172 raft_consensus.cc:359] T abfa81c3c78a498285e2961530272a39 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.987551 1172 raft_consensus.cc:385] T abfa81c3c78a498285e2961530272a39 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.987592 1172 raft_consensus.cc:740] T abfa81c3c78a498285e2961530272a39 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:50.987783 1172 consensus_queue.cc:260] T abfa81c3c78a498285e2961530272a39 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.988353 1172 ts_tablet_manager.cc:1434] T abfa81c3c78a498285e2961530272a39 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260318 02:51:50.988620 1172 tablet_bootstrap.cc:492] T 258dc29e4e4245289b7e450837edcd24 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
I20260318 02:51:50.990178 1172 tablet_bootstrap.cc:654] T 258dc29e4e4245289b7e450837edcd24 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:50.980576 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de38fe3eb88147eab65f3dfed37fbf7d" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:50.993758 1173 raft_consensus.cc:385] T 2f80f29dfd814acd8b7e143a72231dfd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:50.993847 1173 raft_consensus.cc:740] T 2f80f29dfd814acd8b7e143a72231dfd P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
W20260318 02:51:50.993940 997 leader_election.cc:343] T de38fe3eb88147eab65f3dfed37fbf7d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:50.994040 997 leader_election.cc:304] T de38fe3eb88147eab65f3dfed37fbf7d P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:50.994050 1173 consensus_queue.cc:260] T 2f80f29dfd814acd8b7e143a72231dfd P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:50.994489 2152 raft_consensus.cc:2749] T de38fe3eb88147eab65f3dfed37fbf7d P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:50.996953 1109 heartbeater.cc:344] Connected to a master server at 127.0.104.188:41593
I20260318 02:51:51.008592 2152 raft_consensus.cc:493] T fa077243d5634d888f3a191b7f9d2d19 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:51.008782 2152 raft_consensus.cc:515] T fa077243d5634d888f3a191b7f9d2d19 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:51.009408 2152 leader_election.cc:290] T fa077243d5634d888f3a191b7f9d2d19 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
I20260318 02:51:51.010195 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa077243d5634d888f3a191b7f9d2d19" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:51.011164 997 leader_election.cc:343] T fa077243d5634d888f3a191b7f9d2d19 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
W20260318 02:51:51.011436 999 leader_election.cc:343] T fa077243d5634d888f3a191b7f9d2d19 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: fa077243d5634d888f3a191b7f9d2d19
I20260318 02:51:51.011523 999 leader_election.cc:304] T fa077243d5634d888f3a191b7f9d2d19 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:51.011930 2152 raft_consensus.cc:2749] T fa077243d5634d888f3a191b7f9d2d19 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:51.013608 1173 ts_tablet_manager.cc:1434] T 2f80f29dfd814acd8b7e143a72231dfd P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.044s user 0.000s sys 0.002s
I20260318 02:51:51.014638 1173 tablet_bootstrap.cc:492] T fe82e581368c4d8a894f0283c1a710fe P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
I20260318 02:51:51.014793 1172 tablet_bootstrap.cc:492] T 258dc29e4e4245289b7e450837edcd24 P 9422bb7011f342b08be0b073a88c4c4d: No bootstrap required, opened a new log
I20260318 02:51:51.014940 1172 ts_tablet_manager.cc:1403] T 258dc29e4e4245289b7e450837edcd24 P 9422bb7011f342b08be0b073a88c4c4d: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20260318 02:51:51.015681 1172 raft_consensus.cc:359] T 258dc29e4e4245289b7e450837edcd24 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:51.015856 1172 raft_consensus.cc:385] T 258dc29e4e4245289b7e450837edcd24 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:51.016319 1172 raft_consensus.cc:740] T 258dc29e4e4245289b7e450837edcd24 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Initialized, Role: FOLLOWER
I20260318 02:51:51.016556 1172 consensus_queue.cc:260] T 258dc29e4e4245289b7e450837edcd24 P 9422bb7011f342b08be0b073a88c4c4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:51.017175 1173 tablet_bootstrap.cc:654] T fe82e581368c4d8a894f0283c1a710fe P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:51.017195 1172 ts_tablet_manager.cc:1434] T 258dc29e4e4245289b7e450837edcd24 P 9422bb7011f342b08be0b073a88c4c4d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260318 02:51:51.020287 2859 raft_consensus.cc:493] T 15f79ab1c38141adaed4bd381df26d9b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:51.020488 2859 raft_consensus.cc:515] T 15f79ab1c38141adaed4bd381df26d9b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:51.021158 2859 leader_election.cc:290] T 15f79ab1c38141adaed4bd381df26d9b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:51.021857 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f79ab1c38141adaed4bd381df26d9b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
I20260318 02:51:51.021978 1172 tablet_bootstrap.cc:492] T 868605c58c1d4744ab8930313e7dcaa9 P 9422bb7011f342b08be0b073a88c4c4d: Bootstrap starting.
W20260318 02:51:51.022512 719 leader_election.cc:343] T 15f79ab1c38141adaed4bd381df26d9b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:51.024118 1172 tablet_bootstrap.cc:654] T 868605c58c1d4744ab8930313e7dcaa9 P 9422bb7011f342b08be0b073a88c4c4d: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:51.026412 2152 raft_consensus.cc:493] T e993481bf55747b0a6a1c996c6917408 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:51.026546 2152 raft_consensus.cc:515] T e993481bf55747b0a6a1c996c6917408 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:51.027128 2152 leader_election.cc:290] T e993481bf55747b0a6a1c996c6917408 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:51.028587 999 leader_election.cc:343] T e993481bf55747b0a6a1c996c6917408 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: e993481bf55747b0a6a1c996c6917408
I20260318 02:51:51.034457 2152 raft_consensus.cc:493] T 565add8c21f343f2b11c12a9bb7ff111 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:51.034610 2152 raft_consensus.cc:515] T 565add8c21f343f2b11c12a9bb7ff111 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:51.035171 2152 leader_election.cc:290] T 565add8c21f343f2b11c12a9bb7ff111 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
W20260318 02:51:51.035775 999 leader_election.cc:343] T 565add8c21f343f2b11c12a9bb7ff111 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 565add8c21f343f2b11c12a9bb7ff111
I20260318 02:51:51.045919 2859 raft_consensus.cc:493] T dfb3e7fe7a834636a16ee8a772b73ee2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:51.046108 2859 raft_consensus.cc:515] T dfb3e7fe7a834636a16ee8a772b73ee2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:51.046732 2859 leader_election.cc:290] T dfb3e7fe7a834636a16ee8a772b73ee2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025)
I20260318 02:51:51.049329 1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3e7fe7a834636a16ee8a772b73ee2" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9422bb7011f342b08be0b073a88c4c4d" is_pre_election: true
W20260318 02:51:51.049937 719 leader_election.cc:343] T dfb3e7fe7a834636a16ee8a772b73ee2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:51.055739 2152 raft_consensus.cc:493] T ca4e1eec9a2148488295416cd68ca607 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:51.055902 2152 raft_consensus.cc:515] T ca4e1eec9a2148488295416cd68ca607 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } }
I20260318 02:51:51.056517 2152 leader_election.cc:290] T ca4e1eec9a2148488295416cd68ca607 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a903d876086423b8016d705b98895ad (127.0.104.129:46711), b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443)
W20260318 02:51:51.058115 999 leader_election.cc:343] T ca4e1eec9a2148488295416cd68ca607 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: ca4e1eec9a2148488295416cd68ca607
W20260318 02:51:51.068172 997 consensus_peers.cc:597] T fe82e581368c4d8a894f0283c1a710fe P 9422bb7011f342b08be0b073a88c4c4d -> Peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Couldn't send request to peer b25f4f05e0c94c8db825d5afa0b8bf18. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260318 02:51:51.070007 2152 raft_consensus.cc:493] T 99b4933dda1e465bb1d14d20433f3772 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:51.070160 2152 raft_consensus.cc:515] T 99b4933dda1e465bb1d14d20433f3772 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:51.070758 2152 leader_election.cc:290] T 99b4933dda1e465bb1d14d20433f3772 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:51.071581 999 leader_election.cc:343] T 99b4933dda1e465bb1d14d20433f3772 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 99b4933dda1e465bb1d14d20433f3772
I20260318 02:51:51.021822 922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f79ab1c38141adaed4bd381df26d9b" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:51.028462 924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e993481bf55747b0a6a1c996c6917408" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:51.035887 916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565add8c21f343f2b11c12a9bb7ff111" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:51.048684 919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfb3e7fe7a834636a16ee8a772b73ee2" candidate_uuid: "6a903d876086423b8016d705b98895ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:51.057431 923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4e1eec9a2148488295416cd68ca607" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:51.072994 719 leader_election.cc:343] T 15f79ab1c38141adaed4bd381df26d9b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:51.073136 719 leader_election.cc:304] T 15f79ab1c38141adaed4bd381df26d9b P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:51.073388 2859 raft_consensus.cc:2749] T 15f79ab1c38141adaed4bd381df26d9b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:51.071439 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b4933dda1e465bb1d14d20433f3772" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:51.078270 719 leader_election.cc:343] T dfb3e7fe7a834636a16ee8a772b73ee2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:51.078442 719 leader_election.cc:304] T dfb3e7fe7a834636a16ee8a772b73ee2 P 6a903d876086423b8016d705b98895ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a903d876086423b8016d705b98895ad; no voters: 9422bb7011f342b08be0b073a88c4c4d, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:51.078863 2859 raft_consensus.cc:2749] T dfb3e7fe7a834636a16ee8a772b73ee2 P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:51.079200 997 leader_election.cc:343] T e993481bf55747b0a6a1c996c6917408 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:51.079310 997 leader_election.cc:304] T e993481bf55747b0a6a1c996c6917408 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
W20260318 02:51:51.079689 997 leader_election.cc:343] T 565add8c21f343f2b11c12a9bb7ff111 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:51.079777 997 leader_election.cc:304] T 565add8c21f343f2b11c12a9bb7ff111 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:51.079952 2831 raft_consensus.cc:2749] T e993481bf55747b0a6a1c996c6917408 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:51.080057 997 leader_election.cc:343] T ca4e1eec9a2148488295416cd68ca607 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:51.080096 2831 raft_consensus.cc:2749] T 565add8c21f343f2b11c12a9bb7ff111 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:51.080130 997 leader_election.cc:304] T ca4e1eec9a2148488295416cd68ca607 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:51.080278 2831 raft_consensus.cc:2749] T ca4e1eec9a2148488295416cd68ca607 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260318 02:51:51.080448 997 leader_election.cc:343] T 99b4933dda1e465bb1d14d20433f3772 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:51.080529 997 leader_election.cc:304] T 99b4933dda1e465bb1d14d20433f3772 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:51.080756 2831 raft_consensus.cc:2749] T 99b4933dda1e465bb1d14d20433f3772 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:51.082701 441 catalog_manager.cc:5002] TS b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): tablet 2dab268da5e843cab5c28a521217df97 (table default.Table_c6d53ff287654d37b638cd812b89127f [id=b8168c5ff40940f4ad3d544513810e9b]) successfully deleted
I20260318 02:51:51.086099 441 catalog_manager.cc:5002] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): tablet 77a17ef7cfee4d65808b11e9cb51e7df (table default.Table_4c6d7289bf5c4971892927a94cbf91f6 [id=94a6d43822c04d3ba847366297c204f9]) successfully deleted
I20260318 02:51:51.086335 1173 tablet_bootstrap.cc:492] T fe82e581368c4d8a894f0283c1a710fe P b25f4f05e0c94c8db825d5afa0b8bf18: No bootstrap required, opened a new log
I20260318 02:51:51.086524 1173 ts_tablet_manager.cc:1403] T fe82e581368c4d8a894f0283c1a710fe P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent bootstrapping tablet: real 0.073s user 0.002s sys 0.002s
I20260318 02:51:51.087340 1173 raft_consensus.cc:359] T fe82e581368c4d8a894f0283c1a710fe P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:51.087587 1173 raft_consensus.cc:385] T fe82e581368c4d8a894f0283c1a710fe P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260318 02:51:51.087682 1173 raft_consensus.cc:740] T fe82e581368c4d8a894f0283c1a710fe P b25f4f05e0c94c8db825d5afa0b8bf18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f4f05e0c94c8db825d5afa0b8bf18, State: Initialized, Role: FOLLOWER
I20260318 02:51:51.087952 1173 consensus_queue.cc:260] T fe82e581368c4d8a894f0283c1a710fe P b25f4f05e0c94c8db825d5afa0b8bf18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
W20260318 02:51:51.090042 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 295ac73a106e4a7e87d001a79f80cb99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 295ac73a106e4a7e87d001a79f80cb99 already in progress: creating tablet
I20260318 02:51:51.090920 1173 ts_tablet_manager.cc:1434] T fe82e581368c4d8a894f0283c1a710fe P b25f4f05e0c94c8db825d5afa0b8bf18: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260318 02:51:51.091238 1173 tablet_bootstrap.cc:492] T e998e290291c443394f478c4ac1cfbd2 P b25f4f05e0c94c8db825d5afa0b8bf18: Bootstrap starting.
W20260318 02:51:51.090363 441 catalog_manager.cc:4982] TS 9422bb7011f342b08be0b073a88c4c4d (127.0.104.131:37025): delete failed for tablet 30c4e42a55914561a9f4ee330594eef6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30c4e42a55914561a9f4ee330594eef6 already in progress: creating tablet
I20260318 02:51:51.096364 1173 tablet_bootstrap.cc:654] T e998e290291c443394f478c4ac1cfbd2 P b25f4f05e0c94c8db825d5afa0b8bf18: Neither blocks nor log segments found. Creating new log.
I20260318 02:51:51.096626 2152 raft_consensus.cc:493] T 8b715c5a31ba4515996595de89f1d62c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:51.096784 2152 raft_consensus.cc:515] T 8b715c5a31ba4515996595de89f1d62c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:51.097357 2152 leader_election.cc:290] T 8b715c5a31ba4515996595de89f1d62c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
W20260318 02:51:51.098593 999 leader_election.cc:343] T 8b715c5a31ba4515996595de89f1d62c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a903d876086423b8016d705b98895ad (127.0.104.129:46711): Not found: Tablet not found: 8b715c5a31ba4515996595de89f1d62c
I20260318 02:51:51.098912 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b715c5a31ba4515996595de89f1d62c" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:51.099462 997 leader_election.cc:343] T 8b715c5a31ba4515996595de89f1d62c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:51.099570 997 leader_election.cc:304] T 8b715c5a31ba4515996595de89f1d62c P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9422bb7011f342b08be0b073a88c4c4d; no voters: 6a903d876086423b8016d705b98895ad, b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:51.100234 2831 raft_consensus.cc:2749] T 8b715c5a31ba4515996595de89f1d62c P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260318 02:51:51.100767 2831 raft_consensus.cc:493] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:51.100881 2831 raft_consensus.cc:515] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:51.101460 2831 leader_election.cc:290] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:51.101888 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cda2afa253041449b3c5dcb0547160b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad" is_pre_election: true
I20260318 02:51:51.102094 781 raft_consensus.cc:2468] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 0.
I20260318 02:51:51.102674 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cda2afa253041449b3c5dcb0547160b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
W20260318 02:51:51.103250 997 leader_election.cc:343] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:51.103790 999 leader_election.cc:304] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:51.104408 2831 raft_consensus.cc:2804] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260318 02:51:51.104478 2831 raft_consensus.cc:493] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260318 02:51:51.104532 2831 raft_consensus.cc:3060] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:51.104666 456 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet 848769c787374a2f83fcf68691da4111
I20260318 02:51:51.105113 456 catalog_manager.cc:6741] ReplaceTablet: tablet 848769c787374a2f83fcf68691da4111 deleted and replaced by tablet 445088099bce4ecc8f69bc7d1b3e48f5
I20260318 02:51:51.105201 456 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:47158 (request call id 1686) took 1172 ms. Trace:
I20260318 02:51:51.105254 456 rpcz_store.cc:276] 0318 02:51:49.932851 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:50.007808 (+ 74957us) service_pool.cc:225] Handling call
0318 02:51:50.055939 (+ 48131us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x616000041254. stack: 00007f1dba898c56 00007f1dba898a10 00007f1db98733ad 0000000000986fb4 0000000000986f7d 00007f1dc9c086bd 00007f1dc9c087b3 00007f1dc67ce7a1 00007f1dce4a4f2d 00007f1dce63dadb 00007f1dc5131107 00007f1dc5130e35 00007f1dc189a55e 00007f1dc189943e 00007f1dc189f675 00007f1dc189ff9f
0318 02:51:51.105184 (+1049245us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0318 02:51:50.194438 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0318 02:51:50.195502 (+ 1064us) write_op.cc:432] Acquiring schema lock in shared mode
0318 02:51:50.195509 (+ 7us) write_op.cc:435] Acquired schema lock
0318 02:51:50.195511 (+ 2us) tablet.cc:661] Decoding operations
0318 02:51:50.196466 (+ 955us) write_op.cc:620] Acquiring the partition lock for write op
0318 02:51:50.196481 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0318 02:51:50.196487 (+ 6us) tablet.cc:684] Acquiring locks for 2 operations
0318 02:51:50.213606 (+ 17119us) tablet.cc:700] Row locks acquired
0318 02:51:50.213610 (+ 4us) write_op.cc:260] PREPARE: finished
0318 02:51:50.213856 (+ 246us) write_op.cc:270] Start()
0318 02:51:50.218381 (+ 4525us) write_op.cc:276] Timestamp: P: 1773802310213743 usec, L: 0
0318 02:51:50.218387 (+ 6us) op_driver.cc:348] REPLICATION: starting
0318 02:51:50.219654 (+ 1267us) log.cc:844] Serialized 628 byte log entry
0318 02:51:51.085391 (+865737us) op_driver.cc:464] REPLICATION: finished
0318 02:51:51.099760 (+ 14369us) write_op.cc:301] APPLY: starting
0318 02:51:51.099781 (+ 21us) tablet.cc:1366] starting BulkCheckPresence
0318 02:51:51.099827 (+ 46us) tablet.cc:1369] finished BulkCheckPresence
0318 02:51:51.099854 (+ 27us) tablet.cc:1371] starting ApplyRowOperation cycle
0318 02:51:51.099998 (+ 144us) tablet.cc:1382] finished ApplyRowOperation cycle
0318 02:51:51.100054 (+ 56us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0318 02:51:51.100061 (+ 7us) write_op.cc:312] APPLY: finished
0318 02:51:51.100149 (+ 88us) log.cc:844] Serialized 29 byte log entry
0318 02:51:51.104327 (+ 4178us) write_op.cc:489] Releasing partition, row and schema locks
0318 02:51:51.104373 (+ 46us) write_op.cc:454] Released schema lock
0318 02:51:51.104382 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":110057856,"child_traces":[["op",{"apply.queue_time_us":14277,"num_ops":2,"prepare.queue_time_us":7919,"prepare.run_cpu_time_us":1227,"prepare.run_wall_time_us":27212,"raft.queue_time_us":130,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":8,"replication_time_us":866955,"thread_start_us":14984,"threads_started":1}]]}
I20260318 02:51:51.107095 2831 raft_consensus.cc:515] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:51.108045 761 tablet_service.cc:1558] Processing DeleteTablet for tablet 848769c787374a2f83fcf68691da4111 with delete_type TABLET_DATA_DELETED (replaced by tablet 445088099bce4ecc8f69bc7d1b3e48f5) from {username='slave'} at 127.0.0.1:49862
I20260318 02:51:51.109004 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cda2afa253041449b3c5dcb0547160b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18"
W20260318 02:51:51.109568 997 leader_election.cc:343] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:51.110033 2831 leader_election.cc:290] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Requested vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:51.110611 781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cda2afa253041449b3c5dcb0547160b" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a903d876086423b8016d705b98895ad"
I20260318 02:51:51.110824 781 raft_consensus.cc:3060] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad [term 0 FOLLOWER]: Advancing to term 1
I20260318 02:51:51.113773 781 raft_consensus.cc:2468] T 3cda2afa253041449b3c5dcb0547160b P 6a903d876086423b8016d705b98895ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9422bb7011f342b08be0b073a88c4c4d in term 1.
I20260318 02:51:51.114459 999 leader_election.cc:304] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a903d876086423b8016d705b98895ad, 9422bb7011f342b08be0b073a88c4c4d; no voters: b25f4f05e0c94c8db825d5afa0b8bf18
I20260318 02:51:51.115317 2831 raft_consensus.cc:2804] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d [term 1 FOLLOWER]: Leader election won for term 1
I20260318 02:51:51.115615 2831 raft_consensus.cc:697] T 3cda2afa253041449b3c5dcb0547160b P 9422bb7011f342b08be0b073a88c4c4d [term 1 LEADER]: Becoming Leader. State: Replica: 9422bb7011f342b08be0b073a88c4c4d, State: Running, Role: LEADER
I20260318 02:51:51.116192 2152 raft_consensus.cc:493] T 3291ecec94e642e3a995a2d7006619e7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260318 02:51:51.116590 2152 raft_consensus.cc:515] T 3291ecec94e642e3a995a2d7006619e7 P 9422bb7011f342b08be0b073a88c4c4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" member_type: VOTER last_known_addr { host: "127.0.104.130" port: 37443 } } peers { permanent_uuid: "9422bb7011f342b08be0b073a88c4c4d" member_type: VOTER last_known_addr { host: "127.0.104.131" port: 37025 } } peers { permanent_uuid: "6a903d876086423b8016d705b98895ad" member_type: VOTER last_known_addr { host: "127.0.104.129" port: 46711 } }
I20260318 02:51:51.117233 2152 leader_election.cc:290] T 3291ecec94e642e3a995a2d7006619e7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443), 6a903d876086423b8016d705b98895ad (127.0.104.129:46711)
I20260318 02:51:51.117381 454 catalog_manager.cc:5958] T 00000000000000000000000000000000 P ee6aa91804a2401fa0ceb31b196ec40a: Sending DeleteTablet for 3 replicas of tablet b4f47ccf0b194919902cc4142b097bf3
I20260318 02:51:51.117822 454 catalog_manager.cc:6741] ReplaceTablet: tablet b4f47ccf0b194919902cc4142b097bf3 deleted and replaced by tablet 37b10a1465dc469890538844bd9be897
I20260318 02:51:51.117926 454 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:47158 (request call id 1684) took 1366 ms. Trace:
I20260318 02:51:51.118155 917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3291ecec94e642e3a995a2d7006619e7" candidate_uuid: "9422bb7011f342b08be0b073a88c4c4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f4f05e0c94c8db825d5afa0b8bf18" is_pre_election: true
I20260318 02:51:51.117990 454 rpcz_store.cc:276] 0318 02:51:49.751080 (+ 0us) service_pool.cc:168] Inserting onto call queue
0318 02:51:50.005339 (+254259us) service_pool.cc:225] Handling call
0318 02:51:50.056111 (+ 50772us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x616000041254. stack: 00007f1dba898c56 00007f1dba898a10 00007f1db98733ad 0000000000986fb4 0000000000986f7d 00007f1dc9c086bd 00007f1dc9c087b3 00007f1dc67ce7a1 00007f1dce4a4f2d 00007f1dce63dadb 00007f1dc5131107 00007f1dc5130e35 00007f1dc189a55e 00007f1dc189943e 00007f1dc189f675 00007f1dc189ff9f
0318 02:51:51.117902 (+1061791us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0318 02:51:50.222770 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0318 02:51:50.282429 (+ 59659us) write_op.cc:432] Acquiring schema lock in shared mode
0318 02:51:50.282437 (+ 8us) write_op.cc:435] Acquired schema lock
0318 02:51:50.282439 (+ 2us) tablet.cc:661] Decoding operations
0318 02:51:50.282574 (+ 135us) write_op.cc:620] Acquiring the partition lock for write op
0318 02:51:50.282586 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0318 02:51:50.282592 (+ 6us) tablet.cc:684] Acquiring locks for 2 operations
0318 02:51:50.282673 (+ 81us) tablet.cc:700] Row locks acquired
0318 02:51:50.282676 (+ 3us) write_op.cc:260] PREPARE: finished
0318 02:51:50.282719 (+ 43us) write_op.cc:270] Start()
0318 02:51:50.282758 (+ 39us) write_op.cc:276] Timestamp: P: 1773802310282701 usec, L: 0
0318 02:51:50.282762 (+ 4us) op_driver.cc:348] REPLICATION: starting
0318 02:51:50.282961 (+ 199us) log.cc:844] Serialized 628 byte log entry
0318 02:51:51.100504 (+817543us) op_driver.cc:464] REPLICATION: finished
0318 02:51:51.115896 (+ 15392us) write_op.cc:301] APPLY: starting
0318 02:51:51.115915 (+ 19us) tablet.cc:1366] starting BulkCheckPresence
0318 02:51:51.115966 (+ 51us) tablet.cc:1369] finished BulkCheckPresence
0318 02:51:51.115994 (+ 28us) tablet.cc:1371] starting ApplyRowOperation cycle
0318 02:51:51.116127 (+ 133us) tablet.cc:1382] finished ApplyRowOperation cycle
0318 02:51:51.116187 (+ 60us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0318 02:51:51.116193 (+ 6us) write_op.cc:312] APPLY: finished
0318 02:51:51.116298 (+ 105us) log.cc:844] Serialized 29 byte log entry
0318 02:51:51.116817 (+ 519us) write_op.cc:489] Releasing partition, row and schema locks
0318 02:51:51.116840 (+ 23us) write_op.cc:454] Released schema lock
0318 02:51:51.116847 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":116205440,"child_traces":[["op",{"apply.queue_time_us":15336,"num_ops":2,"prepare.queue_time_us":34396,"prepare.run_cpu_time_us":941,"prepare.run_wall_time_us":118989,"raft.queue_time_us":116,"raft.run_cpu_time_us":8,"raft.run_wall_time_us":9,"replication_time_us":817714,"threads_started":1}]]}
W20260318 02:51:51.118665 997 leader_election.cc:343] T 3291ecec94e642e3a995a2d7006619e7 P 9422bb7011f342b08be0b073a88c4c4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b25f4f05e0c94c8db825d5afa0b8bf18 (127.0.104.130:37443): Illegal state: must be running to vote when last-logged opid is not known
I20260318 02:51:51.119432 748 tablet_service.cc:1558] Processing DeleteTablet for tablet b4f47ccf0b194919902cc4142b097bf3 with delete_type TABLET_DATA_DELETED (replaced by tablet 37b10a1465dc469890538844bd9be897) from {username='slave'